How Nielsen uses serverless concepts on Amazon EKS for big data processing with Spark workloads

Original URL: https://aws.amazon.com/blogs/architecture/how-nielsen-uses-serverless-concepts-on-amazon-eks-for-big-data-processing-with-spark-workloads/

Added Date: January 30, 2025

Memo: Running local mode Spark cluster in k8 pods to processing the small files coming, this mode is more efficient than running big Spark cluster to process huge amount files in batch.