How Nielsen uses serverless concepts on Amazon EKS for big data processing with Spark workloads
Article Written: January 28, 2025
Added: January 30, 2025
Type: project
Summary
Running local mode Spark cluster in k8 pods to processing the small files coming, this mode is more efficient than running big Spark cluster to process huge amount files in batch.