Apache Flink

Apache Flink is a framework and distributed processing engine for stateful computations over unbounded and bounded data streams.

Web site

Github repository

Tech tags:

• Run on YARN
• Run on Mesos
• Run on K8s
• In-Memory Performance
• Data streaming transformation

Related shared contents:

• Optimizing Flink’s join operations on Amazon EMR with Alluxio
  tech1
  2026-02-03

  The article discusses the challenges of correlating real-time data with historical data in data analysis, particularly in e-commerce scenarios. It presents an optimized solution using Apache Flink to join streaming order data with historical customer and product information, leveraging Alluxio for caching. The implementation details include using Hive dimension tables and Flink's temporal joins to enhance performance and reduce bottlenecks. The article also addresses state management issues in Flink applications and provides insights into improving data processing efficiency.
• Introducing Impressions at Netflix (part 1)
  project
  2025-02-14
• Building a User Signals Platform at Airbnb
  project
  2024-11-20

In productions with:

Pinterest