Apache Flink
Stream processing framework with powerful stream
...Developers program against high-level APIs—DataStream and Table/SQL—to express transformations, joins, and stateful patterns, while specialized libraries support CEP, machine learning workflows, and connectors. A rich connector ecosystem integrates with systems like Kafka, Kinesis, filesystems, JDBC sources/sinks, and object stores. Deployments span Kubernetes, YARN, Mesos, and standalone clusters, and operational features such as savepoints, state backends, and metrics make long-running jobs manageable in production.