Apache Samza and Apache Kafka, both developed and opened source by Engineering LinkedIn, which providing a near real time big data streaming.

LinkedIn's largest Samza job is processing more than one million messages per-second during peak traffic hours.

Read more: https://engineering.linkedin.com