Lambda Architecture

Lambda Architecture » λ lambda-architecture.net http://lambda-architecture.net/

Twitter's tweets analysis using Lambda Architecture - Knoldus Blogs https://blog.knoldus.com/2017/01/31/twitters-tweets-analysis-using-lambda-architecture/

File:Diagram of Lambda Architecture (generic).png

Lambda architecture is a data-processing architecture designed to handle massive quantities of data by taking advantage of both batch and stream-processing methods. This approach to architecture attempts to balance latency, throughput, and fault-tolerance by using batch processing to provide comprehensive and accurate views of batch data, while simultaneously using real-time stream processing to provide views of online data. The two view outputs may be joined before presentation. The rise of lambda architecture is correlated with the growth of big data, real-time analytics, and the drive to mitigate the latencies of map-reduce.^[1]

Lambda architecture depends on a data model with an append-only, immutable data source that serves as a system of record.^[2]:32 It is intended for ingesting and processing timestamped events that are appended to existing events rather than overwriting them. State is determined from the natural time-based ordering of the data.