This talk introduces Apache Pulsar, a durable, distributed messaging system. Pulsar uses Apache BookKeeper as its storage layer for message persistence. In this talk, Jia will discuss how this layered architecture allows Pulsar to achieve a high level of scalability and performance. In particular, It will cover:
- Pulsar’s segment oriented architecture. This architecture allows easy elasticity for your messaging cluster without having to do cumbersome rebalancing operations. - The benefits that this segment oriented architecture brings. - A benchmark of throughput and latency of Pulsar messaging system.
In short, this talk will be a deep dive into the storage internals of a large scale, production validated distributed messaging system.
Jia is the core engineer of Streamlio, a company focused on building next generation real time processing engines. Streamlio mainly focus on 3 open source projects, which include Apache BookKeeper, Apache Pulsar, and Heron. Before Streamlio, Jia was the Principal Engineer at EMC Beijing... Read More →
