Presentation by Martin Thompson on the quest for predictable latency, presented at the Jfokus VM Tech Summit.
Concurrent programming with locks is hard. Concurrent programming without using locks can be really hard. Concurrent programming with relaxed memory ordering and predictable latency semantics is said to be only for wizards. This talk focuses on a decade long quest to discover algorithms that provide very high throughput while keeping latency low and predictable. Additionally, they need to provide real-time telemetry on how a system is performing via non-blocking operations. We will cover some fundamental theory of concurrency and then compare various approaches to the same problem so that we can measure the impact on latency. We’ll also show how some of these algorithm implementations get more interesting given the new features in Java 8.