From Fragmented Systems to Live Insights at Scale
In the session “Real-Time Market Insights — Powering Optiver’s Live Trading Dashboard with Databricks Apps and Dash,” attendees got an inside look at how we:
- Replaced siloed, on-prem systems with a unified, petabyte-scale Databricks platform
- Cut end-to-end latency from minutes to seconds through Spark and Structured Streaming optimization
- Empowered traders to build and iterate on dashboards without engineering support
- Solved scale and reliability challenges with smart caching, version control, and modular dashboard generation
By hosting Dash apps directly on Databricks, we eliminated infrastructure overhead while enforcing fine-grained access controls through Unity Catalog. The result is a dashboarding ecosystem that balances trader autonomy with engineering performance — built for impact at speed and scale.
Watch the Talk
For engineers working with real-time systems, market data, or scalable streaming architectures, this talk is a deep dive worth watching.
Interested in building systems like this?
At Optiver, our engineers work on low latency pipelines, real-time analytics and scalable infrastructure to support fast and informed decision making. We’re hiring data engineers in
