Migrating Terabytes of Metrics: Challenges and insights from Mimir to ClickHouse
2025-09-10 , Event Space #1

As organizations scale, so do their challenges. In this session, we'll share our journey migrating terabytes of metrics data from Grafana Mimir to ClickHouse-a transformation driven by the need to overcome scalability and flexibility limitations in our previous stack.

We’ll discuss the initial pain points that prompted the switch, from storage and operational bottlenecks to the constraints of PromQL-based querying. The migration was far from a simple lift-and-shift: we had to ensure uninterrupted service, continue delivering new features, and ingest fresh data throughout the process. Our approach balanced dual operation between platforms, incremental data movement, and robust validation strategies.

A key part of our transformation was rethinking our ingestion paradigm, moving from PromQL to ClickHouse SQL. We’ll detail the technical and organizational hurdles we faced, the solutions that worked, and the lessons learned-offering practical insights for anyone considering a similar migration or looking to modernize their stack. Join us for a deep dive into the real-world challenges and breakthroughs of managing data at scale.

I’m currently an Engineering Manager at Cast AI, where I lead the development of our reporting suite. Before this, I worked at Hootsuite developing data pipelines for analytics, and at Keysight Technologies, focusing on network infrastructure testing and cybersecurity products. I’m passionate about Go and Kubernetes and I enjoy building scalable, automated cloud solutions. I’m excited to connect with fellow professionals and share insights on the evolving DevOps landscape.