DevOpsDays Kerala

How we built an Observability Platform on top of several CNCF Projects
2024-09-28 , KeyNote/DevOps

During the launch of our first product, we experimented with several CNCF projects to build an observability platform that provides insights into cost, right-sizing, security and troubleshooting to support our production and lower environments.
We leveraged Prometheus Kubernetes APIs, OpenCost, Vertical Pod Autoscale, KubeScape, Cillium, Pixi, ArgoCD & Kyverno to collect data, correlate and generate insights to support our team. To manage the vast amount of data, we built an event-driven platform using gRPC & Strimzi.
The internal project was such a success that we decided to productize and eventually replace our existing product.

During this talk, I will explain the high-level architecture, the challenges we faced, and the lessons learned which hopefully benefit other teams looking to build similar solutions using Open Source tools & libraries.


This talk touches several aspects.
The architecture and technical challenges, the security and other considerations of building the solution and finally the challenges of using Open Source for your solution and how you can contribute & positively impact those projects.

Rajith Attapattu is the CTO and founder of Randoli. Rajith has spent the last five years helping organizations of all sizes adopt Kubernetes as well as studying organizations that have built platform engineering solutions.

These efforts resulted in Randoli building it's App Insights Platform with an emphasis on Faster troubleshooting, workload optimization, DevEx & Developer empowerment. Prior to Randoli he spent 11 years at Red Hat in Engineering and Consulting roles.