Pipes, Streams, and Queries: Engineering Fast Data at Scale

Join us in Bangalore for an amazing meetup at the intersection of streaming data and high-performance analytics. Whether you are building real-time pipelines, optimizing query performance at scale, or figuring out how to make streaming and storage work together in production, this event is for you. Engineers and architects from ClickHouse and GlassFlow will share practical lessons from the field, covering everything from stream processing and ingestion patterns to sub-second query performance on live data. Connect with the Bangalore Streams community and walk away with ideas you can actually use. Don't miss out! RSVP and secure your spot! 🗓️ Agenda: 09:30 AM: Registration & networking 10:30 AM: Welcome & opening 10:40 AM: Making Postgres Migration Boring With ClickPipes by Amogh Bharadwaj, Senior Software Engineer @ ClickHouse 11:10 PM: From Raw Telemetry to Actionable Insights: Processing OpenTelemetry Streams for ClickHouse by Sasi Teja, Open Source Community Catalyst 11:30 PM: Break 11:45 PM: ClickHouse in Production: Understanding and Managing Resource Behaviour by Shri Veena M P, Data Platform Engineer at Platformatory 12:15 PM: Closing Remarks 12:30 PM: Lunch & networking If anyone from the community is interested in sharing a talk at future events, complete this CFP form and we’ll be in touch. 🎤 Session: Making Postgres Migration Boring With ClickPipes Description: Postgres-to-Postgres migration is still surprisingly manual and error-prone. Moving between providers like RDS and Cloud SQL often requires users to generate schema dumps themselves, and coordinate multiple fragile migration steps manually. On top of that, initial loads can be slow, and many existing solutions lack good progress tracking, observability, and alerting — making migrations difficult to monitor and trust in production. In this talk, I’ll introduce the PG-to-PG ClickPipes we’re building at ClickHouse to make Postgres migration far more seamless. Speaker: Amogh Bharadwaj, Senior Software Engineer @ ClickHouse I’m Amogh Bharadwaj, a Bangalore-based software engineer and BITS Hyderabad graduate. I was part of the founding team at PeerDB, a Postgres-first ETL platform acquired by ClickHouse, where I now work on managed Postgres and lead efforts around data movement via ClickPipes. 🎤 Session: From Raw Telemetry to Actionable Insights: Processing OpenTelemetry Streams for ClickHouse Description: Modern systems generate massive volumes of telemetry data, but raw signals rarely arrive in a form that's ready for analysis. In this talk, we'll explore how OpenTelemetry, GlassFlow, and ClickHouse can be combined to build real-time telemetry pipelines that transform raw events into actionable insights. Through examples from observability and telecom RAN signal-quality monitoring, we'll cover stream enrichment, deduplication, data quality controls, and optimization techniques that enable low-latency analytics at scale. Attendees will leave with practical patterns for building production-grade telemetry architectures on ClickHouse. Speaker: Sasi Teja, Open Source Community Catalyst 🎤 Session: ClickHouse in Production: Understanding and Managing Resource Behaviour Description: ClickHouse delivers powerful analytics performance across a wide range of deployment sizes. Getting the most out of it in production requires understanding how it manages resources under the hood from connector configurations to internal cache mechanics. This talk walks through a real-world production investigation, covering how to systematically analyze memory growth patterns using system tables and memory metrics, review connector configurations, and apply practical monitoring strategies to catch issues early. The talk covers debugging techniques, monitoring strategies, and operational best practices particularly relevant for resource-constrained ClickHouse deployments. Speaker: Shri Veena M P, Data Platform Engineer at Platformatory