Session: Real-Time Data Pipelines: Leveraging Kafka, Delta Lake, and AI for Fast Insights
In the age of real-time decision-making, data pipelines must be fast, reliable, and scalable. This session explores how technologies like Apache Kafka and Delta Lake can power efficient real-time data systems.
We'll dive into real-world case studies, demonstrating how to integrate AI-driven analytics into streaming pipelines for actionable insights. Attendees will leave with a comprehensive understanding of designing, implementing, and optimizing real-time data flows for business success.
Bio
Manasa Hari is a Lead Engineer with over 12 years of experience designing scalable, event-driven API architectures. She has led major projects optimizing API workflows, driving automation, and enhancing data pipelines, resulting in significant performance gains. Manasa specializes in API design, APIOps, and security standards like OAuth2.
Her passion for empowering women in tech has driven her to mentor over 12 aspiring engineers, conduct technical workshops, and build communities that support career growth. She is a featured speaker at global conferences, including Grace Hopper Celebration and Civo Navigate.