Session: Cloud Data Engineering
With today’s surge of data comes the problems of processing that data, obtaining the correct skills to manage and analyze that data, and establishing rules to govern the data’s use and analytics. The big data technology stack is ever-growing and sometimes confusing, even more so when we add the complexities of setting up big data environments in the cloud. This talk will discuss different implementation patterns to solve the most common big data use cases and provide pros and cons for different cloud implementation and technology options. It will include a short demo for data ingest, transformation, storage and analytics using Spark, data lake, data warehouse, and reporting technologies.
Bio
Muazma Zahid is a Senior Software Engineering Manger at Microsoft Azure Global team, where she enables customers to deploy the most demanding Data workloads on Azure. She has been a Data Engineer/Architect and Speaker for over thirteen years working on several Big Data, Cloud Computing, and AI Technologies. She is an active researcher in biomedical engineering and her research software is used in EKG machines all around the world.
Muazma is an advocate of diversity and inclusion. She is President of non-profit organization Pakistani Women in Computing which is on a mission to build a strong global network of Pakistani women in technology and allies to foster the community’s growth through meaningful connections and learning opportunities. She has led several programs for AnitaB.org and currently leads the AnitaB.org Seattle community. She is also a leader at Women Who Code and Women at Microsoft.