Arpita
Vats
Senior AI Enginner at Linkedin
"Mixture of Experts in Vision Models"
"Mixture of Experts in Vision Models"
21 - 2:10 PM EDT/New York (See in local time)
Add to Calendar
05/21/2025 2:10 PM
05/21/2025 02:30 PM
America/New_York
#WTGC2025
"Mixture of Experts in Vision Models"
#WTGC2025
"Mixture of Experts in Vision Models"
https://www.womentech.net/ringcentral
https://www.womentech.net/ringcentral
"Mixture of Experts in Vision Models"
"Mixture of Experts in Vision Models"
Don’t miss out and join visionaries, innovators, and thought leaders from all over the world at the Women in Tech Global Conference.
Vote by Sharing
Unite 100 000 Women in Tech to Drive Change with Purpose and Impact.
Do you want to see this session? Help increase the sharing count and the session visibility. Sessions with +10 votes will be available to career ticket holders.
Please note that it might take some time until your share & vote is reflected.
Session: Mixture of Experts in Vision Models
The Mixture of Experts (MoE) approach has emerged as a transformative architecture in deep learning, especially within vision models. This talk will delve into the application of MoE in vision systems, showcasing its potential to optimize performance, scalability, and efficiency. Traditional vision models often struggle with balancing model capacity and computational efficiency, leading to challenges in deploying large-scale, real-time applications. MoE addresses these challenges by activating only a subset of specialized "experts" based on the input data, allowing the model to adapt dynamically while keeping computational costs manageable.The session will explore the architecture of MoE in vision models, including gating mechanisms and expert selection processes that optimize both accuracy and speed. I will discuss how MoE enhances performance in tasks such as image classification, object detection, and scene understanding, offering greater flexibility and robustness compared to traditional architectures.
Attendees will gain insights into the design and implementation of MoE models, including strategies for training and managing expert diversity. The talk will also cover the challenges encountered, such as load balancing across experts and mitigating overfitting, as well as solutions to these issues. Real-world applications and case studies will demonstrate how MoE-based vision models can be effectively integrated into industry solutions, providing a roadmap for scaling AI systems efficiently while maximizing performance.
Key Takeaways
- Benefits of using MoE Models
- Insights about MoE Models
- MoE Model challenges and how to overcome
Bio
I am a Senior AI Engineer at LinkedIn with expertise in AI, Deep Learning, NLP, and Computer Vision. I have experience from Meta and Amazon, where I focused on LLM and Generative AI. I have published papers and led projects enhancing recommendation algorithms and multimedia models for various industry applications.