Session: Building and evaluating robust conversational interfaces using LLMs
The rapid advancements in machine learning and natural language processing have led to a surge in the development of conversational agents. In this talk, I present an innovative framework for designing, evaluating, and deploying human-like conversational agents in retail and hospitality. The framework addresses challenges such as conversation rigidity, tonality, and latency in large language models. Additionally, it incorporates customer-data pipelines for personalized interactions and robust conversational interfaces.We will demonstrate the creation of a performance baseline using off-the-shelf models, evaluate the retrieval pipeline, and how to bootstrap annotated datasets for fine-tuning task-specific models. This cutting-edge framework paves the way for next-generation conversational agents, revolutionizing customer interactions across industries.
Bio
Janvi is a Senior ML research engineer at Samsung Research America. Previously working on Samsung's artificial humans division, she lead the realistic behavior and conversation generation component of virtual humans - while ensuring that the quality and latency of interaction with an artificial human is not affected. She works on a variety of AI ML related projects, specially focused in the LLM, search and retrieval space. She loves taking vague, undefined problems and translating them into tangible pieces that can be tackled.