Sapir Weissbuch

The Art of Scaling: Lessons from Training LTX-Video Foundation Model
Sapir Weissbuch

Abstract

In the rapidly evolving landscape of artificial intelligence, the development of large-scale foundation models marks a transformative phase, driving innovation across diverse fields like natural language processing and bioinformatics. These models capitalize on extensive datasets to unfold versatile capabilities that can be fine-tuned for various applications. However, the path to developing such models is fraught with challenges, primarily balancing the computational demands with the sophistication of neural architectures. This round-table discussion will delve into the intricate aspects of large-scale model training.

This round-table discussion will address key aspects of training large-scale AI models, focusing on the challenges of managing large datasets and complex computations. We’ll explore indicators for when scaling becomes necessary, the evolution of skills required for these projects, and the impact on data science roles. The conversation will also cover emerging technologies in AI, the importance of collaborative efforts across sectors, and strategies for managing infrastructure costs.

Bio

Sapir Weissbuch is a skilled deep learning researcher with a specialization in generative AI for image and video creation. Previously at Lightricks, she was a key member of the Foundational Models team, contributing significantly to generative AI projects, including the development of the open-source LTX-Video model. Sapir holds an MSc in computer science from the Hebrew University of Jerusalem, focusing on machine learning for NLP, and a BSc in mathematics and physics from Bar Ilan University. Beyond her technical expertise, Sapir is passionate about the arts and writing, which complements her innovative approach to technology.

Agenda

8:45 Reception
9:30 Opening remarks by WiDS TLV ambassadors
9:45 Dr. Mor Geva , Tel Aviv University: “MRI for Large Language Models: Mechanistic Interpretability from Neurons to Attention Heads”
10:15 Panel: “Pioneering Progress: a strategic look at the GenAI revolution and the new role of data scientists“
Shani Gershtein, Melingo
Mirit Elyada Bar, Intuit
Dr. Asi Messica, Lightricks
Moderated by Nitzan Gado, Intuit
10:45 Poster pitches
10:55 Break
11:10 Lightning talks session
12:30 Lunch & poster session
13:30 Roundtable session & poster session
14:30 Roundtable closing
14:40 Shunit Agmon, Technion: “Bridging the Gender Gap in Clinical AI: Temporal Adaptation with TeDi-BERT”
15:00 Shaked Naor Hoffmann, Apartment List: “Building Generative AI Agents for Production: Turning Ideas into Real-World Applications”
15:20 Closing remarks
15:30 The end