Miriam Horovicz

Fiverr
AgentSHAP: Explaining Tool Usage in LLM Agents
Miriam Horovicz

Abstract

As LLM agents call more APIs, tools, and services, it becomes harder to tell which ones actually matter. In this talk, we present AgentSHAP, a black-box method for attributing an agent’s output to its tools using Shapley values. We’ll show how AgentSHAP works in practice, how it scales via Monte Carlo sampling, and how it can be used to identify redundant tools, reduce cost, and improve agent reliability in production systems.

Bio

Miriam Horovicz is an AI researcher currently working at Fiverr, with a strong focus on language models and conversational AI. She holds a B.Sc. in Computer Science and is completing a Master’s degree in Artificial Intelligence. Miriam has previous experience at National Instruments, where she led computer vision and generative AI projects. She’s also co-authored research on explainability in large language models, including the TokenSHAP method presented at NLP4Science 2024.

Agenda

08:45

Reception & gathering

09:30

Opening remarks by WiDS TLV ambassadors

09:45

Keynote session: Prof. Michal Rosen Zvi

10:15

Keynote session: Hadas Grossmon Ella

10:45

Poster pitches

10:55

Break

11:10

Lightning talks session

12:45

Lunch & poster session

13:30

Roundtable session & poster session

14:20

Roundtable closing

14:30

Talk by Hila Paz

14:50

Talk by Dr. Moran Mizrahi

15:15

Closing remarks

15:30

End