Amal Iyer (@aiyerix) profile picture

Machine Learning, Computational Neuroscience, Food and Travel Building things @fiddlerlabs | Previously: @hplabs and @qualcomm AI Research

Joined July 2023
Photo by Amal Iyer (@aiyerix)Photo by Amal Iyer (@aiyerix)Photo by Amal Iyer (@aiyerix)
At #AIForward Summit 2023, @aiyerix dove deep into the importance of evaluating #LLMs in pre-production using Fiddler Auditor, the open-source robustness library for red-teaming of LLMs. Watch full video: fiddler.ai/resources/ai-forw…
1
165
Larger context lengths are an existential challenge to vector DB providers. 128K context length suffices most chatbot applications
47
Attention: A good f*n bagel is all you need.
39
Using GPT-4 for evals. Cost is 🥲
33
Excited for the upcoming workshop on Responsible and Open Foundation models. Pretty solid line-up!
1
59
Replying to @goodside
@goodside & @simonw showed that LLMs are vulnerable to #PromptInjection attacks. Check out how Fiddler Auditor can help minimize prompt injection attacks through #LLM testing: fiddler.ai/blog/evaluate-llm… (by @aiyerix & Karen He) #GenerativeAI #ResponsibleAI #RobustML #TrustworthyAI
3
3
527
Announcing our 🌟open-source🌟 Fiddler Auditor - the first robustness library that leverages LLMs to evaluate other LLMs! fiddler.ai/blog/introducing-… #MLOps teams can now test LLM robustness with adversarial examples, out-of-distribution inputs, and linguistic variations to improve AI performance. #LLMOps #MachineLearning #AI #ArtificialIntelligence #LLM #OpenSource #DataScience #DataEngineering #DataScientist #DataEngineer
1
4
254