Data Scientist @ElsevierConnect. Interested in #HealthcareAI, #NLProc, #ML. Previously @ornl & @oacore. One day I'll visit Mars
United States
Joined December 2009
- Tweets977
- Following732
- Followers454
- Likes499
Improving Reproducibility of Gen AI Evaluations
Would you trust results that you can’t reproduce? Reproducibility is the backbone of trust in AI research. Without it, we risk misleading conclusions, wasted effort, and barriers to meaningful innovation.
There are a lot more insights in the paper that won't fit in this post. If you care about reproducibility, I can highly recommend giving it a read.
In my last post, I shared why I believe learning NLP is a smart investment—even as generative AI takes center stage.
Today, I wanted to share my three favorite resources to learn NLP.
Is Learning NLP Still Worth It In The Age Of Generative AI?
Here's why I think learning foundational NLP skills is a great investment.
If you're interested in building evaluations for generative AI applications, I highly recommend this blog post by Hamel Husain: Creating a LLM-as-a-Judge That Drives Business Results hamel.dev/blog/posts/llm-jud…
Here are a few reasons why:
