Research Science @unlikelyAI

London, England
Joined May 2012
We introduce h4rm3l, a language, a synthesizer, and a scalable and explainable dynamic LLM red-teaming toolkit. h4rm3l found > 2.6k new jailbreak attacks targeting @OpenAI, @AIatMeta, and @AnthropicAI LLMs. 📝 arxiv.org/pdf/2408.04811 🌐 mdoumbouya.github.io/h4rm3l 🧵1/6 👇🏾
2
12
2
31
11,580
Rishabh Shukla retweeted
Announcing DataGemma, a set of open models that utilize Data Commons through Retrieval Interleaved Generation (RIG) & Retrieval Augmented Generation (RAG) to ground LLMs in real-world data for fact-checking, responsible AI development & more. Read more at goo.gle/datagemma
9
106
9
436
37,331
Rishabh Shukla retweeted
Mitigating Hallucination in LLMs This paper summarizes 32 techniques to mitigate hallucination in LLMs. Introduces a taxonomy categorizing methods like RAG, Knowledge Retrieval, CoVe, and more. Provides tips on how to apply these methods and highlights the challenges and limitations inherent in them. arxiv.org/abs/2401.01313
17
264
23
1,135
126,355
Excited to participate in the @PistoiaAlliance Digital Transformation in R&D conference today! I’ll be joining a panel to discuss federated technologies and what @lifebitAI is doing to enable federated data access, analysis and ML across multi-omics, EHR and imaging data.
1
3
12
In a major scientific breakthrough, the latest version of #AlphaFold has been recognised as a solution to one of biology's grand challenges - the “protein folding problem”. It was validated today at #CASP14, the biennial Critical Assessment of protein Structure Prediction (1/3)
117
2,347
1,174
9,583
🎉 Papers with Code partners with arXiv! Code links are now shown on arXiv articles, and authors can submit code through arXiv. Read more: medium.com/paperswithcode/pa…
42
1,685
282
6,108
Rishabh Shukla retweeted
I recommend web.stanford.edu/~jurafsky/s… on NLP in general. Linguistics wise, I am reading Emily M. Bender's two books morphology and syntax, and semantics and pragmatics. They are not easy to absorb but are very interesting. I'd love to see more linguistics recommendations as well.
1
5
1
34
Fascinating insight: Trained solely on unsupervised language modeling, the Transformer's attention mechanism recovers high-level structural (folding) and functional properties of proteins! Blog: blog.einstein.ai/provis/ Paper: arxiv.org/abs/2006.15222 Code: github.com/salesforce/provis
8
200
28
758
Rishabh Shukla retweeted
Neural Architecture Search without Training reddit.com/r/MachineLearning…
9
32
Rishabh Shukla retweeted
Excited to announce the Hateful Memes Challenge, a new dataset and competition for vision and language, focusing on multimodal understanding and reasoning: arxiv.org/abs/2005.04790 "Mean" memes shown here as an illustration of the problem. Some highlights: (1/7)
13
91
16
379
Rishabh Shukla retweeted
#AI & #DrugDiscovery - a great overview of the @JLABS & @Innovation_F Cambridge event featuring our #MachineLearning engineer @0_rishabh 🙌🚀
How is #AI / #MachineLearning transforming #drugdiscovery? Associate @MichaelNewtonIP shares his takeaways from a recent @JLABS @Innovation_F event featuring @HanNamshik of @TheMilnerInst and @0_rishabh of @lifebitAI here: bit.ly/37sywKQ
Rishabh Shukla retweeted
We are absolutely thrilled to collaborate with @sanogenetics to further our joint mission of advancing knowledge, making #genomics #research faster & more patient-centric, while helping to democratise access to the latest #bioinformatics techniques. bit.ly/2QAKvjG
7
1
13
Classifiers are secretly energy-based models! Every softmax giving p(c|x) has an unused degree of freedom, which we use to compute the input density p(x). This makes classifiers into generative models without changing the architecture. arxiv.org/abs/1912.03263
9
335
11
1,416
Rishabh Shukla retweeted
Senior #ML Engineer at @Lifebit, @0_rishabh, presenting at 'Science First: Personalising #Healthcare Through #AI', organised by @JLABS & @IF_Cambridge. Rishabh elaborates on how to make data AI-ready by improving the #quality, #accessibility & #Interoperability of #data🚀
1
5
11
Rishabh Shukla retweeted
“Now What?” John J. Hopfield Hopfield is a theoretical physicist, molecular biologist, neuroscientist, and AI researcher. His broad background led him to publish a 5-page (unrefereed) paper on what is now known as Hopfield Networks, his most cited work. pni.princeton.edu/john-hopfi…
2
35
5
180
Trends 📈 - track the popularity of deep learning frameworks for paper implementations. Current share in Q3 2019: PyTorch 38% (up 6%), TensorFlow 22% (down 2%), other 39% (down 3%) paperswithcode.com/trends
3
44
3
133
The Hamiltonian formalism is fundamental to physics and possesses many properties useful for machine learning. Our new papers show how to bring these properties to neural networks:
8
143
17
619
Really excited to be sharing the results of our + others' research into language models and their social impacts, as well as what we've learned on publication norms in the past 6 months. xitter.cf/OpenAI/status/11638438… Direct link to the report: d4mucfpksywv.cloudfront.net/…
GPT-2 6-month follow-up: we're releasing the 774M parameter model, an open-source legal doc organizations can use to form model-sharing partnerships, and a technical report about our experience coordinating to form new publication norms: openai.com/blog/gpt-2-6-mont…
4
32
2
126
Applications are now open for our 2020 Research Scientist and Engineering internships! We offer hands-on experience working collaboratively on projects that push the frontiers of AI and science across a wide variety of teams. Find out more or apply: deepmind.com/careers/interns…
9
190
21
555