Join me for Ray Summit 2026! register.linuxfoundation.org… #RaySummit
Finished developers.google.com/learn/… and learned about the fundamentals of model inference, choosing right model format, and how to measure and optimize performance. Looking forward to apply this knowledge to improve the user experience of some AI agents @googledevs #NVIDIAGTC
🚀 Gemini Headless is a game-changer for server-side AI automation at scale:
🔹 Built for headless server automation
🔹 Zero-deadlock background I/O piping
🔹 High-throughput parallel execution
🔹 Fully async & type-safe
google-gemini.github.io/gemi…
We can run #Claude Code with #Ollama now ❤️ Really cool! This is huge for those who can’t use cloud models but still want Claude running locally🚀
🔗 ollama.com/blog/claude
any-llm @MozillaAI - Another LiteLLM proxy alternative which is more lightweight and cleaner way to communicate with an LLM provider using a single interface
👉 github.com/mozilla-ai/any-ll…
Strix - Open-source AI agents for penetration testing. Makes it easy to run a penetration test in hours and not weeks and also get a compliance report for this. Plus it can also run it as part of CI/CD github.com/usestrix/strix
#PenTesting #AIAgent
I’m officially Ray Foundations Certified!
Excited to be part of the growing Ray community and to continue building distributed AI applications with Ray.
#RayFoundationsCertified #RaySummit2025
📷Get certified now: courses.anyscale.com/courses…
Future Data Systems Seminar Series — Fall 2025 starting today.
db.cs.cmu.edu/seminars/fall2…
#dbms #cmu
Today the MCP Steering Committee is soft-launching the official OSS MCP Registry. This is a build in public launch to start getting feedback and contributions.
blog.modelcontextprotocol.io…
#mcp #llm
AGENTS.md just dropped and it’s a big step for standardization: an open, clean format for coding agents! 🔥
With a community led by OpenAI, with teams from Factory, Cursor, Jules team from Google, Roo Code, and more.
🔗 agents.md/
#agentic #LLM
New lib for asynchronous and composable AI Pipelines
⛓️ Chaining (+) or Parallelizing (//) processors.
🔌 Integrates with Gemini and Gemini Live APIs.
🚀 Orchestrate concurrent tasks with asyncio.
🖼️ Diverse content: text, images, audio, and PDFs.
developers.googleblog.com/en…
#genai
For #MCP Builders: all the videos from the #MCPDevSummit in San Francisco held in May are now live youtube.com/playlist?list=PL…
New #MCP features are being shipped each week—Auth, Elicitations, User interactions, UI functionalities, and more ⚡
Someone uploaded an old EXE File to Claude 3.7 and it recreated the game in Python reddit.com/r/ClaudeAI/commen…
Here is the original chat with Claude claude.ai/share/3eecebc5-ff9…
Starting this week, #deepseekai will be open-sourcing 5 repos – one daily drop – not because they have made grand claims, but simply as developers sharing their small-but-sincere progress
📢 github.com/deepseek-ai/open-…
#llm #transparency
Microsoft just released BitNet an inference framework for 1-bit #LLMs so you can run a 100bn BitNet b1.58 model on a single CPU
🤯It achieve speeds comparable to human reading (5-7 tokens per second) and it is perfect for local devices
👉 github.com/microsoft/BitNet
Google hard dataset for evaluating RAG applications:
🐇 evaluating a multi-hop rag application
🔖 benchmarking a language model on reasoning an factuality
Baseline results range 41% for basic prompting up to 66% for multi-step retrieval & reasoning.
huggingface.co/datasets/goog…
Practical RAG
(i) Use semantic (aka vector database) and keyword search
(ii) Situate the chunks of the doc in the greater context by summarizing the role they play
(iii) More chunks are usually better (eg. 20 chunks)
(iv) Rerank the chunks.
anthropic.com/news/contextua…
OpenAI released an evaluation dataset
🌍 14 languages: Arabic, Spanish,….
🧠 57 subjects: elementary to advanced professional
🎓 translated by professional translators
🔬 Evaluates general knowledge across diverse cultures, used in openai/simple-evals
huggingface.co/datasets/open…
The future is running your own AI cluster at home with your own everyday devices.
Check how to run a Llama 3.1 405B model on MacBooks with exo 🤯
github.com/exo-explore/exo

