The LLM ecosystem has become crowded very quickly. New models, frameworks, agent platforms and AI builders appear almost every week. The difficult part is no longer finding tools. It is understanding 𝗪𝗛𝗔𝗧 𝗘𝗔𝗖𝗛 𝗢𝗡𝗘 𝗜𝗦 𝗔𝗖𝗧𝗨𝗔𝗟𝗟𝗬 𝗠𝗘𝗔𝗡𝗧 𝗧𝗢 𝗗𝗢. Here is a practical way to look at the stack. 𝗟𝗟𝗠 𝗣𝗥𝗢𝗩𝗜𝗗𝗘𝗥𝗦 These provide the foundation models that power AI applications. OpenAI, Claude, Gemini, Llama, Mistral, Grok, DeepSeek 𝗔𝗜 𝗔𝗚𝗘𝗡𝗧 𝗙𝗥𝗔𝗠𝗘𝗪𝗢𝗥𝗞𝗦 These are used when an AI system needs to 𝗥𝗘𝗔𝗦𝗢𝗡, 𝗣𝗟𝗔𝗡, 𝗨𝗦𝗘 𝗧𝗢𝗢𝗟𝗦 𝗔𝗡𝗗 𝗧𝗔𝗞𝗘 𝗔𝗖𝗧𝗜𝗢𝗡𝗦 instead of simply returning an answer. LangGraph, CrewAI, AutoGen, AutoGPT, CAMEL-AI 𝗟𝗟𝗠 𝗔𝗣𝗣𝗟𝗜𝗖𝗔𝗧𝗜𝗢𝗡 𝗙𝗥𝗔𝗠𝗘𝗪𝗢𝗥𝗞𝗦 These help developers connect a model with enterprise data, tools, retrieval, memory and application logic. LangChain, LlamaIndex, Haystack, DSPy, Guardrails AI 𝗣𝗥𝗢𝗠𝗣𝗧 𝗔𝗡𝗗 𝗘𝗩𝗔𝗟𝗨𝗔𝗧𝗜𝗢𝗡 𝗧𝗢𝗢𝗟𝗦 Building the prompt is only one part of the job. These tools help teams manage prompts, test different versions, observe model behaviour and evaluate the quality of outputs. Langfuse, PromptLayer, ChainForge, PromptPerfect 𝗩𝗘𝗖𝗧𝗢𝗥 𝗗𝗔𝗧𝗔𝗕𝗔𝗦𝗘𝗦 These are commonly used to store and search embeddings, making 𝗦𝗘𝗠𝗔𝗡𝗧𝗜𝗖 𝗦𝗘𝗔𝗥𝗖𝗛 𝗔𝗡𝗗 𝗥𝗔𝗚-𝗕𝗔𝗦𝗘𝗗 𝗔𝗣𝗣𝗟𝗜𝗖𝗔𝗧𝗜𝗢𝗡𝗦 possible. Pinecone, Qdrant, ChromaDB, FAISS, Weaviate, Milvus 𝗟𝗢𝗪-𝗖𝗢𝗗𝗘 𝗔𝗡𝗗 𝗡𝗢-𝗖𝗢𝗗𝗘 𝗔𝗜 𝗕𝗨𝗜𝗟𝗗𝗘𝗥𝗦 These make it possible to create AI workflows, prototypes and applications without writing every part of the system from scratch. n8n, Flowise, Langflow, Replit, Lovable, v0, Chatbase 𝗦𝗢 𝗛𝗢𝗪 𝗗𝗢𝗘𝗦 𝗧𝗛𝗘 𝗦𝗧𝗔𝗖𝗞 𝗖𝗢𝗠𝗘 𝗧𝗢𝗚𝗘𝗧𝗛𝗘𝗥? At a very simplified level, an application may look something like this: Model Framework Data or Vector Database Evaluation Agent Layer Application For example: Claude or OpenAI LangChain Qdrant Langfuse LangGraph AI Application This is 𝗡𝗢𝗧 𝗔 𝗠𝗔𝗡𝗗𝗔𝗧𝗢𝗥𝗬 𝗔𝗥𝗖𝗛𝗜𝗧𝗘𝗖𝗧𝗨𝗥𝗘. Many applications will use only some of these layers, while others may combine them differently. And that is the more useful way to learn this ecosystem. Do not try to master every new AI tool that appears. 𝗨𝗡𝗗𝗘𝗥𝗦𝗧𝗔𝗡𝗗 𝗪𝗛𝗔𝗧 𝗘𝗔𝗖𝗛 𝗟𝗔𝗬𝗘𝗥 𝗦𝗢𝗟𝗩𝗘𝗦, 𝗪𝗛𝗘𝗥𝗘 𝗜𝗧 𝗙𝗜𝗧𝗦, 𝗔𝗡𝗗 𝗪𝗛𝗘𝗧𝗛𝗘𝗥 𝗬𝗢𝗨𝗥 𝗨𝗦𝗘 𝗖𝗔𝗦𝗘 𝗔𝗖𝗧𝗨𝗔𝗟𝗟𝗬 𝗡𝗘𝗘𝗗𝗦 𝗜𝗧.