Suparna Chowdhury retweeted
AI SYSTEM DESIGN ROADMAP
β
βββ 1. FOUNDATIONS
β βββ AI, ML, Deep Learning & Generative AI
β βββ Mathematics, Statistics & Probability
β βββ Python, NumPy & Pandas
β βββ Neural Networks & Transformers
β βββ LLM Fundamentals & Tokenization
β
βββ 2. AI MODEL ARCHITECTURE
β βββ Model Selection & Evaluation
β βββ LLMs, SLMs & Multimodal Models
β βββ Embedding Models & Rerankers
β βββ Fine-Tuning, LoRA & PEFT
β βββ Model Serving & Inference
β
βββ 3. DATA ENGINEERING
β βββ Data Collection & Ingestion
β βββ Data Cleaning & Preprocessing
β βββ Data Labeling & Governance
β βββ Feature & Embedding Pipelines
β βββ Data Quality & Versioning
β
βββ 4. LLM APPLICATION ARCHITECTURE
β βββ Prompt Engineering
β βββ Structured Outputs & Function Calling
β βββ RAG (Retrieval-Augmented Generation)
β β βββ Document Chunking
β β βββ Embeddings & Vector Databases
β β βββ Hybrid Search & Reranking
β β βββ Retrieval Evaluation
β βββ AI Agents & Tool Use
β βββ Memory & Context Management
β βββ Multi-Agent Systems
β
βββ 5. SYSTEM ARCHITECTURE
β βββ Requirements & Workload Estimation
β βββ Monoliths, Microservices & Modular Design
β βββ API Gateway & Model Gateway
β βββ Synchronous & Asynchronous Processing
β βββ Message Queues & Event-Driven Systems
β βββ Caching & Semantic Caching
β βββ Load Balancing & Autoscaling
β βββ Distributed Systems & Fault Tolerance
β
βββ 6. STORAGE & INFRASTRUCTURE
β βββ SQL & NoSQL Databases
β βββ Vector Databases
β βββ Object Storage & Data Lakes
β βββ GPU / CPU Compute Infrastructure
β βββ Containers & Kubernetes
β βββ Cloud Platforms
β βββ Model Serving Infrastructure
β
βββ 7. AI EVALUATION & OBSERVABILITY
β βββ Offline & Online Evaluation
β βββ Accuracy, Relevance & Groundedness
β βββ Hallucination Detection
β βββ LLM-as-a-Judge
β βββ Tracing & Distributed Logging
β βββ Latency, Throughput & Token Usage
β βββ A/B Testing & Continuous Evaluation
β
βββ 8. SECURITY & GOVERNANCE
β βββ Authentication & Authorization
β βββ Prompt Injection Defense
β βββ Data Privacy & PII Protection
β βββ Secrets & Key Management
β βββ Guardrails & Output Validation
β βββ Model Supply Chain Security
β βββ Responsible AI & Compliance
β
βββ 9. PERFORMANCE & COST OPTIMIZATION
β βββ Quantization & Distillation
β βββ Batching & Parallel Inference
β βββ Model Routing & Cascading
β βββ KV Caching
β βββ GPU Utilization & Throughput
β βββ Token Budget Optimization
β βββ QualityβLatencyβCost Trade-offs
β
βββ 10. MLOps & LLMOps
β βββ CI/CD & Model Versioning
β βββ Automated Testing & Evaluation
β βββ Model Deployment & Rollbacks
β βββ Data & Prompt Versioning
β βββ Drift Detection & Monitoring
β βββ Continuous Improvement
β
βββ 11. END-TO-END AI SYSTEM DESIGN
βββ AI Chatbot / Customer Support
βββ RAG-Based Knowledge Assistant
βββ AI Coding Assistant
βββ AI Search & Recommendation Engine
βββ Document Intelligence Platform
βββ AI Agent / Workflow Automation
βββ Real-Time Voice AI System
βββ Multimodal AI Application
βββ Large-Scale AI Inference Platform
βββ Production-Ready AI SaaS
βββ Requirements & Architecture
βββ Data & Model Pipeline
βββ APIs & Infrastructure
βββ Security & Evaluation
βββ Scaling & Cost Optimization
βββ Reliability & Production Monitoring
Follow @e_opore to learn more. Bookmark and share for more people to master it.
Suparna Chowdhury retweeted
Learn AI for free directly from top companies.
1 - Anthropic:
anthropic.skilljar.com
2 - Google:
grow.google/ai
3 - Meta:
ai.meta.com/resources/
4 - NVIDIA:
developer.nvidia.com/cuda
5 - Microsoft:
learn.microsoft.com/en-us/trβ¦
6 - OpenAI:
academy.openai.com
7 - IBM:
skillsbuild.org
8 - AWS:
skillbuilder.aws
9 - DeepLearning.AI:
deeplearning.ai
10 - Hugging Face:
huggingface.co/learn
Comment "Learning" if you find this helpful.
Repost so others can take help.
Must bookmark for future reference.
Suparna Chowdhury retweeted
The US government, citing national security authorities, has issued an export control directive to suspend all access to Fable 5 and Mythos 5 by any foreign national, whether inside or outside the United States, including foreign national Anthropic employees.
The net effect of this order is that we must abruptly disable Fable 5 and Mythos 5 for all our customers to ensure compliance.
Access to all other Claude models is not affected.
We apologize for this disruption to our customers. We believe this is a misunderstanding and are working to restore access as soon as possible.
Read our full statement: anthropic.com/news/fable-mytβ¦
Suparna Chowdhury retweeted
Today I'm publishing a new essay, Policy on the AI Exponential. AI is progressing extremely fastβmuch faster than the policy process was built to handle. The essay lays out where I think the technology is now, and the action needed to close the gap: darioamodei.com/post/policy-β¦
Suparna Chowdhury retweeted
Google released Gemma 4 12B, a multimodal model that runs text, images, and audio on 8GB VRAM!
We'll fine-tune it to master chess and predict the exact next move.
Tech stack:
- @UnslothAI for efficient fine-tuning.
- @huggingface transformers to run it locally.
Let's go! π
Suparna Chowdhury retweeted
You're in a Research Scientist interview at OpenAI.
The interviewer asks:
"How would you expand the context length of an LLM from 2K to 128K tokens?"
You: "I will fine-tune the model on longer docs with 128K context."
Interview over.
Here's what you missed:
Suparna Chowdhury retweeted
π¨Anthropic just showed a 24-minute workshop on how to actually do prompts for Claude.
Taught by the people who built it.
Free. No registration. No paywall.
I've seen $300 courses that don't cover what they teach in the first 8 minutes.
Watch it and bookmark it now!
Suparna Chowdhury retweeted
New blog post: The bug that taught me more about PyTorch than years of using it
started with a simple training loss plateau... ended up digging through optimizer states, memory layouts, kernel dispatch, and finally understanding how PyTorch works!
Suparna Chowdhury retweeted
I just published Mastering SQL: Top Interview Questions and Answers link.medium.com/p9w5lHSvIOb
#SQL #MySQL #SQLInterview #TechCareer #DataScience #DatabaseDesign #TechTips #SQLQueries #Optimization #interviewPreps #DataAnalytics #DataAnalysis #Interview
Suparna Chowdhury retweeted
Check out my latest article on Medium!
The Art of Feature Engineering: Encoding Categorical Variables
link.medium.com/eTmCN981sOb
Learn how to encode it effectively with methods like One-Hot Encoding, Label Encoding, & more!
#MachineLearning #DataScience #DataPreprocessing #AI #ML
Suparna Chowdhury retweeted
Boost your database performance and ensure efficient data retrieval!
Check out my article on Mastering SQL SELECT Query Optimization in MySQL: link.medium.com/KjCkspTjANb
π Learn to use the EXPLAIN clause, leverage indexes, and more!
π Share and follow for more insights! #MySQL
Suparna Chowdhury retweeted
I just published Understanding SQL JOINS link.medium.com/ULAVKpfwkNb
#SQL #DataAnalytics #InterviewTips
Suparna Chowdhury retweeted
Dive into our latest article on SQL window functions!
Learn the key differences and use cases of ROW_NUMBER(), RANK(), and DENSE_RANK() to boost your data analysis skills.
#SQL #DataAnalysis #DataScience
link.medium.com/3mZBAgbefNb
Suparna Chowdhury retweeted
π #SQLChallenge Day 3/30: Problem #25 in Ace the Data Science Interview!
Write a query to get the percentage breakdown of time spent sending vs. opening snaps by age group, rounded to 2 decimal places.
πgithub.com/suchow07/sql-chalβ¦
#SQL #DataAnalytics #DataAnalyst #SQLQueries

















