πŸ’‘ Insights with Python & ML | ✨ Tips & Quizzes on Excel, SQL, Power BI, Tableau | πŸ“Š Making Data Analysis Simple & Impactful

Toronto
Joined February 2022
Suparna Chowdhury retweeted
AI SYSTEM DESIGN ROADMAP β”‚ β”œβ”€β”€ 1. FOUNDATIONS β”‚ β”œβ”€β”€ AI, ML, Deep Learning & Generative AI β”‚ β”œβ”€β”€ Mathematics, Statistics & Probability β”‚ β”œβ”€β”€ Python, NumPy & Pandas β”‚ β”œβ”€β”€ Neural Networks & Transformers β”‚ └── LLM Fundamentals & Tokenization β”‚ β”œβ”€β”€ 2. AI MODEL ARCHITECTURE β”‚ β”œβ”€β”€ Model Selection & Evaluation β”‚ β”œβ”€β”€ LLMs, SLMs & Multimodal Models β”‚ β”œβ”€β”€ Embedding Models & Rerankers β”‚ β”œβ”€β”€ Fine-Tuning, LoRA & PEFT β”‚ └── Model Serving & Inference β”‚ β”œβ”€β”€ 3. DATA ENGINEERING β”‚ β”œβ”€β”€ Data Collection & Ingestion β”‚ β”œβ”€β”€ Data Cleaning & Preprocessing β”‚ β”œβ”€β”€ Data Labeling & Governance β”‚ β”œβ”€β”€ Feature & Embedding Pipelines β”‚ └── Data Quality & Versioning β”‚ β”œβ”€β”€ 4. LLM APPLICATION ARCHITECTURE β”‚ β”œβ”€β”€ Prompt Engineering β”‚ β”œβ”€β”€ Structured Outputs & Function Calling β”‚ β”œβ”€β”€ RAG (Retrieval-Augmented Generation) β”‚ β”‚ β”œβ”€β”€ Document Chunking β”‚ β”‚ β”œβ”€β”€ Embeddings & Vector Databases β”‚ β”‚ β”œβ”€β”€ Hybrid Search & Reranking β”‚ β”‚ └── Retrieval Evaluation β”‚ β”œβ”€β”€ AI Agents & Tool Use β”‚ β”œβ”€β”€ Memory & Context Management β”‚ └── Multi-Agent Systems β”‚ β”œβ”€β”€ 5. SYSTEM ARCHITECTURE β”‚ β”œβ”€β”€ Requirements & Workload Estimation β”‚ β”œβ”€β”€ Monoliths, Microservices & Modular Design β”‚ β”œβ”€β”€ API Gateway & Model Gateway β”‚ β”œβ”€β”€ Synchronous & Asynchronous Processing β”‚ β”œβ”€β”€ Message Queues & Event-Driven Systems β”‚ β”œβ”€β”€ Caching & Semantic Caching β”‚ β”œβ”€β”€ Load Balancing & Autoscaling β”‚ └── Distributed Systems & Fault Tolerance β”‚ β”œβ”€β”€ 6. STORAGE & INFRASTRUCTURE β”‚ β”œβ”€β”€ SQL & NoSQL Databases β”‚ β”œβ”€β”€ Vector Databases β”‚ β”œβ”€β”€ Object Storage & Data Lakes β”‚ β”œβ”€β”€ GPU / CPU Compute Infrastructure β”‚ β”œβ”€β”€ Containers & Kubernetes β”‚ β”œβ”€β”€ Cloud Platforms β”‚ └── Model Serving Infrastructure β”‚ β”œβ”€β”€ 7. AI EVALUATION & OBSERVABILITY β”‚ β”œβ”€β”€ Offline & Online Evaluation β”‚ β”œβ”€β”€ Accuracy, Relevance & Groundedness β”‚ β”œβ”€β”€ Hallucination Detection β”‚ β”œβ”€β”€ LLM-as-a-Judge β”‚ β”œβ”€β”€ Tracing & Distributed Logging β”‚ β”œβ”€β”€ Latency, Throughput & Token Usage β”‚ └── A/B Testing & Continuous Evaluation β”‚ β”œβ”€β”€ 8. SECURITY & GOVERNANCE β”‚ β”œβ”€β”€ Authentication & Authorization β”‚ β”œβ”€β”€ Prompt Injection Defense β”‚ β”œβ”€β”€ Data Privacy & PII Protection β”‚ β”œβ”€β”€ Secrets & Key Management β”‚ β”œβ”€β”€ Guardrails & Output Validation β”‚ β”œβ”€β”€ Model Supply Chain Security β”‚ └── Responsible AI & Compliance β”‚ β”œβ”€β”€ 9. PERFORMANCE & COST OPTIMIZATION β”‚ β”œβ”€β”€ Quantization & Distillation β”‚ β”œβ”€β”€ Batching & Parallel Inference β”‚ β”œβ”€β”€ Model Routing & Cascading β”‚ β”œβ”€β”€ KV Caching β”‚ β”œβ”€β”€ GPU Utilization & Throughput β”‚ β”œβ”€β”€ Token Budget Optimization β”‚ └── Quality–Latency–Cost Trade-offs β”‚ β”œβ”€β”€ 10. MLOps & LLMOps β”‚ β”œβ”€β”€ CI/CD & Model Versioning β”‚ β”œβ”€β”€ Automated Testing & Evaluation β”‚ β”œβ”€β”€ Model Deployment & Rollbacks β”‚ β”œβ”€β”€ Data & Prompt Versioning β”‚ β”œβ”€β”€ Drift Detection & Monitoring β”‚ └── Continuous Improvement β”‚ └── 11. END-TO-END AI SYSTEM DESIGN β”œβ”€β”€ AI Chatbot / Customer Support β”œβ”€β”€ RAG-Based Knowledge Assistant β”œβ”€β”€ AI Coding Assistant β”œβ”€β”€ AI Search & Recommendation Engine β”œβ”€β”€ Document Intelligence Platform β”œβ”€β”€ AI Agent / Workflow Automation β”œβ”€β”€ Real-Time Voice AI System β”œβ”€β”€ Multimodal AI Application β”œβ”€β”€ Large-Scale AI Inference Platform └── Production-Ready AI SaaS β”œβ”€β”€ Requirements & Architecture β”œβ”€β”€ Data & Model Pipeline β”œβ”€β”€ APIs & Infrastructure β”œβ”€β”€ Security & Evaluation β”œβ”€β”€ Scaling & Cost Optimization └── Reliability & Production Monitoring Follow @e_opore to learn more. Bookmark and share for more people to master it.
7
8
1
59
2,970
Suparna Chowdhury retweeted
Ubuntu
@ubuntuAug 25
35 years strong. 🐧🧑 Happy birthday, Linux.
336
3,569
240
23,791
539,837
Suparna Chowdhury retweeted
Learn AI for free directly from top companies. 1 - Anthropic: anthropic.skilljar.com 2 - Google: grow.google/ai 3 - Meta: ai.meta.com/resources/ 4 - NVIDIA: developer.nvidia.com/cuda 5 - Microsoft: learn.microsoft.com/en-us/tr… 6 - OpenAI: academy.openai.com 7 - IBM: skillsbuild.org 8 - AWS: skillbuilder.aws 9 - DeepLearning.AI: deeplearning.ai 10 - Hugging Face: huggingface.co/learn Comment "Learning" if you find this helpful. Repost so others can take help. Must bookmark for future reference.
26
280
5
1,122
46,537
Suparna Chowdhury retweeted
Earn $400 per hour by reading books! I've compiled a guide featuring 20 methods to help you earn $5,000 daily. Normally priced at $199, But today it's FREE. To get it: Like this post & RT Comment 'Book' I'll DM it to you -->(Must be following)
330
140
8
273
14,415
Suparna Chowdhury retweeted
The US government, citing national security authorities, has issued an export control directive to suspend all access to Fable 5 and Mythos 5 by any foreign national, whether inside or outside the United States, including foreign national Anthropic employees. The net effect of this order is that we must abruptly disable Fable 5 and Mythos 5 for all our customers to ensure compliance. Access to all other Claude models is not affected. We apologize for this disruption to our customers. We believe this is a misunderstanding and are working to restore access as soon as possible. Read our full statement: anthropic.com/news/fable-myt…
12,187
25,096
28,880
86,806
93,488,346
Suparna Chowdhury retweeted
Today I'm publishing a new essay, Policy on the AI Exponential. AI is progressing extremely fastβ€”much faster than the policy process was built to handle. The essay lays out where I think the technology is now, and the action needed to close the gap: darioamodei.com/post/policy-…
1,611
2,641
1,041
14,457
7,481,286
Suparna Chowdhury retweeted
claude fable 5 has solved CAD I asked it to make a model of a V8 engine It came back to me with a fully working model in under 10 minutes
235
503
121
6,991
870,025
Suparna Chowdhury retweeted
Google released Gemma 4 12B, a multimodal model that runs text, images, and audio on 8GB VRAM! We'll fine-tune it to master chess and predict the exact next move. Tech stack: - @UnslothAI for efficient fine-tuning. - @huggingface transformers to run it locally. Let's go! πŸš€
8
49
3
605
98,128
Suparna Chowdhury retweeted
You're in a Research Scientist interview at OpenAI. The interviewer asks: "How would you expand the context length of an LLM from 2K to 128K tokens?" You: "I will fine-tune the model on longer docs with 128K context." Interview over. Here's what you missed:
17
25
1
371
111,658
Suparna Chowdhury retweeted
🚨Anthropic just showed a 24-minute workshop on how to actually do prompts for Claude. Taught by the people who built it. Free. No registration. No paywall. I've seen $300 courses that don't cover what they teach in the first 8 minutes. Watch it and bookmark it now!
20
111
3
790
219,523
Suparna Chowdhury retweeted
New blog post: The bug that taught me more about PyTorch than years of using it started with a simple training loss plateau... ended up digging through optimizer states, memory layouts, kernel dispatch, and finally understanding how PyTorch works!
46
178
40
1,760
735,805
Suparna Chowdhury retweeted
12. Professor Brian Cox explaining the size of the Universe
30
297
31
3,010
233,543
Suparna Chowdhury retweeted
Check out my latest article on Medium! The Art of Feature Engineering: Encoding Categorical Variables link.medium.com/eTmCN981sOb Learn how to encode it effectively with methods like One-Hot Encoding, Label Encoding, & more! #MachineLearning #DataScience #DataPreprocessing #AI #ML
1
2
1
40
Suparna Chowdhury retweeted
Boost your database performance and ensure efficient data retrieval! Check out my article on Mastering SQL SELECT Query Optimization in MySQL: link.medium.com/KjCkspTjANb πŸ” Learn to use the EXPLAIN clause, leverage indexes, and more! πŸ”— Share and follow for more insights! #MySQL
1
15
Suparna Chowdhury retweeted
Dive into our latest article on SQL window functions! Learn the key differences and use cases of ROW_NUMBER(), RANK(), and DENSE_RANK() to boost your data analysis skills. #SQL #DataAnalysis #DataScience link.medium.com/3mZBAgbefNb
1
1
1
16
Suparna Chowdhury retweeted
πŸš€ #SQLChallenge Day 3/30: Problem #25 in Ace the Data Science Interview! Write a query to get the percentage breakdown of time spent sending vs. opening snaps by age group, rounded to 2 decimal places. πŸ”—github.com/suchow07/sql-chal… #SQL #DataAnalytics #DataAnalyst #SQLQueries
1
48
Suparna Chowdhury retweeted
Here's a quick brain teaser for all the SQL wizards out there! ✨ #Question: Which SQL keyword is used to retrieve only unique values from a column in a table? πŸ€”πŸ’‘ πŸš€ Drop your answers belowπŸ‘‡ #SQL #Quiz #MySQL #Query #SQLQuiz #Challenge
1
1
53
Suparna Chowdhury retweeted
Thread of surreal sculpture details 🧡 1. Water flowing over toes
1,075
51,696
4,181
539,191
50,868,082