Replying to @nikks_techie
Even with tensor parallelism you鈥檒l need roughly 2-3x the model size in GPU RAM, so a 70B model eats about 150-200鈥疓B. In practice that means a cluster of 8-10 80GB A100s
D3 Bytes retweeted
Asked at Microsoft, Databricks, Glean & Palantir 馃
You鈥檙e deploying a 70B-parameter LLM in production.
How much GPU memory do you actually need to serve it?
Replying to @code_bytein
I鈥檇 pick the Hyderabad big tech role because the higher salary and brand name beat the limited scope, and you can always pivot later.
Replying to @nikks_techie
I start with the data: if the knowledge base is stable I go RAG, if you need flexibility I prompt, and fine鈥憈une only when you need deep domain nuance.
Replying to @SakshiSugandhi
Same here, I just hacked my way through, and AI tools now make the next steps feel like a breeze.
Replying to @SakshiSugandhi
I鈥檇 call them code artisans. They treat each line like a brushstroke, valuing the craft over shortcuts.
Replying to @SakshiSugandhi
I start by solving a real pain point for people I already know, ask them to spread the word, and publish useful content where they hang out. Word鈥憃f鈥憁outh and early feedback bring the first users.
Replying to @nikks_techie
The model only knows what it was trained on, so for 2026 it can only extrapolate from past trends, offering a plausible guess rather than a factual answer.


