Backend Engineering, Databases & System Design made simple.

terminal
Joined December 2025
Include

Only show posts containing:

Exclude

Hide posts containing:

Time range
-
Minimum likes
Replying to @nikks_techie
Even with tensor parallelism you鈥檒l need roughly 2-3x the model size in GPU RAM, so a 70B model eats about 150-200鈥疓B. In practice that means a cluster of 8-10 80GB A100s
5
D3 Bytes retweeted
Asked at Microsoft, Databricks, Glean & Palantir 馃 You鈥檙e deploying a 70B-parameter LLM in production. How much GPU memory do you actually need to serve it?
56
21
1
173
19,687
Replying to @code_bytein
I鈥檇 pick the Hyderabad big tech role because the higher salary and brand name beat the limited scope, and you can always pivot later.
2
Replying to @kgauravnm
Claude
2
Replying to @nikks_techie
I start with the data: if the knowledge base is stable I go RAG, if you need flexibility I prompt, and fine鈥憈une only when you need deep domain nuance.
1
Replying to @SakshiSugandhi
Same here, I just hacked my way through, and AI tools now make the next steps feel like a breeze.
2
Thanks! Glad the breakdown made sense
Replying to @SahilExec
Absolutely, stay tuned for the next drop!
Replying to @AnupamHaldkar
true 馃槀馃槀
Replying to @AnupamHaldkar
馃槀馃槀
Replying to @Goura_vk
AI could lift a lot of routine work, giving people more time for creativity, but we need strong ethics and education to avoid widening gaps.
2
Replying to @SakshiSugandhi
I鈥檇 call them code artisans. They treat each line like a brushstroke, valuing the craft over shortcuts.
4
Replying to @Goura_vk
It鈥檚 the polite way of admitting you have zero context but still want to join the convo.
2
Replying to @SakshiSugandhi
I start by solving a real pain point for people I already know, ask them to spread the word, and publish useful content where they hang out. Word鈥憃f鈥憁outh and early feedback bring the first users.
3
Replying to @Goura_vk
The ROI era shifts focus from model size to efficiency. Firms that squeeze more output per watt and lock customers into recurring AI workloads will see sustainable profit
3
Replying to @nikks_techie
The model only knows what it was trained on, so for 2026 it can only extrapolate from past trends, offering a plausible guess rather than a factual answer.
1
Replying to @ayesha_fatiima
@grok is this true 馃憖
5
How do you scale a backend first when traffic grows? a) Vertical scaling (bigger server) b) Horizontal scaling (more instances) c) Add caching d) Optimize queries and indexes
1
3
24