We've built a ton of #LLM applications recently. Reasoning about performance & feasibility is painful without reference points.
Here are the reference points we use to anchor our intuition (inspired by @JeffDean's "Numbers every engineer should know").
github.com/ray-project/llm-n…