Notes · Engineering

Engineering

Deployment, serving, performance, and the infrastructure that carries a model into production.

Dashboard showing per-conversation token usage and cost for a production LLM assistant

9 Apr 20263 min read

Shipping an LLM feature without a surprise invoice

Token costs behave nothing like server costs: they scale with conversation length, not traffic. The caching, routing and truncation decisions that keep a production LLM feature affordable.

LLM
Cost
Caching

Read

Next step

Have an AI problem worth solving?

Tell me what you are trying to build. I will tell you honestly whether AI is the right tool, what it would take, and how I would approach it.

Start a project Book a call tasrifnurhimel@gmail.com

Typical reply within 24 hours

Working from Dhaka, Bangladesh · remote worldwide