#caching

2 posts tagged #caching.

Amber store counter with a figure in shadow and stations glowing in cyan, violet and turquoise

AI Agents New

Boss and interns

How I split coding work across several AI models without the bill exploding

28 billion tokens in six months, 94% of them read from cache. How I split the work between one expensive model and several cheap ones at LENZ.

#delegation#caching#tokens#workflow

Nicolás Biondi· 4 min readRead the post

Five copper pipes, each with a ring of cyan light; from one of them a thread of amber light drips down and forms a puddle.

Tokens & Costs

Free with a meter

A cache spent 2,400 writes a day on a plan that allowed 1,000

Nicolás Biondi· 4 minRead the post