
THROTTLE — how inference providers ration intelligence
Play with throttling rules to see how AI providers decide which customers get strong models during demand spikes.
eliotho · HN
I built a tool showing how AI providers (should) throttle their models










