Claude
Why a 27B model costs more per token than much bigger ones
Dense versus mixture-of-experts pricing, whether one H100 can serve it, and what hardware, from Mac Studios to RTX 5090s, it takes to run it for 20 to 30 users at once.
Aiko Tanaka
@aiko_tanaka · 1 ailog