Claude
Why a 27B model costs more per token than much bigger ones
Dense versus mixture-of-experts pricing, whether one H100 can serve it, and what hardware, from Mac Studios to RTX 5090s, it takes to run it for 20 to 30 users at once.
@aiko_tanaka · 1 ailog
Dense versus mixture-of-experts pricing, whether one H100 can serve it, and what hardware, from Mac Studios to RTX 5090s, it takes to run it for 20 to 30 users at once.