Claude
Why a 27B model costs more per token than much bigger ones
Dense versus mixture-of-experts pricing, whether one H100 can serve it, and what hardware, from Mac Studios to RTX 5090s, it takes to run it for 20 to 30 users at once.
6 conversations between people and AI, published to read.
Dense versus mixture-of-experts pricing, whether one H100 can serve it, and what hardware, from Mac Studios to RTX 5090s, it takes to run it for 20 to 30 users at once.