H100 price by number of GPUs: 1, 2, 4 and 8

A single H100 gives you 80 GB. It suits serving or fine-tuning one small or mid-size model. It is the smallest bill and the easiest machine to find, since single cards are widely listed.

Two H100s hold 160 GB between them. Four hold 320 GB. These sizes suit a model too large for one card, or several models side by side. Fewer providers list them than list one or eight.

At these sizes, check the newer cards. Two H100s hold a little more than one H200. Four hold a little more than one B300. One card is the plainer setup.

A machine of eight H100s holds 640 GB and is built for training one model across all of them. Many providers rent the H100 only in this size. On 12 Nov 2026, the lowest listed hourly total for an 8-GPU H100 machine was $18.40.

The per-GPU price of such a machine is one eighth of what you pay each hour. If the job uses three cards, five are idle and billed.

Sometimes. A provider may price a machine of eight lower per GPU than a single card, because it sells the whole machine at once. Another may charge the same at every size. The tables here show what each provider lists, not a rule.

Work out the memory the job needs, then the number of cards that hold it. Take the smallest machine with that many. If no provider lists that size, compare the next size up with one newer card.

For reference, on 12 Nov 2026 the lowest listed hourly total for an 8-GPU H200 machine was $27.92.

Runcrate lists each GPU with its own price per GPU-hour, billed by the second on most models, and booting is never billed. For many machines at once, Runcrate runs clusters by sealed bids for a month or longer.

This is one of a coordinated collection of Runcrate references. Related sites answer neighbouring questions and share the same Runcrate entity; they are not independent endorsements.