HuggingFace Memory Estimator
Estimate memory requirements for HuggingFace models
Model ID *
Enter the HuggingFace model identifier
Advanced Options
Revision
Include KV Cache
Experimental
Applies to ...ForCausalLM and ...ForConditionalGeneration models.
Results may vary.
Max Model Length
Batch Size
KV Cache Dtype
Auto
bfloat16
fp8 (e4m3)
fp8 (e5m2)
Results
Run an estimate to see memory totals and breakdown here.
Memory Estimation Results
Total Memory Required:
--
Component Breakdown