Unverified50% confidenceBenchmarkExact time
At batch 128 with the 7B AWQ model, the L40S's cost per million output tokens is $0.036, lower than the 3090's $0.040.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
10/18/2026
First Seen
Valid until: 11/1/2026
Sources
Related Entities
Related Claims
UnverifiedUnder the same H100 configuration, the cost per million output tokens is about $0.22–0.23 under an 8-request concurrent load.70% similarUnverifiedRunning vLLM 0.27.1 official image to infer Qwen2.5-0.5B-Instruct (fp16) on an H100 SXM 80GB on vast.ai ($2.689 per hour, 20 vCPU), the cost per million output tokens is about $1.26 under a single-request serial load.69% similarUnverifiedCalculated by VRAM capacity, the B70 is approximately $41/GB and the R9700 is approximately $55/GB.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1061233API
curl https://kongchang.com/api/v1/knowledge/claims/1061233MCP
get_claim(id=1061233)