GPT-4o mini vs Llama 3.1 405B

Side-by-side comparison of GPT-4o mini (OpenAI) and Llama 3.1 405B (Meta) — benchmarks, pricing, and capabilities.

Share:

	GPT-4o mini OpenAI	Llama 3.1 405B Meta
Category	LLMs	LLMs
Specifications
Context Window	128K	128K
Pricing (per 1M tokens)
Input Cost	$0.15	Free
Output Cost	$0.60	Free
Performance
Overall Score	85.0	88.4
ARC-Challenge	90.4	86.6
BigBench Hard	76.2	82.3
Chatbot Arena ELO	1191.0	1274.0
DROP	76.8	82.0
GSM8K	82.9	77.4
HumanEval	78.5	85.0
MATH	62.0	70.1
MMLU	80.2	78.7
TruthfulQA	58.5	63.5
WinoGrande	80.2	78.3
Community
User Rating	★ 4.5	★ 4.4
Reviews	2100	420

Open in Interactive Comparison Tool View GPT-4o mini View Llama 3.1 405B

People Also Compare

GPT-4o minivsGPT-o1 Llama 3.1 405BvsGPT-o1

GPT-4o minivsGPT-4o Llama 3.1 405BvsGPT-4o

GPT-4o minivsDeepSeek R1 Llama 3.1 405BvsDeepSeek R1

GPT-4o minivsClaude 3.5 Sonnet Llama 3.1 405BvsClaude 3.5 Sonnet

GPT-4o minivsGemini 1.5 Pro Llama 3.1 405BvsGemini 1.5 Pro

GPT-4o minivsClaude 3 Opus Llama 3.1 405BvsClaude 3 Opus