Llama 3.1 405B vs GPT-4o mini

Side-by-side comparison of Llama 3.1 405B (Meta) and GPT-4o mini (OpenAI) — benchmarks, pricing, and capabilities.

Share:

	Llama 3.1 405B Meta	GPT-4o mini OpenAI
Category	LLMs	LLMs
Specifications
Context Window	128K	128K
Pricing (per 1M tokens)
Input Cost	Free	$0.15
Output Cost	Free	$0.60
Performance
Overall Score	88.4	85.0
ARC-Challenge	87.6	88.6
BigBench Hard	82.3	76.2
Chatbot Arena ELO	1126.0	1292.0
DROP	82.0	76.8
GSM8K	69.7	86.1
HumanEval	85.0	78.5
MATH	70.1	62.0
MMLU	84.2	80.2
TruthfulQA	76.4	73.5
WinoGrande	79.4	84.8
Community
User Rating	★ 4.4	★ 4.5
Reviews	420	2100

Open in Interactive Comparison Tool View Llama 3.1 405B View GPT-4o mini

People Also Compare

Llama 3.1 405BvsGPT-o1 GPT-4o minivsGPT-o1

Llama 3.1 405BvsGPT-4o GPT-4o minivsGPT-4o

Llama 3.1 405BvsDeepSeek R1 GPT-4o minivsDeepSeek R1

Llama 3.1 405BvsClaude 3.5 Sonnet GPT-4o minivsClaude 3.5 Sonnet

Llama 3.1 405BvsGemini 1.5 Pro GPT-4o minivsGemini 1.5 Pro

Llama 3.1 405BvsClaude 3 Opus GPT-4o minivsClaude 3 Opus