Side-by-side comparison of Devin (Cognition) and CodeLlama 70B (Meta) — benchmarks, pricing, and capabilities.
| Devin Cognition | CodeLlama 70B Meta | |
|---|---|---|
| Category | AI Agents | Code Models |
| Specifications | ||
| Context Window | — | 100K |
| Pricing (per 1M tokens) | ||
| Input Cost | — | — |
| Output Cost | — | — |
| Performance | ||
| Overall Score | 84.0 | 79.0 |
| HumanEval | — | 67.8 |
| MBPP | — | 70.5 |
| SWE-bench Verified | 41.5 | — |
| Community | ||
| User Rating | ★ 4.1 | ★ 4.2 |
| Reviews | 180 | 310 |