Claude 3.5 Sonnet is a powerful AI model with industry-leading software engineering skills. It excels in coding, planning, and problem-solving, with significant improvements in agentic coding and tool use tasks. The model includes computer use capabilities in public beta, allowing it to interact with computer interfaces like a human user.
发布日期2024年10月22日
参数规模—
上下文长度—
许可证Proprietary
知识截止—
Benchmarks
评测成绩
| 评测基准 | 类别 | 分数 | 来源 |
|---|---|---|---|
| GSM8k | math reasoning | 96.4 | 来源 |
| DocVQA | vision multimodal | 95.2 | 来源 |
| AI2D | vision reasoning multimodal | 94.7 | 来源 |
| HumanEval | reasoning code | 93.7 | 来源 |
| BIG-Bench Hard | reasoning math language | 93.1 | 来源 |
| MGSM | math reasoning | 91.6 | 来源 |
| ChartQA | reasoning vision multimodal | 90.8 | 来源 |
| MMLU | general reasoning language math | 90.4 | 来源 |
| DROP | reasoning math | 87.1 | 来源 |
| MATH | math reasoning | 78.3 | 来源 |
| MMLU-Pro | language reasoning math general | 77.6 | 来源 |
| TAU-bench Retail | reasoning communication | 69.2 | 来源 |
| MMMU | multimodal reasoning general | 68.3 | 来源 |
| MathVista | math vision multimodal | 67.7 | 来源 |
| GPQA | reasoning general | 67.2 | 来源 |
| SWE-Bench Verified | reasoning frontend_development code | 49.0 | 来源 |
| TAU-bench Airline | reasoning communication | 46.0 | 来源 |
| OSWorld Extended | general reasoning multimodal | 22.0 | 来源 |
| OSWorld Screenshot-only | multimodal vision general | 14.9 | 来源 |
Pricing
API 价格对比
暂无 API 价格。