Gemma 2 27B IT is an instruction-tuned version of Google's state-of-the-art open language model. Built from the same research and technology as Gemini, it's optimized for dialogue applications through supervised fine-tuning, distillation from larger models, and RLHF. The model excels at text generation tasks including question answering, summarization, and reasoning.
发布日期2024年6月27日
参数规模27.2B
上下文长度—
许可证Gemma
知识截止—
Benchmarks
评测成绩
| 评测基准 | 类别 | 分数 | 来源 |
|---|---|---|---|
| ARC-E | reasoning general | 88.6 | 来源 |
| HellaSwag | reasoning | 86.4 | 来源 |
| BoolQ | language reasoning | 84.8 | 来源 |
| TriviaQA | general reasoning | 83.7 | 来源 |
| Winogrande | reasoning language | 83.7 | 来源 |
| PIQA | reasoning physics general | 83.2 | 来源 |
| MMLU | general reasoning language math | 75.2 | 来源 |
| BIG-Bench | reasoning math language | 74.9 | 来源 |
| GSM8k | math reasoning | 74.0 | 来源 |
| ARC-C | reasoning general | 71.4 | 来源 |
| MBPP | reasoning general | 62.6 | 来源 |
| AGIEval | reasoning general math | 55.1 | 来源 |
| Social IQa | reasoning psychology | 53.7 | 来源 |
| HumanEval | reasoning code | 51.8 | 来源 |
| MATH | math reasoning | 42.3 | 来源 |
| Natural Questions | reasoning general search | 34.5 | 来源 |
Pricing
API 价格对比
暂无 API 价格。