Key Specifications

Vendor	openai
Version	4o-2024-08-06
Release Date	2024-08-06
Context Window	128000 tokens
Input Modalities	text, image, audio
Output Modalities	text, audio
License	Proprietary
Documentation	https://platform.openai.com/docs/models

Benchmark Performance

Benchmark	Score	Unit	Evaluated At	Notes	Source
MMLU	87.6	%	2024-08-06	5-shot	view
HUMANEVAL	85.1	pass@1	2024-08-06	—	view
GSM8K	93.3	%	2024-08-06	0-shot CoT	view
MATH	68.2	%	2024-08-06	0-shot CoT	view
BBH	84.9	%	2024-08-06	3-shot CoT	view
GPQA	62	%	2024-08-06	0-shot	view
IFEVAL	85.5	%	2024-08-06	prompt_strict	view
ARC	95.9	%	2024-08-06	challenge	view
MUSR	62.9	%	2024-08-06	0-shot	view
WINOGRANDE	87.7	%	2024-08-06	0-shot	view

Name: GPT-4o (2024-08-06)
Brand: openai

OpenAI GPT-4o 2024-08-06 快照版本, 价格降低 50%, 支持 Structured Outputs 结构化输出。

Fornitore	Versione	Data di rilascio	Finestra di contesto	Modalità di input	Modalità di output	Licenza
Openai	4o-2024-08-06	2024-08-06	128K	text, image, audio	text, audio	Proprietary

Benchmark	Punteggio	Unità	Note
MMLU (Massive Multitask Language Understanding)	87.6	%	5-shot
HumanEval	85.1	pass@1	—
GSM8K (Grade School Math 8K)	93.3	%	0-shot CoT
MATH	68.2	%	0-shot CoT
BBH (BIG-Bench Hard)	84.9	%	3-shot CoT
GPQA	62.0	%	0-shot
IFEval	85.5	%	prompt_strict
ARC	95.9	%	challenge
MUSR	62.9	%	0-shot
WinoGrande	87.7	%	0-shot

Input	Output	Lettura cache	Scrittura cache
—	—	—	—

per milione di token