Skip to content
Artwork for 脈報
脈報 · Yesterday · 6 min

AI 模型排行榜開始懲罰瞎掰!前三名只差 3 分,每題成本卻差了將近 8 倍

Artificial Analysis 推出 Intelligence Index v5,多項評測對瞎掰與出錯重罰,六成建立在不公開的題目或答案上。前三名 Claude Opus 5.5、GPT-6 Astra、GPT-6.1 Sol 只差 3 分,每題成本卻從 10.04 美元到 1.27 美元,相差約 8 倍。 ⭐ 文章深度讀:AI 模型評測換考法!誰的答案能直接交出去又要花多少錢 → https://heymaibao.com/ai-model-benchmark-v5-cost-per-task-dfd257/ ⚡ 章節重點 排行榜的新問法 00:00 新評測的計分規則 00:34 前三名的分數與帳單 02:01 總榜沒說的差距 03:41 下次看榜的清單 05:29 📝 懶人包 ∙ v5 總分前三名 58、57、55 分,只差 3 分 ∙ GPT-6.1 Sol 少不到 4 分,每題成本約 Opus 的八分之一 ∙ 開放權重最佳 Kimi K3.1 Pro 46 分,落後第一名 12 分 ∙ 我的觀點:這份榜可以讀成誰的東西比較能直接交出去 📚 參考資料 Announcing Artificial Analysis Intelligence Index v5 Artificial Analysis → https://artificialanalysis.ai/articles/artificial-analysis-intelligence-index-v5 Artificial Analysis Progress Index v1 Methodology | Artificial Analysis → https://artificialanalysis.ai/methodology/progress-index Intelligence Benchmarking | Artificial Analysis → https://artificialanalysis.ai/methodology/intelligence-benchmarking Steering thinking → https://platform.claude.com/docs/en/build-with-claude/thinking-steering-and-cost OpenAI 開放權重模型(gpt-oss) | OpenAI Help Center → https://help.openai.com/zh-hant/articles/11870455-openai-open-weight-models-gpt-oss Kimi K3.1 Pro Tech Blog: Advancing Open Intelligence → https://www.kimi.ai/blog/kimi-k3-1-pro Kimi K3.1 Pro open weights: status and date | Agentic Weekly → https://theagenticweekly.com/guides/kimi-k3-1-pro-open-weights

0:00-6:09

transcript

No transcript — this publisher did not publish one.

show notes


Artificial Analysis 推出 Intelligence Index v5,多項評測對瞎掰與出錯重罰,六成建立在不公開的題目或答案上。前三名 Claude Opus 5.5、GPT-6 Astra、GPT-6.1 Sol 只差 3 分,每題成本卻從 10.04 美元到 1.27 美元,相差約 8 倍。

⭐ 文章深度讀:AI 模型評測換考法!誰的答案能直接交出去又要花多少錢
→ https://heymaibao.com/ai-model-benchmark-v5-cost-per-task-dfd257/

⚡ 章節重點
排行榜的新問法 00:00
新評測的計分規則 00:34
前三名的分數與帳單 02:01
總榜沒說的差距 03:41
下次看榜的清單 05:29

📝 懶人包
∙ v5 總分前三名 58、57、55 分,只差 3 分

∙ GPT-6.1 Sol 少不到 4 分,每題成本約 Opus 的八分之一

∙ 開放權重最佳 Kimi K3.1 Pro 46 分,落後第一名 12 分

∙ 我的觀點:這份榜可以讀成誰的東西比較能直接交出去

📚 參考資料
Announcing Artificial Analysis Intelligence Index v5 Artificial Analysis
→ https://artificialanalysis.ai/articles/artificial-analysis-intelligence-index-v5

Artificial Analysis Progress Index v1 Methodology | Artificial Analysis
→ https://artificialanalysis.ai/methodology/progress-index

Intelligence Benchmarking | Artificial Analysis
→ https://artificialanalysis.ai/methodology/intelligence-benchmarking

Steering thinking
→ https://platform.claude.com/docs/en/build-with-claude/thinking-steering-and-cost

OpenAI 開放權重模型(gpt-oss) | OpenAI Help Center
→ https://help.openai.com/zh-hant/articles/11870455-openai-open-weight-models-gpt-oss

Kimi K3.1 Pro Tech Blog: Advancing Open Intelligence
→ https://www.kimi.ai/blog/kimi-k3-1-pro

Kimi K3.1 Pro open weights: status and date | Agentic Weekly
→ https://theagenticweekly.com/guides/kimi-k3-1-pro-open-weights

links8