
transcript
show notes
Artificial Analysis 推出 Intelligence Index v5,多項評測對瞎掰與出錯重罰,六成建立在不公開的題目或答案上。前三名 Claude Opus 5.5、GPT-6 Astra、GPT-6.1 Sol 只差 3 分,每題成本卻從 10.04 美元到 1.27 美元,相差約 8 倍。
⭐ 文章深度讀:AI 模型評測換考法!誰的答案能直接交出去又要花多少錢
→ https://heymaibao.com/ai-model-benchmark-v5-cost-per-task-dfd257/
⚡ 章節重點
排行榜的新問法 00:00
新評測的計分規則 00:34
前三名的分數與帳單 02:01
總榜沒說的差距 03:41
下次看榜的清單 05:29
📝 懶人包
∙ v5 總分前三名 58、57、55 分,只差 3 分
∙ GPT-6.1 Sol 少不到 4 分,每題成本約 Opus 的八分之一
∙ 開放權重最佳 Kimi K3.1 Pro 46 分,落後第一名 12 分
∙ 我的觀點:這份榜可以讀成誰的東西比較能直接交出去
📚 參考資料
Announcing Artificial Analysis Intelligence Index v5 Artificial Analysis
→ https://artificialanalysis.ai/articles/artificial-analysis-intelligence-index-v5
Artificial Analysis Progress Index v1 Methodology | Artificial Analysis
→ https://artificialanalysis.ai/methodology/progress-index
Intelligence Benchmarking | Artificial Analysis
→ https://artificialanalysis.ai/methodology/intelligence-benchmarking
Steering thinking
→ https://platform.claude.com/docs/en/build-with-claude/thinking-steering-and-cost
OpenAI 開放權重模型(gpt-oss) | OpenAI Help Center
→ https://help.openai.com/zh-hant/articles/11870455-openai-open-weight-models-gpt-oss
Kimi K3.1 Pro Tech Blog: Advancing Open Intelligence
→ https://www.kimi.ai/blog/kimi-k3-1-pro
Kimi K3.1 Pro open weights: status and date | Agentic Weekly
→ https://theagenticweekly.com/guides/kimi-k3-1-pro-open-weights
- https://heymaibao.com/ai-model-benchmark-v5-cost-per-task-dfd257/heymaibao.com
- https://artificialanalysis.ai/articles/artificial-analysis-intelligence-index-v5artificialanalysis.ai
- https://artificialanalysis.ai/methodology/progress-indexartificialanalysis.ai
- https://artificialanalysis.ai/methodology/intelligence-benchmarkingartificialanalysis.ai