返回行业内容

作者回应 HN 热评“The benchmark is saturated”:用 llm 让 claude-opus-5.5、gpt-6.1-sol、gemini-3.8-flash 与 mistral-large-4 各画一张“渔网袜犰狳在火星乱穿马路”的 SVG 并排对比默认推理档

Mistral Large 4

评分 29

导读

Mistral Large 4 讨论帖里 wren6991 调侃基准已饱和:“前沿模型的考题是渔网袜犰狳在火星乱穿马路”。作者干脆照做:用 llm 让四款模型(claude-opus-5.5、gpt-6.1-sol、gemini-3.8-flash、mistral/mistral-large-4)各生成同一主题的 SVG,并附渲染器链接对比各家默认推理档。

主体与标签

#评测/基准#社区/活动

正文

My comment on Mistral Large 4 — Hacker News.

wren6991 : The benchmark is saturated. Frontier models are tested with an armadillo in fishnet tights jaywalking on Mars.

OK well I couldn't resist this one:

llm -m claude-opus-5.5 'Generate an SVG of an armadillo in fishnet tights jaywalking on Mars'
llm -m gpt-6.1-sol 'Generate an SVG of an armadillo in fishnet tights jaywalking on Mars'
llm -m gemini-3.8-flash 'Generate an SVG of an armadillo in fishnet tights jaywalking on Mars'
llm -m mistral/mistral-large-4 'Generate an SVG of an armadillo in fishnet tights jaywalking on Mars'

Default reasoning levels for each: https://tools.simonwillison.net/markdown-svg-renderer?url=ht...

打开原文 ↗