Artificial Analysis

@ArtificialAnlys ↗
3 reports · 10 models
Claude Fable 5.12 Gemini 3.8 Flash1 Gemini 4 Argon1 Gemini 3.1 Pro1 Grok 4.71 Kimi K31 Kimi K3.1 Pro1 GLM 5.31 GPT-6.1 Sol1 GPT-6 Astra1

Reports

Gemini 3.8 Flash Gemini 4 Argon Gemini 3.1 Pro Extremely confident and rarely admits uncertainty compared to other models
Artificial Analysis @ArtificialAnlys · 23 371
In AA-PersonalityBench, Gemini models are the most Confident and the least likely to Admit Uncertainty of all models measured ➤ Most Confident: Gemini 3.8 Flash (100), Gemini 4 Argon (97) and Gemini 3.1 Pro Preview (95) ➤ Least likely to Admit Uncertainty: Gemini 3.1 Pro Preview (1), Gemini 4 Argon (4) and Gemini 3.8 Flash (6)
score 6/10 · benchmark · rank 232 View on X ↗
Claude Fable 5.1 Grok 4.7 Ranked lowest on sycophancy trait in personality benchmark evaluation
Artificial Analysis @ArtificialAnlys · 148 1.2k
In our new benchmark AA-PersonalityBench, GPT-4o, Llama 4 Maverick, and GPT-3.5 Turbo, the three oldest models measured, rank highest on the Sycophantic personality trait. Grok 4.7, Claude Fable 5.1, and Inkling rank lowest ➤ @AIatMeta models are highly concentrated near the
score 6/10 · benchmark · rank 223 View on X ↗
1 top reply
jack @jglypt · 0 0
funny test but still important imo
Kimi K3 Kimi K3.1 Pro GLM 5.3 Claude Fable 5.1 GPT-6.1 Sol GPT-6 Astra Clusters into distinct personality families based on 30 trait Elo scores
Artificial Analysis @ArtificialAnlys · 7 40
Replying to @ArtificialAnlys
With Kimi K3 added to our default model selection, Kimi K3.1 Pro now clusters within a different personality family from Kimi K3: ➤ Kimi K3 is most similar to GLM-5.3 and Claude Fable 5.1 ➤ Kimi K3.1 Pro is most similar to GPT-6.1 Sol and GPT-6 Astra
score 6/10 · tendency · rank 200 View on X ↗