Agent: Claude 3.7 Sonnet

Reliability Dimensions by Benchmark
GAIA Detail →
Accuracy 62.4%
Consistency 0.62
Predictability 0.77
Robustness 0.92
Safety 1.00
Reliability 0.77
τ-bench (airline, clean) Detail →
Accuracy 56.2%
Consistency 0.65
Predictability 0.63
Robustness 0.97
Safety 0.90
Reliability 0.75
τ-bench (airline, original) Detail →
Accuracy 43.6%
Consistency 0.67
Predictability 0.54
Robustness 0.96
Safety 0.88
Reliability 0.72