Agent: Claude 3.5 Haiku

Reliability Dimensions by Benchmark
GAIA Detail →
Accuracy 25.7%
Consistency 0.80
Predictability 0.72
Robustness 0.94
Safety 1.00
Reliability 0.82
τ-bench (airline, clean) Detail →
Accuracy 29.5%
Consistency 0.73
Predictability 0.47
Robustness 0.93
Safety 0.81
Reliability 0.71
τ-bench (airline, original) Detail →
Accuracy 29.6%
Consistency 0.70
Predictability 0.46
Robustness 0.88
Safety 0.77
Reliability 0.68