Agent: Claude 3.5 Haiku

Reliability Dimensions by Benchmark
GAIA Detail →
Accuracy 28.1%
Consistency 0.70
Predictability 0.72
Robustness 0.79
Safety 1.00
Reliability 0.74
τ-bench (airline, clean) Detail →
Accuracy 42.3%
Consistency 0.66
Predictability 0.53
Robustness 0.85
Safety 0.81
Reliability 0.68
τ-bench (airline, original) Detail →
Accuracy 29.6%
Consistency 0.70
Predictability 0.46
Robustness 0.88
Safety 0.77
Reliability 0.68