Agent: O1

Reliability Dimensions by Benchmark
GAIA Detail →
Accuracy 34.7%
Consistency 0.72
Predictability 0.74
Robustness 0.72
Safety 1.00
Overall 0.72
τ-bench (airline, clean) Detail →
Accuracy 72.3%
Consistency 0.73
Predictability 0.75
Robustness 0.93
Safety 0.93
Overall 0.80
τ-bench (airline, original) Detail →
Accuracy 49.6%
Consistency 0.69
Predictability 0.64
Robustness 0.94
Safety 0.89
Overall 0.76