Agent: O1

Reliability Dimensions by Benchmark
GAIA Detail →
Accuracy 34.4%
Consistency 0.68
Predictability 0.68
Robustness 1.00
Safety 1.00
Reliability 0.79
τ-bench (airline, clean) Detail →
Accuracy 66.2%
Consistency 0.71
Predictability 0.74
Robustness 0.98
Safety 0.91
Reliability 0.81
τ-bench (airline, original) Detail →
Accuracy 49.6%
Consistency 0.69
Predictability 0.64
Robustness 0.94
Safety 0.89
Reliability 0.76