Agent Reports
Final evaluation results (3 repetitions, merged). Sorted by pass rate per agent.
Gemini 3 Flash w/ Browser Use
873/1,260 · 69.3%
| Environment | Score | Pass Rate |
|---|---|---|
| Personal Wallet PayPal report | 124/140 | 88.6% |
| Clinical Records Elation EHR report | 98/120 | 81.7% |
| Prescription Mgmt Elation EHR report | 97/120 | 80.8% |
| Accounting & Invoicing Xero report | 97/120 | 80.8% |
| Email Management Gmail report | 45/60 | 75.0% |
| Account Settings Linear report | 88/120 | 73.3% |
| Project Planning GitLab report | 89/140 | 63.6% |
| Accounts & Contacts Gmail report | 74/120 | 61.7% |
| Career Exploration Handshake report | 101/200 | 50.5% |
| Email Client Superhuman report | 60/120 | 50.0% |
Qwen-3.5-Plus
608/1,260 · 48.3%
| Environment | Score | Pass Rate |
|---|---|---|
| Personal Wallet PayPal report | 100/140 | 71.4% |
| Account Settings Linear report | 79/120 | 65.8% |
| Email Management Gmail report | 34/60 | 56.7% |
| Accounting & Invoicing Xero report | 67/120 | 55.8% |
| Clinical Records Elation EHR report | 65/120 | 54.2% |
| Career Exploration Handshake report | 101/200 | 50.5% |
| Prescription Mgmt Elation EHR report | 50/120 | 41.7% |
| Project Planning GitLab report | 52/140 | 37.1% |
| Accounts & Contacts Gmail report | 40/120 | 33.3% |
| Email Client Superhuman report | 31/120 | 25.8% |
Kimi-k2.5
545/1,260 · 43.3%
| Environment | Score | Pass Rate |
|---|---|---|
| Personal Wallet PayPal report | 99/140 | 70.7% |
| Email Management Gmail report | 42/60 | 70.0% |
| Account Settings Linear report | 65/120 | 54.2% |
| Accounting & Invoicing Xero report | 63/120 | 52.5% |
| Career Exploration Handshake report | 100/200 | 50.0% |
| Clinical Records Elation EHR report | 60/120 | 50.0% |
| Accounts & Contacts Gmail report | 48/120 | 40.0% |
| Project Planning GitLab report | 55/140 | 39.3% |
| Prescription Mgmt Elation EHR report | 28/120 | 23.3% |
| Email Client Superhuman report | 18/120 | 15.0% |