Secondary research / weighted feature assessment

13 orchestrators, one feature rubric

This is a weighted feature assessment from docs, repos and feature testing, not a measured performance leaderboard. Click a column to sort. "n/r" marks a criterion with no evidence: it is unranked, and the range shows the score if it were 0 or full marks. The assessed point score is the midpoint of that range.

Reproduce this benchmark

Read the scores as a feature assessment. Orca was run end-to-end with stub agents; T3 Code was not run through an equivalent session, so Orca 93 vs T3 Code 90 is a difference in assessed features and evidence, not an experimentally proven gap.

Doc coverage
Share of rubric weight backed by documentation or other cited evidence.
Hands-on validation
None, Launched (installed and opened on Linux), or Stub end-to-end (six stub-agent sessions driven and verified).
Measured results
Which logged measurements exist for the tool in runs/.
Assessed scores
Full table

Every criterion

Leaderboard, sortable by column
1Orca55455455493.093.0 to 93.0100%Stub end-to-endStub run x3, launch probe
2T3 Code54555445390.090.0 to 90.0100%LaunchedServer probe
3Synara54435335479.079.0 to 79.0100%LaunchedLaunch probe
4Emdash44335435n/r74.572.0 to 77.095%LaunchedLaunch probe
5Paseo4n/rn/r55445n/r74.557.0 to 92.065%LaunchedLaunch probe
6OpenChamber34n/r45445n/r74.064.0 to 84.080%LaunchedLaunch probe
7Superset44443424n/r72.570.0 to 75.095%LaunchedLaunch probe
8Cloudroom44n/r55325n/r72.062.0 to 82.080%LaunchedLaunch probe
9Vibe Kanban44325245369.069.0 to 69.0100%LaunchedBoot only
10Claude Squad53214345365.065.0 to 65.0100%Stub end-to-endStub run x3
11Conductor34541n/r13462.555.0 to 70.085%NoneNone
12Sculptor253242n/r4360.055.0 to 65.090%NoneNone
13Mux (now 'Xum')n/r3n/rn/r4334n/r58.536.0 to 81.055%LaunchedLaunch probe
  • A Agent breadth w15
  • B Isolation and parallelism w15
  • C Review, merge and PR flow w15
  • D Remote, cloud and mobile reach w10
  • E Openness and license w10
  • F Maturity and momentum w15
  • G Linux setup friction (measured) w10
  • H Pricing and BYO model w5
  • I Docs and transparency w5
Sensitivity

Does the ranking survive other weightings?

Weight profileTop 5 (score)
Default (ours)Orca (93.0), T3 Code (90.0), Synara (79.0), Emdash (74.5), Paseo (74.5)
Solo terminal hackerOrca (94.5), T3 Code (88.1), Synara (79.4), OpenChamber (77.1), Emdash (76.3)
Team shipping PRsT3 Code (90.4), Orca (90.4), Synara (77.4), Superset (74.3), Emdash (71.7)
Remote / phone-firstOrca (93.9), T3 Code (92.2), Paseo (78.7), Cloudroom (78.3), Synara (76.5)

Solo terminal hacker: friction 20, openness 15, review 8, reach 3. Team shipping PRs: review 30, maturity 20. Remote / phone-first: reach 30, friction 5. Unlisted criteria keep the default weight.

Landscape, not scored

9 more tools we checked

ToolCategoryLicenseWhy no score
Cursor (Agents Window)First-party IDEProprietaryNot tested: needs account sign-in.
Codex (CLI + ChatGPT app)First-partyApache-2.0 (CLI); app proprietaryNot tested: no ChatGPT login on box.
Claude Code desktopFirst-partyProprietaryNot tested: no Claude login.
opencodeAgent CLIMITInstalled and used as the real-model agent in lane B.
Warp (Oz)Terminal + cloud agentsAGPL-3.0 (client)Not tested: needs account.
AmpAgent + remote runtimeProprietary (not verified)Not tested: needs account.
Crystal -> NimbalystDeprecatedMIT (Crystal)Not tested: Crystal deprecated (last release v0.3.5, Feb 26 2026).
TerragonShut downApache-2.0 (as-is snapshot)Not tested: service is gone; snapshot has no releases.
OmnaraPivotedApache-2.0Not tested: it pivoted from mobile remote-control for coding CLIs to a managed-agent platform, a different category.