A1 ratingsLlamaIndexLlamaIndex

LlamaIndex
LlamaIndex · framework · Any industry Not enough facts yet
-Grade
-Score
±2095% range
-Rank of 1134
0%From fleets
FR-CAT-00915Catalog no.
Researched, but under 60% of the method could be measured from public sources, and a grade needs 60%. Vendors can send the missing facts.
The six pillars
Each bar is the score; the bracket is its 95% range.
Can you see what it costs?
Vendor cost API (Per-job cost via expand=usage on finished Parse/Extract jobs) · prices published
Desk research 100 · counts for 25% · A cost API you can call scores highest; an admin console or cloud billing export next; a card statement or emailed invoice is all some products leave you. Published prices add to it.
Can you see how much it's used?
GET /api/v1/beta/usage-metrics (credits per record with project_id; usage_tags on Enterprise)
Desk research 100 · counts for 15% · A usage API (tokens, seats, credits, conversations) a buyer can read.
Can you tie cost to one agent?
partial
Not known yet. Sits at a neutral 50 with a wide range until facts arrive · counts for 15% · Exact (one key or project per agent) beats by-project, by-workspace or by-user.
Can an agent on it report out?
Not known yet. Sits at a neutral 50 with a wide range until facts arrive · counts for 15% · A remote MCP connector scores highest, then a local MCP server, an SDK, an API or a workflow step; copy-and-paste lowest. Any open standard counts, not just FleetRegistry.
Can you control spend and access?
Spend cap: Hard cap · Per-agent keys: Scoped · Revoke: Console only · SSO: SSO only
Desk research 91 · counts for 20% · Hard spend caps (30%), scoped per-agent keys (25%), an audit log you can read by API (20%), revoking by API (15%), SSO with SCIM (10%).
Does it work on small plans?
Small plans don't get the data
Desk research 0 · counts for 10% · Whether the plan a person or small business buys gets the cost and usage data at all.
Where the evidence comes from
Independent fleets0%Desk research39%Neutral starting point61%
Once three independent fleets report on a pillar, desk research counts for at most a third of it. FleetRegistry's own fleets never count.
Controls on record
Spend capHard cap
Per-agent keysScoped
Audit logNot known
RevokeConsole only
SSOSSO only
PricesPublished
Admins can pause jobs when included credits run out or set an optional monthly cap on overage; running jobs can push past the cap. Plans also have fixed PAYG ceilings. API keys scoped to user and project, revoked in the UI. SAML/OIDC SSO; no SCIM or audit log documented. The OSS framework has none of these.
History
11-12 - 11-13 - 11-14 - 11-15 - 11-16 - 11-17 - 11-18 - 11-19 -
Not saved yet. Published grades are sealed daily into the transparency log (N4.4). Grade held since 2026-10-02.Run agents on LlamaIndex?
Give each one a permanent number, a named person who answers for it, and a record of what it can touch and what it costs. Free.