Independence

Nobody can pay to change the answer.

Probative Labs checks what AI vendors claim. That only works if it is independent of them, so these rules are public and you can hold me to them.

No AI for sale

Probative Labs does not build, resell or implement AI products, and takes no referral or partner fees from AI vendors.

Vendors cannot pay for results

No vendor can pay Probative Labs to evaluate, certify or rank its product, or buy, preview, edit or suppress a result or a benchmark.

Never a share of the savings

Customers pay per program. A share of savings would reward finding value, which is the opposite of neutral measurement.

The method is open

Every result records the engine version, data fingerprints and settings, so anyone with the same data gets the same answer.

Results belong to the customer

I never publish a customer's results, or name a customer, without written permission.

Benchmarks are anonymous

No names, ticket text or money, shown only once five organizations contribute, and never sold.

Conflicts are disclosed

If I, or anyone working on your analysis, have a financial interest in a vendor being measured, you hear about it before the work starts.

If these rules change, the change is recorded publicly, with its date, before it takes effect.