IQA.ORG | The Conformance Challenge — one exam, two schemes | rttp.com/challenge

The Conformance Challenge

A specification is worth exactly what a stranger can reproduce from it. These specifications are frozen, the vectors are public, and the answers ship inside every package. Now we would like to see what the documents alone are worth.

The deal

Take the AICENT-002 specification and the published vector set — 35 vectors, sha256 4b743e63..., shipped inside every package. Write an implementation in any language, from the specification alone. Do not read our code. Replay all 35 vectors byte for byte.

The tiers

What you get

Sanity check before you start

pip install rttp && python -m rttp.selftest     # [PASS] all 80 checks passed (3 skipped)
npm install @aicent/rttp && npx @aicent/rttp    # [PASS] all 35 checks passed

These are the reference implementations, CI-asserted on every push. Yours should disagree with them in nothing but the language.


The scoreboard

SchemeIndependent implementations
rttp0 — the seat is open
iqa0 — the seat is open

Reference implementations by the authors do not count — that is the entire point of this page.

The rules

  1. From the specification alone. Do not read our source.
  2. Any language. Zero restrictions.
  3. Offline. No account, no network, no phone-home.
  4. Deterministic. Same input, same bytes, every time.

How to submit

Publish your implementation in a public repository, then email the link and your replay output to lee@iqa.org. We will read it, run it against the vectors, and list it. If something fails, we will tell you exactly which vector and why — and if the fault is ours, you get the credit for finding it.