API COMPATIBILITY / 1.0.0-BETA.1

Know what your
AI API can do.

One command-line tool. Three API families.
Test real behavior and turn compatibility claims into evidence.

Get AIQA

OpenAIAnthropicGoogle GenAI

01 / FROM REQUEST TO REPORT

Compatibility.
With the details attached.

Probe the protocol.

Check models, chat and messages, streaming, tools, structured output, and errors against versioned profiles.

Follow the evidence.

Compare native API behavior with built-in SDK checks. Inspect capability routing, usage, rate limits, and incomplete checks.

Make the next fix clear.

Read Markdown reports or process versioned JSON. Get compatibility verdicts and actionable guidance for each target.

02 / GET STARTED

One binary.
Ready for your terminal.

Linux, macOS, and FreeBSD · amd64 / arm64

curl -LsSf https://ilyar.github.io/aiqa/install.sh | sh

Installs beta.2 to ~/.local/bin and verifies SHA-256. Add that directory to your PATH. No sudo or shell-profile changes. Read the installer.

Custom directory or version

curl -LsSf https://ilyar.github.io/aiqa/install.sh -o install.sh
AIQA_INSTALL_DIR="$HOME/bin" AIQA_VERSION=1.0.0-beta.2 sh install.sh
export PATH="$HOME/bin:$PATH"
aiqa --version

Prefer a direct download?

Choose your operating system and CPU. On Unix, rename the download to aiqa, run chmod +x aiqa, and move it into your PATH. On Windows, rename it to aiqa.exe and place it in a directory on PATH.

Version 1.0.0-beta.2 downloads
System	Intel / AMD 64-bit	ARM 64-bit
Linux	amd64 ↓	arm64 ↓
macOS	Intel ↓	Apple silicon ↓
Windows	amd64 .exe ↓	arm64 .exe ↓
FreeBSD	amd64 ↓	arm64 ↓

SHA256SUMS · Release notes. Windows users can also run the shell installer in Git Bash.

03 / FOR API PROVIDER OPERATORS

Your agent.
Protocol evidence.

Use the AIQA Provider Operator skill with Codex, Claude Code, or another skill-capable coding agent. It helps define the compatibility you need, run bounded checks, explain failures, and propose configuration changes backed by report evidence.

npx skills add ilyar/aiqa --skill aiqa-provider-operator

Skill version 1.0.1, designed for AIQA 1.0.0-beta.2. Install the AIQA binary separately using the instructions above. The bounded runner requires Python 3.10+ on a POSIX host; Windows users can run it in WSL. Installing the skill does not run checks or change your provider.

Then ask your agent

Use $aiqa-provider-operator to check my staging API for OpenAI compatibility. Help me choose the profile and model, agree the paid-request scope, and read the key from my environment. Explain the report and propose configuration fixes before applying changes.

Define the contract.

Choose one endpoint, protocol, model, and profile. Keep credentials out of prompts and approve the scope before making paid API requests.

Find the actual cause.

Separate protocol failures from missing coverage, quotas, access restrictions, and local execution limits. No tested model means no compatibility claim.

Fix, then recheck.

Review changes to routing, authentication, streaming, or response mapping. Recheck the same contract after approved changes; keep the before-and-after evidence private.

Compatibility checks can incur provider charges. The runner does not enable image generation, high-token probing, persistent-resource creation, or external extensions. It does not deploy changes or upload your reports. Limits bound work, not an exact monetary spend.

Review the versioned skill ↗

04 / YOUR FIRST CLI CHECK

Point it at your API.

export OPENAI_BASE_URL="https://your-provider.example/v1"
export OPENAI_API_KEY="your-api-key"

aiqa test=compat --model=your-model \
  --format=markdown,json --name=compat-report

Requests use your provider account and may incur charges. Image generation and persistent-resource probes have explicit opt-in gates. Review reports before sharing them.

Read the full documentation ↗

Know what yourAI API can do.

Compatibility.With the details attached.