paip-model-test

PAIP LLM Proxy model testsuite

Usage

Set the required environment variables:

PALANTIR_AIP_URL=https://example.palantirfoundry.com
PALANTIR_AIP_API_TOKEN=your-foundry-token

Run the suite:

pnpm test:models

Optional environment variables:

• OUTPUT_PATH: report path, defaults to results.json
• MODEL_TEST_PROMPT: prompt used for text models, defaults to Reply with exactly: ok
• REQUEST_TIMEOUT_MS: per-request timeout, defaults to 60000
• CONCURRENCY: concurrent model probes, defaults to 4