Best practices

operator_id strategy, batch vs single, retries, idempotency, observability.

operator_id strategy

session_id strategy

Single vs batch

UseEndpoint
Real-time middlewarePOST /v1/score
End-of-shift import, nightly backfill, historical replayPOST /v1/score/batch

Batch saves request overhead and stays inside per-key rate limits for the same volume.

Idempotency

Both SDKs auto-generate an Idempotency-Key header on every POST. Server-side deduplication is live: retries with the same key return the cached envelope. No manual step needed.

Retries

Only retry on 429 and 5xx. Do not retry 4xx other than 429. The SDKs handle this by default.

Observability

Next step