PacketSafari

AI Model Troubleshooting

Diagnose connection, qualification, parser, and model-selection failures in an on-prem deployment.

Check problems in this order:

  1. Confirm the base URL, scheme, hostname, port, and /v1 path where required.
  2. Confirm the inference server is reachable from the PacketSafari containers, not only from the deployment host.
  3. Approve the host when it is outside the PacketSafari container network.
  4. Install the private CA when internal HTTPS uses a private or self-signed certificate.
  5. Confirm corporate proxy settings when the customer network requires them.
  6. Save the connection, use Models → Refresh models, then Health → Test model. The latter uses model credits and does not attempt fallback.
  7. Confirm the exact served model ID and model profile.
  8. Confirm the inference server uses the parser required by its installed release.
  9. Run Qualify selected model; do not treat discovery as Agent readiness.
SymptomLikely causeAction
Pending approval bannerEndpoint host is not allowlistedRun the displayed approve-ai-host command on the deployment host.
Connection refused or timeoutWrong URL, endpoint down, proxy block, or missing approvalVerify endpoint reachability, URL, proxy logs, and approval state.
Certificate verification failurePrivate CA is not trusted by egress-ironproxyInstall the CA and restart the proxy.
Model is absent after connection succeedsDiscovery is unavailable or the served ID differsRefresh models or enter the exact model ID manually.
Team cannot see an otherwise available modelConnection grants, model audience/workflows, or member model-selection permissionCheck all three under AI Access; saving provider credentials alone is not a grant.
Model uses unexpected reasoningExplicit run, environment, settings-file or saved CLI overrideInspect effective run settings and remove the override before testing the per-model default.
Requests fail only under parallel loadInference-server queue, context or memory capacityReproduce at one active request, then increase gradually; size server admission limits and worker capacity from measurements.
Qualification fails on tool callsWrong tool parser or incompatible server/model revisionCheck the installed vLLM/SGLang parser matrix and update the model profile.
Qualification passes but investigation quality is poorProtocol compatibility does not guarantee model qualityKeep the route out of production and test a representative PCAP or another qualified model.

For egress diagnostics, PacketSafari also includes:

python3 scripts/test_egress_enforcement.py
python3 scripts/test_external_ai_host_approval.py