Skip to content

CLI Guidance by Deployment

Find the command reference for the component and version actually installed.

Back to Articles

THOX includes multiple applications and services. This page does not define a universal installed thox command. Use the CLI and release documentation supplied with the specific component; earlier generic command examples are not deployment instructions.

Start an inference service

Identify the installed runtime and use its documented launch method. Confirm the binding address, authentication, model path and supported accelerator before exposing a service.

Stop a service

Use the component service manager or documented shutdown command. Check for active work first; do not assume a generic force-stop option is safe.

Inspect status

Use the installed application status view or the health endpoint documented for that service. A process running does not prove that a model is loaded or a peer connection is established.

Inspect and manage models

Use the model list for your actual runtime. For hosted ThoxLLM Cloud, use authenticated GET /v1/models as shown in the API guide.

Confirm artifact compatibility and license before downloading. Confirm what files will be affected before removing or replacing a local model.

Run a test request

Use the client or API contract supported by the endpoint. Start with a small synthetic prompt and a bounded output length. Check the selected processing location and any usage charges.

Change configuration

Use the configuration format for the installed version. Review the impact of endpoint, authentication and routing changes; a local endpoint name does not prevent a configured hosted fallback.

Collect diagnostics

Use the component supported diagnostic export or logs. Include version, timestamp and the error needed to reproduce the issue. Redact keys, tokens, private prompts and unrelated account details.

Update or recover

Use the published release and update method for your product. Check compatibility and backups before upgrading. Confirm a supported rollback procedure rather than assuming a universal rollback command.

Related guidance