Deploy an instance
Response
Parameters
string
default:"gpu.a100"
Instance class. One of
gpu.t4, gpu.a10, gpu.a100, gpu.h100.integer
default:"1"
Number of replicas to deploy. Traffic is load-balanced across replicas.
integer
default:"30"
Automatically stop the instance after this many minutes of inactivity. Set
0 to disable.Check deployment status
ready before sending prediction requests.
Response
string
Deployment status. One of
provisioning, warming, ready, degraded, stopped.integer
Number of prediction requests currently waiting in the queue.
Stop an instance
Release compute when you are done:Instances are billed per second while they are in
provisioning, warming, or ready states.