The endpoint for liveness probes. Determines if the container needs to be restarted.
Optionalno_Skip the build step and deploy the base image as-is. Baseten copies the image to its container registry without running docker build or modifying the image in any way.
The endpoint for inference requests. This is mapped to Baseten's /predict route.
The endpoint for readiness probes. Determines when the container can accept traffic.
Optionalrun_The Linux UID to run the server process as inside the container. Use this when your base image expects a specific non-root user (for example, NVIDIA NIM containers).
The port where the server runs. Port 8080 is reserved by Baseten's internal reverse proxy and cannot be used.
Optionalstart_The command to start the server. Required when no_build is not true.
Deploy a custom Docker image that has its own HTTP server, without writing a Model class.