Deployment Containers

Base Containers

When you launch a Deployment, it runs inside a Docker container (often referred to as a runtime. Any Docker image hosted in a public or private container registry can be used as the Deployment's runtime. Additionally, Gradient includes several popular runtimes out of the box:

Name

Description

Container Tag

URL

TensorFlow

TensorFlow Serving

tensorflow/serving:latest-gpu

DockerHub

ONNX

Based on the official ONNX community project

paperspace/onnx

DockerHub

TensorRT

NVIDIA's optimized runtime

paperspace/tensorrt

DockerHub

Other Containers

Name

Description

Container Tag

URL

Flask

A basic Python web server framework

paperspace/flask

DockerHub

Also see Custom Deployment Containers