Deployment Containers

Base Containers
When you launch a Deployment, it runs inside a Docker container (often referred to as a runtime.  Any Docker image hosted in a public or private container registry can be used as the Deployment's runtime.   Additionally, Gradient includes several popular runtimes out of the box:
Popular Containers
Name
Description
Container Tag
URL
TensorFlow            
TensorFlow Serving
tensorflow/serving:latest-gpu
​DockerHub​
ONNX
Based on the official ONNX community project
paperspace/onnx
​DockerHub​
TensorRT
NVIDIA's optimized runtime
paperspace/tensorrt
​DockerHub​
Other Containers
Name
Description
Container Tag
URL
Flask
A basic Python web server framework
paperspace/flask
​DockerHub​
Also see Custom Deployment Containers
Custom Deployment Containers
/deployments/deployment-containers/custom-deployment-containers

Optimize Models for Inference

Custom Deployment Containers

Last updated 3 months ago

Name	Description	Container Tag	URL
*TensorFlow*	TensorFlow Serving	`tensorflow/serving:latest-gpu`	DockerHub
ONNX	Based on the official ONNX community project	`paperspace/onnx`	DockerHub
TensorRT	NVIDIA's optimized runtime	`paperspace/tensorrt`	DockerHub