Storage Providers

Storage providers are a way to connect storage to Gradient. Gradient manages this storage provider to ensure that your data is verified and immutable. Gradient will create a folder with your Paperspace team handle at this storage provider. Gradient does not provide general S3 capabilities through the storage provider interface: it is merely a way to manage credentials and the storage of specific Gradient features such as models, notebook workspaces and datasets currently only available on private and managed clusters.

Supported types:

  • S3-compatible storage

Configure your storage bucket

From within a new or existing S3 bucket, you'll need to edit the CORS configuration so your data can be viewed within Gradient.

CORS

To access an S3-compatible storage provider you may have to add CORS rules to your bucket

[
{
"AllowedHeaders": [
"*"
],
"AllowedMethods": [
"GET",
"PUT"
],
"AllowedOrigins": [
"https://console.paperspace.com"
],
"ExposeHeaders": [],
"MaxAgeSeconds": 3000
}
]

Within the bucket permissions settings, you'll see an option to edit the CORS configuration. Click edit, then copy and paste the JSON above, and then save your changes.

Add a Storage Provider

A Storage Provider can be created on your team's settings page.

Note: The "AccessKey" and SecretAccessKey" can be obtained from the "my security credentials" section of the AWS Identity and Access Management (IAM) portal. See the following:

CLI

A Storage Provider can also be created with the Gradient CLI

$ gradient storageProviders create s3 --name test --bucket my-bucket --accessKey=access-key --secretAccessKey=secret-key
Created storage provider: splgct3arqdh77c