Managing Files

​

Including Files in Deployments

[cerebrium.deployment]
include = [
    "src/*.py",         # Python files in src.
    "config/*.json",    # JSON files in config.
    "requirements.txt"  # Specific files.
]

exclude = [
    "tests/*",          # Skip test files.
    "*.log"            # Skip log files.
]

​

Managing Persistent Storage

cerebrium ls --region eu-north-1
cerebrium cp model.bin -r eu-north-1

1. Upload files with cerebrium cp:
   # Upload to root directory
   cerebrium cp src_file_name.txt
   
   # Upload to specific location
   cerebrium cp src_file_name.txt dest_file_name.txt
   
   # Upload to directory
   cerebrium cp dir_name sub_folder/
   
2. List files with cerebrium ls:
   # List root contents
   cerebrium ls
   
   # List specific folder
   cerebrium ls sub_folder/
   
3. Remove files with cerebrium rm:
   # Remove a file
   cerebrium rm file_name.txt
   
   # Remove a directory
   cerebrium rm folder_name
   
4. Download files with cerebrium download:
   # Download to current directory with same filename
   cerebrium download file_name.txt
   
   # Download with a different local filename
   cerebrium download file_name.txt local_file_name.txt
   
   # Download from a subdirectory
   cerebrium download sub_folder/file_name.txt
   

​

Using Stored Files

import os
import torch

# Load a model from persistent storage.
file_path = "/persistent-storage/segment-anything/sam_vit_h_4b8939.pth"
model = torch.jit.load(file_path)

# Read a file from persistent storage
with open("/persistent-storage/data/config.json", "r") as f:
    config = json.load(f)

# Write to persistent storage
with open("/persistent-storage/data/results.json", "w") as f:
    json.dump(results, f)

# Check if file exists in persistent storage
if os.path.exists("/persistent-storage/models/mymodel.pt"):
    model = torch.load("/persistent-storage/models/mymodel.pt")

​

Increasing Storage Capacity

1. Via Dashboard: Navigate to the project and select Volumes. Click the three-dot menu on the volume and select Increase Size.

2. Via API: Use the resize volume endpoint:

curl -X POST "https://api.cerebrium.ai/v4/projects/{project_id}/volumes/{volume_id}/resize" \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"newSizeGb": 200}'

​

Storage Quota Errors

1. Remove unnecessary files from /persistent-storage using cerebrium rm
2. Resize the volume to a larger capacity (up to 1TB self-service)
3. Contact support for storage beyond 1TB