Skip to main content

How To Create A Bucket

A Bucket is your private cloud storage container where datasets, models, and artifacts will be hosted.

Security Highlight: LUML does not store your data on its servers and does not act as an intermediary in data transfer. The platform's architecture is designed so that interaction occurs directly between your browser (Client-side) and the cloud storage. This ensures that your files never pass through the platform's backend, guaranteeing maximum confidentiality.

To enable this direct connection, your provider must be S3-compatible and have correctly configured access policies.

General Instruction​

Regardless of the chosen provider (Amazon S3, Google Cloud, Azure, Wasabi, DigitalOcean), the setup process follows these steps:

  1. Create an account with a cloud provider.
  2. Create a Bucket.
  3. Configure CORS (to allow the browser to upload files directly).
  4. Generate an Access Key and Secret Key.
  5. Connect the bucket to LUML by specifying the region and endpoint.

Key Concepts​

Storage Classes​

When creating a bucket, you must choose a storage class. This affects cost and speed:

  • Standard / Hot: Best for LUML. Fast access, no early deletion fees, though storage cost is higher. Choose this for active work.
  • Archive / Cold: Cheaper storage but slow access and expensive retrieval. Not recommended for active models.

CORS (Cross-Origin Resource Sharing)​

This setting is critical precisely because of LUML's client-side architecture. Since the file upload is initiated by your browser (located on the platform's domain) and the recipient is the cloud bucket (a different domain), the browser will block such requests without explicit permission. Configuring CORS "tells" the bucket that it is allowed to accept direct requests (PUT, POST) from the platform's web interface.

Typical JSON for S3-compatible systems:

[
    {
        "AllowedHeaders": ["*"],
        "AllowedMethods": ["GET", "POST", "PUT", "DELETE", "HEAD"],
        "AllowedOrigins": ["*"],
        "ExposeHeaders": ["Content-Range"],
        "MaxAgeSeconds": 3000
    }
]

Guide for Amazon AWS (S3)​

Amazon S3 is the standard. If you are a beginner, we recommend starting here.

Create a Bucket​

  1. Go to the AWS Console and find the S3 service.
  1. Click Create bucket.
  2. Enter a unique name and select a Region (remember this, you will need it for LUML).
  3. Other settings (Block Public Access) can be left as default, as LUML uses signed URLs for access.

Configure CORS​

  1. Click on the name of the created bucket.
  2. Go to the Permissions tab.
  1. Scroll down to the Cross-origin resource sharing (CORS) section.
  1. Click Edit and paste the JSON code (see "Key Concepts" above).
  2. Click Save changes.

Get Keys​

  1. In the top right corner, click on your account name → Security credentials.
  2. Find the Access keys section.
  3. Click Create access key.
  4. Copy the Access Key and Secret Access Key.

Important: The Secret Key is shown only once! Save it securely.

Guide for Google Cloud Storage (GCS)​

Google Cloud has specific requirements. It is not natively S3-compatible, so it requires enabling "Interoperability" mode.

Create a Bucket​

  1. In the Google Cloud Console, go to Cloud Storage → Buckets.
  2. Click Create.
  3. Set a name, select a Region, and choose the Standard class.
  4. Click Create.

Configure CORS (via Terminal)​

Google Cloud lacks a simple visual CORS editor, so we will use the built-in console.

  1. Activate Cloud Shell (terminal icon in the top right corner).

And here is the terminal:

  1. Create a configuration file using the command: nano cors.json
  2. Paste the following text into the editor:
[
  {
    "origin": ["*"],
    "method": ["GET", "POST", "PUT", "DELETE", "HEAD"],
    "responseHeader": ["*"],
    "maxAgeSeconds": 3000
  }
]
  1. Save the file: press Ctrl+O, then Enter, then Ctrl+X to exit.
  2. Apply settings to your bucket with the command:
gsutil cors set cors.json gs://YOUR_BUCKET_NAME
  1. Verify success with:
gsutil cors get gs://YOUR_BUCKET_NAME

Get Keys (Interoperability)​

  1. Go to Cloud Storage → Settings.
  2. Open the Interoperability tab.
  3. Click Create a key for a service account (or User account).
  4. Copy the generated Access Key and Secret.

Connecting to LUML​

The final step is adding the configured bucket to the platform.

  1. In LUML, go to Settings → Buckets.
  2. Click Add new bucket.
  3. Fill in the fields:

  • Bucket Name - The name you gave the bucket during creation.

  • Region - The bucket's region (e.g., us-east-1).

  • Endpoint - The provider's address without https://. For AWS: s3.amazonaws.com (or s3.us-east-1.amazonaws.com). For Google: storage.googleapis.com.

  • Access Key & Secret Key - The keys you obtained earlier.

  1. Click Save. If everything is configured correctly, your bucket is ready to use.