Skip to content

Mounting GS storage bucket inside containers #36

@priyakasimbeg

Description

@priyakasimbeg

I am trying to launch experiments locally with mounted data stored on GCS. Eventually I would like to run the experiments remotely on Kubernetes/VertexAI so I'd like the container to mount the data itself instead of mounting the data on the host machine manually.
I am using prebuilt containers by passing in the image path to the Container executable type. My entrypoint script mounts the GS data buckets with gcsfuse and runs the python training script. However, when running my containers through the xmanager launch script the gcsfuse operation exits with code 1. Running the containers manually with the --privileged option seemed to resolve the issue. However, there currently doesn't exist a xmanager DockerOption to specify --privileged mode.
Is it possible to add such an option? Or is there a different recommended way to mount the data?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions