path
that is passed to methods such as hub.load(path)
, hub.dataset(path)
, hub.empty(path)
and others. The path prefixes are:hub://workspace_name/dataset_name
s3://bucket_name/dataset_name
gcs://bucket_name/dataset_name
!activeloop login
expire after 1000 hrs. Credentials created using API tokens in Activeloop Platform expire after the time specified for the individual token. Therefore, long-term workflows should be run using API tokens in order to avoid expiration of credentials mid-workflow.aws configure
. This creates a credentials file on your machine that is automatically access by hub during authentication.AWS_ACCESS_KEY_ID
,AWS_SECRET_ACCESS_KEY
, and AWS_SESSION_TOKEN (optional)
in environmental variables of the same name, which are loaded as default credentials if no other credentials are specified.AWS_ACCESS_KEY_ID
,AWS_SECRET_ACCESS_KEY
, and AWS_SESSION_TOKEN (optional)
, and pass it to hub using:endpoint_url
can be used for connecting to other object storages supporting S3-like API such as MinIO, StorageGrid and others.endpoint_url
the the creds
dictionary.creds
parameter in hub.load('gcs://.....', creds = 'path_to_keys.json')
. It is also possible to manually pass the information from the JSON file into the creds
parameter using: hub.load('gcs://.....', creds = {information from the JSON file})
hub.load('gcs://.....', creds = 'browser')
. This requires that the project credentials are stored on your machine, which happens after gcloud
is initialized and logged in through the CLI.hub.load('gcs://.....', creds = 'cache')