The Hoss client library provides Python bindings for interacting with a Hoss server and the data stored within it.
- Create a virtualenv using Python 3.6 or later
- Run
pip install -U hoss-client
- Create a virtualenv using Python 3.6 or later
- Clone this repo
- Run
pip3 install .to install thehoss-clientlibrary
Once you have access to a Hoss server, you must create a personal access token to interact with the API. Log in and navigate to the "personal access token" page using the drop down menu in the top right corner. Then create a new personal access token.
Set the HOSS_PAT environmental variable to this token before using the client library (e.g. export HOSS_PAT=hp_mytoken).
The client library will automatically (via the AuthService class) handle getting a JWT as needed and check of the JWT has expired (and get a new JWT when that happens).
Then you can connect to the server and get started:
import hoss
import os
server = hoss.connect('https://hoss.my-domain.com')
The Hoss client library also provides a CLI when installed. Run hoss -h in your virtualenv to see available commands
The primary function currently provided by the CLI is an upload tool. This tool currently is optimized to upload a directory of medium to large files.
The the directory that you provide will be created in the specified dataset and all files that do not match the optional skip regex will be uploaded.
Files that already exist in the destination will not be uploaded again. Remember, you must set the HOSS_PAT env var before running the tool.
hoss upload <dataset name> <absolute path to the upload dir>
You can optionally write metadata key-value pairs using the -m flag (i.e -m subject_id=123). Multiple -m optional args are supported.
You can optionally filter out files to upload using a regex string with the --skip arg.
You can specify the endpoint (defaults to localhost) using the --endpoint arg.
There are examples available in the client/examples directory. In particular, the client/examples/notebooks directory contains useful example Jupyter notebooks.
This library is effectively tested via the Hoss integration test suite. These tests should be run or updated as needed before accepting PRs.
Docs are automatically built and published via GitHub actions to Read The Docs.
To edit and view locally:
- Set up a virtualenv using the dependencies in
docs/requirements.txt. - Install the
hoss-clientdependencies using something likepip install . - Use Makefile to render your changes
cd docs make html - Then open
docs/build/html/index.htmlin your browser.
To cut a new release, increment the library version in hoss/version.py. Then tag main using the same version.
GitHub Actions will automatically update the "stable" docs and push a release to pypi.