dataio-artpark

Dataio is a Postgres and FASTAPI based Dataset Management System (DMS) for users to access and manage datasets distributed by the Data Science Innovation Hub, ARTPARK. The scaffolding can be used to build a similar system for your own datasets.

You can find the documentation for the project here, and we're also on PyPI here.

Installation

Install the project using pip:

pip install dataio-artpark

or using uv:

uv add dataio-artpark

Development

We use uv to manage the project. Clone the repository and run:

uv sync

How to set up the local dev environment.

Run below command to set up the DB. API keys for users will be generated in the db/init/data_inserts folder

bash ./src/dataio/db/init/recreate_full.sh

Starting the API Server

uv run fastapi dev src/dataio/api

To start with logging & autoreload enabled

uvicorn src.dataio.api.main:app --log-config log_config.yml --reload