0.1.0

0.1.0 (2022-02-10)

Please see the full release notes at https://spacepy.github.io/dbprocessing/release_notes.html

This is the first public packaged release of dbprocessing. For the convenience of those working directly from git checkouts, these release notes summarize changes made since the creation of the public repository on 2020-07-15.

New features

• Support for processes that take no input was added, as part of many enhancements to DBRunner.py.
• New script linkUningested.py to find files which match product format but are not in database, and symlink them to the incoming directory so they can be ingested.
• Python 3 support was added.
• Added options --count, --exist, and --quiet to printProcessQueue.py to allow flow control in shell scripts based on the process queue state.
• Added options --product to filter output and --sort to printProcessQueue.py to sort output.
• Initial PostgreSQL support was added.

Deprecations and removals

None

Dependency requirements

SQLAlchemy and dateutil are required. No minimum version has been established, but dbprocessing is known to work with SQLAlchemy 1.1 and dateutil 2.6.

Major bugfixes

• Fixed ProcessQueue.buildChildren on older databases without yesterday and tomorrow columns in the Productprocesslink table.
• Fixed runMe to always maintain the output_interface version specified by the code. Updates to a code's interface version will increment the quality version of its output (not the interface); updates to a file's interface version will increment the quality version of child files (rather than assuming children were up-to-date and failing to reprocess them).
• Fixed buildChildren to only look for files which are recorded in the database as existing on disk. Most notably, this means ProcessQueue.py will not attempt to use nonexistent files as inputs to processing.