Skip to content

Feature/27 generic csv loader #28

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
brendan-oconnell wants to merge 7 commits into
base: develop
Choose a base branch
from
Open

Feature/27 generic csv loader #28

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
9c2f5e2
Created get_work, create contributors
Aug 8, 2025
32e5571
complete logic for create_contributors, add logic for create_language…
Aug 14, 2025
92d6452
Add logic for create_languages, create_subject, create_publication, c…
Aug 18, 2025
5d93e79
use convert_nan_to_none method
Aug 20, 2025
0d9f8a0
Merge branch 'develop' into feature/27-generic-csv-loader
brendan-oconnell Nov 6, 2025
6c90b13
Partially addressed review comments
Nov 19, 2025
bfd64b2
Minor improvements to loader used in ingesting Venice University Pres…
Nov 28, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ pip install -r requirements.txt

## CLI Usage

Available modes, depending on publisher input: `OBP` (Open Book Publishers), `punctum` (punctum books), `AM` (African Minds), `UWP` (University of Westminster Press), `WHP` (The White Horse Press), `EDITUS` (Editus), `EDUEPB` (EDUEPB), `EDUFBA` (EDUFBA), `Rosario` (Editorial Universidad del Rosario), `Leuven` (Leuven University Press), `LHarmattan` (L'Harmattan), `MayFly` (MayFly Books), `PlayStory` (Play Story Press)
Available modes, depending on publisher input: `OBP` (Open Book Publishers), `punctum` (punctum books), `AM` (African Minds), `UWP` (University of Westminster Press), `WHP` (The White Horse Press), `EDITUS` (Editus), `EDUEPB` (EDUEPB), `EDUFBA` (EDUFBA), `Rosario` (Editorial Universidad del Rosario), `Leuven` (Leuven University Press), `LHarmattan` (L'Harmattan), `MayFly` (MayFly Books), `PlayStory` (Play Story Press), `CSV` (Thoth CSV template)

### Live Thoth API
```
Expand Down
5 changes: 4 additions & 1 deletion bookloader.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -58,7 +58,8 @@ class BookLoader:
"edited_volume": "EDITED_BOOK",
"Journal Issue": "JOURNAL_ISSUE",
"Journal": "JOURNAL_ISSUE",
"textbook": "TEXTBOOK"
"textbook": "TEXTBOOK",
"Textbook": "TEXTBOOK",
}
work_statuses = {
"Active": "ACTIVE",
Expand Down Expand Up @@ -103,9 +104,11 @@ class BookLoader:
"Foreword": "FOREWORD_BY",
"A24": "INTRODUCTION_BY",
"Introduction": "INTRODUCTION_BY",
"Introduction By": "INTRODUCTION_BY",
"writer of introduction": "INTRODUCTION_BY",
"A15": "PREFACE_BY",
"Preface": "PREFACE_BY",
"Preface By": "PREFACE_BY",
"Music editor": "MUSIC_EDITOR",
"Research By": "RESEARCH_BY",
"Contributions By": "CONTRIBUTIONS_BY",
Expand Down
Loading