Skip to content

Feature/webhooks pt1 #668

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
rhigman wants to merge 77 commits into
base: launch/v1.0.0
Choose a base branch
from
Open

Feature/webhooks pt1 #668

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
77 commits
Select commit Hold shift + click to select a range
99ca79e
GraphQL Subscription backed by new Event DB table (incomplete)
rhigman Jan 9, 2025
36f8e99
Revert "GraphQL Subscription backed by new Event DB table (incomplete)"
rhigman Jan 9, 2025
7bd8329
Merge branch 'develop' into feature/webhooks_pt1
rhigman Jan 13, 2025
39b246e
Attach Redis pool to GraphQL API and send a value when create_work mu…
rhigman Jan 15, 2025
08e6f19
Merge branch 'develop' into feature/webhooks_pt1
rhigman Jan 20, 2025
1d846e5
Rename pool imports to be consistent with new thoth.rs changes
rhigman Jan 20, 2025
6531a23
Implement Event model and Redis lpush method as basic queue logic (wo…
rhigman Jan 27, 2025
5e0c728
Merge branch 'develop' into feature/webhooks_pt1
rhigman Jan 28, 2025
0b8db06
Merge branch 'develop' into feature/webhooks_pt1
rhigman Feb 3, 2025
cc43147
Minimal implementation of Loco modulebased on starter code (compiles,…
rhigman Feb 4, 2025
b0685b7
Add minimal Loco config based on autogen plus docs for Workers
rhigman Feb 5, 2025
0a5d8ab
Changelog placeholder
rhigman Feb 5, 2025
1a28ebd
Correct config by enabling redis feature (on by default, but defaults…
rhigman Feb 6, 2025
98f0c97
Merge branch 'develop' into feature/webhooks_pt1
rhigman Mar 24, 2025
dcff2b7
Add Loco module to dev Dockerfile
rhigman Mar 25, 2025
45acb83
Add a skeleton background worker based on Loco docs/examples
rhigman Apr 15, 2025
394f6c6
Merge branch 'develop' into feature/webhooks_pt1
rhigman Apr 15, 2025
3939b0d
Add Task which fires Worker: works, but doesn't connect to Redis
rhigman Apr 15, 2025
b708cd4
Main Loco instance should be both server and worker
rhigman Apr 23, 2025
608ff74
Connect Loco worker to correct Redis queue
rhigman Apr 24, 2025
8e18364
Loco seems to expect Redis queue names to be prepended with 'queue:'
rhigman Apr 24, 2025
b4442a6
Simple output of tracing to console
rhigman Apr 24, 2025
4b0056b
Revert queue name prefix as this is for Loco-created queues (i.e. for…
rhigman May 13, 2025
d9774eb
Hardcode Redis connection (successfully retrieves queue items)
rhigman May 13, 2025
caafab5
Revert "Simple output of tracing to console"
rhigman May 13, 2025
9043811
Move Redis connection to Initializer
rhigman May 13, 2025
497cf5b
Deserialize queue items into thoth-api Event structure
rhigman May 13, 2025
559551b
Tidy syntax
rhigman May 13, 2025
4e943ea
Review markups
rhigman May 14, 2025
c3101a2
Add Thoth version to Event
rhigman May 14, 2025
bafc926
Tidy syntax
rhigman May 14, 2025
9ef64f0
Call Worker from Initializer loop
rhigman May 14, 2025
97cee90
Add BLPOP to Thoth Redis methods and replace deadpool dependency
rhigman May 14, 2025
ddf086e
Remove Task which is now unused
rhigman May 14, 2025
9063cf1
Merge branch 'develop' into feature/webhooks_pt1
rhigman May 15, 2025
45effe5
Pass Event from Initializer to Worker to be processed further
rhigman May 15, 2025
fbb76f6
Proper naming
rhigman May 19, 2025
e75c06f
Send Event to different Worker based on event type
rhigman May 19, 2025
d869a82
Fix formatting
rhigman May 19, 2025
1550400
Fix linting
rhigman May 19, 2025
f94ef3c
Loco tests require thoth-processor/config/test.yaml file to pass (cop…
rhigman May 19, 2025
62973f9
Nest Loco config under thoth-processor
rhigman May 19, 2025
b6e3c88
Add processor to infrastructure files
rhigman May 19, 2025
94d1b4a
Get Redis URI from environment
rhigman May 19, 2025
fa53d25
Retrive Redis URL from config instead of hardcoding
rhigman May 19, 2025
e56c42a
Ignore Clippy warning (can't change size of loco_rs::Error)
rhigman May 20, 2025
3c402f8
Add Webhooks to database model and implement minimal API query
rhigman May 21, 2025
e057e30
Webhooks should be nested under publisher rather than shared between …
rhigman May 22, 2025
5628326
Use standard crud pattern for webhooks
rhigman May 22, 2025
7f7bde7
Fix build error: EventType no longer only used by backend
rhigman May 22, 2025
a55084a
Fill out GraphQL CRUD implementation for webhooks (fixes remaining co…
rhigman May 22, 2025
f886f4d
Tweaks to bring Webhook objects more into line with existing GraphQL …
rhigman May 22, 2025
6ed92da
Fix formatting
rhigman May 22, 2025
65b98b1
Improve database error message reporting
rhigman May 22, 2025
d8488e7
Correct EventType definition to fix database error
rhigman May 22, 2025
b942dcf
Merge branch 'develop' into feature/webhooks_pt1
rhigman Jun 11, 2025
6739efe
Re-version migrations following new release
rhigman Jun 11, 2025
a1efdc1
Skeleton logic for calling into GraphQL (working, with placeholders)
rhigman Jun 17, 2025
3bdfb6a
Correct graphql syntax to allow proper json serialisation
rhigman Jun 18, 2025
c1166ff
Replace placeholder query with correct graphql syntax for webhooks re…
rhigman Jun 18, 2025
c382910
Use appropriate structures for deserialising response
rhigman Jun 18, 2025
5c60c15
Skeleton logic for firing a GitHub Actions webhook (working, with pla…
rhigman Jun 19, 2025
873f450
Pass in webhook parameters as arguments
rhigman Jun 19, 2025
2553832
Pull async webhook firing out into separate worker
rhigman Jun 19, 2025
a8562f6
Extend webhook fire logic to all event type workers
rhigman Jun 19, 2025
998f3f4
Fix formatting
rhigman Jun 19, 2025
a7d9fb2
Back loco with Postgres instead of Redis (inc. sqlx issue workaround …
rhigman Jun 25, 2025
031a878
Revert "Back loco with Postgres instead of Redis (inc. sqlx issue wor…
rhigman Jul 1, 2025
47639ef
Draft (inline) logic for retrieving Loco Redis queue items via GraphQ…
rhigman Jul 7, 2025
b0fffcd
Restructure queue retrieval and add GraphQL doc strings
rhigman Jul 8, 2025
b399e0c
Small formatting fixes
rhigman Jul 8, 2025
06cee92
Minor improvements for consistency etc
rhigman Jul 10, 2025
3aba604
Retrieve GraphQL API URL from config instead of hard-coding
rhigman Jul 10, 2025
743a8fe
Add client payload and pass down work_id to send to GitHub Action
rhigman Jul 22, 2025
f026497
Add platform to webhook data model so that it can be passed to GitHub…
rhigman Jul 22, 2025
746d3c9
Make fire_webhook generic, store raw payload instead of platform
rhigman Jul 23, 2025
a4e64a0
Review markup: hardcode Loco config path
rhigman Jul 23, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions CHANGELOG.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,8 @@ The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).

## [Unreleased]
### Added
- Webhooks: event creation in GraphQL when works are changed, event handling via Loco

## [[0.13.13]](https://github.com/thoth-pub/thoth/releases/tag/v0.13.13) - 2025-06-05
### Changed
Expand Down
Loading
Loading