-
Notifications
You must be signed in to change notification settings - Fork 4
Description
The following methods can't be tested on cpus only:
- Cellpose-SAM (runs into time limits)
- Segger (the last prediction step
segmentcurrently requires a gpu)
The way how to integrate these methods would be:
- take the docker containers and convert them to singularity containers
- test the method script on the cluster with gpu access
- disable the test for these methods
Comment from Luke about disabling tests (discord 15.07.2025; Answer on the question if gpus will be available in open problem GitHub action tests):
Maybe at some stage but probably not any time soon. The problem is that you have to pay for the GPU runners on GHA and I'm not sure if we have a budget for that.
In the meantime, what we do for the batch integration task is disable the tests for methods that need a GPU. We did this by adding a base_method schema to the API https://github.com/openproblems-bio/task_batch_integration/blob/main/src/api/base_method.yaml. This defines everything for a method but without the tests. The normal method schema then inherits from this but adds the tests https://github.com/openproblems-bio/task_batch_integration/blob/main/src/api/comp_method.yaml. Most methods should use the comp_method schema but when we need to disable the tests we use base_method instead.