Skip to content

Support of gpu only methods #44

@LouisK92

Description

@LouisK92

The following methods can't be tested on cpus only:

  • Cellpose-SAM (runs into time limits)
  • Segger (the last prediction step segment currently requires a gpu)

The way how to integrate these methods would be:

  • take the docker containers and convert them to singularity containers
  • test the method script on the cluster with gpu access
  • disable the test for these methods

Comment from Luke about disabling tests (discord 15.07.2025; Answer on the question if gpus will be available in open problem GitHub action tests):
Maybe at some stage but probably not any time soon. The problem is that you have to pay for the GPU runners on GHA and I'm not sure if we have a budget for that.

In the meantime, what we do for the batch integration task is disable the tests for methods that need a GPU. We did this by adding a base_method schema to the API https://github.com/openproblems-bio/task_batch_integration/blob/main/src/api/base_method.yaml. This defines everything for a method but without the tests. The normal method schema then inherits from this but adds the tests https://github.com/openproblems-bio/task_batch_integration/blob/main/src/api/comp_method.yaml. Most methods should use the comp_method schema but when we need to disable the tests we use base_method instead.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions