[Bug/Help] Missing files and model checkpoint for inference

[NanAlbert]

I recently read your AAAI paper Segment Anything Across Shots and was inspired by its innovative approach to cross-shot segmentation. This aligns perfectly with my current research direction, so I tried to reproduce the inference process using your open-source code, but encountered critical file missing issues and a request for an additional model checkpoint. Details are as follows:

1. Missing configs folder and key YAML fileThe entire configs directory is not included in the repository, especially the critical configuration file: configs/saas/saas_hiera_b+.yaml
   This file is likely required for loading model parameters and inference settings.
2. Missing core functions: trans_understanding and memory_enhancer
   When executing the inference command provided in the documentation (or as per common usage), the runtime throws a TypeError: SAMBase.init() missing 2 required positional arguments for two functions: trans_understanding and memory_enhancer. It is suspected that there may be other unopened auxiliary modules or dependency files related to these two functions.
3. Request for the SAAS_l_ytvos_tma.pt checkpoint
   The repository currently provides SAAS_b+_ytvos_tma.pt, I would greatly appreciate it if you could provide the SAAS_l_ytvos_tma.pt model checkpoint (if available).

Your research on cross-shot segmentation is of great significance to my ongoing work. I would be grateful if you could help resolve these missing file issues.

Thank you very much for your contributions and support!

[hengrui-h]

Hi NanAIbert.
Sorry for delayed reply. We are really excited for your interest in our project.
For the problem 1, the configs directory is included in the directory sam2. The YAML file is correctly involved in the directory.

Provided the deployment is correct, the environment will automatically look for and retrieve the relevant config directories and files from the sam2 directory. The script we provided works fine in our environment. Perhaps you could share a screenshot of your run and the output of pip list (installed packages) so we can better understand the issue you’re encountering.

For the problem 2, I think this problem is caused by problem 1, since the structures of trans_understanding and memory enchancer are defined in saas config file and not defined in default sam2 config file. If you use correct yaml file, SAM2Base class should be correctly initailized.

For problem 3, we are sorry for delayed checkpoint release. We are currently focusing on another paper work. We will release the rest checkpoints after double-checking their versions, as soon as possible.