Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
508 commits
Select commit Hold shift + click to select a range
6e0fb04
adding more tests
jkobject May 16, 2025
1029217
new test function, better savings, preventing OOMs
jkobject May 19, 2025
d03134e
likely solution
jkobject May 20, 2025
b32e23a
final debug of the test, it is now working fully
jkobject May 21, 2025
8aa8bdd
debug of some issues
jkobject May 22, 2025
cad61f0
better readme
jkobject May 22, 2025
6d16a03
release: version 2.3.0 🚀
jkobject May 22, 2025
dda3e3e
updating some stuff
jkobject May 26, 2025
b072a7d
debuging VAE
jkobject May 26, 2025
8ef0069
nothing
jkobject May 26, 2025
d45f6b9
solving last part
jkobject May 27, 2025
a386771
removing pdb
jkobject May 27, 2025
aa33ca1
Merge remote-tracking branch 'cantini/main' into dev
jkobject May 27, 2025
c8727e1
solving gene memap and cleanup
jkobject May 28, 2025
2617b3c
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject May 28, 2025
c16c73e
testing better class compression
jkobject May 28, 2025
725526a
quick solve
jkobject May 28, 2025
4f8066d
nothing really
jkobject May 28, 2025
ef69c4c
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject May 28, 2025
9cd5d12
debug
jkobject May 28, 2025
7374fc1
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject May 28, 2025
0363cb4
dbug
jkobject May 28, 2025
d129703
debug
jkobject May 28, 2025
eb67c61
debug
jkobject May 28, 2025
17791e4
couple things that seemed to help
jkobject May 29, 2025
4caf729
debug
jkobject May 29, 2025
59d2f96
testing different parameters
jkobject May 31, 2025
32ba88e
debug
jkobject May 31, 2025
ea77f44
debugged embeddings
jkobject Jun 2, 2025
fa2db8b
debug
jkobject Jun 2, 2025
a6b47c6
more
jkobject Jun 2, 2025
353925d
debug
jkobject Jun 3, 2025
387699b
testing this
jkobject Jun 4, 2025
569a15a
tiny debug
jkobject Jun 4, 2025
d874325
what a debug
jkobject Jun 5, 2025
150121e
working on the notebooks
jkobject Jun 6, 2025
688a561
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject Jun 6, 2025
1f978ef
setting ft ge to false, preventing OOM cell emb
jkobject Jun 8, 2025
625919d
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject Jun 8, 2025
74004f4
that should help my life
jkobject Jun 10, 2025
2124540
comparing embeddings
jkobject Jun 10, 2025
975cb60
applying prev stash
jkobject Jun 10, 2025
cb53164
debug
jkobject Jun 10, 2025
a1ae9d9
key debug to apply
jkobject Jun 11, 2025
dbc7548
generating gene locs and logging more val
jkobject Jun 13, 2025
329bd17
before base_v3
jkobject Jun 13, 2025
8e5706d
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject Jun 13, 2025
d4fd345
a debug
jkobject Jun 13, 2025
3737551
again
jkobject Jun 13, 2025
a9e5c59
more
jkobject Jun 13, 2025
a2e1cae
some different base_v3 parameters
jkobject Jun 16, 2025
c5e2f58
changing activation location
jkobject Jun 16, 2025
eb5d9dd
ecs/cce, cell transf as params, invert TF weights
jkobject Jun 16, 2025
a4b4de7
Revert "changing activation location"
jkobject Jun 18, 2025
fd5bb6d
adding VAE
jkobject Jun 16, 2025
2238ac3
seems needed
jkobject Jun 17, 2025
ccb1888
quick change
jkobject Jun 17, 2025
f4d6e2a
Merge commit '32ba88ec8910a4b93bdd5bb3d1c0baf929ff300c' into making-i…
jkobject Jun 17, 2025
6c65861
adding back mask zeros
jkobject Jun 17, 2025
fbb53c0
debugged embeddings
jkobject Jun 2, 2025
95511c9
reverting some from previous version - TO RUN as VAE
jkobject Jun 18, 2025
b90e615
adding all important things from model/*
jkobject Jun 17, 2025
851e46d
same
jkobject Jun 18, 2025
effb5a9
Merge commit '8e5706db1a27bdb56174f79c2b6de7fb7a524e18' into making-i…
jkobject Jun 19, 2025
f7216a7
fix lamib-db schema deprication - README.md
unikill066 Jun 23, 2025
b1ed92f
Merge pull request #36 from unikill066/main
jkobject Jun 29, 2025
9dfad09
Update Dockerfile
jkobject Jun 30, 2025
7b9db90
Update README.md
jkobject Jun 30, 2025
6728bac
simple debug
jkobject Jun 30, 2025
f79f1e1
linting
jkobject Jun 30, 2025
e0f0909
good version and params
jkobject Jun 30, 2025
6276ce3
Merge branch 'making-it-work-2' into dev
jkobject Jun 30, 2025
423995b
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject Jun 30, 2025
978babc
new model packages v and some debug
jkobject Jul 1, 2025
378e046
debug
jkobject Jul 22, 2025
0750d1a
nothing
jkobject Jul 28, 2025
106bb62
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject Jul 28, 2025
712e95e
Update README.md
jkobject Jul 29, 2025
a301f2a
some improvements and multiple debugs
jkobject Jul 31, 2025
ebd6c49
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject Jul 31, 2025
6112b3f
adding one more adv_cls
jkobject Jul 31, 2025
f5dde53
dbug?
jkobject Aug 3, 2025
1bd709d
solving issue further
jkobject Aug 3, 2025
bd54778
debug
jkobject Aug 4, 2025
2cee53a
again
jkobject Aug 4, 2025
bef071a
again
jkobject Aug 4, 2025
4d2b725
wip
jkobject Aug 4, 2025
5f38d18
trying to log
jkobject Aug 4, 2025
2879744
hope to be final dbug
jkobject Aug 4, 2025
9dae438
again
jkobject Aug 5, 2025
bc330e1
improvements and debugs
jkobject Aug 5, 2025
29a6a60
release: version 2.3.1 🚀
jkobject Aug 5, 2025
0a74931
Update README.md
jkobject Aug 5, 2025
fa6af1d
Update README.md
jkobject Aug 5, 2025
0c95008
release: version 2.3.2 🚀
jkobject Aug 5, 2025
6a205a5
release: version 2.3.3 🚀
jkobject Aug 5, 2025
6585e2d
Update README.md
jkobject Aug 5, 2025
2826635
debug
jkobject Aug 5, 2025
d6256cb
Merge branch 'main' of https://github.com/cantinilab/scPRINT
jkobject Aug 5, 2025
6f92f13
release: version 2.3.4 🚀
jkobject Aug 5, 2025
3f3e67a
by default umap generation
jkobject Aug 5, 2025
d7b834a
release: version 2.3.5 🚀
jkobject Aug 5, 2025
eb4fb03
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject Aug 5, 2025
7e8d608
Merge branch 'main' into dev
jkobject Aug 5, 2025
9c1afbc
wip on many notebooks
jkobject Aug 6, 2025
1ffade8
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject Aug 6, 2025
d1e10bf
ES update
jkobject Aug 11, 2025
288309b
novel task definition for generation and solve es
jkobject Aug 11, 2025
d4cd8b6
update package version, gene names as dict, gene emb task, generate d…
jkobject Aug 12, 2025
78035e9
xenium, output emb, denoisin, cross species wip or finished
jkobject Aug 12, 2025
74dacbe
denoising, cross species wip or finished
jkobject Aug 12, 2025
2ca1008
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject Aug 12, 2025
29e3f60
debugs
jkobject Aug 13, 2025
1311c7f
working on files
jkobject Aug 13, 2025
cf2ee04
adding gitignore
jkobject Aug 13, 2025
918750b
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject Aug 13, 2025
a6555e3
debug tf masker
jkobject Aug 18, 2025
230e4ea
debug tf masker
jkobject Aug 18, 2025
42eeeb7
works1
jkobject Aug 18, 2025
03bcc57
works
jkobject Aug 18, 2025
4adc7cb
works
jkobject Aug 18, 2025
e311075
xenium, output emb, denoisin, cross species wip or finished
jkobject Aug 12, 2025
4edcec1
denoising, cross species wip or finished
jkobject Aug 12, 2025
002a866
working on files
jkobject Aug 13, 2025
45d4523
adding gitignore
jkobject Aug 13, 2025
ab7127a
debug tf masker
jkobject Aug 18, 2025
2ef296c
works
jkobject Aug 18, 2025
cc1a9ce
solve for previous versions
jkobject Aug 18, 2025
0fa464c
debug tf masker
jkobject Aug 18, 2025
0072795
debugs
jkobject Aug 18, 2025
4367db5
adding new function to potentially improve classification results
jkobject Aug 18, 2025
335a25a
all debugs
jkobject Aug 18, 2025
2392133
nothing
jkobject Aug 18, 2025
d161fb1
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject Aug 19, 2025
f35c80a
debug
jkobject Aug 19, 2025
72cdbc3
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject Aug 19, 2025
679d858
for jz
jkobject Aug 19, 2025
3200b1a
some more debugs
jkobject Aug 19, 2025
84e3222
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject Aug 19, 2025
8477594
debug more
jkobject Aug 19, 2025
7653559
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject Aug 19, 2025
7b01bcc
issue with test datasets, removing
jkobject Aug 19, 2025
f946fbe
testing novel parameters
jkobject Aug 21, 2025
0cfd875
esm works back
jkobject Aug 21, 2025
add3011
running different examples
jkobject Aug 21, 2025
b349a10
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject Aug 21, 2025
5691aee
running the notebooks
jkobject Aug 27, 2025
3df4338
using gene_pos file and giving it to the model for more clarity
jkobject Aug 27, 2025
189c17d
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject Aug 27, 2025
29f1b8d
update ablation study too
jkobject Aug 27, 2025
dda838f
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject Aug 27, 2025
64bff64
redbug
jkobject Aug 27, 2025
b97a0b1
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject Aug 27, 2025
e936cf7
more debugs
jkobject Aug 28, 2025
9178115
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject Aug 28, 2025
bfb5e67
simplification and device-wide contrastive loss
jkobject Aug 28, 2025
eb6366e
missed some files in prev commit
jkobject Aug 28, 2025
c9bcb13
make binning work wip
jkobject Aug 29, 2025
12bcb55
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject Aug 29, 2025
4b3c63b
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject Aug 29, 2025
5bfc4e0
improv
jkobject Aug 29, 2025
9f8a44f
improv
jkobject Aug 29, 2025
5c6cfa7
improvements
jkobject Aug 29, 2025
ad18e7c
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject Aug 29, 2025
2338ce7
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject Aug 31, 2025
dcd456e
make it work on non jz
jkobject Sep 1, 2025
18c97af
working on notebook and better adv clss
jkobject Sep 1, 2025
28ab6c1
better sq classifier loc
jkobject Sep 1, 2025
cce6a24
exprBasedFT
jkobject Sep 1, 2025
ec714b7
simple dbug
jkobject Sep 2, 2025
d7d341c
solving knn-cells and adv bugs
jkobject Sep 4, 2025
fcc4478
all the notebook
jkobject Sep 9, 2025
9513220
some debug
jkobject Sep 9, 2025
14a0e82
Merge remote-tracking branch 'origin/dev' into breaking
jkobject Sep 9, 2025
8baea69
working on notebooks
jkobject Sep 10, 2025
fe5ef35
testing out stuff
jkobject Sep 11, 2025
4a0df59
Merge remote-tracking branch 'origin/dev' into breaking
jkobject Sep 11, 2025
00ec72a
novel weight init
jkobject Sep 11, 2025
f3fd0fd
debug multi cell model
jkobject Sep 11, 2025
ee517af
debug long run times
jkobject Sep 12, 2025
7bd506b
debug long run times
jkobject Sep 12, 2025
8d93360
making nocls and binning works
jkobject Sep 15, 2025
bf125d9
Merge branch 'dev' into breaking
jkobject Sep 15, 2025
1268d2e
trying to prevent NaNs
jkobject Sep 16, 2025
05badae
should work better now
jkobject Sep 17, 2025
9c91e24
solution to logging issues on wandb
jkobject Sep 17, 2025
34b5d44
wip
jkobject Sep 17, 2025
e39619d
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject Sep 17, 2025
995d348
solve some GNN random expr stuff and masking genes
jkobject Sep 21, 2025
7993de0
max_cont_len useless
jkobject Sep 21, 2025
35f09c8
Refactor transformer handling with FlashTransformer
jkobject Sep 21, 2025
1b1f407
dbug
jkobject Sep 21, 2025
6f48987
debug pred embedding in case of no cell_emb
jkobject Sep 22, 2025
042d6ac
debug stuff
jkobject Sep 22, 2025
6e2e13f
simple dbug
jkobject Sep 22, 2025
295971f
should be more similar to prev version
jkobject Sep 23, 2025
4e0ee05
did we solve it?
jkobject Sep 24, 2025
ad4c2df
quick cell emb db
jkobject Sep 24, 2025
22a1e41
dbug
jkobject Sep 24, 2025
6e1e287
dbug adv class
jkobject Sep 26, 2025
52fa89d
runnning notebooks
jkobject Sep 30, 2025
4281097
debug tf masking
jkobject Oct 1, 2025
c3cbaf3
running notebooks
jkobject Oct 1, 2025
61fe5cf
Merge branch 'dev' of https://github.com/cantinilab/scPRINT into dev
jkobject Oct 1, 2025
228195e
zarr better
jkobject Oct 3, 2025
06f2434
debug submit & large
jkobject Oct 3, 2025
6b138fe
Merge branch 'dev' into breaking
jkobject Oct 3, 2025
837142f
more complex loss
jkobject Oct 5, 2025
5c8a7f0
more complex loss
jkobject Oct 5, 2025
2b6c5a9
dbug
jkobject Oct 5, 2025
8ac3c1a
adding ft v2
jkobject Oct 6, 2025
3c69a89
nothing really
jkobject Oct 6, 2025
1f170fe
Merge remote-tracking branch 'origin/dev' into breaking
jkobject Oct 6, 2025
7425d9e
debug was no gene fine tuning!!!
jkobject Oct 8, 2025
474ae3c
debug was no gene fine tuning (forgot commit)
jkobject Oct 8, 2025
a4eeee3
removing blocking
jkobject Oct 10, 2025
378fe36
wip on the notebooks
jkobject Oct 27, 2025
a94e9d6
wip
jkobject Oct 28, 2025
b796fb6
Merge branch 'dev' into breaking
jkobject Oct 28, 2025
d2cf215
work in progress
jkobject Oct 29, 2025
42aa318
more
jkobject Oct 29, 2025
85acb62
Merge branch 'breaking' of https://github.com/cantinilab/scPRINT into…
jkobject Oct 29, 2025
7af8845
debug
jkobject Oct 29, 2025
191a7cf
WIP
jkobject Oct 30, 2025
1020b69
Merge branch 'breaking' of https://github.com/cantinilab/scPRINT into…
jkobject Oct 30, 2025
f9b333e
easy debug
jkobject Oct 31, 2025
fcb68e9
debug hyper test and binning, mask zeros,
jkobject Nov 2, 2025
4758674
one more debug
jkobject Nov 2, 2025
cee0da9
nothing
jkobject Nov 3, 2025
14dbf5d
debug
jkobject Nov 4, 2025
da3c3a0
Merge branch 'breaking' of https://github.com/cantinilab/scPRINT into…
jkobject Nov 4, 2025
c913258
debug
jkobject Nov 5, 2025
24cefea
real debug
jkobject Nov 5, 2025
ea27544
nothing
jkobject Nov 5, 2025
5e5ad11
Merge branch 'breaking' of https://github.com/cantinilab/scPRINT into…
jkobject Nov 5, 2025
968b98b
debug
jkobject Nov 6, 2025
9c3a3c1
Merge branch 'breaking' of https://github.com/cantinilab/scPRINT into…
jkobject Nov 6, 2025
dc2553b
debug
jkobject Nov 7, 2025
060d5cd
save wip
jkobject Nov 12, 2025
914ecd6
continuing notebooks
jkobject Nov 12, 2025
c56190f
update
jkobject Nov 13, 2025
f0b3897
update
jkobject Nov 13, 2025
cdd5c42
make it work
jkobject Nov 13, 2025
3b6ad04
debug
jkobject Nov 14, 2025
3dd4d38
WIP on latest questions
jkobject Nov 16, 2025
e95f075
correct versions
jkobject Nov 19, 2025
9af3922
Merge branch 'main' into breaking
jkobject Nov 19, 2025
00c0ebe
latest notebook version
jkobject Nov 19, 2025
3f453b0
Merge branch 'breaking' of https://github.com/cantinilab/scPRINT into…
jkobject Nov 19, 2025
ddec5b6
wip
jkobject Nov 22, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 6 additions & 8 deletions .github/workflows/main.yml
Original file line number Diff line number Diff line change
Expand Up @@ -23,19 +23,12 @@ jobs:
runs-on: ${{ matrix.os }}
steps:
- uses: actions/checkout@v4
- name: Install poetry
run: pipx install poetry
- uses: actions/setup-python@v5
with:
python-version: ${{ matrix.python-version }}
cache: 'poetry'
- name: Free Disk Space (Ubuntu)
uses: jlumbroso/free-disk-space@main
with:
# this might remove tools that are actually needed,
# if set to "true" but frees about 6 GB
tool-cache: false

# all of these default to true, but feel free to set to
# "false" if necessary for your workflow
android: true
Expand All @@ -44,8 +37,13 @@ jobs:
large-packages: false
docker-images: true
swap-storage: false
- name: Install uv
uses: astral-sh/setup-uv@v3
- uses: actions/setup-python@v5
with:
python-version: ${{ matrix.python-version }}
- name: Install project
run: make install
run: make virtualenv
continue-on-error: false
- name: Run linter
run: make lint
Expand Down
9 changes: 4 additions & 5 deletions .github/workflows/release.yml
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ jobs:
- name: Generate Changelog
run: .github/release_message.sh > release_message.md
- name: Release
uses: softprops/action-gh-release@v2
uses: softprops/action-gh-release@v1
with:
body_path: release_message.md

Expand All @@ -38,12 +38,11 @@ jobs:
runs-on: ${{ matrix.os }}
steps:
- uses: actions/checkout@v4
- name: Install poetry
run: pipx install poetry
- name: Install uv
uses: astral-sh/setup-uv@v3
- uses: actions/setup-python@v5
with:
python-version: ${{ matrix.python-version }}
cache: "poetry"
- name: Build and publish
run: |
poetry publish -u __token__ -p ${{ secrets.POETRY_TOKEN }} --build
uv build && uv publish -u __token__ -p ${{ secrets.POETRY_TOKEN }}
32 changes: 32 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -178,3 +178,35 @@ data/main/bias_sparse.npz
*.gv
data/log/
file.txt
*.dataset
*.arrow
tests/data/step_0__predict_part_0_0.h5ad
data/human_dcm_hcm_nf/
data/geneformertest.csv
clf_omni.pkl
metrics__*.json
config/torm.txt
torm.json
notebooks/additional/figures/
notebooks/data/temp/
data/main/*.parquet
!data/main/avg_embedding.parquet
!data/main/biomart_pos.parquet
data/main/gene_embs/
data/main/gene_locs/
step_*.h5ad
*/.lamindb/
*.lndb
notebooks/data/xenium/
notebooks/data/visium/
notebooks/scPRINT-2-repro-notebooks/normalize_log/
notebooks/data/GSE215121/
notebooks/data/GSE72056/
metrics_*.json
notebooks/scPRINT-2-repro-notebooks/benchmark_datasets.tar.gz
notebooks/scPRINT-2-repro-notebooks/._normalize_log
figures/umap_*.png
notebooks/scPRINT-2-repro-notebooks/data/*.png
data/data.zarr/
data/*.png
data/*.tsv
18 changes: 15 additions & 3 deletions .gitmodules
Original file line number Diff line number Diff line change
@@ -1,3 +1,15 @@
[submodule "RNABERT"]
path = scprint/tokenizers/RNABERT
url = https://github.com/jkobject/RNABERT
[submodule "tools/DeepSEM"]
path = tools/DeepSEM
url = https://github.com/jkobject/DeepSEM
[submodule "tools/SERGIO"]
path = tools/SERGIO
url = https://github.com/jkobject/SERGIO
[submodule "tools/scFoundation"]
path = tools/scFoundation
url = https://github.com/biomap-research/scFoundation
[submodule "tools/scGPT"]
path = tools/scGPT
url = https://github.com/jkobject/scGPT
[submodule "tools/Geneformer"]
path = tools/Geneformer
url = https://huggingface.co/ctheodoris/Geneformer/
16 changes: 16 additions & 0 deletions Dockerfile
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
# Use the specified base image
FROM openproblems/base_pytorch_nvidia:1

# Install Python packages using pip
RUN pip install git+https://github.com/cantinilab/scPRINT.git@d8cc270b099c8d5dacf6913acc26f2b696685b2b
RUN pip install gseapy==1.1.2
RUN pip install git+https://github.com/jkobject/scDataLoader.git@c67c24a2e5c62399912be39169aae76e29e108aa

RUN lamin init --storage ./main --name main --schema bionty
RUN lamin load anonymous/main

RUN python -c 'import bionty as bt; bt.base.reset_sources(confirm=True); bt.core.sync_all_sources_to_latest()'
RUN python -c 'from scdataloader.utils import populate_my_ontology; populate_my_ontology()'

# Set the default command (can be overridden)
CMD ["scprint", "--help"]
Loading
Loading