File download on windows completes but the file is incorrect

[psenin-sanofi]

Hi folks:

When i download files via API, the download completes, but file size is different than when I download via browser. Consequently, API-downloaded files wouldn't open with gzip or viewers... This is kind of breaking.

Downloaded via API:
07/27/2022 07:44 PM 21,186 barcodes.tsv.gz
07/27/2022 07:44 PM 155,898 features.tsv.gz
07/27/2022 07:44 PM 44,249,530 matrix.mtx.gz
3 File(s) 44,426,614 bytes

Downloaded via browser:
07/27/2022 08:38 PM 21,115 barcodes.tsv.gz
07/27/2022 08:38 PM 155,265 features.tsv.gz
07/27/2022 08:39 PM 44,241,306 matrix.mtx.gz
3 File(s) 44,417,686 bytes

$ python --version
Python 3.8.12

$ pip freeze
aiohttp==3.8.1
aiosignal==1.2.0
alabaster==0.7.12
anndata==0.8.0
appdirs==1.4.4
argon2-cffi==21.3.0
argon2-cffi-bindings==21.2.0
asciitree==0.3.3
astroid==2.11.7
asttokens==2.0.5
async-timeout==4.0.2
atomicwrites==1.4.1
attrs==21.4.0
Babel==2.10.3
backcall==0.2.0
beautifulsoup4==4.11.1
bleach==5.0.1
build==0.8.0
CacheControl==0.12.11
cachey==0.2.1
cachy==0.3.0
cellpose==2.1.0
certifi @ file:///C:/Windows/TEMP/abs_e9b7158a-aa56-4a5b-87b6-c00d295b01fanefpc8_o/croots/recipe/certifi_1655968940823/work/certifi
cffi==1.15.1
charset-normalizer==2.1.0
cleo==0.8.1
click==8.1.3
clikit==0.6.2
cloudpickle==2.1.0
colorama==0.4.5
commonmark==0.9.1
coverage==6.4.2
crashtest==0.3.1
cycler==0.11.0
dask==2022.6.1
dask-image==2021.12.0
debugpy==1.6.0
decorator==5.1.1
defusedxml==0.7.1
dill==0.3.5.1
distlib==0.3.5
docrep==0.3.2
docstring-parser==0.14.1
docutils==0.18.1
entrypoints==0.4
executing==0.8.3
fasteners==0.17.3
fastjsonschema==2.15.3
fastremap==1.13.2
filelock==3.7.1
fonttools==4.34.0
freetype-py==2.3.0
frozenlist==1.3.0
fsspec==2022.5.0
h5py==3.7.0
HeapDict==1.0.1
hsluv==5.0.3
html5lib==1.1
idna==3.3
igraph==0.9.11
imagecodecs==2022.2.22
imageio==2.19.3
imagesize==1.4.1
importlib-metadata==4.12.0
importlib-resources==5.8.0
inflect==5.6.0
iniconfig==1.1.1
ipykernel==6.15.0
ipython==8.4.0
ipython-genutils==0.2.0
ipywidgets==7.7.1
isort==5.10.1
jedi==0.18.1
Jinja2==3.1.2
joblib==1.1.0
jsonschema==4.6.1
jupyter==1.0.0
jupyter-client==7.3.4
jupyter-console==6.4.4
jupyter-core==4.10.0
jupyterlab-pygments==0.2.2
jupyterlab-widgets==1.1.1
keyring==23.7.0
kiwisolver==1.4.3
lazy-object-proxy==1.7.1
leidenalg==0.8.10
llvmlite==0.38.1
locket==1.0.0
lockfile==0.12.2
magicgui==0.5.1
MarkupSafe==2.1.1
matplotlib==3.5.2
matplotlib-inline==0.1.3
matplotlib-scalebar==0.8.1
mccabe==0.7.0
mistune==0.8.4
msgpack==1.0.4
multidict==6.0.2
napari==0.4.16
napari-console==0.0.4
napari-plugin-engine==0.2.0
napari-svg==0.1.6
natsort==8.1.0
nbclient==0.6.6
nbconvert==6.5.0
nbformat==5.4.0
nest-asyncio==1.5.5
networkx==2.8.4
notebook==6.4.12
npe2==0.5.1
numba==0.55.2
numcodecs==0.10.0
numpy==1.22.4
numpydoc==1.4.0
omnipath==1.0.5
opencv-python-headless==4.6.0.66
packaging==20.9
pandas==1.4.3
pandocfilters==1.5.0
parso==0.8.3
partd==1.2.0
pastel==0.2.1
patsy==0.5.2
pep517==0.12.0
pexpect==4.8.0
pickleshare==0.7.5
Pillow==9.2.0
PIMS==0.6.1
Pint==0.19.2
pkginfo==1.8.3
platformdirs==2.5.2
pluggy==1.0.0
poetry==1.1.14
poetry-core==1.0.8
prometheus-client==0.14.1
prompt-toolkit==3.0.30
psutil==5.9.1
psygnal==0.3.5
ptyprocess==0.7.0
pure-eval==0.2.2
py==1.11.0
pycparser==2.21
pydantic==1.9.1
Pygments==2.12.0
pylev==1.4.0
pylint==2.14.5
pynndescent==0.5.7
PyOpenGL==3.1.6
pyparsing==3.0.9
PyQt5==5.15.7
PyQt5-Qt5==5.15.2
PyQt5-sip==12.11.0
pyrsistent==0.18.1
pytest==7.1.2
pytest-cov==3.0.0
python-dateutil==2.8.2
pytomlpp==1.0.11
pytz==2022.1
PyWavelets==1.3.0
pywin32==304
pywin32-ctypes==0.2.0
pywinpty==2.0.5
PyYAML==6.0
pyzmq==23.2.0
qtconsole==5.3.1
QtPy==2.1.0
requests==2.28.1
requests-toolbelt==0.9.1
rich==12.4.4
scanpy==1.9.1
scikit-image==0.19.3
scikit-learn==1.1.1
scipy==1.8.1
seaborn==0.11.2
Send2Trash==1.8.0
session-info==1.0.0
sevenbridges-python==2.9.0
shellingham==1.4.0
six==1.16.0
slicerator==1.1.0
snowballstemmer==2.2.0
soupsieve==2.3.2.post1
Sphinx==5.0.2
sphinxcontrib-applehelp==1.0.2
sphinxcontrib-devhelp==1.0.2
sphinxcontrib-htmlhelp==2.0.0
sphinxcontrib-jsmath==1.0.1
sphinxcontrib-qthelp==1.0.3
sphinxcontrib-serializinghtml==1.1.5
squidpy==1.2.2
stack-data==0.3.0
statsmodels==0.13.2
stdlib-list==0.8.0
superqt==0.3.2
terminado==0.15.0
texttable==1.6.4
threadpoolctl==3.1.0
tifffile==2022.5.4
tinycss2==1.1.1
toml==0.10.2
tomli==2.0.1
tomlkit==0.11.1
toolz==0.11.2
torch==1.12.0
tornado==6.2
tox==3.25.1
tqdm==4.64.0
traitlets==5.3.0
typer==0.4.2
typing_extensions==4.3.0
umap-learn==0.5.3
urllib3==1.26.9
validators==0.20.0
virtualenv==20.16.0
vispy==0.10.0
wcwidth==0.2.5
webencodings==0.5.1
widgetsnbextension==3.6.1
wincertstore==0.2
wrapt==1.14.1
xarray==2022.3.0
yarl==1.7.2
zarr==2.12.0
zipp==3.8.0

Thanks!

[pavlemarinkovic]

Hi @psenin-sanofi ,

Thanks for your feedback.
We were able to reproduce the issue, and we are currently looking into it. We will get back to you as soon as we have more info.

[pavlemarinkovic]

@psenin-sanofi
We are still investigating the issue, but until we fix it, as a workaround, you can use the "download_info" method to get downloadable URL: Get downloadable URL for a file. You can then use this URL to download the file, instead of using the "download".

[locastre]

We are encountering this problem as well. The file download method works OK on Linux platform, but running the same code on Windows results in corrupted files downloaded locally. Has there been any progress on a fix for this?