Skip to content

[Feature Request] Support CUDA-13 #1504

@retonym

Description

@retonym

Required prerequisites

  • I have searched the Issue Tracker that this hasn't already been reported. (comment there if it has.)

Motivation

I am currently working in an environment equipped with CUDA 13.
However, when attempting to run TileLang kernels, I encountered a compatibility issue because the current implementation seems to be hardcoded or linked against CUDA 12 (libnvrtc.so.12).

    import tilelang
  File "/opt/venv/lib/python3.13/site-packages/tilelang/__init__.py", line 99, in <module>
    import tvm
  File "/opt/venv/lib/python3.13/site-packages/tilelang/3rdparty/tvm/python/tvm/__init__.py", line 27, in <module>
    from .base import TVMError, __version__, _RUNTIME_ONLY
  File "/opt/venv/lib/python3.13/site-packages/tilelang/3rdparty/tvm/python/tvm/base.py", line 58, in <module>
    _LIB, _LIB_NAME = _load_lib()
                      ~~~~~~~~~^^
  File "/opt/venv/lib/python3.13/site-packages/tilelang/3rdparty/tvm/python/tvm/base.py", line 45, in _load_lib
    lib = ctypes.CDLL(lib_path[0], ctypes.RTLD_GLOBAL)
  File "/root/.local/share/uv/python/cpython-3.13.9-linux-aarch64-gnu/lib/python3.13/ctypes/__init__.py", line 390, in __init__
    self._handle = _dlopen(self._name, mode)
                   ~~~~~~~^^^^^^^^^^^^^^^^^^
OSError: libnvrtc.so.12: cannot open shared object file: No such file or directory

Solution

No response

Alternatives

No response

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requesthelp wantedExtra attention is needed

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions