Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
66 commits
Select commit Hold shift + click to select a range
750ca5a
first version
fbusato Dec 18, 2025
f040c10
add unit test
fbusato Dec 19, 2025
464ccc2
documentation
fbusato Dec 19, 2025
6f32ae9
Update libcudacxx/include/cuda/__mdspan/mdspan_to_dlpack.h
fbusato Dec 19, 2025
3457d3a
Merge branch 'mdspan-to-dlpack' of github.com:fbusato/cccl into mdspa…
fbusato Dec 19, 2025
ee05eda
add many types
fbusato Dec 19, 2025
4d2e0da
remove operator->
fbusato Dec 19, 2025
f290320
formatting
fbusato Dec 19, 2025
7a22848
fix MSVC warning
fbusato Dec 20, 2025
f78db30
improve documentation
fbusato Dec 20, 2025
1467ab2
fix MSVC warning
fbusato Dec 20, 2025
d844f65
first version
fbusato Dec 20, 2025
3843556
complete the implementation
fbusato Dec 23, 2025
977909f
add unit test
fbusato Dec 23, 2025
b0e1fbc
cuda.coop: Use cuda.core.experimental.Linker instead of internal numb…
shwina Dec 18, 2025
50da3d4
Make c2h vector comparisons `constexpr` (#7009)
davebayer Dec 18, 2025
f8a4d06
improves comments on decoupled lookback example (#7015)
elstehle Dec 18, 2025
e9f0a13
Extract reduce_op_sync into a free function (#7004)
bernhardmgruber Dec 18, 2025
362d316
Remove experimental namespace from cuda.core import (#7022)
NaderAlAwar Dec 18, 2025
28d22c9
reexpress completion signature transform alias to make clangd happy (…
ericniebler Dec 19, 2025
1e28e8c
Qualify call to `__launch_impl` in launch.h to avoid ambiguity errors…
ericniebler Dec 19, 2025
f21a158
Rework hierarchy levels (#6957)
davebayer Dec 19, 2025
1ef85d4
Use vectorized tuning for triad benchmark for dtypes of size 2 (#7019)
NaderAlAwar Dec 19, 2025
00a1b95
[libcu++] Fix synchronous resource adapter property passing (#6976)
pciolkosz Dec 19, 2025
adc23f5
[libcu++] Remove _view from the shared memory getter name (#6997)
pciolkosz Dec 19, 2025
33aa542
[thrust] Ignore CUDA free errors in thrust memory resource (#7002)
pciolkosz Dec 19, 2025
262b718
[libcu++] Correctly handle extended lambda in cuda::launch (#6987)
pciolkosz Dec 19, 2025
6402bc6
the `<stdexcept>` header must be included when using `_CCCL_THROW`, …
fbusato Dec 19, 2025
5546b87
Error out when nvrtcc cannot parse cuda_thread_count (#7035)
bernhardmgruber Dec 19, 2025
58aba1d
Allow all public headers to be included with host compilers only (#7012)
davebayer Dec 19, 2025
e80cee2
[cuda.compute]: Fixes and updates to benchmarks (#6999)
shwina Dec 19, 2025
d91b711
Support operations with side-effects (state) in `cuda.compute` (#7008)
shwina Dec 19, 2025
c40c68d
Fix `cuda::memcpy async` edge cases and add more tests (#6608)
bernhardmgruber Dec 19, 2025
16bdfbf
Explicitly set `CCCL_TOPLEVEL_PROJECT` to `OFF` when needed (#7016)
KyleFromNVIDIA Dec 19, 2025
11d32ec
[libcu++] Add explicit alignment specification in buffer (#7005)
pciolkosz Dec 19, 2025
d1dcaa5
Use the sccache-dist build cluster for RAPIDS CI jobs (#7014)
trxcllnt Dec 19, 2025
52834f8
first version
fbusato Dec 20, 2025
dec5dca
complete the implementation
fbusato Dec 23, 2025
b38a6a7
add unit test
fbusato Dec 23, 2025
fe72fcc
Merge branch 'dlpack-to-mdspan' of github.com:fbusato/cccl into dlpac…
fbusato Dec 23, 2025
5be1893
fix unit test
fbusato Dec 23, 2025
f0909df
formatting
fbusato Dec 23, 2025
d149dff
minor fixes
fbusato Dec 23, 2025
e96ebea
fix compiler warnings
fbusato Dec 23, 2025
136ab59
refactor vector type traits by removing conditional compilation for v…
fbusato Jan 5, 2026
501f48c
reenable vector types for CTK 13
fbusato Jan 5, 2026
bd6094c
Merge branch 'main' into mdspan-to-dlpack
fbusato Jan 5, 2026
604257d
fix msvc warning
fbusato Jan 5, 2026
f7c5eb4
Merge branch 'mdspan-to-dlpack' into dlpack-to-mdspan
fbusato Jan 5, 2026
14cf251
documentation and copyright
fbusato Jan 6, 2026
eb2635a
fix index_operator.pass
fbusato Jan 6, 2026
ea7e4e4
fix formatting
fbusato Jan 6, 2026
8e813f1
Merge branch 'main' into mdspan-to-dlpack
fbusato Jan 6, 2026
c20e897
Merge branch 'main' into dlpack-to-mdspan
fbusato Jan 6, 2026
b6a52cd
use internal type
fbusato Jan 7, 2026
0f8d8b7
Merge branch 'main' into mdspan-to-dlpack
fbusato Jan 7, 2026
1c7f5d4
Merge branch 'mdspan-to-dlpack' into dlpack-to-mdspan
fbusato Jan 7, 2026
9bbf73b
address comments
fbusato Jan 7, 2026
83b6eb2
Merge branch 'main' into dlpack-to-mdspan
fbusato Jan 14, 2026
ba38968
use _CCCL_HAS_DLPACK
fbusato Jan 14, 2026
d41a7ae
Merge branch 'main' into dlpack-to-mdspan
fbusato Jan 22, 2026
4774c70
align with mdspan_to_dlpack
fbusato Jan 22, 2026
8c283af
align Availability notes
fbusato Jan 23, 2026
3c4137e
Update libcudacxx/include/cuda/__mdspan/dlpack_to_mdspan.h
fbusato Jan 23, 2026
1ab523a
fix mul_overflow
fbusato Jan 23, 2026
d2e1517
address comments
fbusato Jan 26, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions docs/libcudacxx/extended_api/mdspan.rst
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,7 @@ Mdspan
mdspan/restrict_accessor
mdspan/shared_memory_accessor
mdspan/mdspan_to_dlpack
mdspan/dlpack_to_mdspan

.. list-table::
:widths: 25 45 30 30
Expand Down Expand Up @@ -40,3 +41,8 @@ Mdspan
- Convert a ``mdspan`` to a ``DLTensor``
- CCCL 3.2.0
- CUDA 13.2

* - :ref:`dlpack to mdspan <libcudacxx-extended-api-mdspan-dlpack-to-mdspan>`
- Convert a ``DLTensor`` to a ``mdspan``
- CCCL 3.2.0
- CUDA 13.2
138 changes: 138 additions & 0 deletions docs/libcudacxx/extended_api/mdspan/dlpack_to_mdspan.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,138 @@
.. _libcudacxx-extended-api-mdspan-dlpack-to-mdspan:

DLPack to ``mdspan``
====================

This functionality provides a conversion from `DLPack <https://dmlc.github.io/dlpack/latest/>`__ ``DLTensor`` to ``cuda::host_mdspan``, ``cuda::device_mdspan``, and ``cuda::managed_mdspan``.

Defined in the ``<cuda/mdspan>`` header.

Conversion functions
--------------------

.. code:: cuda

namespace cuda {

template <typename ElementType, size_t Rank, typename LayoutPolicy = cuda::std::layout_stride>
[[nodiscard]] cuda::host_mdspan<ElementType, cuda::std::dims<Rank, int64_t>, LayoutPolicy>
to_host_mdspan(const DLTensor& tensor);

template <typename ElementType, size_t Rank, typename LayoutPolicy = cuda::std::layout_stride>
[[nodiscard]] cuda::device_mdspan<ElementType, cuda::std::dims<Rank, int64_t>, LayoutPolicy>
to_device_mdspan(const DLTensor& tensor);

template <typename ElementType, size_t Rank, typename LayoutPolicy = cuda::std::layout_stride>
[[nodiscard]] cuda::managed_mdspan<ElementType, cuda::std::dims<Rank, int64_t>, LayoutPolicy>
to_managed_mdspan(const DLTensor& tensor);

} // namespace cuda

Template parameters
-------------------

- ``ElementType``: The element type of the resulting ``mdspan``. Must match the ``DLTensor::dtype``.
- ``Rank``: The number of dimensions. Must match ``DLTensor::ndim``.
- ``LayoutPolicy``: The layout policy for the resulting ``mdspan``. Defaults to ``cuda::std::layout_stride``. Supported layouts are:

- ``cuda::std::layout_right`` (C-contiguous, row-major)
- ``cuda::std::layout_left`` (Fortran-contiguous, column-major)
- ``cuda::std::layout_stride`` (general strided layout)

Semantics
---------

The conversion produces a non-owning ``mdspan`` view of the ``DLTensor`` data:

- The ``mdspan`` data pointer is computed as ``static_cast<char*>(tensor.data) + tensor.byte_offset``.
- For ``rank > 0``, ``mdspan.extent(i)`` is ``tensor.shape[i]``.
- For ``layout_stride``, ``mdspan.stride(i)`` is ``tensor.strides[i]`` (or computed as row-major if ``strides`` is ``nullptr`` for DLPack < v1.2).
- The device type is validated:

- ``kDLCPU`` for ``to_host_mdspan``
- ``kDLCUDA`` for ``to_device_mdspan``
- ``kDLCUDAManaged`` for ``to_managed_mdspan``

Supported element types:

- ``bool``.
- Signed and unsigned integers.
- IEEE-754 Floating-point and extended precision floating-point, including ``__half``, ``__nv_bfloat16``, ``__float128``, FP8, FP6, FP4 when available.
- Complex: ``cuda::std::complex<__half>``, ``cuda::std::complex<float>``, and ``cuda::std::complex<double>``.
- `CUDA built-in vector types <https://docs.nvidia.com/cuda/cuda-programming-guide/05-appendices/cpp-language-extensions.html#built-in-types>`__, such as ``int2``, ``float4``, etc.
- Vector types for extended floating-point, such as ``__half2``, ``__nv_fp8x4_e4m3``, etc.

Constraints
-----------

- ``LayoutPolicy`` must be one of ``cuda::std::layout_right``, ``cuda::std::layout_left``, or ``cuda::std::layout_stride``.
- For ``layout_right`` and ``layout_left``, the ``DLTensor`` strides must be compatible with the layout.

Runtime errors
--------------

The conversion throws ``std::invalid_argument`` in the following cases:

- ``DLTensor::ndim`` does not match the specified ``Rank``.
- ``DLTensor::dtype`` does not match ``ElementType``.
- ``DLTensor::data`` is ``nullptr``.
- ``DLTensor::shape`` is ``nullptr`` (for rank > 0).
- Any ``DLTensor::shape[i]`` is negative.
- ``DLTensor::strides`` is ``nullptr`` for DLPack v1.2 or later.
- ``DLTensor::strides`` is ``nullptr`` for ``layout_left`` with rank > 1 (DLPack < v1.2).
- ``DLTensor::strides[i]`` is not positive for ``layout_stride``.
- ``DLTensor::strides`` are not compatible with the requested ``layout_right`` or ``layout_left``.
- ``DLTensor::device.device_type`` does not match the target mdspan type.
- Data pointer is not properly aligned for the element type.

Availability notes
------------------

- This API is available only when DLPack header is present, namely ``<dlpack/dlpack.h>`` is found in the include path.
- This API can be disabled by defining ``CCCL_DISABLE_DLPACK`` before including any library headers. In this case, ``<dlpack/dlpack.h>`` will not be included.

References
----------

- `DLPack C API <https://dmlc.github.io/dlpack/latest/c_api.html>`__ documentation.

Example
-------

.. code:: cuda

#include <dlpack/dlpack.h>
#include <cuda/mdspan>
#include <cuda/std/cassert>
#include <cuda/std/cstdint>

int main() {
int data[6] = {0, 1, 2, 3, 4, 5};

// Create a DLTensor manually for demonstration
int64_t shape[2] = {2, 3};
int64_t strides[2] = {3, 1}; // row-major strides

DLTensor tensor{};
tensor.data = data;
tensor.device = {kDLCPU, 0};
tensor.ndim = 2;
tensor.dtype = DLDataType{kDLInt, 32, 1};
tensor.shape = shape;
tensor.strides = strides;
tensor.byte_offset = 0;

// Convert to host_mdspan
auto md = cuda::to_host_mdspan<int, 2>(tensor);

assert(md.rank() == 2);
assert(md.extent(0) == 2 && md.extent(1) == 3);
assert(md.stride(0) == 3 && md.stride(1) == 1);
assert(md.data_handle() == data);
assert(md(0, 0) == 0 && md(1, 2) == 5);
}

See also
--------

- :ref:`libcudacxx-extended-api-mdspan-mdspan-to-dlpack` for the reverse conversion.
2 changes: 1 addition & 1 deletion libcudacxx/include/cuda/__internal/dlpack.h
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@
# include <dlpack/dlpack.h>

# define _CCCL_DLPACK_AT_LEAST(_MAJOR, _MINOR) \
(DLPACK_MAJOR_VERSION > (_MAJOR) || (DLPACK_MAJOR_VERSION == (_MAJOR) && DLPACK_VERSION_MINOR >= (_MINOR)))
(DLPACK_MAJOR_VERSION > (_MAJOR) || (DLPACK_MAJOR_VERSION == (_MAJOR) && DLPACK_MINOR_VERSION >= (_MINOR)))
# define _CCCL_DLPACK_BELOW(_MAJOR, _MINOR) (!_CCCL_DLPACK_AT_LEAST(_MAJOR, _MINOR))

# if DLPACK_MAJOR_VERSION != 1
Expand Down
Loading
Loading