Skip to content
#

nvrtc

Here are 22 public repositories matching this topic...

Native Rust engine for neural network inference and training: LLM, image, video, speech and music models on hand-written CUDA kernels JIT-compiled via NVRTC for any NVIDIA sm_80+ GPU (native NVFP4/MXFP8 on Blackwell sm_120+). .syn bundles in NVFP4/MXFP8/SQ1–SQ8, GGUF loads directly. No PyTorch, no Python.

  • Updated Sep 30, 2026
  • Rust

Add this topic to your repo

To associate your repository with the nvrtc topic, visit your repo's landing page and select "manage topics."

Learn more