matmul

Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.

Distributed Communication-Optimal Matrix-Matrix Multiplication Algorithm

Matrix multiplication on GPUs for matrices stored on a CPU. Similar to cublasXt, but ported to both NVIDIA and AMD GPUs.

a from-scratch, pure-C deep learning library for CPU-only training, emphasizing high performance and no external ML dependencies.

NVIDIA GPU accelerated C++ tensor library for learning deep learning :)

Userspace driver, matmul, and on-NPU op library for Rockchip NPUs (RK3588 & Subset on RK3576) via the mainline rocket DRM-accel driver

Floating-point matrix multiplication implementation (arbitrary precision)

Matrix multiplication on the NPU inside RK3588

My gemm optimization on a RPi 4b achieved a 220x performance boost, showing speeds faster than Eigen and close to OpenBLAS.

CCO is an open-source system for managing, validating, and improving GPU.

ForMatmul - A Fortran library that overloads the matmul function to enable efficient matrix multiplication with/without coarray.

This project integrates a custom CUDA-based matrix multiplication kernel into a PyTorch deep learning model, leveraging GPU acceleration for matrix operations. The goal is to compare the performance of this custom kernel with PyTorch's built-in matrix multiplication and demonstrate how custom CUDA kernels can optimize compute-intensive operations.

Generate optimized MatMul cuda kernel automatically using tvm auto schedule.

AI Basics in Hindi

Raspberry Pi Pico (RP2040) and Adafruit Metro M7 (NXP IMXRT10XX) benchmark

Open, reproducible AMD XDNA1 + Strix Point XDNA2 compute on Linux: pinned builds, CPU-reference checks, persistent C/Python runners, and an LLM roadmap.

Bit-exact, cross-hardware deterministic matrix multiplication using Q16.16 fixed-point arithmetic and SHA-256 verification. Provides identical AI inference results across NVIDIA GPUs, CPUs, and OSs. Essential for ZK-ML, Fintech, and AI Safety. Includes a PyTorch drop-in replacement, API and GPT-2 demo.

Optimised matrix multiplication kernels for acceleration on the Tenstorrent Tensix architecture

OpenMP Matrix Multiplication Offloading Playground