Hacker News with Generative AI: CUDA

Rust-CUDA Project Restarted for Enabling Nvidia CUDA Kernels Within Rust Code (phoronix.com)
The open-source Rust CUDA project has been "rebooted" to get back onto the effort of allowing NVIDIA CUDA compute kernels to be coded within the Rust programming language.

Rust, CUDA, Programming Languages, GPU Computing, Open Source

5 points by LinuxBender 18 days ago | 1 comments

DeepSeek's AI breakthrough bypasses industry-standard CUDA, uses PTX (tomshardware.com)

Artificial Intelligence, Computer Hardware, CUDA

136 points by pseudolus 23 days ago | 72 comments

Show HN: HipScript – Run CUDA in the browser with WebAssembly and WebGPU (lights0123.com)
Online compiler for HIP and NVIDIA® CUDA® code to WebGPU

WebAssembly, WebGPU, CUDA, GPU Programming, Programming Languages

309 points by lights0123 44 days ago | 32 comments

Show HN: Lightweight Llama3 Inference Engine – CUDA C (github.com/abhisheknair10)
Llama3.cu is a CUDA native implementation of the LLaMA3 architecture for causal language modeling.

Show HN, CUDA, Inference Engines

12 points by abhisheknair10 47 days ago | 0 comments

Show HN: A GPU-accelerated MD5 Hash Cracker, Written Using Rust and CUDA (github.com/vaktibabat)
MD5 hash cracking with CUDA and Rust, implemented from scratch

Security, Programming, Rust, GPU, CUDA

4 points by vaktibabat 51 days ago | 0 comments

Show HN: Cudair – live-reloading for developing CUDA applications (github.com/ei-sugimoto)
cudair enable live-reloading for developing CUDA applications like golang-air. I recommend using docker.

CUDA, Software Development, Tools, Programming, Open Source

5 points by ei-sugimoto 60 days ago | 0 comments

Train a Mnist VAE with C and CUDA (github.com/ggerganov)
Hi, I just want to share what I have been working on recently. This is an example of training a MNIST VAE. The goal is to use only ggml pipeline and its implementation of ADAM optimizer.

Machine Learning, Programming, C, CUDA, Generative AI

54 points by bssrdf 61 days ago | 2 comments

Fast LLM Inference From Scratch (using CUDA) (andrewkchan.dev)
This post is about building an LLM inference engine using C++ and CUDA from scratch without libraries.

CUDA, Programming, Inference, C++

344 points by homarp 68 days ago | 57 comments

Check if your performance intuition still works with CUDA (wordsandbuttons.online)
For those of you who don't know what CUDA is, let me explain. Imagine, buses were never invented. There are cars, trains, planes, and motorcycles, just not buses. And one day someone smart asks himself: “wouldn't it be splendid to have cars that would fit a lot of people? One guy could be driving, and all the rest will enjoy the ride.” “Right, like trucks but for people!” “No-no-no, who on earth would ever want to travel by truck?

Performance Optimization, CUDA, Programming, Computer Science

12 points by EvgeniyZh 97 days ago | 0 comments

CUDA Programming Course – High-Performance Computing with GPUs [video] (youtube.com)

CUDA, Programming, High-Performance Computing, GPUs, Video

26 points by yarapavan 100 days ago | 1 comments

John Nickolls "ultimately willed CUDA into existence" (twitter.com)

CUDA, Computer Graphics, Hardware, History, Technology

13 points by wmf 126 days ago | 3 comments

Initial CUDA Performance Lessons (probablydance.com)
I am somehow very late to learning CUDA. I didn’t even know until recently that CUDA is just C++ with a small amount of extra stuff. If I had known that there is so little friction to learning it, I would have checked it out much earlier. But if you come in with C++ habits, you’ll write suboptimal code, so here are some lessons I had to learn to get things to run fast.

CUDA, Programming, Performance, C++

164 points by ibobev 132 days ago | 43 comments

Zen, CUDA, and Tensor Cores – Part 1 [video] (youtube.com)

Zen, CUDA, Tensor Cores, Video, Programming

30 points by surprisetalk 169 days ago | 13 comments

Zen, CUDA, and Tensor Cores, Part I: The Silicon (computerenhance.com)

Zen, CUDA, Computer Architecture, AI

175 points by throwaway71271 170 days ago | 35 comments

Gemlite: Towards Building Custom Low-Bit Fused CUDA Kernels (mobiusml.github.io)

CUDA, Computer Graphics, Machine Learning, Software Development

47 points by un_ess 189 days ago | 2 comments

LibreCUDA – Launch CUDA code on Nvidia GPUs without the proprietary runtime (github.com/mikex86)