Hacker News with Generative AI: GPUs

Linux Introducing a Standardized Way of Informing User-Space over Hung GPUs (phoronix.com)
The upcoming Linux 6.15 kernel is set to finally introduce a standardized way of informing user-space of GPUs becoming hung or otherwise unresponsive.

Linux, Kernel Development, GPUs, Software, Operating Systems

10 points by mfiguiere 23 hours ago | 0 comments

We were wrong about GPUs (fly.io)
We’re building a public cloud, on hardware we own. We raised money to do that, and to place some bets; one of them: GPU-enabling our customers. A progress report: GPUs aren’t going anywhere, but: GPUs aren’t going anywhere.

Cloud Computing, Hardware, GPUs, Progress Reports

916 points by mxstbr 7 days ago | 574 comments

800x Speed Boost on Nvidia GPUs (scmp.com)
A high-performance algorithm that could solve complicated material design problems on consumer GPUs has been developed by Chinese researchers, achieving a groundbreaking 800-fold increase in speed over traditional methods.

Artificial Intelligence, Computer Science, Hardware, GPUs, Research

10 points by nthypes 20 days ago | 5 comments

How to Run DeepSeek R1 Distilled Reasoning Models on RyzenAI and Radeon GPUs (guru3d.com)

Deep Learning, Computer Hardware, GPUs, AI Models

82 points by waltercool 20 days ago | 22 comments

Exacluster with 144 Nvidia H200 AI GPUs detailed by its designer (tomshardware.com)

Hardware, Artificial Intelligence, Nvidia, GPUs

11 points by doener 21 days ago | 0 comments

Tiny Corp Nearing "Completely Sovereign" Compute Stack for AMD GPUs with Tinygr (phoronix.com)
George Hotz' Tiny Corp that develops the Tinygrad neural network framework and sells the Tinybox NVIDIA and AMD powered AI workstations is nearing a "completely sovereign" software stack for GPU compute on AMD.

AMD, GPUs, AI, Software, Hardware

7 points by todsacerdoti 36 days ago | 0 comments

If GPUs Are So Good, Why Do We Still Use CPUs at All? (codingstuff.substack.com)
There’s this old video from 2009 that’s been going viral on Twitter recently. Its supposed to give viewers an intuition of the difference between CPUs and GPUs.

GPUs, CPUs, Hardware, Performance, Computer Science

90 points by teddywahle 45 days ago | 69 comments

AMD 'Strix Halo' Ryzen AI Max+ Debuts with RDNA 3.5 Graphics and Zen 5 CPU Cores (tomshardware.com)

AMD, CPUs, GPUs, Hardware, Technology

83 points by kcb 46 days ago | 83 comments

Nvidia's Christmas Present: GB300 and B300 – Reasoning Inference, Amazon, Memory (semianalysis.com)
Merry Christmas has come thanks to Santa Huang. Despite Nvidia’s Blackwell GPU’s having multiple delays, discussed here, and numerous times through the Accelerator Model due to silicon, packaging, and backplane issues, that hasn’t stopped Nvidia from continuing their relentless march.

Nvidia, GPUs, Hardware, AI, Amazon

6 points by rbanffy 57 days ago | 0 comments

GPU Glossary (modal.com)
We wrote this glossary to solve a problem we ran into working with GPUs here at Modal : the documentation is fragmented, making it difficult to connect concepts at different levels of the stack, like Streaming Multiprocessor Architecture , Compute Capability , and nvcc compiler flags .

GPUs, Software, Documentation, Glossary

3 points by abhi9u 70 days ago | 0 comments

Ask HN: How Are AMD GPUs/ROCm for Machine Learning in 2024? (ycombinator.com)
Ask HN: How Are AMD GPUs/ROCm for Machine Learning in 2024?

Machine Learning, AMD, GPUs, Hardware, Ask HN

3 points by Decabytes 71 days ago | 0 comments

How AMD Is Taking Standard C/C++ Code to Run Directly on GPUs (phoronix.com)
Back at the 2024 LLVM Developers' Meeting was an interesting presentation by AMD engineer Joseph Huber for how they have been exploring running common, standard C/C++ code directly on GPUs without having to be adapted for any GPU language / programming dialects or other adaptations.

AMD, GPUs, C/C++, Programming, Hardware

26 points by peutetre 72 days ago | 3 comments

Maxsun makes a GPU with two built-in M.2 SSD ports (tomshardware.com)

Hardware, SSD, GPUs, Storage, Technology

9 points by LorenDB 76 days ago | 0 comments

GPU Accelerated Object Storage (acceleratedcloudstorage.com)
GPU-Optimized Cloud Object Storage for Real-Time Data Access

Cloud Storage, GPUs, Real-time Data

17 points by NKdeveloper 98 days ago | 7 comments

AMD Developing Next-Gen Fortran Compiler Based on Flang, Optimized for AMD GPUs (phoronix.com)
AMD today went public with details on the "AMD Next-Gen Fortran Compiler" as a new Fortran compiler they are working on based on LLVM's Flang.

AMD, Fortran, Compilers, GPUs, LLVM

5 points by sandwichsphinx 100 days ago | 0 comments

CUDA Programming Course – High-Performance Computing with GPUs [video] (youtube.com)

CUDA, Programming, High-Performance Computing, GPUs, Video

26 points by yarapavan 101 days ago | 1 comments

Fujitsu, AMD Plan to Pair Monaka CPUs with Instinct GPUs (theregister.com)
Fujitsu and AMD announced plans on Friday to develop a new, more energy-efficient AI and HPC compute platform that will pair the Japanese tech vendor's next-gen CPUs with the House of Zen's Instinct accelerators.

AI, CPUs, GPUs, Hardware, Partnerships

5 points by rbanffy 110 days ago | 0 comments

Security flaws found in Nvidia GeForce GPUs (pcworld.com)
Graphics card manufacturer Nvidia is currently issuing a warning to all owners of GeForce GPUs. According to an Nvidia security bulletin, several security vulnerabilities requiring urgent attention have been discovered in the company’s own display drivers and other software.

Security, Hardware, Nvidia, GPUs, Software

216 points by wumeow 111 days ago | 148 comments

RISC-V SiFive P550 CPU Demoed with AMD Radeon RX 7900 XTX GPU in Debian Linux (tomshardware.com)

RISC-V, CPUs, GPUs, Linux, Hardware

14 points by jrepinc 114 days ago | 1 comments

Beelink Open-Sourced Multi-Functional GPU Ex Docking Station for Mini PCs (gamingonlinux.com)
Hardware vendor Beelink have "open-sourced" their Multi-Functional EX Docking Station that you can use to extend their GTi Ultra Series mini PCs with a full GPU.

Hardware, Open Source, Mini PCs, GPUs, Docking Stations

8 points by retro_guy 114 days ago | 6 comments

Ask HN: What is the cheapest ($/hour) H100 renting service with quick spin-up? (ycombinator.com)
Something that can be programmatically spun up and turned off in seconds would be ideal.

Cloud Computing, GPUs, Pricing, Programming

10 points by dtquad 117 days ago | 4 comments

Nvidia's Blackwell GPUs are sold out for the next 12 months (tomshardware.com)

Nvidia, GPUs, Hardware, Availability

3 points by doener 132 days ago | 1 comments

Benchmarking Llama 3.1 405B on 8x AMD MI300X GPUs (dstack.ai)
At dstack, we've been adding support for AMD GPUs with SSH fleets, so we saw this as a great chance to test our integration by benchmarking AMD GPUs. Our friends at Hot Aisle, who build top-tier bare metal compute for AMD GPUs, kindly provided the hardware for the benchmark.

Benchmarking, Hardware, GPUs

11 points by latchkey 135 days ago | 3 comments

Lunar Lake's iGPU: Debut of Intel's Xe2 Architecture (chipsandcheese.com)
Intel has a long history of making integrated GPUs, and they’ve recognized how important iGPUs are to thin and light laptops.

Intel, GPUs, Laptops, Architecture, Hardware

131 points by mfiguiere 136 days ago | 63 comments

Our container platform is in production. It has GPUs. Here's an early look (cloudflare.com)
We’ve been working on something new — a platform for running containers across Cloudflare’s network. We already use it in production for Workers AI, Workers Builds, Remote Browsing Isolation, and the Browser Rendering API. Today, we want to share an early look at how it’s built, why we built it, and how we use it ourselves.

Cloud Computing, Containerization, GPUs, Networking, Early Access

199 points by jgrahamc 147 days ago | 74 comments

We are self-hosting our GPUs (gumlet.com)
We decided to move off the cloud and host our GPUs. Here is the story of why and how we did it.

Cloud Computing, GPUs, Hosting

67 points by adityapatadia 157 days ago | 59 comments

AMD deprioritizing flagship gaming GPUs: Jack Hyunh on New Strategy vs. Nvidia (tomshardware.com)
AMD's plans for high-end GPUs with its upcoming Radeon RX 8000-series have been cast into doubt by several hardware leakers who assert that AMD has canceled its upper-tier RX 8000 cards. However, the company hasn't officially commented on the matter before.

AMD, GPUs, Hardware, Gaming, Strategy

22 points by pella 166 days ago | 16 comments

PyTorch 2.4 Now Supports Intel GPUs for Faster Workloads (pytorch.org)

PyTorch, Machine Learning, Deep Learning, GPUs, Intel

19 points by soulbadguy 174 days ago | 2 comments

Run Stable Diffusion 10x Faster on AMD GPUs (stablediffusiontutorials.com)

Stable Diffusion, AMD, GPUs, Machine Learning, Performance

45 points by lastdong 174 days ago | 1 comments

Copper's reach is shrinking so Broadcom is strapping optics directly to GPUs (theregister.com)

Hardware, Semiconductor Industry, Networking, GPUs

7 points by LorenDB 178 days ago | 0 comments