Hacker News with Generative AI: Parallel Computing

Visualizing 6D Mesh Parallelism (main-horse.github.io)
This is a companion longpost for a fun project I’ve yet to finish. In here, I show the reader how I personally visualize the collective communications involved in a simple 2⁶ 6D parallel mesh:

Visualization, Parallel Computing, 6D Mesh, Computer Graphics

59 points by lnyan 32 days ago | 3 comments

Programming Language Memory Models (2021) (swtch.com)
Programming language memory models answer the question of what behaviors parallel programs can rely on to share memory between their threads.

Programming Languages, Memory Management, Parallel Computing

140 points by fanf2 37 days ago | 29 comments

Amdahl's Law (wikipedia.org)
In computer architecture, Amdahl's law (or Amdahl's argument[1]) is a formula that shows how much faster a task can be completed when you add more resources to the system.

Computer Architecture, Performance Optimization, Parallel Computing

35 points by redbell 56 days ago | 4 comments

Show HN: Chili. Rust port of Spice, a low-overhead parallelization library (github.com/dragostis)
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.

Programming, Rust, Libraries, Open Source, Parallel Computing

233 points by dragostis 121 days ago | 42 comments

Richard Feynman and the Connection Machine (1989) (longnow.org)
One day when I was having lunch with Richard Feynman, I mentioned to him that I was planning to start a company to build a parallel computer with a million processors. His reaction was unequivocal, "That is positively the dopiest idea I ever heard."

Richard Feynman, Parallel Computing, History

177 points by jmstfv 133 days ago | 49 comments

I want a good parallel computer [video] (youtube.com)

Parallel Computing, Video, Hardware

15 points by raphlinus 172 days ago | 0 comments

Parallel Nix Evaluation (determinate.systems)

Parallel Computing, Nix, System Administration, Software Development

7 points by tripdout 203 days ago | 0 comments

Welcome to the Parallel Future of Computation (higherorderco.com)

Parallel Computing, Technology

168 points by Epholys 246 days ago | 6 comments

Bend: A Parallel Language (pages.dev)

Programming, Languages, Parallel Computing

11 points by fofoz 246 days ago | 1 comments

Bend: A Python-Like Parallel Language for GPUs and Multicore CPUs (higherorderco.com)

Programming, Parallel Computing, GPUs, CPUs, Python

12 points by davikr 247 days ago | 1 comments

Consistency LLM: converting LLMs to parallel decoders accelerates inference 3.5x (hao-ai-lab.github.io)