Hacker News with Generative AI: Edge Computing

NVIDIA Releases Jetson Orin Nano Super (nvidia.com)
The NVIDIA Jetson Orin Nano™ Super Developer Kit is a compact, yet powerful computer that redefines generative AI for small edge devices.

NVIDIA, Hardware, Generative AI, Edge Computing

5 points by Kylejeong21 31 days ago | 5 comments

Nvidia Jetson Orin Nano Super: The most affordable generative AI supercomputer (nvidia.com)
The NVIDIA Jetson Orin Nano™ Super Developer Kit is a compact, yet powerful computer that redefines generative AI for small edge devices.

Generative AI, Hardware, Edge Computing, AI, NVIDIA

16 points by centum 32 days ago | 4 comments

Omnivision-968M: Vision Language Model with 9x Tokens Reduction for Edge Devices (nexa.ai)

Computer Vision, Edge Computing, AI Models, Tokenization

69 points by BUFU 64 days ago | 12 comments

Transistor for fuzzy logic hardware: promise for better edge computing (techxplore.com)
Edge computing devices, devices located in proximity to the source of data instead of in large data centers, could perform computations locally. This could reduce latency, particularly in real-time applications, as it would minimize the need to transfer data from the cloud.

Edge Computing, Hardware, Fuzzy Logic

37 points by wglb 67 days ago | 5 comments

Edge Scripting: Build and run applications at the edge (bunny.net)
Lightning-fast global CDN

Edge Computing, Cloud Computing, Web Development, CDN

111 points by gnabgib 72 days ago | 86 comments

GDDR7 Memory Supercharges AI Inference (semiengineering.com)
High bandwidth and low latency are paramount for AI-powered edge and endpoints.

AI, Hardware, Memory, Inference, Edge Computing

68 points by PaulHoule 82 days ago | 34 comments

How the new Raspberry Pi AI Hat supercharges LLMs at the edge (novusteck.com)
The Raspberry Pi AI HAT+ introduces two performance options: a 13 TOPS model for $70 and a 26 TOPS model for $110, both featuring Hailo AI accelerators for high-performance machine learning tasks.

Artificial Intelligence, Hardware, Raspberry Pi, Machine Learning, Edge Computing

9 points by novusteck 85 days ago | 10 comments

Un Ministral, Des Ministraux (mistral.ai)
Introducing the world’s best edge models.

Artificial Intelligence, Edge Computing

216 points by veggieroll 94 days ago | 99 comments

Starbase: SQLite on the Edge (starbasedb.com)
Plug & Play SQLite

Databases, SQLite, Edge Computing

169 points by hunvreus 105 days ago | 47 comments

Serving 70B-scale LLMs efficiently on low-resource edge devices [pdf] (arxiv.org)
Large model inference is shifting from cloud to edge due to concerns about the privacy of user interaction data.

Edge Computing, Privacy, Efficiency

248 points by simonpure 107 days ago | 58 comments

Llama 3.2: Lightweight models for edge devices (twitter.com)

AI, Edge Computing, New Releases

8 points by tosh 115 days ago | 0 comments

Edge Image Builder (suse.com)
Working at the edge introduces a number of complications not seen in a traditional data center.

Edge Computing, Cloud Computing, Software, Infrastructure

20 points by meysamazad 130 days ago | 5 comments

Show HN: Nexa SDK – Build powerful and efficient AI apps on edge devices (github.com/NexaAI)

Software, Artificial Intelligence, Edge Computing

27 points by frednoodle 132 days ago | 4 comments

Show HN: We built a knowledge hub for running LLMs on edge devices (github.com/NexaAI)