Hacker News with Generative AI: AI Infrastructure

Orchestrating GPUs in data centers and private clouds (dstack.ai)
Recent breakthroughs in open-source AI have made AI infrastructure accessible beyond public clouds, driving demand for running AI workloads in on-premises data centers and private clouds. This shift offers organizations both high-performant clusters and flexibility and control.
AI Infrastructure, Data Centers, Private Clouds, Open Source
21 points by latchkey 3 days ago | 4 comments
Max GPU: A new GenAI native serving stac (modular.com)
Three years ago we set out to redefine how AI is developed and deployed. Our goal wasn’t simply to improve existing systems, but to rebuild AI infrastructure from the ground up to deliver a more performant, programmable, and portable infrastructure platform. We recognized that to address today’s challenges and stay ahead of rapid technological evolution, we needed to completely rethink the AI stack from first principles.
Generative AI, Cloud Computing, AI Infrastructure
40 points by ivell 66 days ago | 5 comments
Show HN: TrustGraph – Do More with AI with Less (Open Source AI Infrastructure) (github.com/trustgraph-ai)
TrustGraph deploys a full E2E (end-to-end) AI solution with native GraphRAG in minutes. Autonomous Knowledge Agents build ultra-dense knowlege graphs to fully capture all knowledge context. TrustGraph is designed for maximum flexibility and modularity whether it's calling Cloud LLMs or deploying SLMs On-Device. TrustGraph ingests data to build a RDF style knowledge graph to enable accurate and private RAG responses using only the knowledge you want, when you want.
Artificial Intelligence, Open Source, Knowledge Graphs, AI Infrastructure
22 points by cybermaggedon 137 days ago | 5 comments