Hacker News with Generative AI: Data Extraction

Nvidia-Ingest: Multi-modal data extraction (github.com/NVIDIA)
NVIDIA-Ingest is a scalable, performance-oriented document content and metadata extraction microservice. Including support for parsing PDFs, Word and PowerPoint documents, it uses specialized NVIDIA NIM microservices to find, contextualize, and extract text, tables, charts and images for use in downstream generative applications.

Data Extraction, Microservices, Generative AI, PDFs, NVIDIA

145 points by mihaid150 8 days ago | 45 comments

Liberate tabular data from scanned documents (blog.wzb.eu)
During the last months I often had to deal with the problem of extracting tabular data from scanned documents.

Data Extraction, OCR, Document Processing

6 points by leonry 30 days ago | 0 comments

Gemini Flash 2.0 Experimental: A bit more accurate, but slower (ycombinator.com)
I just updated my data extraction leaderboard with Gemini Flash 2.0 Experimental. It is quite a bit slower with large input token sizes right now, but a bit more accurate than Gemini 1.5 Flash which is at the top right now.

AI, Data Extraction, Benchmarking

3 points by peytoncasper 37 days ago | 1 comments

Show HN: Documind – Open-source AI tool to turn documents into structured data (github.com/DocumindHQ)

Open-source, AI, Data Extraction, Document Processing, Software

169 points by Tammilore 61 days ago | 64 comments

Show HN: Get any domain's brand data via API (brand.dev)
Get logos, primary colors, descriptions, classifications, and more from any domain with a single api call.

API, Brand Data, Domain Information, Web Development, Data Extraction

32 points by ICodeSometimes 63 days ago | 33 comments

Scaling Document Data Extraction with LLMs and Vector Databases (timescale.com)
Extracting structured data from unstructured documents is a powerful use case for large language models (LLMs). This sort of data extraction from complex documents has always remained a challenge. Done either completely manually or using current intelligent document processing (IDP) platforms that utilize previous-generation machine learning or natural language processing (NLP) techniques is very time-consuming and tedious.

Data Extraction, Vector Databases

12 points by avthar 64 days ago | 2 comments

Maxun: Open-Source No-Code Web Data Extraction Platform (github.com/getmaxun)
Maxun lets you train a robot in 2 minutes and scrape the web on auto-pilot. Web data extraction doesn't get easier than this!

Open Source, Web Scraping, Data Extraction, Automation

58 points by thunderbong 70 days ago | 8 comments

Show HN: Tile.run – Extract structured data from any document via API (tile.run)
tile.run is the simplest way to extract data from any document with best in class accuracy.

API, Data Extraction, Software, Web Development

11 points by ntkris 72 days ago | 6 comments

Launch HN: Midship (YC S24) – Turn PDFs, docs, and images into usable data (ycombinator.com)
Hey HN, we are Max, Kieran, and Aahel from Midship (https://midship.ai). Midship makes it easy to extract data from unstructured documents like pdfs and images.

YC Startups, Data Extraction, Document Processing, AI, Software

121 points by maxmaio 73 days ago | 61 comments

Video scraping: extracting JSON from a 35s screen capture for 1/10th of a cent (simonwillison.net)
The other day I found myself needing to add up some numeric values that were scattered across twelve different emails.

Web Scraping, Data Extraction, Automation, Cost Optimization, Efficiency

309 points by simonw 93 days ago | 46 comments

Extracting financial disclosure and police reports with OpenAI Structured Output (github.com)
Instantly share code, notes, and snippets.

OpenAI, Finance, Law Enforcement, Data Extraction

254 points by danso 99 days ago | 89 comments

Show HN: Pipet – CLI tool for scraping and extracting data online, with pipes (github.com/bjesus)
Pipet is a command line based web scraper. It supports 3 modes of operation - HTML parsing, JSON parsing, and client-side JavaScript evaluation. It relies heavily on existing tools like curl, and it uses unix pipes for extending its built-in capabilities.

Command Line, Web Scraping, Tools, Programming, Data Extraction

49 points by yoavm 110 days ago | 7 comments

Table Extraction Using LLMs (nanonets.com)
Picture this - you’re drowning in a sea of PDFs, spreadsheets, and scanned documents, searching for that one piece of data trapped somewhere in a complex table.

Machine Learning, Data Extraction, Tables

18 points by StarrySkies11 117 days ago | 1 comments

Bitten by Unicode (pyatl.dev)
One product of mine takes reports that come in as a table that’s been exported to PDF, which means text extraction. For dollar figures I find a prefixed dollar symbol and convert the number following it into a `float`. If there’s a hyphen in addition to the dollar symbol, it’s negative.

Python, Programming, Text Processing, Data Extraction

130 points by pryelluw 131 days ago | 129 comments

Show HN: Painless Data Extraction and Web Automation (agentql.com)

Web Automation, Data Extraction, Tools

11 points by shuhao_tf 151 days ago | 1 comments

DocuPanda – convert any PDF/image to a schema-driven, structured JSONs (docupanda.com)

Data Extraction, JSON, PDF Conversion

16 points by uri_merhav 162 days ago | 4 comments

How to crawl big websites with no sitemap? (ycombinator.com)

Web Scraping, Data Extraction, Website Crawling

9 points by mateozaratefw 199 days ago | 9 comments

NuExtract: A LLM for Structured Extraction (huggingface.co)