Live data from Hacker News

Launch HN: Context.dev (YC S26) – API to get structured data from any website

context.dev

1–10 of 102 posts

Launch HN: Context.dev (YC S26) – API to get structured data from any website

#1
Hi Hacker News, I’m Yahia. I built Context.dev (https://www.context.dev/) to make it really easy to integrate web data into your products and agents.

Here’s a demo video: https://www.tella.tv/video/build-faster-with-context-dev-api...

Since it’s an API, here are the docs: https://docs.context.dev/quickstart.

You can send us a URL and get back clean Markdown, rendered HTML, screenshots, extracted images, etc.. You can also send us a domain and get company or brand context: name, description, logos, colors, fonts, social links, screenshots, style information, and related metadata. For more custom use cases, you can send a URL plus a JSON Schema and ask us to extract structured data from the site into that shape. For example, you might ask for pricing plans, product categories, office locations, support links, integration partners, or anything else that is visible on the public site.

The goal is to give developers the output they actually want. Raw HTML is rarely the useful thing; the useful thing is usually Markdown for a model, JSON for an application, a logo for a UI, or a structured company profile for an agent.

Before, I worked at Amazon and Sunrun, and co-founded StockAlarm.io & essense.io, both of which were acquired. Also, I built knifegeek.io, which scraped pocket knives from across the internet and listed them easily. The project is outdated now (coming back soon) but back then it hit the frontpage of hacker news and people seemed to like it: https://news.ycombinator.com/item?id=34604281.

Just before Context.dev, I built Brand.dev. The idea was that your software product should automatically know about your customer if they sign up with a corporate email. The API pulled brand data such as logos, backdrops, name, description, industry, and more from the public web and surfaced it to your product to integrate as part of their onboarding experience. That’s worth doing because conversion rates on onboarding improve dramatically when you go from “enter all this info” to “confirm all this info” (and there was never any privacy concern all the information is public).

That was a nifty niche, but the more customers used it, it became obvious that “brand data” was only one slice of a larger need. People started asking for things like screenshots, structured extraction, and LLM ready data. So I expanded to Context.dev, and applied to YC (got rejected after an interview), then kept going and re-applied at which point I got in as a solo founder.

People use Context.dev in more ways than I can list, but here are some: keeping context up to date on customer websites for chatbots - building beautiful brand assets/ads for customers - enrichment flows using agent harnesses like eve.dev - crawling customer websites into chatbot knowledge bases - turning GitHub repos into branded docs sites - academic journal and PDF crawling. There are a ton more examples at https://www.context.dev/customers.

We know that many crawlers are not behaving like good citizens on the web, and the entire space has a bad reputation as a result. At the same time, customers are not usually trying to buy “scraping”. They are trying to make a support bot work, personalize onboarding, enrich CRM records, generate docs, monitor leads, or let an agent research a company. There are lots of legit use cases. We want to satisfy those while being respectful of everyone involved.

We maintain a caching layer and avoid hammering websites. Customers can configure the cache, but if we find we’re sending too many requests to a url in a certain amount of time, we step in and tone it down. Websites can opt out of our service, and we respect these requests and add them to our block list.

We focus on customers who want to build cool things for their users. Enriching onboarding is a popular use case. So is integrating context about their own websites (things like support bots), and building agents that can automatically reason about complex tasks involving the internet.

We only allow customers to use brand data to identify a specific customer on their software, you cannot use it in your own materials or to imply endorsement.

I'd love to hear your feedback about the product in the comments, thanks!

Launch HN: Context.dev (YC S26) – API to get structured data from any website
context.dev

Re: Launch HN: Context.dev (YC S26) – API to get structured data from any website

#4
post #3

Great, another thing I have to block server side. Reminds me of the image leech protections that had to be in place because bandwidth was expensive. History doesn’t repeat but rhymes as they say.

Maybe AI-service-blocklist-as-a-service could be a YC company.

Re: Launch HN: Context.dev (YC S26) – API to get structured data from any website

#7
post #4
post #3

Great, another thing I have to block server side. Reminds me of the image leech protections that had to be in place because bandwidth was expensive. History doesn’t repeat but rhymes as they say.

Maybe AI-service-blocklist-as-a-service could be a YC company.

Better business model would be some sort of micropayment setup - allow humans, but make scrapers pay a hundredth of a cent for access.

Re: Launch HN: Context.dev (YC S26) – API to get structured data from any website

#8
post #6

Unclear what difference exists against Firecrawl - their team has been shipping great features extremely quickly lately, and their core offerings have become really good. I am interested in KnifeGeek though - looking for a good OTF (ultratech?)

There's alot of overlap at the moment, but we're diverging quite quickly.

If you want differences as of right now

- 1 credit = 1 scrape, no hidden credit multiplier - we have world class brand data - we're focused primarily on the infra use-case, rather than gtm & everything else - anecdotally, customers have seen their error rates drop quite dramatically

In general it's a huge space, firecrawl is a wonderful company, it's fun to compete with them, planning to add more things soon which should make the differences clear

Re: Launch HN: Context.dev (YC S26) – API to get structured data from any website

#9
post #2

So basically web scraping as a service with an API on top?

yes but we do alot more that may not be clear at first glance, things like brand data, and for scraping handling pdf, ocr, docx, ppt, xlsx automatically

shipping a bunch of new things soon which should make it clearer, but as of today yeah

Re: Launch HN: Context.dev (YC S26) – API to get structured data from any website

#10
post #5

Seems wildly expensive, furthermore not a single mention of "ip" on homepage? Not using rotating ip's, residential proxies? AKA unusable for high value data.

you're welcome to try it on our demo page (no signup needed), should handle everything just fine, yes we don't mention ips on the homepage

also, while it might seem expensive, we're cheaper than every other option out there, because there's no hidden credit multipliers. every single customer who uses us halved their bill + error rate

Post reply on HN