Live data from Hacker News

Show HN: Sosumi.ai – Convert Apple Developer docs to AI-readable Markdown

sosumi.ai

61–70 of 74 posts

Re: Show HN: Sosumi.ai – Convert Apple Developer docs to AI-readable Markdown

#63

Just wondering - can't AI read HTML? If so how are we training our models?

The AI only sees a bit of HTML plus a bunch of JS that, when executed, generates more HTML. If the AI does not run the JS it won’t see everything. During training they probably use a crawler that runs a headless browser behind the scenes to get everything a human would get.

So... The answer is to use during the real-time access the same headless browser as they used during the training? Which they already do, unless you ask specifically to write and run a python script that uses simple requests?

It is like generating static webpages just for SEO: obsolete since 2012[1], and few years later for other major websites.

[1] https://www.i-programmer.info/news/81-web-general/4248-googl...

Re: Show HN: Sosumi.ai – Convert Apple Developer docs to AI-readable Markdown

#64

"AI-readable Markdown" — can't we just say "Markdown"? I'm serious about this, why are we focussing on making things accessible to AI when they should just be machine-readable and accessible to human beings in the first place? No need to taint this by bringing AI into it.

> why are we focussing on making things accessible to AI Because that’s the authors actual goal? To take a web page that looks fine to human eyes but is unintuitively not accessible to AI. That’s genuinely useful and valuable. Sure it’s no different than converting it to markdown for human eyes. But it’s important to be clear about not just WHAT but also WHY. C’mon now. This isn’t controversial or even bad.

Makes one wonder what apple’s actual goal is

Re: Show HN: Sosumi.ai – Convert Apple Developer docs to AI-readable Markdown

#65
Nice! Do you think it could be adapted to other docs sites?

I made a small clone of the tutorials section (https://clone-swiftui-tutorial.vercel.app/) where the content is already Markdown (and use codehike to turn the markdown into a rich UI). This made me realize that codehike is AI-friendly, in the sense that even for non-linear UIs the original content is still AI-readable Markdown.

Re: Show HN: Sosumi.ai – Convert Apple Developer docs to AI-readable Markdown

#67
post #26

This is awesome and timely for me...going to give it a whirl. Thanks for building. Also, there should totally be an easter egg where clicking something somewhere plays the sound!

Great idea! I just added that. Try clicking the icon in the header.

Ha, amazing and so nostalgic

Re: Show HN: Sosumi.ai – Convert Apple Developer docs to AI-readable Markdown

#68

How to reliably HTML to MD for any page on the internet? I remember struggling with this in the past How hard would it be to build an MCP that's basically a proxy for web search except it always tries to build the markdown version of the web pages instead of passing HTML? Basically Sosumi.ai but instead of working on only for Apple docs it works for any web page (including every doc on the internet)

I think HTML -> Markdown is a bit of a red herring.

In many cases, a Markdown distillation of HTML can improve the signal-to-noise ratio — especially for sites mired in tag soup (intentionally or not). But that's an optimization for token efficiency; LLMs can usually figure things out.

The motivation behind Sosumi is better understood as a matter of accessibility. The way AI assistants typically fetch content from the web precluded them from getting any useful information from developer.apple.com.

You could start to solve the generalized problem with an MCP that 1) used a headless browser to access content for sites that require JS, and 2) used sampling (i.e. having a tool use the host LLM) to summarize / distill HTML.

Re: Show HN: Sosumi.ai – Convert Apple Developer docs to AI-readable Markdown

#69

Is it possible to download an archive of the data so I can run searches against it locally (without AI)?

Hi Saagar! One could indeed use this method to export this information en-masse, however that would require the kind of automated access that the site ToS explicitly forbids.

For the Swift standard library and other open-source frameworks, you could probably extract this from documentation comments using DocC, Jazzy, or the like.

Re: Show HN: Sosumi.ai – Convert Apple Developer docs to AI-readable Markdown

#70

Just saying, sites like these are also pretty great for accessibility, screen reader users in particular. I think this one would be slightly better if it rendered that Markdown as simple HTML if accessed through a real browser, but I can imagine even this version being pretty useful. I think it could also make the "Small web" crowd pretty happy too.

Amen to that. It's funny how virtues like accessibility and good API design matter just as much as ever in this new era. Good ideas don't go out of style.
Post reply on HN