Live data from Hacker News

Show HN: Crul – Query Any Webpage or API

crul.com

61–70 of 81 posts

Re: Show HN: Crul – Query Any Webpage or API

#61

I was able to sign-up successfully. But the download file is not set to public access (or something like that) on your S3. Screenshot: https://www.dropbox.com/s/i254xxbdenmqde1/screenshot%202023-...

Thanks for the heads up. Could you share what browser you are using? And are you downloading from https://www.crul.com/account?

Re: Show HN: Crul – Query Any Webpage or API

#62
post #36

Earlier quoted context omitted.

> although currently an enterprise feature. Wait, so we literally can't go faster than 1 req/s unless we pay? I have to say I'm pretty disappointed :/

If you attach to the running docker container, these defaults appear to be defined in /crul/dist/crul-docker/packages/startup/.env Don't spam APIs. That said, if you're determined to do so, there's not much this or any other tool can do to stop you from trying.

Yeah exactly. Living up to your username :) nice find! Note this is a global default, unlike domain policies which are associated with a domain.

Re: Show HN: Crul – Query Any Webpage or API

#63

I was able to sign-up successfully. But the download file is not set to public access (or something like that) on your S3. Screenshot: https://www.dropbox.com/s/i254xxbdenmqde1/screenshot%202023-...

Thanks for the heads up. Could you share what browser you are using? And are you downloading from https://www.crul.com/account ?

Yes, trying to download from inside the Crul account after I successfully signed in. I'm using Safari 16.3 on macOS 13.2.1.

Re: Show HN: Crul – Query Any Webpage or API

#64
post #57

Can it get text of a web page given just URL, like how pocket app saves the text or the link.

You would need to do a bit filtering to get the exact text you need. For example, to get the text for this post you could run: open https://news.ycombinator.com/item?id=34970917 || filter "(attributes.class == 'toptext')" || table innerText

This requires me to know the HTML structure in advance. I want to do it on any page. Mozilla has readability JS which does it, wanted to know if this tool has the same feature. BTW it's a great tool.

Re: Show HN: Crul – Query Any Webpage or API

#65

Earlier quoted context omitted.

Thanks for the heads up. Could you share what browser you are using? And are you downloading from https://www.crul.com/account ?

Yes, trying to download from inside the Crul account after I successfully signed in. I'm using Safari 16.3 on macOS 13.2.1.

I'm having trouble replicating. Although I did get a prompt from Safari to allow downloads from crul.com. The screenshot looks like it is redirecting from the button, is that what you are seeing - rather than the button triggering a download?

Re: Show HN: Crul – Query Any Webpage or API

#66
post #12

Ah, I see it's pronounced more like "Krull" than "cruel".

lol - yeah. https://www.imdb.com/title/tt0085811/?ref_=tt_urv We've been thinking of ways to make the pronunciation a bit clearer, maybe a mascot or something. Open to ideas!

Could use a cruller as a logo.

Re: Show HN: Crul – Query Any Webpage or API

#67
post #64

Earlier quoted context omitted.

You would need to do a bit filtering to get the exact text you need. For example, to get the text for this post you could run: open https://news.ycombinator.com/item?id=34970917 || filter "(attributes.class == 'toptext')" || table innerText

This requires me to know the HTML structure in advance. I want to do it on any page. Mozilla has readability JS which does it, wanted to know if this tool has the same feature. BTW it's a great tool.

Thank you! The query below would get you the full page text, although it likely wont be too legible. I'll read up on readability JS some, it looks quite magic and could possibly be added in.

open https://news.ycombinator.com/item?id=34970917 || filter "(nodeName == 'BODY')" || table innerText

Often you can use crul to discover the html structure in the results table. With a `find "text string"` to filter rows and then a filter on the column values that identify the desired elements.

Re: Show HN: Crul – Query Any Webpage or API

#69
This looks very cool. Congrats on the launch!

Have you thought about open sourcing it? I realize you want to sustain a business, but an open core model with commercial features would allow you to do that. A free tool like this would be a welcome addition to the ecosystem, most of which is FOSS already, and would help build a community around your product.

Post reply on HN