Viewing profile — KhoomeiK

NVIDIA did something similar with GANs in 2020 [1], except users could actually play those games (unlike in this diffusion work which just plays back simulated video). Sentdex late…

Everything relevant in "program synthesis" moved to the new buzzword "codegen"

Interesting—LangChain seemed kinda like unnecessary abstractions in natural language (since everything is just string manipulations), but with AI video, there's so many different a…

Just unrolled the thread for you here! https://threadreaderapp.com/thread/1794082465398812770.html

Thanks! I have no idea—unfortunately, very few Hindus maintain the Vedic fire rites. There are also no active central authorities on matters of Vedic ritual. The only plan of now i…

Vedic Hinduism had a similar concept of eternal fire. I recently wrote up a twitter thread [1] explaining how the modern interpretation of Vedic instructions on starting these sacr…

Hey HN! Chinchilla (DeepMind 2022) tells us that when we scale up our language model training, we should scale the parameters and data equally. Over the last several months I've be…

Maybe this project another commenter is working on? https://news.ycombinator.com/item?id=40373310

Awesome pics! We love tarsiers too

Great question! See this thread: https://news.ycombinator.com/item?id=40369713

Yes it does work headless and we do grab a fullpage screenshot including scrolling (by resizing viewport to content height). We haven’t had to deal with infinite scrolling much but…

They do show textboxes with labels. From our readme: "Keep in mind that Tarsier tags different types of elements differently to help your LLM identify what actions are performable …

We have a lot more powerful use-cases for Tarsier in web data extraction at the moment. Stay tuned for a broader launch soon!

We run OCR on the screenshot & convert it to whitespace-structured text, that is passed to the LLM. The images below might make it clearer for you: [1] https://github.com/reworkd/t…

Yup, it could! There are a lot of players in the generalist personal web agent space but I personally think that use-case will be eaten by big players since fundamental foundation …

VimGPT couples the perception to a specific LLM/agent whereas Tarsier is solely a perception system that you can use for any uni/multi-modal web agent. So it's hard to compare, but…

We're hoping to release an evals paper about Bananalyzer this summer and compare Tarsier to a variety of other perception systems in it. The hard part with evaluating a perception/…

More OCR providers are on the roadmap and we'd love for you to contribute any local OCR models you think could be useful! I wouldn't call it a wrapper though :)

Thanks! We might put out a paper about it with some Carnegie Mellon collaborators this summer.