I have experimented with Kor several times, cool idea.
Kor: a half-baked prototype that "helps" you extract structured data using LLMs
11–17 of 17 posts
Re: Kor: a half-baked prototype that "helps" you extract structured data using LLMs
#12Does this take advantage of the new OpenAI functions api? From a quick look, I can't find any indication that it does. Although I find it tricky to disentangle the langchain abstractions, so I might be missing it. Kor's last release predates the announcement of OpenAI functions, so probably not. Seems like this is now best done via functions, if you're using OpenAI's models? They call out "extracting structured data…
No, it is not using openai functions. Since it is on top of langchain it uses the LLM abstraction of it and it can be used with other models as well.
Yup, the flexibility of running against any model via langchain is super helpful.
Re: Kor: a half-baked prototype that "helps" you extract structured data using LLMs
#13Earlier quoted context omitted.
No, it is not using openai functions. Since it is on top of langchain it uses the LLM abstraction of it and it can be used with other models as well.
Yup, the flexibility of running against any model via langchain is super helpful.
Are there any useful alternative models though? Most I've found weren't particularly good at following instructions or using tools in the way langchain provides them.
Re: Kor: a half-baked prototype that "helps" you extract structured data using LLMs
#14Earlier quoted context omitted.
No, it is not using openai functions. Since it is on top of langchain it uses the LLM abstraction of it and it can be used with other models as well.
Yup, the flexibility of running against any model via langchain is super helpful.
FYI, the upcoming version of gpt4 does considerably worse emulating function calls / generating code-like strings, but gets better again if you switch to the function call API: https://twitter.com/reissbaker/status/1671361372092010497
(My guess is the same is true of gpt-3.5, although I haven't tested it.)
That being said, Langchain has a nearly drop-in replacement if you want to start using the function call API: https://python.langchain.com/docs/modules/agents/agent_types...
Re: Kor: a half-baked prototype that "helps" you extract structured data using LLMs
#15Neat, I was just looking for something like this today, I think I'll give it a spin. Does anybody here have experience with metadata extraction using LLMs? I've been thinking about it recently. and wonder if just making a big prompt and putting that into OpenGPT or even ChatGPT is really the way to go, or if there is a "cleverer" way. Maybe you could train specifically for certain fields, or use the LLM in a differen…
We're using LLMs to generate web scrapers and data processing steps on the fly that adapt to website changes. Using an LLM for every data extraction, as most comparable tools do, is expensive and slow, but using LLMs to generate the scraper code and subsequently adapt it to website modifications is highly efficient.
Try it out https://kadoa.com
Re: Kor: a half-baked prototype that "helps" you extract structured data using LLMs
#16Neat, I was just looking for something like this today, I think I'll give it a spin. Does anybody here have experience with metadata extraction using LLMs? I've been thinking about it recently. and wonder if just making a big prompt and putting that into OpenGPT or even ChatGPT is really the way to go, or if there is a "cleverer" way. Maybe you could train specifically for certain fields, or use the LLM in a differen…
We're using LLMs to generate web scrapers and data processing steps on the fly that adapt to website changes. Using an LLM for every data extraction, as most comparable tools do, is expensive and slow, but using LLMs to generate the scraper code and subsequently adapt it to website modifications is highly efficient. Try it out https://kadoa.com
That is a very thought provoking use case and optimization for LLMs, thanks for sharing.
Re: Kor: a half-baked prototype that "helps" you extract structured data using LLMs
#17[deleted]