Extracting financial disclosure and police reports with OpenAI Structured Output
1–10 of 93 posts
Re: Extracting financial disclosure and police reports with OpenAI Structured Output
#2Made a small project to help extract structure from documents (pdf,jpg,etc -> JSON or CSV): https://datasqueeze.ai/
There's 10 free pages to extract if anyone wants to give it a try. I've found that just sending a pdf to models doesn't extract it properly especially with longer documents. Have tried to incorporate all best practices into this tool. It's a pet project for now. Lmk if you find it helpful!
Re: Extracting financial disclosure and police reports with OpenAI Structured Output
#3Made a small project to help extract structure from documents (pdf,jpg,etc -> JSON or CSV): https://datasqueeze.ai/ There's 10 free pages to extract if anyone wants to give it a try. I've found that just sending a pdf to models doesn't extract it properly especially with longer documents. Have tried to incorporate all best practices into this tool. It's a pet project for now. Lmk if you find it helpful!
tried it works great, ty!
Re: Extracting financial disclosure and police reports with OpenAI Structured Output
#4Made a small project to help extract structure from documents (pdf,jpg,etc -> JSON or CSV): https://datasqueeze.ai/ There's 10 free pages to extract if anyone wants to give it a try. I've found that just sending a pdf to models doesn't extract it properly especially with longer documents. Have tried to incorporate all best practices into this tool. It's a pet project for now. Lmk if you find it helpful!
Similarly I've found old-school OCR is needed for more reliability.
Re: Extracting financial disclosure and police reports with OpenAI Structured Output
#5Made a small project to help extract structure from documents (pdf,jpg,etc -> JSON or CSV): https://datasqueeze.ai/ There's 10 free pages to extract if anyone wants to give it a try. I've found that just sending a pdf to models doesn't extract it properly especially with longer documents. Have tried to incorporate all best practices into this tool. It's a pet project for now. Lmk if you find it helpful!
[deleted]
Re: Extracting financial disclosure and police reports with OpenAI Structured Output
#6Cool work! Correct me if I'm wrong, but I believe to use the new OpenAI structured output that's more reliable, the response_format should be "json_schema" instead of "json_object". It's been a lot more robust for me.
Re: Extracting financial disclosure and police reports with OpenAI Structured Output
#7Made a small project to help extract structure from documents (pdf,jpg,etc -> JSON or CSV): https://datasqueeze.ai/ There's 10 free pages to extract if anyone wants to give it a try. I've found that just sending a pdf to models doesn't extract it properly especially with longer documents. Have tried to incorporate all best practices into this tool. It's a pet project for now. Lmk if you find it helpful!
Similarly I've found old-school OCR is needed for more reliability.
Combining google's ocr with llm gives OCR superpowers. Tell the llm the text is from an ocr and ask it to correct it.
Re: Extracting financial disclosure and police reports with OpenAI Structured Output
#8We used GPT 4o for more or less the same stuff. Got a boatload of scanned bills we had to digitize, and GPT really nailed the task. Made a schema, and just fed the model all the bills.
Worked better than any OCR we tried.
Re: Extracting financial disclosure and police reports with OpenAI Structured Output
#9> Note that this example simply passes a PNG screenshot of the PDF to OpenAI's API — results may be different/more efficient if you send it the actual PDF.
OpenAI's API only accepts images: https://platform.openai.com/docs/guides/vision
To my knowledge, all the LLM services that take in PDF input do their own text extraction of the PDF before feeding it to an LLM.
Re: Extracting financial disclosure and police reports with OpenAI Structured Output
#10I’m making a free open source library for this, check it at http://github.com/fetchfox/fetchfox
MIT license. It’s just one line of code to get started: ‘fox.run(“get data from example.com”)’