31–40 of 41 posts
Man I hate that AI writing tic. I appreciate the instincts for sharing the workflow. It's still very difficult to get AI to put an info dense description together though, we tend to get long and vague.
With media ingestion this is called "eager" processing. Historically for things like pulling thumbnails for images / video and pre-generating common sizes for things. This follows the same pattern and makes all the sense in the world. My only concern is that due to the non deterministic nature of LLMs new models will reveal new information about your data. For example you might identify a car in an image but the cont…
Earlier quoted context omitted.
What does Mermaid text description of an image mean? Descriptions of images that are charts or diagrams to start with?
Most diagrams I come across are basically boxes and arrows which are representable with mermaid flow charts without losing information. The layout of the mermaid will usually look differently, but that is not typically what matters. ChatGPT is quite good in creating mermaid flow charts from random box and arrow diagram images.
Earlier quoted context omitted.
For a RAG project for a client with a lot of PDFs and Powerpoints with images, I used ColPali a year ago. I see the provider ColiVara is still online but it seems to have fizzled out. Retrieving based on text and then giving the generation model the image instead is much smarter than retrieving based on image. Image-based retrieval is slow and expensive. Same with giving the model an image vs a structured representat…
> For a RAG project for a client with a lot of PDFs and Powerpoints with images, I used ColPali a year ago How was the accuracy compared to pre-parsing the image and doing search in the text?
But the experience was that it was able to find small details in PDFs, in technical diagrams, and this was really not captured well at all with OCR.
In general, OCR I think should be used more as an add-on to retrieve data, not given to the generation model itself. Similar to retrieving based off a text description and then giving the generation model the image.
Earlier quoted context omitted.
Most diagrams I come across are basically boxes and arrows which are representable with mermaid flow charts without losing information. The layout of the mermaid will usually look differently, but that is not typically what matters. ChatGPT is quite good in creating mermaid flow charts from random box and arrow diagram images.
Which cheap vision model would you recommend for ingesting category diagrams and producing mermaid facsimiles?
Seriously? - Marketing material? check - Bloated to the extreme? check - "Get a free trial" at the end? check - Entirely LLM generated? check