Live data from Hacker News

ETL Texts

github.com

1–3 of 3 posts

Re: ETL Texts

#2
If it can be useful to anyone, I share below some code that I started to set up to build a process that allows me to extract, clean and translate texts from files

The repo comprises services for text processing and use cases for specific analyses:

Text Extraction: Extracts text from various documents.

Text Translation: Provides optional multilingual translation.

Text Cleaning: Cleans and standardizes text for analysis.

Information Extraction: Uses GPT-3.5 to extract information from texts, saving it in JSON format.