Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

TextAnalysisTool.NET

textanalysistool.github.io

Post reply on HN
Print view View original

1–10 of 45 posts

Re: TextAnalysisTool.NET

#2

Post by internetter »

Marginally related, but this is one of the things I'm bullish on ChatGPT for. Too frequently, I've gotten hundreds of lines of malformed textual data that I need to standardize. This is like impossible with REGEX but I can drop it into GPT and it does this wonderfully.

Re: TextAnalysisTool.NET

#3

Post by Liftyee »

internetter wrote: post #2

Marginally related, but this is one of the things I'm bullish on ChatGPT for. Too frequently, I've gotten hundreds of lines of malformed textual data that I need to standardize. This is like impossible with REGEX but I can drop it into GPT and it does this wonderfully.

Agreed. It works especially well for formatting where semantics matter, such as separating the term and definitions of flashcards. Hard to do with code, but easy with GPT.

Re: TextAnalysisTool.NET

#4

Post by BurnerBotje »

internetter wrote: post #2

Marginally related, but this is one of the things I'm bullish on ChatGPT for. Too frequently, I've gotten hundreds of lines of malformed textual data that I need to standardize. This is like impossible with REGEX but I can drop it into GPT and it does this wonderfully.

There is however no indication if it failed on a line when using ChatGPT, it could provide you with a slightly incorrect result.

Re: TextAnalysisTool.NET

#5

Post by internetter »

BurnerBotje wrote: post #4
internetter wrote: post #2

Marginally related, but this is one of the things I'm bullish on ChatGPT for. Too frequently, I've gotten hundreds of lines of malformed textual data that I need to standardize. This is like impossible with REGEX but I can drop it into GPT and it does this wonderfully.

There is however no indication if it failed on a line when using ChatGPT, it could provide you with a slightly incorrect result.

Yeah that's always been a fear but I always dog food and I've had no issues yet

Re: TextAnalysisTool.NET

#6

Post by ukuina »

BurnerBotje wrote: post #4
internetter wrote: post #2

Marginally related, but this is one of the things I'm bullish on ChatGPT for. Too frequently, I've gotten hundreds of lines of malformed textual data that I need to standardize. This is like impossible with REGEX but I can drop it into GPT and it does this wonderfully.

There is however no indication if it failed on a line when using ChatGPT, it could provide you with a slightly incorrect result.

You could run it through thrice with a different prompt/temperature/model and pick the majority result (or exit with success on the first two passing runs).

Re: TextAnalysisTool.NET

#9

Post by akoboldfrying »

ukuina wrote: post #6
BurnerBotje wrote: post #4

Earlier quoted context omitted.

There is however no indication if it failed on a line when using ChatGPT, it could provide you with a slightly incorrect result.

You could run it through thrice with a different prompt/temperature/model and pick the majority result (or exit with success on the first two passing runs).

Good idea. If the data is a list of records where the order isn't important, randomly permuting them (ETA: then sorting the final outputs) would be another option.

ETA2: Would the downvoter care to explain why? Genuinely puzzled.

Post reply on HN