Live data from Hacker News

OpenAI Privacy Filter

openai.com

1–10 of 78 posts

Re: OpenAI Privacy Filter

#6
post #4

I'm surprised nobody else has commented on this. This is a very straightforward and useful thing for a small locally runnable model to do.

And also something that it’s dangerous to try to do stochastically.

It's going to be stochastic in some sense whether you want it to be or not, human error never reaches zero percent. I would bet you a penny you'd get better results doing one two-second automated pass + your usual PII redaction than your PII redaction alone.

Re: OpenAI Privacy Filter

#9
There's some interesting technical details in this release:

> Privacy Filter is a bidirectional token-classification model with span decoding. It begins from an autoregressive pretrained checkpoint and is then adapted into a token classifier over a fixed taxonomy of privacy labels. Instead of generating text token by token, it labels an input sequence in one pass and then decodes coherent spans with a constrained Viterbi procedure.

> The released model has 1.5B total parameters with 50M active parameters.

> [To build it] we converted a pretrained language model into a bidirectional token classifier by replacing the language modeling head with a token-classification head and post-training it with a supervised classification objective.

Re: OpenAI Privacy Filter

#10
50M effective parameters is impressively light. Is there a similarly light model on the prompt injection side? Most of the mainstream ones seem heavier
Post reply on HN