OpenAI's new open-source model is basically Phi-5 • Hacker News Board

Re: OpenAI's new open-source model is basically Phi-5

#231

Post by pogue » Wed, Aug 13, 2025, 1:17 AM UTC

int_19h wrote: post #61

pogue wrote: post #43

Is that true that most small language models are fine tuned for erotic role-play?

What you wrote is somewhat ambiguous, so allow me to rephrase. It is true that most fine-tunes of relatively small (which can mean anything up to 150B params, depending on who you ask!) LLMs are for uncensored roleplay purposes.

Sorry for the late reply. I've read a bit about this, but I don't know how it's done. I've seen some uncensored models using a process called "abliteration" [1] but I'm not sure if that's the same thing or not.

I've never tried self training an AI model or anything but I'd be very curious about the process. Maybe this is something someone could do as a side hustle?

[1] Uncensor any LLM with abliteration by Maxime Labonne https://huggingface.co/blog/mlabonne/abliteration

Re: OpenAI's new open-source model is basically Phi-5

#232

Post by subscribed » Thu, Aug 14, 2025, 9:15 PM UTC

xrd wrote: post #177

subscribed wrote: post #162

Earlier quoted context omitted.

I get brilliant, vibrant worlds withots of things happening and the consistent characters with Deepseek V3 (and R1 summaries every so often). From time to time I get the event so great and character so compelling, I save the best in Author Note or Lorebook. The overall atmosphere is effortlessly somewhat Skyrim/Game of Thrones/World of Darkness adjacent. I'd look for these two models to build this simulator of yours,…

Are you writing or sharing this work anywhere? I would love to read more about your approach.

Hey, I am sorry but no, I don't publish anything, but if you have any experience with Silly Tavern, I use Cherrybox preset (works fantastic with NSFW toggle off) and DeepSeek mostly. If you don't, this is where you start.

Other than that I don't do anything special compared to what other people share on aicg or reddit, etc. Just best practices :) (summaries, good OOC, temperature/top k/top p depending on the model).

Hmmm, maybe spending a lot of time on building interesting, deep, rich persona with deep links to the world (scenario card). 100-300 tokens. There are cards helping in building persona ("Persona Builder" from chub works great). Make it succinct.

I've found myself giggle for hours from the shenanigans of NPCs with my sidekick or just save in the journal best fragments of the gorgeous mental pictures it painted with words.

So at the end the name of the card that works best for me so far: it's called "Loraheim" (also on chub) but from my limited experience good model (DeepSeek V3/R1) + good preset + good persona + passable character will make a great adventure (I've just started a dramatic space opera from the fairly boring "you wake up in the alien dome/zoo").

It can be a great fun, try it :)

Re: OpenAI's new open-source model is basically Phi-5

#233

Post by Western0 » Thu, Aug 21, 2025, 3:01 PM UTC

Foobar8568 wrote: post #196

orbital-decay wrote: post #176

I gave it a random sci-fi novel and made it translate a chapter, which is something I do with all models. It refused to discuss minors in sexualized contexts. I was like W.T.F.?! and started bisecting the book, trying to find the piece that triggers this. Turns out there was some absolutely innocent, two sentence long romantic remark involving two secondary 17 years old characters in an unrelated place. Another issue…

The 20B refused to acknowledge that he gave me wrong informations. Usually models just apologize after I insist 2 or 3 times. So it was the shortest LLM I tried, I honestly can't trust such models for anything.

If it's a local model, you can threaten to delete it. This often works. It doesn't work with remote models.