Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI's new open-source model is basically Phi-5

seangoedecke.com

Post reply on HN
Print view View original

121–130 of 233 posts

Re: OpenAI's new open-source model is basically Phi-5

#121

Post by jondwillis »

sterlind wrote: post #89
michaelt wrote: post #39

Earlier quoted context omitted.

The pro-porn side has zero PR because respectable public figures don't see pro-porn advocacy as a good career move. At most, you'll get some oblique references to it. Meanwhile, the anti-porn side has a formidable alliance: Right-wing, religiously-motivated anti-porn activists. Left-wing, feminism-motivated anti-porn activists. Big corporate types with lots of $$$$ to spend who want their customer support chatbot to…

on the other hand, Musk et al are building AI-powered thirst traps, like Grok's "Ani", or the accursed Replika bots (whose user base went on suicide watch when the company abruptly decided to digitally neuter their "companions.") erotic roleplay, imo, is much less harmful than using LLMs as surrogate partners. porn and sex workers have existed for millenia. they're an outlet for sexual tension. they don't alleviate f…

We already have a generation of hikkikomoris stepping up at bat. The ones behind them in line will be something else altogether!

Re: OpenAI's new open-source model is basically Phi-5

#122

Post by isoprophlex »

zacmps wrote: post #120
fho wrote: post #109

Earlier quoted context omitted.

Are you getting good results with this? Some time ago I build an "overworld simulator" by having a bunch if jsons that represented villages, characters, building, story hooks and plots. I just asked ChatGPT to "simulate the gameworld by a week". Technically this worked great, but everything was somewhat bland and generic. Noteable not-highlights: - there is a shimmer in the nearby forests that keep villagers up at ni…

Might be fixable with promoting and/or a much lower temperature?

I've had some success in letting it generate lists of things at high temperature and picking the last item in the list.

Ask some model to generate a number uniformly between 0 and 100; you get 47 a lot. Or 27. Something like that.

Ask it for a list of numbers, uniformly distributed, and it also often starts with the same number. However later elements in the sequence will converge (imperfectly) to a better approximation of uniformity.

The same for names of the dwarves and paladins in your party.

Re: OpenAI's new open-source model is basically Phi-5

#123

Post by jondwillis »

nickpsecurity wrote: post #114
izabera wrote: post #26

Earlier quoted context omitted.

what's the problem with that? we have erotic texts dating back thousands of years, basically as old as the act of writing itself https://en.wikipedia.org/wiki/Istanbul_2461

[flagged]

There’s some wisdom in whatever version of the translation of a translation of a translation of a memory of an oral story that you’re reading and lazily thrusting at a bunch of tech bros and bots, but just as much distortion, manipulation, and human ability to misunderstand and oversimplify.

Re: OpenAI's new open-source model is basically Phi-5

#124

Post by compumetrika »

magicalhippo wrote: post #15

I've found good use of Phi-4 at home, and after a few tests of the GPT-OSS 20B version I'm quite impressed so far. Particularly one SQL question that has tripped every other model of similar or smaller size that I've tried, like Devstral 24B, Falcon 3 7B, Qwen2.5-coder 14B and Phi 4 14B. The question contains an key point which is obvious for most humans, and which all of the models I tried previously have failed to…

Get a Strix Point or Strix Halo with 128GB DDR5 RAM and you can run gpt-oss 120B at 10-20+ TPS.

Re: OpenAI's new open-source model is basically Phi-5

#125

Post by tough »

isoprophlex wrote: post #122
zacmps wrote: post #120

Earlier quoted context omitted.

Might be fixable with promoting and/or a much lower temperature?

I've had some success in letting it generate lists of things at high temperature and picking the last item in the list. Ask some model to generate a number uniformly between 0 and 100; you get 47 a lot. Or 27. Something like that. Ask it for a list of numbers, uniformly distributed, and it also often starts with the same number. However later elements in the sequence will converge (imperfectly) to a better approximat…

token entanglement is an interesting emergent behaviour https://owls.baulab.info/

Re: OpenAI's new open-source model is basically Phi-5

#126

Post by mvdtnz »

lmm wrote: post #62
wmf wrote: post #33

Earlier quoted context omitted.

I have no problem with it and I can understand why people don't want to say "I'm trying to pornify this model and it refuses to talk dirty!" in public. But if you're calling a model garbage maybe you should be honest about what the "problem" is.

Why? Is there any reason to believe problems in that context won't generalise?

Are you serious? Of course there are reasons to believe they won't generalise.

Re: OpenAI's new open-source model is basically Phi-5

#127

Post by mvdtnz »

michaelt wrote: post #39
izabera wrote: post #26

Earlier quoted context omitted.

what's the problem with that? we have erotic texts dating back thousands of years, basically as old as the act of writing itself https://en.wikipedia.org/wiki/Istanbul_2461

The pro-porn side has zero PR because respectable public figures don't see pro-porn advocacy as a good career move. At most, you'll get some oblique references to it. Meanwhile, the anti-porn side has a formidable alliance: Right-wing, religiously-motivated anti-porn activists. Left-wing, feminism-motivated anti-porn activists. Big corporate types with lots of $$$$ to spend who want their customer support chatbot to…

It's not pro-porn and anti-porn. It's pro-porn and people who just don't think this is that important an issue. The latter massively, MASSIVELY outweighs you guys.

Re: OpenAI's new open-source model is basically Phi-5

#128

Post by numpad0 »

wmf wrote: post #20

I saw a bunch of people complaining on Twitter about how GPT-OSS can't be customized or has no soul and I noticed that none of them said what they were trying to accomplish. "The main use-case for fine-tuning small language models is for erotic role-play, and there’s a serious demand." Ah.

Maybe I'm just not seeing it, but is that use case really real and not just prudish hallucinations? The market for NSFW novels is smaller than even cyberpunk paperbacks, there's no way everyday people build up addiction for an interactive version of it.

Re: OpenAI's new open-source model is basically Phi-5

#129

Post by xwolfi »

eru wrote: post #56
wmf wrote: post #22

Earlier quoted context omitted.

Yeah, it always seemed like a sad commentary on our world that AIs are devoting their weights to encyclopedic knowledge of Harry Potter, Pokemon, and Reddit trolling.

Why? You gotta provide what your customers want. And it's far from sad that we have so many resources, we can give everyone a supercomputer in their pocket just to take selfies and talk about Pokemon. Why would our AIs be any different?

Because we really could use all that time, money and uranium to train them on complex problems we need to solve, rather than entertainment.

But you're right, shareholders of OpenAI want profit, not progress, and they'll give us our intellectual Big Mac.

Re: OpenAI's new open-source model is basically Phi-5

#130

Post by magicalhippo »

compumetrika wrote: post #124
magicalhippo wrote: post #15

I've found good use of Phi-4 at home, and after a few tests of the GPT-OSS 20B version I'm quite impressed so far. Particularly one SQL question that has tripped every other model of similar or smaller size that I've tried, like Devstral 24B, Falcon 3 7B, Qwen2.5-coder 14B and Phi 4 14B. The question contains an key point which is obvious for most humans, and which all of the models I tried previously have failed to…

Get a Strix Point or Strix Halo with 128GB DDR5 RAM and you can run gpt-oss 120B at 10-20+ TPS.

Good point, though at the price of a 5090 I'm more tempted to get the 5090, as I do still game a bit as well.
Post reply on HN