Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

TextSynth Server

bellard.org

Post reply on HN
Print view View original

91–100 of 115 posts

Re: TextSynth Server

#91

Post by DrewADesign »

yeahsure22 wrote: post #54
DrewADesign wrote: post #49

Earlier quoted context omitted.

In the US, people's jobs effectively justify their existence. Smugly saying mid or late career professionals can "become water" when their entire career category faces collapse is the most patronizing thing I've heard in a long time. That's a non-recoverable blow to many smart, capable people. There's a big difference between demanding we stop the wheels of progress to protect a few people and saying we owe the masse…

[flagged]

Only someone who claims to have all the answers would make such bold incorrect assumptions about who I am and what I know. The demand for my specialty is waxing, I'm likely safer than most work-a-day software developers, and it's my third career. Don't talk to me about becoming water in my career and life. I also don't think that lacking my brain plasticity and marketable cognitive profile should disqualify someone from easy access to food, housing, and health care. So if that body of water drains into the ethically feeble sewer of self-absorbed SV business culture, I'll opt for evaporating on a rock instead.

Re: TextSynth Server

#92

Post by alexvoda »

rvz wrote: post #46
summarity wrote: post #2

> The GPU version is commercial software. Please contact... Shame.

"Shame. I cannot take the code / binary and run it as a SaaS efficiently." - HNers Good for him to commercialize it, and at least he is not pretending to be a non-profit accepting VC money.

Countering SaaS-ifying by others can also be achieved through the AGPL or through the BSL (initially not open-source, reverts to open source after set period).

I do believe one of the failures of GPL was not being AGPL from the start.

Re: TextSynth Server

#93

Post by turtleyacht »

munificent wrote: post #78
hardwaresofton wrote: post #17

I've been feeling FOMO (for lack of a better term) about recent AI & ML/GPT progression. It feels like ML/AI it might be the beginning of the end for a large class of things (if I wanted to be alarmist I'd say "everything") -- and the fact that Fabrice Bellard has jumped in and done the absolutely obvious rising-tide thing (building an API that abstracts the technologies) speaks volumes. Releasing something like this…

Every one of these articles fills me with a related kind of dread. My whole life, my whole personality is architected around making things by hand for other people . My ideal world is a hipster stereotype where we all sit around using a small number of artisanal products to make other artisanal products for each other. The arc of my programming career has gone lower and lower down the stack because when I create, I e…

Interested to know what your plans are. You've thought about this a lot, and for me your books sit next to all the others I have on C, assembly, math, etc--and, I am a bit embarrased to say, a large portion of which I still need to study.

I don't think I should despair too much, and simply grant triumph to a statistical steamroller.

The value is we'll still be making stuff, or yearning for it, and AI becomes a part of our toolkit (or never). Perhaps in your case, we will see Prompt Engineering Patterns someday.

I intend to plop down a tiny fortune enabling my children to have obscene hardware for wherever their personal projects take them, and server-grade CPUs, multiple GPUs, and fiber will be a given.

Just know you're standing at a height somewhere above, and as a giant to me I hope you can see farther ahead :)

Maybe we'll retreat more into our personally-named server, managing a handful of like-minded users, crafting rooms in a MUD no one will read. We'll publish stats for our packet filter, read stories typed by hand, and make little games.

There are still lots of problems we would be completely new to in many domains, people suffering injustice, and are those not things we might be interested in as well?

For sake of learning things, we are still satisfied. Even if AI were to generate it in an instant. For sake of satisficing our home labs and side projects, we find a tiny reprieve.

Re: TextSynth Server

#94

Post by DrewADesign »

UncleEntity wrote: post #56
DrewADesign wrote: post #49

Earlier quoted context omitted.

In the US, people's jobs effectively justify their existence. Smugly saying mid or late career professionals can "become water" when their entire career category faces collapse is the most patronizing thing I've heard in a long time. That's a non-recoverable blow to many smart, capable people. There's a big difference between demanding we stop the wheels of progress to protect a few people and saying we owe the masse…

Not all that long ago people on this very site were super enthusiastic about the prospect that my job would very likely be taken over by the robots. Because, you see, the robots didn’t need to be perfect but merely fractionally safer than the humans. Now all I see is No True Scotsman arguments on why the current crop of AI won’t take away their jobs and, ironically, my job is pretty safe due to Tesla’s tomfoolery cau…

Yeah, it's pretty bizarre. So many people who become incensed by businesses profiting from being shitty to customers are gleefully just dumping the clutch without looking for people in the crosswalk. Maybe literally if the car is driven by an algorithm. I'll bet they could whip up a lot of macho, patronizing personal-responsibility-based arguments in support of being able to mow down the slower pedestrians at crosswalks though.

Re: TextSynth Server

#95

Post by npace12 »

vidarh wrote: post #81
datpiff wrote: post #76

Earlier quoted context omitted.

Apparently the point is proving it's possible. Not making it useful.

No, that was not the point at all. The point is that ChatGPT understands the code well enough to explain what it does, and so there's reason to wonder how soon someone leverages that in a disassembler to produce far better output to the point where using releasing "only" the binary as an obfuscation mechanism stops being viable. E.g. additional value would be comments about purpose, labels for function entry points t…

https://github.com/20urc3/Sekiryu

Re: TextSynth Server

#96

Post by vidarh »

npace12 wrote: post #95
vidarh wrote: post #81

Earlier quoted context omitted.

No, that was not the point at all. The point is that ChatGPT understands the code well enough to explain what it does, and so there's reason to wonder how soon someone leverages that in a disassembler to produce far better output to the point where using releasing "only" the binary as an obfuscation mechanism stops being viable. E.g. additional value would be comments about purpose, labels for function entry points t…

https://github.com/20urc3/Sekiryu

Thanks. That's at least the start of the type of thing I was thinking of.

Re: TextSynth Server

#97

Post by g9yuayon »

munificent wrote: post #78
hardwaresofton wrote: post #17

I've been feeling FOMO (for lack of a better term) about recent AI & ML/GPT progression. It feels like ML/AI it might be the beginning of the end for a large class of things (if I wanted to be alarmist I'd say "everything") -- and the fact that Fabrice Bellard has jumped in and done the absolutely obvious rising-tide thing (building an API that abstracts the technologies) speaks volumes. Releasing something like this…

Every one of these articles fills me with a related kind of dread. My whole life, my whole personality is architected around making things by hand for other people . My ideal world is a hipster stereotype where we all sit around using a small number of artisanal products to make other artisanal products for each other. The arc of my programming career has gone lower and lower down the stack because when I create, I e…

> My whole life, my whole personality is architected around making things by hand for other people.

Not sure if there's a conflict here. We still use compilers, right? Unless we write in machine instructions, there's always some kind of program generations somewhere.

> I get no joy out of duct taping a few libraries together (though I respect others who do).

You still can work on stuff that requires human ingenuity . If you look at the the credits section of the GPT-4 paper, you will see many people there because they are the master of "low-level" optimization. For instance, the author of Reformer is a lead in the Long Context section, because apparently he knows how to reduce the O(N^2) of self attention to O(Nlog(N)), to say the least.

Re: TextSynth Server

#98

Post by a_subsystem »

turmeric_root wrote: post #88
a_subsystem wrote: post #79

"...REST JSON API..." Please update. https://roy.gbiv.com/untangled/2008/rest-apis-must-be-hypert...

I disagree with the linked post, most people use 'REST' to refer to JSON-over-HTTP now.

You disagree with the guy who created the term REST?

Re: TextSynth Server

#100

Post by liuliu »

ggerganov wrote: post #77
liuliu wrote: post #71

Earlier quoted context omitted.

The comparison table from the ts_server site looks awesome though. I wish we could generate one for llama.cpp, unfortunately too busy with other things at the moment.

Hey liuliu, would love if you join the project when you find the time - your work is really inspiring!

Thank you for the compliment! Definitely would love to contribute in some ways, once we have the benchmark, I have some ideas :)
Post reply on HN