Viewing profile — zingelshuher

[flagged]

> Google knowingly made their search results shittier and shittier for years unfortunately this extends to youtube too. now they have a new shitty trick. you click on the link and …

> It is unlikely people are going to switch en mass to open source models It depends on the task at hands. For complex tasks no way personal computer can compete with giants data c…

> poorly designed government intervention due to misunderstanding of the dynamics behind the process (homelessness) Major drive is easy to understand, just cross the border and you…

had to upvote this

Only if it does nothing. In fact Google is one of the major players in LLM field. The winner is hard to predict, chip makers likely ;) Everybody jumped on bandwagon, Amazon is jump…

I often use ChatGPT4 for technical info. It's easier then scrolling through pages whet it works. But.. the accuracy is inconsistent, to put it mildly. Sometimes it gets stuck on wr…

It's impossible. Meta itself cannot reproduce the model. Because training is randomized and that info is lost. First samples a coming at random. Second there are often drop-out lay…

If we can keep unlimited memory, but use only a selected relevant subset in each chat session. This should help. Of course the key is 'selected', it's another big problem. Like sho…

It's a different animal. In general you cannot reproduce the model even having all the training data. There are too many random factors and nobody keeps track of them. Just pushing…

It's a matter of opinion how much open model should be to be called 'open source'. Looks like some believe they have the right to define it for everybody else to use. Like for soft…

> I'll bet Adobe or similiar will buy this 0,5 mil May be that was the business plan, or 'plan B'

Yes. And there are many forgotten accounts on youtube, their owners now have another way to monetarize. Not sure why Adobe didn't talk to Youtube directly.

As you mentioned models need _random_ videos. Just 'walk outside' will produce more or less the same. My guess Adobe is more interested in 'family' sort of videos, with humans. Thi…

It doesn't affect creators life as they guarantee (likely) it will not be made public. So it's just side income. Likely creators make a lot of fragments which don't get into the fi…

It reflects the fact that Amazon in serious about AI. If fact they are well positioned with their datacenters and a lot of ways to apply, starting with smarter Alexa.

Expect sh*t load of AI hallucinations. As if Wiki isn't bad enough with BS some intentionally posting.

"the bigger you make epsilon "... " thus slower the training progress will be" Sounds like variable epsilon is optimal, that's instead of learning rate, or both together. Would be …

Intuitively looks like models should be close enough, or sparse enough for merge to work. I wonder if MoE experts can be merged(?)

Good luck with that ;) Actually you _can_ learn juggling this way, just couple of minutes at a time.

There are unstable cases when static learning rate doesn't work. Solution starts wobbling too much after some time and explodes. Using too small LR from the beginning leads to loca…

Have to disagree with this. The major limiting factor is the software and lack of applications. If there was a killer application it would be much easier to sell. Then the numbers …

Why isn't he identified personally? Very likely he is 'contributing' to other projects under different accounts.

Question, have you seen the improvement after adding the noise? I mean in practice. Asking because intuition sometimes doesn't work.