Earlier quoted context omitted.
MS not owning OpenAI outright is a technicality. "It would suck to be an MS shareholder" due to things done to subsidiaries of MS constitutes dereliction of duty by MS officers. MS is not Silicon Valley. They're based in Seattle and predate 95% of SV. Besides this is just one of my points. Even if everything you claimed were to be true, OpenAI still is, as I pointed out, part of the American Corporate establishment a…
> OpenAI still is, as I pointed out, part of the American Corporate establishment and despite their PR posturing, they won't provide us with technology to disrupt said establishment They're not acting like they're part of the American corporate establishment, and I don't understand why you think they are. Rather than quote my other comment comparing against 3M, I'll link to it: https://news.ycombinator.com/item?id=36…
GPT-4 details leaked?
461–470 of 648 posts
Re: GPT-4 details leaked?
#462Everyone hates on crypto because of all the electricity use for mining. But how much electricity is the training of all the giant LLMs costing us?
LLMs actually have tangible use (granted far from bespoke yet). Crypto mining has no tangible benefit.
Re: GPT-4 details leaked?
#463Earlier quoted context omitted.
Sure. But remember also that the standard “science” is largely a broken model. Academia sucks. It’s honestly bad. It’s overflowing with papers that are misleading, irrelevant, or fraudulent due to a mix of poor stats knowledge, bad incentives, and a failure to organize effectively. While people praise the scientific method, the majority of achievements we attribute to “science” are not derived from guess and check gr…
I think the search for tiny effects and the belief that they should drive treatment, is one of the biggest things wrong with medical research. Doctors will put millions of people on a pill that hits a vital metabolic pathway, for life, based on tiny (to my thinking) statistically significant (i.e. only a 5% chance they aren't based on a real effect) results. These days I only believe large effects- like smoking cause…
Re: GPT-4 details leaked?
#464Earlier quoted context omitted.
>> We'll keep the science a secret and try to pressure the government into making it illegal for you to compete with us. Just to be clear, there's no science being kept secret because there is no science being done. OpenAI's is a feat of engineering, borne aloft by a huge budget supporting a large team whose expertise lies in tuning neural net systems, and not in doing science. Machine learning, as it is practiced to…
I'm tired of science as a religion. People treat it as some gospel, like if you check out some criterions you're suddenly "scientific" and instantly get a sense of validity and authority that you shouldn't logically get. I judge things as "what you can do", not "what can you predict". The only demonstration of knowledge and understanding is being able to do something. Not predict. Not "scientific method" and ridiculo…
Re: GPT-4 details leaked?
#465Earlier quoted context omitted.
> And safely here means non disruptive to established businesses Why would OpenAI care about that? No, it means safety, as in not giving out dangerous answers that get people killed.
> as in not giving out dangerous answers that get people killed Literally taken, that is quite close to impossible. It was news days ago of somebody who committed suicide after having an interaction with a bot about nuclear risks or similar. To avoid that, the bot would have to be a high-ranking professional psychologist with an explicit purpose not to trigger destructive reactions. And that would fail the nature of…
Re: GPT-4 details leaked?
#466Earlier quoted context omitted.
Sure. But remember also that the standard “science” is largely a broken model. Academia sucks. It’s honestly bad. It’s overflowing with papers that are misleading, irrelevant, or fraudulent due to a mix of poor stats knowledge, bad incentives, and a failure to organize effectively. While people praise the scientific method, the majority of achievements we attribute to “science” are not derived from guess and check gr…
Right. In historical context the scientific method was a huge improvement over the previous method of understanding the world, which was mostly religion. But today, academia is a victim of organizational and political capture, making it less competitive for talent.
Re: GPT-4 details leaked?
#467Earlier quoted context omitted.
>> We'll keep the science a secret and try to pressure the government into making it illegal for you to compete with us. Just to be clear, there's no science being kept secret because there is no science being done. OpenAI's is a feat of engineering, borne aloft by a huge budget supporting a large team whose expertise lies in tuning neural net systems, and not in doing science. Machine learning, as it is practiced to…
I'm tired of science as a religion. People treat it as some gospel, like if you check out some criterions you're suddenly "scientific" and instantly get a sense of validity and authority that you shouldn't logically get. I judge things as "what you can do", not "what can you predict". The only demonstration of knowledge and understanding is being able to do something. Not predict. Not "scientific method" and ridiculo…
Re: GPT-4 details leaked?
#468Earlier quoted context omitted.
>> We'll keep the science a secret and try to pressure the government into making it illegal for you to compete with us. Just to be clear, there's no science being kept secret because there is no science being done. OpenAI's is a feat of engineering, borne aloft by a huge budget supporting a large team whose expertise lies in tuning neural net systems, and not in doing science. Machine learning, as it is practiced to…
I'm tired of science as a religion. People treat it as some gospel, like if you check out some criterions you're suddenly "scientific" and instantly get a sense of validity and authority that you shouldn't logically get. I judge things as "what you can do", not "what can you predict". The only demonstration of knowledge and understanding is being able to do something. Not predict. Not "scientific method" and ridiculo…
Re: GPT-4 details leaked?
#469Earlier quoted context omitted.
Well, Wikipedia might be wrong, but this is how they describe Computer Science: "Computer science is the study of computation, information, and automation. Computer science spans theoretical disciplines (such as algorithms, theory of computation, and information theory) to applied disciplines (including the design and implementation of hardware and software). Though more often considered an academic discipline, compu…
I honestly feel like that, as a "Software Engineer". As the digital world is new, and full of similar concepts to the old analogue world, it's natural that we borrow names along with the concepts. Similar to how a lot of things in the sea are named after land things, with a marine prefix, like the sea horse, sea star, sea cucumber, and so on. And now in IT we have engineers, architects, rockstars, tribes, and science…
The algorithms behind the Facebook feed and your favorite AI/ML product is the science. The code that powers the feed and chatgpt is the engineering.
Wikipedia is not wrong IMHO, but then I studied computer science 20 years ago so maybe I’m out of touch
Re: GPT-4 details leaked?
#470Earlier quoted context omitted.
Just a reminder that LLaMA is not open—in order to use it legally you have to agree to Meta's terms, which currently means research use only. The versions circulating on torrents are essential pirated, and while I don't have an ethical problem with that at all you can't use it safely in a business. The open replacements for LLaMA have yet to reach 30B, let alone 65B.
That hasn’t been true for a while. Falcon 40B seemingly outperforms LLaMA 60B according to the OpenLLM leaderboard https://huggingface.co/tiiuae/falcon-40b