Transformer == Modern AI? Wow, I dont know where should I start My mind literally stuck at the absurdity
AI is in the eye of the beholder.
[deleted]
The Google employees who created transformers
41–50 of 258 posts
Re: The Google employees who created transformers
#42Transformer == Modern AI? Wow, I dont know where should I start My mind literally stuck at the absurdity
It's 2024; do we really have to point out the fact that publications take liberties with headlines? It's been that way forever.
Besides that, are you denying that transformers are the fundamental piece behind all the AI hype today? That's the point of the article. I think the fact that a mainstream publication is writing about the Transformers paper is awesome.
Re: The Google employees who created transformers
#43Earlier quoted context omitted.
In the US, R&D expenses can often be deducted when filing taxes. I’m sure large companies like Google would be taking advantage of those rules.
Can't all expenses be deducted when filing taxes? I mean, taxes are paid on profit, which is revenue minus expenses.
Yeah the person you are replying to was imprecise - there's actually tax credits for R&D expense in the US rather than just tax deductions.
https://www.plantemoran.com/explore-our-thinking/insight/202...
Re: The Google employees who created transformers
#44Transformer == Modern AI? Wow, I dont know where should I start My mind literally stuck at the absurdity
Do you think this current AI hype machine came from something other than transformers?
Re: The Google employees who created transformers
#45Earlier quoted context omitted.
As someone who periodically listens to papers via text-to-speech, I was intrigued when I saw this link. I'm a little uncertain about the "AI simplification" - If I'm reading a paper I don't want to have the second guess everything I hear as to whether it completely misinterpreted, elided, or hallucinated a point. Do you have any personal experience with the results?
If the text fits within the context window most models are pretty reliable at summarizing texts effectively.
They’re good at summarizing text convincingly if you didn’t read the original document, but GPT-4 still makes a ton of basic factual mistakes: https://arxiv.org/abs/2402.13249
I think it will be several decades - maybe longer - before you can throw an arbitrary 20-page document into a computer program and get an accurate one-page summary. People need to take seriously that transformer LLMs don’t understand human language.
Re: The Google employees who created transformers
#46Earlier quoted context omitted.
Tax-free ? This was a regular Google team.
What they meant was that the R&D was fully deductible, not amortized over a number of years. It's like saying that a business's electricity bill is "tax-free" because they can deduct it from their revenues immediately. And as it is, Google certainly paid property taxes immediately on the office building as well as FICA on all of the employees who, of course, paid their own taxes. But haters of the R&D system love to…
There's the benefit of expensing the costs over amortizating them - but there's also straight up cash in the form of R&D tax credits - it's one method tech companies use to minimize their tax bills:
https://www.plantemoran.com/explore-our-thinking/insight/202...
Re: The Google employees who created transformers
#47I thought level 4+ self-driving was going to be the face of "modern AI"... instead we got this thing
Re: The Google employees who created transformers
#48Transformer == Modern AI? Wow, I dont know where should I start My mind literally stuck at the absurdity
It's 2024; do we really have to point out the fact that publications take liberties with headlines? It's been that way forever. Besides that, are you denying that transformers are the fundamental piece behind all the AI hype today? That's the point of the article. I think the fact that a mainstream publication is writing about the Transformers paper is awesome.
OK, so the title should be changed to "8 Google Employees Invented Modern AI Hype"?
Re: The Google employees who created transformers
#49Earlier quoted context omitted.
In the US, R&D expenses can often be deducted when filing taxes. I’m sure large companies like Google would be taking advantage of those rules.
Can't all expenses be deducted when filing taxes? I mean, taxes are paid on profit, which is revenue minus expenses.
Not to mention the thing about tax credits, but when people say "R&D expenses" they often include quite a lot of investments on their definition.
In fact, it's arguable if anything in R&D qualifies as an expense at all.
Re: The Google employees who created transformers
#50> "Realistically, we could have had GPT-3 or even 3.5 probably in 2019, maybe 2020. The big question isn’t, did they see it? The question is, why didn’t we do anything with the fact that we had seen it? The answer is tricky.” The answer is that monopolies stifle technological innovation because one well-established part of their business (advertising-centric search) would be negatively impacted by an upstart branch (…
I was privy to the details of this. Sundar blocked the NEMA team from presenting at I/O with its gpt3 level product in the form of a character. Sundar was afraid of the technology and how it would be received and tried to ice it.
How is that not immediate grounds for his termination? The board should be canned too for allowing such an obvious charlatan to continue ruining the company.