I am all in for allowing tax free bloated RnD departments just with the hope that once in a decade idea will propell the overall economy. The marvel of modern computing is a result of RnD bloat that was done without immediate impact to the bottomlines of their own companies.
Tax-free ? This was a regular Google team.
The Google employees who created transformers
31–40 of 258 posts
Re: The Google employees who created transformers
#32I am all in for allowing tax free bloated RnD departments just with the hope that once in a decade idea will propell the overall economy. The marvel of modern computing is a result of RnD bloat that was done without immediate impact to the bottomlines of their own companies.
Re: The Google employees who created transformers
#33I am all in for allowing tax free bloated RnD departments just with the hope that once in a decade idea will propell the overall economy. The marvel of modern computing is a result of RnD bloat that was done without immediate impact to the bottomlines of their own companies.
Tax-free ? This was a regular Google team.
Re: The Google employees who created transformers
#34> "Realistically, we could have had GPT-3 or even 3.5 probably in 2019, maybe 2020. The big question isn’t, did they see it? The question is, why didn’t we do anything with the fact that we had seen it? The answer is tricky.” The answer is that monopolies stifle technological innovation because one well-established part of their business (advertising-centric search) would be negatively impacted by an upstart branch (…
Re: The Google employees who created transformers
#35> "Realistically, we could have had GPT-3 or even 3.5 probably in 2019, maybe 2020. The big question isn’t, did they see it? The question is, why didn’t we do anything with the fact that we had seen it? The answer is tricky.” The answer is that monopolies stifle technological innovation because one well-established part of their business (advertising-centric search) would be negatively impacted by an upstart branch (…
Sundar was afraid of the technology and how it would be received and tried to ice it.
Re: The Google employees who created transformers
#36[flagged]
The article starts off by saying they all left Google. There's also an entire section narrating how google execs passed on transformers and didn't pick up until OpenAI released GPT. >The picture internally is more complicated. “It was pretty evident to us that transformers could do really magical things,” says Uszkoreit. “Now, you may ask the question, why wasn’t there ChatGPT by Google back in 2018? Realistically, w…
Google certainly seem to have fumbled on rapidly exploiting the tech, but I'm not sure that's totally fair.
Google built BERT in 2018, around the same time as OpenAI built GPT-1, but neither were released.
OpenAI's GPT-2 was built in february 2019 but OpenAI were hesitant to release it due to potential danger, only doing so later in november 2019. GPT-3 followed in july 2020, but ChatGPT which the first accessible to public view of the tech didn't appear until november 2022 (how time flies!).
Google's first transformer-based chatbot, LaMDA, was released in may 2021, well over a year before ChatGPT, but was then rapidly withdrawn due to negative feedback and behavior.
The difference between ChatGPT's acceptable behavior, and success, compared to LaMBDA, was OpenAI's invention of RLHF to better control it. One could argue that Google should have invented something similar themselves earlier, but surely this might have been expected to come from these same people who had been working on language models at Google ...
Re: The Google employees who created transformers
#37Transformer == Modern AI? Wow, I dont know where should I start My mind literally stuck at the absurdity
Re: The Google employees who created transformers
#38Earlier quoted context omitted.
Tax-free ? This was a regular Google team.
In the US, R&D expenses can often be deducted when filing taxes. I’m sure large companies like Google would be taking advantage of those rules.
Re: The Google employees who created transformers
#39I am all in for allowing tax free bloated RnD departments just with the hope that once in a decade idea will propell the overall economy. The marvel of modern computing is a result of RnD bloat that was done without immediate impact to the bottomlines of their own companies.
Re: The Google employees who created transformers
#40I am all in for allowing tax free bloated RnD departments just with the hope that once in a decade idea will propell the overall economy. The marvel of modern computing is a result of RnD bloat that was done without immediate impact to the bottomlines of their own companies.
Tax-free ? This was a regular Google team.
And as it is, Google certainly paid property taxes immediately on the office building as well as FICA on all of the employees who, of course, paid their own taxes.
But haters of the R&D system love to call it "tax-free".