Live data from Hacker News

The Google employees who created transformers

wired.com

21–30 of 258 posts

Re: The Google employees who created transformers

#22
post #15
post #12

[flagged]

As someone who periodically listens to papers via text-to-speech, I was intrigued when I saw this link. I'm a little uncertain about the "AI simplification" - If I'm reading a paper I don't want to have the second guess everything I hear as to whether it completely misinterpreted, elided, or hallucinated a point. Do you have any personal experience with the results?

If the text fits within the context window most models are pretty reliable at summarizing texts effectively.

Re: The Google employees who created transformers

#27
> "Realistically, we could have had GPT-3 or even 3.5 probably in 2019, maybe 2020. The big question isn’t, did they see it? The question is, why didn’t we do anything with the fact that we had seen it? The answer is tricky.”

The answer is that monopolies stifle technological innovation because one well-established part of their business (advertising-centric search) would be negatively impacted by an upstart branch (chatbots) that would cut into search ad revenue.

This is comparable to a investor-owned consortium of electric utilities, gas-fired power plants, and fracked natural gas producers. Would they want the electric utility component to install thousands of solar panels and cut off the revenue from natural gas sales to the utility? Of course not.

It's a good argument for giving Alphabet the Ma Bell anti-trust treatment, certainly.

Re: The Google employees who created transformers

#29

> "Realistically, we could have had GPT-3 or even 3.5 probably in 2019, maybe 2020. The big question isn’t, did they see it? The question is, why didn’t we do anything with the fact that we had seen it? The answer is tricky.” The answer is that monopolies stifle technological innovation because one well-established part of their business (advertising-centric search) would be negatively impacted by an upstart branch (…

On the other hand, Alphabet's inability to deploy GPT-3 or GPT-3.5 has led to the possibility of its disruption, so anti-trust treatment may not be necessary.

Re: The Google employees who created transformers

#30

I am all in for allowing tax free bloated RnD departments just with the hope that once in a decade idea will propell the overall economy. The marvel of modern computing is a result of RnD bloat that was done without immediate impact to the bottomlines of their own companies.

Tax-free ? This was a regular Google team.
Post reply on HN