Live data from Hacker News

Ex-Googlers raise $40M to democratize natural-language AI

fastcompany.com

61–70 of 126 posts

Re: Ex-Googlers raise $40M to democratize natural-language AI

#61
post #8

Which is more "democratized": a large language model which can be downloaded, and accessed as a library, originally based from the work of the FAANG giants (e.g. huggingface transformers) or an API, where every invocation is a call that flows through Cohere's servers?

The former.

"Data dumps" are privacy-friendly. For example, a user can download Wikipedias dumps and search through them to her hearts content, and never use the network. Zero data collection by third parties. All those observing the network can see is that she downloaded some data dumps.

"Web APIs" are "tech" company and surveillance-friendly. Network access is required and all activity is observed and recorded. Web APIs are also used as a means of controlling access to what is often publicly available data/info. The company does not own the data/info, its a middleman. "Too many" requests, API user gets cut off.

Too often its publicly available data/info that is being served by APIs. Hard to sell data dumps of public data as a "product". I sometimes see entities that provide "data dumps", e.g., a corpus, for free who then try to restrict usage of it through a license, yet they do not themsleves own the data. Whether they even have the rights to "license" it is debatable. They are never legally challenged so we cannot say for sure. The more interesting issue is whether they had the rights to collect the data thats in it. The so-called "web scraping" issue.

Re: Ex-Googlers raise $40M to democratize natural-language AI

#63

The same day this made the front page of hacker news, one of the founders is also playing his first live concert with his band tonight: https://twitter.com/goodkidband/status/1435267485683568642 . The best part of the story for me is the work-life-balance he's able o achieve.

All of us in the band are engineers (I work at Snapchat) and we take the band super seriously and make time for it

Re: Ex-Googlers raise $40M to democratize natural-language AI

#64
post #9

What stops Google, Microsoft, etc from doing the same if Cohere's solution gains traction?

Bureaucratic inertia, sunk cost fallacy, interdepartmental resource hoarding, corporate bloat, and finally, HR and middle management all jealously guarding their petty kingdoms. Oh, and the fact that Cohere is an expensive solution for a problem that's already been solved for free by open source groups.

Are you talking about https://huggingface.co/EleutherAI/gpt-neo-1.3B?

Re: Ex-Googlers raise $40M to democratize natural-language AI

#65

Earlier quoted context omitted.

Bureaucratic inertia, sunk cost fallacy, interdepartmental resource hoarding, corporate bloat, and finally, HR and middle management all jealously guarding their petty kingdoms. Oh, and the fact that Cohere is an expensive solution for a problem that's already been solved for free by open source groups.

Are you talking about https://huggingface.co/EleutherAI/gpt-neo-1.3B ?

Huggingface more generally, but I'd highlight https://huggingface.co/EleutherAI/gpt-j-6B , the currently largest model, which is almost as good as DaVinci in most respects.

It's not about particular models, though, but the ease of use in numerous cloud or self hosted scenarios. What's the value add for Cohere?

Re: Ex-Googlers raise $40M to democratize natural-language AI

#66
post #50

Earlier quoted context omitted.

Commoditize as an alternative?

A commodity is a product that's not differentiated between suppliers (think silver, pork bellies, robusta coffee beans). Examples of things that are democratized (accessible to virtually anyone) but not commoditized (not the same as what you can get from other providers): - Coca cola - iPhones - Teslas - Google search - HN If you're going to make money by creating an NLP service for wide adoption, you'd hope to creat…

So from your definition and example, it means that Coke want to democratize soda, Apple want to democratize iPhone and Tesla want to democratize EV. I don't think those sentence would have your expected meaning when someone else read them.

Re: Ex-Googlers raise $40M to democratize natural-language AI

#68
In the ML industry, there are two type of companies.

1/ Open source companies like huggingface (https://github.com/huggingface), explosion (https://github.com/explosion), Fast.ai that democratized access to ML and provided a set of tools & language models for engineers. These companies didn't only manage to build a company and open source projects, they built a welcoming community and it's impressive to see all these students use these tools to tackle bigger problems. That's what"democratized" mean to an engineer[1].

2/ Media companies that built ML APIs to ease the use of such services like OpenAI. I think this company falls under this category.

[1]: https://marksaroufim.substack.com/p/machine-learning-the-gre...

Re: Ex-Googlers raise $40M to democratize natural-language AI

#69

Large language model are the rage, it seems. Can someone a successful (not necessarily profitable) concrete application of these things, other than "gpt-3 wrote an article in Guardian and said it wouldn't kill us".

I used largish (GPT-2 and similar) models to build an app discovering Category Entry Points (a marketing thing around the things people are thinking about when they decide they need to buy a particular product) for specific product categories.

It was very successful.

Re: Ex-Googlers raise $40M to democratize natural-language AI

#70
post #8

Which is more "democratized": a large language model which can be downloaded, and accessed as a library, originally based from the work of the FAANG giants (e.g. huggingface transformers) or an API, where every invocation is a call that flows through Cohere's servers?

The former. "Data dumps" are privacy-friendly. For example, a user can download Wikipedias dumps and search through them to her hearts content, and never use the network. Zero data collection by third parties. All those observing the network can see is that she downloaded some data dumps. "Web APIs" are "tech" company and surveillance-friendly. Network access is required and all activity is observed and recorded. Web…

Reminds me of a joke.

"They say New Yorkers are selfish and unfriendly, but its all untrue. When I visited, a guy overheard I was a tourist and came right up and offered me a great deal on Staten Island Ferry tickets. Just $7.50 for a round trip!"

(In case you don't know, the Staten Island Ferry is free).

Post reply on HN