Live data from Hacker News

Claude 3 model family

anthropic.com

721–723 of 723 posts

Re: Claude 3 model family

#721

Just added Claude 3 to Chat at https://double.bot if anyone wants to try it for coding. Free for now and will push Claude 3 for autocomplete later this afternoon. From my early tests this seems like the first API alternative to GPT4. Huge!

Huawei Chip Breakthrough Used Tech From Two US Gear Suppliers

SMIC used Applied Materials and Lam equipment to make 7nm chip

US wants to further limit China’s access to foreign chip tech

Bloomberg has learned that Huawei and its partner SMIC relied on gear from Applied Materials Lam Researchto produce an advanced chip.

Huawei Technologies Co. and its partner Semiconductor Manufacturing International Corp. relied on US technology to produce an advanced chip in China last year, according to people with knowledge of the matter.

Shanghai-based SMIC used gear from California-based Applied Materials Inc. and Lam Research Corp. to manufacture an advanced 7-nanometer chip for Huawei in 2023, the people said, asking not to be named as the details are not public.

The previously unreported information suggests that China still cannot entirely replace certain foreign components and equipment required for cutting-edge products like semiconductors. The country has made technological self-sufficiency a national priority and Huawei’s efforts to advance domestic chip design and manufacturing have received the backing of Beijing.

Representatives of SMIC, Huawei and Lam did not respond to requests for comment. Applied Materials and the US Commerce Department’s Bureau of Industry and Security, which is responsible for implementing export controls, declined to comment.

Lauded in China as a major leap in indigenous semiconductor fabrication, last year’s SMIC-made processor powered Huawei’s Mate 60 Pro and a wave of patriotic smartphone-buying in the Asian country. The chip is still generations behind the top components from global firms, but ahead of where the US hoped to stop China’s advance.

The machinery used to make it, however, still had foreign sources including technology from Dutch maker ASML Holding NV as well as the gear from Lam and Applied Materials. Bloomberg News reported in October that SMIC had used equipment from ASML for the chip breakthrough.

Leading Chinese chip equipment suppliers including Advanced Micro-Fabrication Equipment Inc. and Naura Technology Group Co. have been trying to catch up with their American peers, but their offerings are still not as comprehensive or sophisticated. China’s top lithography system developer Shanghai Micro Electronics Equipment Group Co. still lags a few generations behind what industry leader ASML is capable of.

SMIC obtained the American machinery before the US banned such sales to China in October 2022, some of the people said. Both firms were among the American suppliers that began pulling their staff from China after those rules went into effect and prohibited US engineers from servicing some machines in the Asian country. ASML also told American employees to stop working with Chinese customers in response to the US curbs, but Dutch and Japanese engineers are still able to service many machines in China — much to the chagrin of their American rivals.

Companies are now prohibited from selling cutting-edge, US-origin technology to either SMIC or Shenzhen-based Huawei. Both tech firms have been blacklisted by the US for alleged links to the Chinese military, while Washington has been tightening China’s overall access to chipmaking equipment and advanced semiconductors.

Those trade curbs pushed Huawei and SMIC to pursue avenues for building a domestic chip supply chain, and the Mate 60 Pro marked a surprising advance in that effort.

After Huawei released the new phone, Washington launched a probe into its processor and US Commerce Secretary Gina Raimondo vowed the “strongest possible” actions to ensure national security. Meanwhile, Republican lawmakers have called for the Biden administration to completely cut off Huawei and SMIC’s access to US technology.

Department of Commerce officials have said they haven’t seen evidence that SMIC can make the 7nm chips “at scale,” a point echoed by ASML’s Chief Executive Officer Peter Wennink.

If SMIC wants to advance its technology without ASML’s state-of-the-art extreme ultraviolet lithography systems, the Chinese chipmaker will not be able to produce chips at a commercially meaningful volume due to technical challenges, Wennink told Bloomberg News in late January.

“The yield is going to kill you. You’re not going to get the number of chips that you need to have high volume chip production,” he said. ASML has not been able to sell its EUV systems to China as the Dutch government has not issued a license allowing those exports.

The US, meanwhile, is pressing allies including the Netherlands, Germany, South Korea and Japan to further tighten restrictions on China’s access to semiconductor technology. That effort is proving controversial and meeting resistance in some countries, as it imposes limits on trade at a time that Chinese businesses are investing in equipment and computational power to compete in the artificial intelligence race.

Huawei may be China’s most promising candidate to develop AI chips to compete with the US. Industry leader Nvidia Corp.’s CEO, Jensen Huang, in December called the Shenzhen firm a “formidable” rival.

Re: Claude 3 model family

#722
post #710

Earlier quoted context omitted.

I have been working on architectures in this field for almost a decade now and I've seen firshand how things have changed. It might seem hard to believe if you have been to university ~10 years ago and only know the state of deep learning from the early revolutions back then, but we are in a totally different era now. With the transformer, we now have a true general-purpose, efficiently scalable, end-to-end different…

> Meaning you can apply it to any task as long as you convert it to the right embedding space This glosses over a massive issue which is that not everything can be efficiently represented as a vector space via embeddings . So your claim of "general purpose" rings hollow. Not to mention that there is no feedback mechanism for the supposed "knowledge" advocates claim Transformer-based models have, so things like metaco…

There is no basis to any of your arguments. Embedding spaces are not defined by humans, but learned. A priori you have zero idea in what way or how efficient things will be encoded. It all depends on the model and it's internally learned world representation. And things like "metacognition" are meaningless terms used by quacks. We don't know how the brain works, we only know what it can do on the outside. And it is mathematically proven that neural networks can do literally everything in principle as well, thanks to universal approximation.

Re: Claude 3 model family

#723
post #364

Opus (and all prior Claude models) still do not correctly answer the Sally question, unfortunately: Q: Sally (a girl) has 3 brothers. Each brother has 2 sisters. How many sisters does Sally have? A: Okay, let's organize the information we have: Sally is a girl. Sally has 3 brothers. Each of Sally's brothers has 2 sisters. Now, let's think about this step by step: We know that Sally is a girl, so she is a sister to he…

This is what my local LLama 13B Q5 had to say on this: > There are two ways to approach this problem. First, we can count each person by gender and then add them up. Second, we can use the given information about the siblings and their genders to find a quicker solution. > Let's go with the second method: > 1. Sally has one sister (herself). > 2. Each brother has two sisters. So, there are 3 sisters for each of her b…

I am running the 7B and it gave: Q: "Sally (a girl) has 3 brothers. Each brother has 2 sisters. How many sisters does Sally have?"

A: "If Sally has 3 brothers, and each brother has 2 sisters, then the total number of sisters is: 3 brothers x 2 sisters per brother = 6 sisters So, Sally has 6 sisters in total."

Closer than 9 but no better.

Post reply on HN