Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Amazon Nova

aws.amazon.com

Post reply on HN
Print view View original

131–140 of 157 posts

Re: Amazon Nova

#131

Post by physicsguy »

Tepix wrote: post #61
zapnuk wrote: post #49

They missed a big opportunity by not offering eu-hosted versions. Thats a big thing for complience. All LLM-providers reserve the right to save (up to 30days) and inspect/check prompts for their own complience. However, this means that company data is potentionally sotred out-of-cloud. This is already problematic, even more so when the storage location is outside the EU.

I'm not sure if hosting it in the EU will do any good for Amazon, there's still the US CLOUD Act: It doesn't really matter where the data is located.

It makes a really big difference for anyone doing business in Europe though.

Legally we're only allowed to use text-embeddings-3-large at work because Azure don't host text-embeddings-3-small within a European region.

Re: Amazon Nova

#132

Post by xendo »

ndr_ wrote: post #125
fumeux_fume wrote: post #120

Earlier quoted context omitted.

This appears to be a way to steal and harvest aws credentials. No one should be following any of these steps.

Do you have any evidence for this accusation? This is a guide for the casual observer who wants to try things out, given that getting started with other AI platforms is so much more straightforward. It's all open source, with transparent hosting, catering to any remaining concerns someone interested in exactly that may have.

Sharing your IAM credentials is like sharing your password. Just don't do it, regardless of the intentions. Even if this one doesn't steal anything it creates a precedence that will let people think it's ok and make them easier targets in the future. Besides, bedrock already has a console, so what's the point of using your UI?

Re: Amazon Nova

#133

Post by donavanm »

sheepscreek wrote: post #102
mikesurowiec wrote: post #27

A rough idea of the price differences... Per 1k tokens Input | Output Amazon Nova Micro: $0.000035 | $0.00014 Amazon Nova Lite: $0.00006 | $0.00024 Amazon Nova Pro: $0.0008 | $0.0032 Claude 3.5 Sonnet: $0.003 | $0.015 Claude 3.5 Haiku: $0.0008 | $0.0004 Claude 3 Opus: $0.015 | $0.075 Source: AWS Bedrock Pricing https://aws.amazon.com/bedrock/pricing/

It’s fascinating that Amazon is investing heavily in Anthropic while simultaneously competing with them.

As others said the product isnt the model, its the API based token usage. Happily selling whatever model you need, with easy integrations from the rest of your aws stack, is the entire point.

Re: Amazon Nova

#134

Post by d4rkp4ttern »

ndr_ wrote: post #74

Setting up AWS so you can try it via Amazon Bedrock API is a hassle, so I made a step-by-step guide: https://ndurner.github.io/amazon-nova . It's 14+ steps!

Setting up Azure LLM access is a similar hellish process. I learned after several days that I had to look at the actual endpoint URL to determine how to set the “deployment name” and “version” etc.

Re: Amazon Nova

#135

Post by coredog64 »

panabee wrote: post #105
sheepscreek wrote: post #102

Earlier quoted context omitted.

It’s fascinating that Amazon is investing heavily in Anthropic while simultaneously competing with them.

Amazon is a retailer and strives to offer choice, whether of books or compute services. AWS is the golden goose. If Amazon doesn't tie up Anthropic, AWS customers who need a SOTA LLM will spend on Azure or GCP. Think of Anthropic as the "premium" brand -- say, the Duracell of LLMs. Nova is Amazon's march toward a house brand, Amazon Basics if you will, that minimizes the need for Duracell and slashes cost for custome…

Minor nit: These days I think Ads has taken over as the golden goose, but that doesn’t diminish the contributions of AWS.

Re: Amazon Nova

#136

Post by UltraSane »

dotBen wrote: post #110
sheepscreek wrote: post #102

Earlier quoted context omitted.

It’s fascinating that Amazon is investing heavily in Anthropic while simultaneously competing with them.

It’s fascinating that Amazon Web Services have so many overlapping and competing services to achieve the same objective. Efficiency/small footprint was never their approach :D For example, look how many different types of database they offer (many achieve the same objective but different instantiation) https://aws.amazon.com/products/?aws-products-all.sort-by=it...

Soon AWS is going to need an LLM just to recommend what service a customer should use.

Re: Amazon Nova

#137

Post by Jfurrrio2 »

dotBen wrote: post #110
sheepscreek wrote: post #102

Earlier quoted context omitted.

It’s fascinating that Amazon is investing heavily in Anthropic while simultaneously competing with them.

It’s fascinating that Amazon Web Services have so many overlapping and competing services to achieve the same objective. Efficiency/small footprint was never their approach :D For example, look how many different types of database they offer (many achieve the same objective but different instantiation) https://aws.amazon.com/products/?aws-products-all.sort-by=it...

They are not competing those are offerings. "AWS has many offerings" is a completly different thing than saying they compete against each other.

Re: Amazon Nova

#138

Post by htrp »

UltraSane wrote: post #136
dotBen wrote: post #110

Earlier quoted context omitted.

It’s fascinating that Amazon Web Services have so many overlapping and competing services to achieve the same objective. Efficiency/small footprint was never their approach :D For example, look how many different types of database they offer (many achieve the same objective but different instantiation) https://aws.amazon.com/products/?aws-products-all.sort-by=it...

Soon AWS is going to need an LLM just to recommend what service a customer should use.

Let me tell you about Amazon Q

Re: Amazon Nova

#139

Post by marcosdumay »

meta_x_ai wrote: post #76
lukev wrote: post #71

Earlier quoted context omitted.

Yeah but even then they won't describe it using the same sort of language that everyone else developing these things does. How many parameters? What kind of corpus was it trained on? MoE, single model, or something else? Will the weights be available? It doesn't even use the words "LLM", "multimodal" or "transformer" which are clearly the most relevant terms here... "foundation model" isn't wrong but it's also the mo…

None of those matters (except multimodal). If you are running a business, the only thing that matters is a) How does it perform on my set of evals b) What is the cost/latency of serving it to my consumers. It shouldn't matter to me how many parameters, corpus it is trained on, whether it's LLM or Transformer or something else

> How does it perform on my set of evals

What kinds of eval? Personally, I have no idea what kind of data you can throw at a "foundation model" and what kind of response you will get.

The only thing it says is that there's machine learning involved... Once you get enough context to understand it's not a spin-off of a TV series.

Re: Amazon Nova

#140

Post by jazzyjackson »

coredog64 wrote: post #135
panabee wrote: post #105

Earlier quoted context omitted.

Amazon is a retailer and strives to offer choice, whether of books or compute services. AWS is the golden goose. If Amazon doesn't tie up Anthropic, AWS customers who need a SOTA LLM will spend on Azure or GCP. Think of Anthropic as the "premium" brand -- say, the Duracell of LLMs. Nova is Amazon's march toward a house brand, Amazon Basics if you will, that minimizes the need for Duracell and slashes cost for custome…

Minor nit: These days I think Ads has taken over as the golden goose, but that doesn’t diminish the contributions of AWS.

Is that why Amazon's product search is terrible? Because it's more profitable for them when I scroll through 5 pages of junk than if I can navigate immediately to the thing I want?
Post reply on HN