Setting up AWS so you can try it via Amazon Bedrock API is a hassle, so I made a step-by-step guide: https://ndurner.github.io/amazon-nova . It's 14+ steps!
Your 14 steps appear to be 'create an IAM user'..?
Amazon Nova
101–110 of 157 posts
Re: Amazon Nova
#102A rough idea of the price differences... Per 1k tokens Input | Output Amazon Nova Micro: $0.000035 | $0.00014 Amazon Nova Lite: $0.00006 | $0.00024 Amazon Nova Pro: $0.0008 | $0.0032 Claude 3.5 Sonnet: $0.003 | $0.015 Claude 3.5 Haiku: $0.0008 | $0.0004 Claude 3 Opus: $0.015 | $0.075 Source: AWS Bedrock Pricing https://aws.amazon.com/bedrock/pricing/
It’s fascinating that Amazon is investing heavily in Anthropic while simultaneously competing with them.
Re: Amazon Nova
#103Setting up AWS so you can try it via Amazon Bedrock API is a hassle, so I made a step-by-step guide: https://ndurner.github.io/amazon-nova . It's 14+ steps!
Your 14 steps appear to be 'create an IAM user'..?
If you're already in the AWS ecosystem or have worked in it, it's no problem. If you're used to "make OpenAI account, add credit card, copy/paste API key" it can be a bit daunting.
Re: Amazon Nova
#104A rough idea of the price differences... Per 1k tokens Input | Output Amazon Nova Micro: $0.000035 | $0.00014 Amazon Nova Lite: $0.00006 | $0.00024 Amazon Nova Pro: $0.0008 | $0.0032 Claude 3.5 Sonnet: $0.003 | $0.015 Claude 3.5 Haiku: $0.0008 | $0.0004 Claude 3 Opus: $0.015 | $0.075 Source: AWS Bedrock Pricing https://aws.amazon.com/bedrock/pricing/
Doesn’t look particularly favourable versus deepseek and qwen. Main deepseek is about same price as smallest nova.
I guess it depends on how sensitive your data is
Re: Amazon Nova
#105A rough idea of the price differences... Per 1k tokens Input | Output Amazon Nova Micro: $0.000035 | $0.00014 Amazon Nova Lite: $0.00006 | $0.00024 Amazon Nova Pro: $0.0008 | $0.0032 Claude 3.5 Sonnet: $0.003 | $0.015 Claude 3.5 Haiku: $0.0008 | $0.0004 Claude 3 Opus: $0.015 | $0.075 Source: AWS Bedrock Pricing https://aws.amazon.com/bedrock/pricing/
It’s fascinating that Amazon is investing heavily in Anthropic while simultaneously competing with them.
Amazon is a retailer and strives to offer choice, whether of books or compute services.
AWS is the golden goose. If Amazon doesn't tie up Anthropic, AWS customers who need a SOTA LLM will spend on Azure or GCP.
Think of Anthropic as the "premium" brand -- say, the Duracell of LLMs.
Nova is Amazon's march toward a house brand, Amazon Basics if you will, that minimizes the need for Duracell and slashes cost for customers.
Not to mention the potential benefits of improving Alexa, which has inexcusably languished despite popularizing AI services.
:Edited for readability
Re: Amazon Nova
#106Setting up AWS so you can try it via Amazon Bedrock API is a hassle, so I made a step-by-step guide: https://ndurner.github.io/amazon-nova . It's 14+ steps!
Thanks for that. Are there any proxies that can communicate with bedrock and serve it via a OpenAI style api?
Try LiteLLM; their core LLM proxy is open source. As an added bonus it also supports other major providers.
Re: Amazon Nova
#107Setting up AWS so you can try it via Amazon Bedrock API is a hassle, so I made a step-by-step guide: https://ndurner.github.io/amazon-nova . It's 14+ steps!
Nice! FWIW, The only nova model I see on the HuggingFace user space page is us.amazon.nova-pro-v1:0. I cloned the repo and added the other nova options in my clone, but you might want to add them to yours. (I would do a PR, but... I'm lazy and it's a trivial PR :-)).
Re: Amazon Nova
#108DOA When marketing talks about price delta and not quality of the output, it is DOA. For LLMs, quality is a more important metric and Nova would always try to play catch with the leaderboard forever.
Maybe. The major models seem to be about tied in terms of quality right now, so cost and ease of use (e.g. you already have an AWS account set up for billing) could be a differentiator.
Re: Amazon Nova
#109Setting up AWS so you can try it via Amazon Bedrock API is a hassle, so I made a step-by-step guide: https://ndurner.github.io/amazon-nova . It's 14+ steps!
Your 14 steps appear to be 'create an IAM user'..?
find to supported region, request model access, wait for model access, create policy, create user, attach policy... it's not comparable
Re: Amazon Nova
#110A rough idea of the price differences... Per 1k tokens Input | Output Amazon Nova Micro: $0.000035 | $0.00014 Amazon Nova Lite: $0.00006 | $0.00024 Amazon Nova Pro: $0.0008 | $0.0032 Claude 3.5 Sonnet: $0.003 | $0.015 Claude 3.5 Haiku: $0.0008 | $0.0004 Claude 3 Opus: $0.015 | $0.075 Source: AWS Bedrock Pricing https://aws.amazon.com/bedrock/pricing/
It’s fascinating that Amazon is investing heavily in Anthropic while simultaneously competing with them.
It’s fascinating that Amazon Web Services have so many overlapping and competing services to achieve the same objective. Efficiency/small footprint was never their approach :D
For example, look how many different types of database they offer (many achieve the same objective but different instantiation)
https://aws.amazon.com/products/?aws-products-all.sort-by=it...