Claude API on AWS Bedrock

If you don't have access to Claude, using AWS Bedrock is the fastest way to get access to Claude 2 and Claude Instant.
AWS bedrock is an offering from Amazon that lets you run several foundation models including Claude, Stable Diffusion, and Cohere.
Running Claude on AWS Bedrock is a good option because it's all serverless meaning that you only pay for what you use.
Collab with code: colab.research...

[@user-ql6cs6wd5k]

How to get the usage tokens of request and response using boto?

[@blackhand9581]

Anyway to get an API key from AWS Claude? Was hoping Amazon would've given us a secret key from the get go. Hoping to use it as a creative writing assistant for my team.

[@toshvelaga]

You won't need the API key if you're using AWS. You can just your AWS credentials and it will work. Getting an actual API key from Anthropic is a hassle so this way is much easier

[@alpineai]

@@toshvelaga can you then connect Claude to tools like Airtable this way? tx!

[@xiaomiwu4734]

Unfortunately I got denied with Claude's access. Anything wrong with the information I provided? But it seems it didn't give me any opportunity to try again.

[@toshvelaga]

Did you go through Claude and apply for access or apply through AWS? If it's through AWS you should instantly get access. That being said I am the US. I've heard that access is limited to the US and UK for now.

[@xiaomiwu4734]

@@toshvelaga Even with AWS, I still got rejected.

[@toshvelaga]

@@xiaomiwu4734 I see sorry about that. What country are you in?

[@xiaomiwu4734]

China

[@AerysBat]

Make sure you are setting the REGION_NAME to match where you requested access. Mine was us-east-1

[@RedCloudServices]

I’m in my bedrock and Claude v2 with a single PDF is not great does embedding matter? because they only have titan and two from huggingface in sagemaker. it lists openai but there’s no way to enter my api keys

[@toshvelaga]

Hmm if Claude v2 with 100k context window isn't good enough on a single PDF, then I would recommend creating embeddings over the PDF using the OpenAI API. I haven't tried creating embeddings with other providers, but I've gotten pretty good results w/ OpenAI + it's very affordable.