AWS Bedrock Connector (GenerativeAI)

Version: 1.0

Release Date: June 14th, 2024

AWS Bedrock offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and AWS through a single API, along with a broad set of capabilities you need to build generative AI applications with security, privacy, and responsible AI.

In this version we focused on delivering the best functionality for infusing AI into your business process. We used a specific set of endpoints to make prompt engineering and model interoperability as simple as possible so you can focus on performance, not prompt syntax.

• AI Generation (Run Inference):

  • Prompt the exact same way across all your models. If a particular model doesn't support a parameter you get an error informing you so you don't have to spend time reading the docs for each model.

  • All models available on Bedrock are immediately available. When Bedrock adds more models, those are AUTOMATICALLY added to our connector. You still need to approve models for use within the AWS console in order to use it in Tray.

  • You can leverage AWS Bedrock Guardrails to configure privacy and security features in their console and then apply them to all the Generative AI work you do right within Tray.

• Create Embeddings:

  • Two model families to choose from. Cohere has batch embedding options and Titan is a reliable model at a bargain.

We can't wait to see what you build on Tray with AWS Bedrock.