The Amplify AI Kit: Chat and Generation on Amazon Bedrock, and What Is Underneath

The AI kit, generally available since November 2024, adds conversation and generation routes to an Amplify Gen 2 backend and a ready-made streaming chat component. Underneath: AppSync, a Lambda that calls Bedrock's Converse API, and DynamoDB for per-user history. What it gives you, what it costs, and when to build the same thing yourself.

What it provides

• Conversation routes: multi-turn, streaming chat with history scoped to the signed-in user, resumable across sessions.

• Generation routes: single requests that return text or structured data, for summaries, extraction and form filling.

• The AIConversation React component: a customizable chat interface that can render UI responses, not just text.

• Tools backed by your Amplify Data queries, so the model can read the user's own data under the same authorization rules.

What is underneath

AppSync handles the API and streaming to the client. A Lambda function bridges AppSync and Bedrock, calling the Converse API. DynamoDB stores conversations and messages per user. You pay for each of those plus the Bedrock model, and there is no separate charge for the kit.

Use it, or build it?

• Use it for a chat or summarization feature inside an Amplify app, where per-user history and auth matter and speed of delivery matters more than control.

• Build it yourself when you need a different model provider or gateway, complex agent loops, evaluation pipelines or retrieval beyond what tools over Amplify Data provide. The architecture is simple to reproduce in CDK.

• Either way, add the basics the demo omits: per-user rate limits, logging of prompts and responses for evaluation, and an eval set before changing models.