|
At this time, we’re saying a brand new console expertise in Amazon Bedrock so that you can experiment, iterate, and scale with the most recent AI fashions on Amazon Bedrock’s next-generation inference engine constructed for prime efficiency, reliability, and safety. This console has a refreshed workflow optimized for bedrock-mantle endpoint, which helps the most recent GPT, Claude, and open-weight fashions with the OpenAI Responses API, OpenAI Chat Completions API, and the Anthropic Messages API.
The brand new console expertise makes it easy to search out the appropriate mannequin and transfer rapidly from analysis to manufacturing.
- New mannequin card – You possibly can browse the complete mannequin catalog, examine them facet by facet on capabilities, modality assist, context window, and relevant service quotas in a single view, eradicating the necessity to sew collectively documentation, and restrict calculators.
- Venture-based work – You may make a undertaking to run evaluations and assessment utilization insights in a single streamlined workflow that mirrors the lifecycle of constructing a generative AI utility.
- Stay documentation – You should utilize project-aware reside documentation: code samples, SDK snippets, and API references are mechanically prefilled together with your undertaking variables. You possibly can copy a snippet straight from the console into your utility and run it with out modification.
Learn how to get began
You possibly can strive a brand new expertise by selecting Strive the Bedrock Mantle Console from throughout the Amazon Bedrock console, or through the use of the new console hyperlink instantly.
You’ll find a project-based dashboard to indicate inference requests and error by vary of latest dates, just lately used fashions, and the undertaking listing. You possibly can create a undertaking, assign fashions, configure API keys, and begin making inference requests in minutes.
A brand new mannequin catalog reveals the most recent GPT, Claude, and open-weight fashions which might be supported on the bedrock-mantle engine. You possibly can see the main points of options, tokens, pricing, enter/output, pricing info, and Regional availability. You can even examine as much as 3 fashions in a single view.
Once you select the undertaking dashboard, you possibly can see the fashions used within the undertaking, the distribution of your token utilization equivalent to whole token utilization, token utilization per minute, inference requests per minute, and tokens per inference request. This could inform your mannequin choice, immediate optimization, and workload consistency choices.
You possibly can choose as much as 3 fashions to start out evaluating to match responses facet by facet with the identical immediate.
To construct your utility within the undertaking, select Getting began. You possibly can migrate present code, construct a brand new app with the Anthropic or OpenAI SDK, or join an AI coding assistant to Bedrock.
Select the API & SDK, your SDK (both Anthropic or OpenAI), your most well-liked programming language, and your authentication methodology. It reveals your atmosphere code to run these in your terminal for a fast take a look at, or save to a .env file to your utility. You can even ship your first request with pattern code snippets to confirm your setup.
Once you select Purchasers, you possibly can choose the AI coding agent supply equivalent to Claude Code, Cline, Codex, Cursor, or OpenCode that you just wish to connect with the bedrock-mantle engine. It offers directions on the right way to set up the AI agent, use your AWS IAM credentials or use a Bedrock API key, set atmosphere variables, and route requests from every AI agent by way of Bedrock.
To find out about Anthropic- and OpenAI-compatible APIs, select Stay API docs. You possibly can select Anthropic API Protocol for entry to Claude mannequin options just like the Messages API or OpenAI API Protocol for entry to options like Responses API.
For instance, while you select OpenAI Response API, it retrieves a mannequin response with the given mannequin ID. These API references are mechanically prefilled with the undertaking’s chosen mannequin ID, Area, bedrock-mantle endpoint URL, and API key reference, they usually replace in place as you alter fashions or settings.
You can even select the present Bedrock console to handle fully-managed options equivalent to Brokers, Information Bases, Guardrails, fine-tuning, or the InvokeModel and Converse APIs to run on the bedrock-runtime endpoint.
Now accessible
The brand new console expertise is accessible in all AWS Areas the place the bedrock-mantle endpoint is obtainable: US East (N. Virginia, Ohio), US West (Oregon), Asia Pacific (Jakarta, Mumbai, Sydney, Tokyo), Europe (Frankfurt, Eire, London, Milan, Stockholm), and South America (São Paulo). Examine the full listing of Areas for future updates.
Give the brand new console expertise a strive within the new Amazon Bedrock console and ship suggestions to AWS re:Submit for Amazon Bedrock or by way of your normal AWS Help contacts.
— Channy
