At AWS re:Invent, NVIDIA contributed GPUs to Amazon’s cloud efforts and added a retriever system to its AI Enterprise Software platform on AWS Marketplace.
Amazon Web Services announced an AI chatbot for enterprise use, new generations of its AI training chips, expanded partnerships and more during AWS re:Invent, held from November 27 to December 1, in Las Vegas.
The focus of AWS CEO Adam Selipsky’s keynote held on day two of the conference was on generative AI and how to enable organizations to train powerful models through cloud services.
Jump to:
Graviton4 and Trainium2 chips announced
Amazon Bedrock: Content guardrails and other features added
Amazon Q: Amazon enters the chatbot race
Amazon S3 Express One Zone opens its doors
Salesforce now available on AWS Marketplace
Amazon removes ETL from more Amazon Redshift integrations
Introducing Amazon One Enterprise authentication scanner
AWS make cloud pact Graviton4 and Trainium2 chips announcedMore must-read AI coverage
Microsoft Brings Its AI Copilot to Windows 10
UK AI Safety Summit: Global Powers Make ‘Landmark’ Pledge to AI Safety
How to Make AI Art: A Complete Guide
Top 10 Artificial Intelligence Use Cases
AWS announced new generations of its Graviton chips, which are server processors for cloud workloads and Trainium, which provides compute power for AI foundation model training.
Graviton4 (Figure A) has 30% better compute performance, 50% more cores and 75% more memory bandwidth than Graviton3, Selipsky said. The first instance based on Graviton4 will be the R8g Instances for EC2 for memory-intensive workloads, available through AWS.
Trainium2 is coming to Amazon EC2 Trn2 instances, and each instance will be able to scale up to 100,000 Trainium2 chips. That provides the ability to train a 300-billion parameter large language model in weeks, AWS stated in a press release.
Figure A
Anthropic will use Trainium and Amazon’s high-performance machine learning chip Inferentia for its AI models, Selipsky and Dario Amodei, chief executive officer and co-founder of Anthropic, announced. These chips may help Amazon muscle into Microsoft’s space in the AI chip market.Amazon Bedrock: Content guardrails and other features added
Selipsky made several announcements about Amazon Bedrock, the foundation model building service, during re:Invent:
Agents for Amazon Bedrock are generally available in preview today.
Custom models built with bespoke fine-tuning and ongoing pretraining are open in preview for customers in the U.S. today.
Guardrails for Amazon Bedrock are coming soon; Guardrails lets organizations conform Bedrock to their own AI content limitations using a natural language wizard.
Knowledge Bases for Amazon Bedrock, which bridge foundation models in Amazon Bedrock to internal company data for retrieval augmented generation, are now generally available in the U.S. Amazon Q: Amazon enters the chatbot race
Amazon launched its own generative AI assistant, Amazon Q, designed for natural language interactions and content generation for work.
