AWS re:Invent is recognized as the largest technology event in the world, held annually by Amazon Web Services (AWS). In 2023, the focus of re:Invent was on crucial aspects such as cloud strategies and operations, advances in Machine Learning, security news, and the integration of IoT and Edge Computing.
During AWS re:Invent 2023, the most recent iterations of two chip lineages were presented: AWS Graviton4 and AWS Trainium2. These developments represent notable improvements in terms of economics and energy efficiency, covering areas such as Machine Learning (ML) training and Generative Artificial Intelligence (GenAI). With these innovative launches, customers now have the flexibility to integrate chips and instances that use third-party processors, allowing the virtual execution of practically any application or workload on Amazon Elastic Compute Cloud (EC2).
About Graviton4:
Representing a substantial advance, Graviton4 offers a notable improvement in computing performance, with an increase of up to 30%. Additionally, it presents a 50% increase in the number of cores and a substantial 75% increase in memory bandwidth, significantly surpassing the previous generation of processors, Graviton3, launched during re:Invent 2021. This enables companies that use AI models daily to analyze large volumes of data to expand their own processing capacity, optimizing execution times and reducing costs.
About Trainium2:
Developed specifically to deliver training at extraordinary speed, Trainium2 outperforms the first generation of Trainium chips by up to 4 times in AI model training. Its ability to be installed in EC2 UltraClusters, with an impressive mark of up to 100,000 chips, makes it possible to train foundation models (FMs) and Large Language Models (LLM) in a remarkably reduced fraction of time.
