Samsung readies its new line of AI accelerator chips to rival Nvidia in the future
With a $2 Trillion valuation Nvidia has proven there's a huge market for GPU's and now everyone else wants a piece of the market.
Key takeaways
- The move will mean competing against companies like Nvidia, but the South Korean company has no plans, at least for now, to rival Nvidia's ultra-high-end AI solutions, such as the H100, B100, or B200.
- Samsung's Mach-1 is an AI inference accelerator based on an Application Specific Integrated Circuit (ASIC) and equipped with LPDDR memory, which makes it particularly suitable for edge computing applications.
- Samsung's Mach-1 is not designed to compete against high-performance AI processors such as the AWS Trainium or the Nvidia H100, but it will certainly compete against other inference-oriented solutions, including AWS Inferentia.
Cite or link to this article
Griffin, M. (2024) 'Samsung readies its new line of AI accelerator chips to rival Nvidia in the future', 311 Institute, 2 April. Available at: https://www.311institute.com/samsung-readies-its-new-line-of-gpus-to-rival-nvidia-in-the-future/ (Accessed: 1 October 2026).
As we see Nvidia smash through multi-trillion dollar valuations as the demand for GPU chips to help train today’s most powerful Artificial Intelligences (AI) becomes white hot Samsung Electronics is gearing up to launch its own AI accelerator chip — the Mach-1 — in early 2025, the company announced at its 55th annual shareholders meeting, reports Sedaily. The move will mean competing against companies like Nvidia, but the South Korean company has no plans, at least for now, to rival Nvidia's ultra-high-end AI solutions, such as the H100, B100, or B200.
Samsung's Mach-1 is an AI inference accelerator based on an Application Specific Integrated Circuit (ASIC) and equipped with LPDDR memory, which makes it particularly suitable for edge computing applications. The report claims that Samsung's Mach-1 has a unique feature that will dramatically reduce memory bandwidth requirements for inference to about 0.125x when compared to existing designs — but does not elaborate on how it will do this, so take this claim with a grain of salt.
The Future of Computing, by Futurist Matthew Griffin
Kye Hyun Kyung, the head of Samsung Electronics Device Solutions Division, overseeing global operations of the Memory, System LSI, and Foundry business units, said that the chip design had passed technological validation on Field-Programmable Gate Arrays (FPGAs) and that the physical finalization of the System-on-Chip (SoC) is currently underway. Kyung assured that the chip would be ready by the end of the year, allowing for the launch of an AI system powered by the Mach-1 chip early next year.
Samsung's Mach-1 is not designed to compete against high-performance AI processors such as the AWS Trainium or the Nvidia H100, but it will certainly compete against other inference-oriented solutions, including AWS Inferentia. It is highly likely that Samsung will position its Mach-1 primarily for edge applications that require low power consumption, minimal dimensions, and low costs, which is where it can probably excel.
Samsung is not only focused on developing the Mach-1 chip but is also actively involved in broader AI semiconductor development efforts, according to Kye Hyun Kyung. The company has established a lab in Silicon Valley dedicated to Artificial General Intelligence (AGI) research, signalling its commitment to becoming a key player in the future of AI technology. The lab's mission is to create new types of processors and memory that meet processing requirements of future AGI systems.
FAQ
Why does this matter?
With a $2 Trillion valuation Nvidia has proven there's a huge market for GPU's and now everyone else wants a piece of the market.
About the author
Matthew Griffin Founder, 311 Institute
Matthew Griffin is a multi-award winning Futurist and expert in Disruption and Innovation, Geopolitics, Leadership, and Technology, who NASA have described as a "walking encyclopaedia of the future" and a "futurist Polymath."
Read full bio
Matthew Griffin is a multi-award winning Futurist and expert in Disruption and Innovation, Geopolitics, Leadership, and Technology, who NASA have described as a "walking encyclopaedia of the future" and a "futurist Polymath." 15-time best selling author of the "Codex of the Future" series, Matthew is the Founder and Futurist in Chief of the 311 Institute, a global Futures and Deep Futures advisory firm working with royal households, world leaders, G7, G20, and G77 governments, NGOs, and multi-national mid and mega cap firms to help them explore, shape, and lead the next 50 years of business and society.
An award-winning YouTube creator with over a million followers, with an unrivalled global reach and impact, Matthew is a highly sought-after international keynote speaker, lecturer, and mentor who collaborates with global leaders through the United Nations Alliance of Civilizations (UNAOC) and United Nations General Assembly (UNGA) to shape pivotal initiatives such as the UN’s AI for Humanity program, the United Nations Conference of the Parties (UN COP), and the World Economic Forum in Davos.
As the former Global Head of Cloud, National Security, and Enterprise Sales for companies including Atos, Dell-EMC, and IBM, Matthew has a proven track record of building multi-billion dollar business units and turning failing divisions into market leaders. His ability to identify, analyse, and communicate the implications of hundreds of emerging technologies and trends is unparalleled, and his insights are trusted by many of the world’s most respected organisations, including ABB, Accenture, Adidas, AON, ARM, BCG, Centrica, Citi, Coca-Cola, Dentons, Deloitte, Dow Jones, EY, Google, KPMG, Lego, Legal & General, LinkedIn, Microsoft, PepsiCo, Qualcomm, RWE, Samsung, Siemens AG and Siemens Energy, T-Mobile, UBS, VISA, Walmart, Workday, Worldpay and many others.
Regularly featured in the global media including the AP, BBC, Bloomberg, CNBC, Discovery, Forbes, Khaleej Times, Telegraph, TIME, ViacomCBS, WIRED, and the WSJ, Matthews mission is to help organisations create a fair and sustainable future whose benefits are shared by everyone irrespective of their ability, background, or circumstances.
What future do you need to see?
Choose one to get started on computing and the future of your organisation.
Sources and further reading
- 2D6PKSCID4 m.sedaily.com
Source: first published by the 311 Institute on 2 April 2024. Cite as: Griffin, M. (2024). Samsung readies its new line of AI accelerator chips to rival Nvidia in the future. 311 Institute. https://www.311institute.com/samsung-readies-its-new-line-of-gpus-to-rival-nvidia-in-the-future/
You are welcome to quote this article with credit and a link to the original.