Jim is a principal analyst and partner at TIRIAS Research, a high-tech research and advisory firm consisting of experienced analysts. Jim has over 30 years of technical and business experience with leading high-tech companies including Intel, Motorola, ON Semiconductor, STMicroelectronics, and General Dynamics Space Systems.
, data center s are the heart of the AI era. However, the exponential increase in performance requires a holistic design approach to overcome increased power and thermal energy limitations. There is innovation in many areas that will address this, including compute architectures, memory, power sources, power distribution, and cooling solutions, to name a few, but one that will have the most significant impact is networking.
Election 2024 Swing State Polls: Georgia, North Carolina Still Razor-Thin—And Pennsylvania’s A Tie While the benefits to the data center are significant, the true value is in the ability to meet the continued increasing demands of AI and HPC workloads. According to Nvidia, the GB200 NVL72 can support 27 trillion parameter model sizes, exceeding the sizes of even the current largest large language models for generative AI , such as GPT-4 and 4o.
Tirias Research will continue examining how system architecture is changing for the AI era and the companies that are driving the innovation, but there was no better place to start than the company that is at the heart of this innovation wave. Although Nvidia continues to innovate in CPUs, GPUs, interconnects and system architecture, the NVLink Switch is an essential innovation to allow for both scaling AI workloads and for improving the efficiency of data centers to make AI more cost effective.
The author and members of the Tirias Research staff do not hold equity positions in any of the companies mentioned. Tirias Research tracks and consults for companies throughout the electronics ecosystem from semiconductors to systems and sensors to the cloud. Tirias Research staff have consulted for Nvidia and companies throughout the semiconductor, server, data center and AI ecosystems.Our community is about connecting people through open and thoughtful conversations.
Cloud Data Center Networking Blackwell GPU Llms Genai AGI
South Africa Latest News, South Africa Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
System Design For The AI Era: Data Centers Require A Holistic ApproachJim is a principal analyst and partner at TIRIAS Research, a high-tech research and advisory firm consisting of experienced analysts. Jim has over 30 years of technical and business experience with leading high-tech companies including Intel, Motorola, ON Semiconductor, STMicroelectronics, and General Dynamics Space Systems.
Read more »
Skywell Q Is A Cute Electric Hatch With 201 HP And A Claimed 0-62 MPH In 3.9 SecondsFound in the cabin is a 15.6-inch infotainment system and an eight-speaker audio system
Read more »
NFL expert: Jim Harbaugh's 'tough guy' approach not workingThe college game is a little different, but Harbaugh already knew that, right?
Read more »
13 Outstanding iPhone 16 And iPhone 16 Pro Cases For Design And FunctionI’ve been writing about technology for two decades and am routinely struck by how the sector swings from startling innovation to persistent repetitiveness. My areas of specialty are wearable tech, cameras, home entertainment and mobile technology.
Read more »
Oura Ring 4 Gets a Slimmer Design, Improved Accuracy, and More SizesThe company just announced the $349 Oura Ring 4, which will feature a slimmer design, improved accuracy, and more sizes. Starting today, the Oura app will also be getting a complete redesign to better organize the swath of new features introduced over the past few months.
Read more »
Bugatti reveals unseen design studies including Atlantic 2-door coupeBugatti's delving into its past and revealing designs that have never been show to the public.
Read more »