This conference call transcript was computer generated and almost certianly contains errors. This transcript is provided for information purposes only.EarningsCall, LLC makes no representation about the accuracy of the aforementioned transcript, and you are cautioned not to place undue reliance on the information provided by the transcript.
spk09: You may begin your conference.
spk06: Thank you. Good afternoon, everyone, and welcome to NVIDIA's conference call for the fourth quarter in fiscal 2024. With me today from NVIDIA are Jensen Huang, President and Chief Executive Officer, and Collette Kress, Executive Vice President and Chief Financial Officer. I'd like to remind you that our call is being webcast live on NVIDIA's investor relations website. The webcast will be available for replay until the conference call to discuss our financial results for the first quarter of fiscal 2025. The content of today's call is NVIDIA's property. It can be reproduced or transcribed without our prior written consent. During this call, we may make forward-looking statements based on current expectations. These are subject to a number of significant risks and uncertainties, and our actual results may differ materially. For a discussion of factors that could affect our future financial results in business, please refer to the disclosure in today's earnings release, our most recent forms 10-K and 10-Q, and the reports that we may file on form 8-K with the Securities and Exchange Commission. All our statements are made as of today, February 21, 2024, based on information currently available to us. Except as required by law, we assume no obligation to update any such statements. During this call, we will discuss non-GAAP financial measures. You can find a reconciliation of these non-GAAP financial measures to GAAP financial measures in our CFO commentary, which is posted on our website. With that, let me turn the call over to Collette.
spk07: Thanks, Simona. Q4 was another record quarter. Revenue of $22.1 billion was up 22% sequentially and up 265% -on-year. And well above our outlook of $20 billion. For fiscal 2024, revenue was $60.9 billion and up 126% from the prior year. Starting with data center. Data center revenue for the fiscal 2024 year was $47.5 billion, more than tripling from the prior year. The world has reached the tipping point of new computing era. The trillion-dollar install base of data center infrastructure is rapidly transitioning from general purpose to accelerated computing. As more law slows, while computing demand continues to skyrocket, companies may accelerate every workload possible to drive future improvement in performance, TCO, and energy efficiency. At the same time, companies have started to build the next generation of modern data centers, what we refer to as AI factories. Purpose built to refine raw data and produce valuable intelligence in the era of generative AI. In the fourth quarter, data center revenue of $18.4 billion was a record of 27% sequentially and up 409% -on-year. Driven by the Nvidia Hopper GPU computing platform, along with InfiniBand -to-end networking. Compute revenue grew more than 5x and networking revenue tripled from last year. We are delighted that supply of Hopper architecture products is improving. Demand for Hopper remains very strong. We expect our next generation products to be supply constrained as demand far exceeds supply. Fourth quarter data center growth was driven by both training and inference of generative AI and large language models across a broad set of industries, use cases, and regions. The versatility and leading performance of our data center platform enables a high return on investment for many use cases, including AI training and inference, data processing, and a broad range of CUDA accelerated workloads. We estimate in the past year, approximately 40% of data center revenue was for AI inference. Building and deploying AI solutions has reached virtually every industry. Many companies across industries are training and operating their AI models and services at scale. Enterprises across Nvidia AI infrastructure through cloud providers, including hyperscales, GPU specialized, and private clouds, or on-premise. Nvidia's computing stack extends seamlessly across cloud and on-premise environments, allowing customers to deploy with a multi-cloud or hybrid cloud strategy. In the fourth quarter, large cloud providers represented more than half of our data center revenue, supporting both internal workloads and external public cloud customers. Microsoft recently noted that more than 50,000 organizations use GitHub Copilot business to supercharge the productivity of their developers, contributing to GitHub revenue growth, accelerating to 40% year on year. And Copilot for Microsoft 365 adoption grew faster in its first two months than the two previous major Microsoft 365 Enterprise Suite releases did. Consumer internet companies have been early adopters of AI and represent one of our largest customer categories. Companies from search to e-commerce, social media, news and video services, and entertainment are using AI for deep learning based recommendation systems. These AI investments are generating a strong return by improving customer engagement, ad conversation, and click throughs rates. Meta, in its latest quarter, cited more accurate predictions and improved advertiser performance as contributing to the significant acceleration in its revenue. In addition, consumer internet companies are investing in generative AI to support content creators, advertisers, and customers through automation tools for content and ad creation, online product descriptions, and AI shopping assistance. Enterprise software companies are applying generative AI to help customers realize productivity gains. Early customers we've partnered with for both training and inference of generative AI are already seeing notable commercial success. ServiceNow's generative AI products in their latest quarter drove their largest ever net new annual contract value contribution of any new product family release. We are working with many other leading AI and enterprise software platforms as well, including Adobe, Databricks, Getty Images, SAP, and Snowflake. The field of foundation large language models is thriving. Anthropic, Google, Inflection, Microsoft, OpenAI, and XAI are leading with continued amazing breakthrough in generative AI. Exciting companies like Adept, AI21, Character AI, Cohere, Nistral, Perplexity, and Runway are building platforms to serve enterprises and creators. New startups are creating LLMs to serve the specific languages, cultures, and customs of the world's many regions. And others are creating foundation models to address entirely different industries like recursion, pharmaceuticals, and generative biomedicines for biology. These companies are driving demand for NVIDIA AI infrastructure through hyperscale or GPU specialized cloud providers. Just this morning, we announced that we collaborated with Google to optimize its -the-art new GEMMA language models to accelerate their inference performance on NVIDIA GPUs in the cloud, data center, and PC. One of the most notable trends over the past year is the significant adoption of AI by enterprises across the industry's verticals, such as automotive, healthcare, and financial services. NVIDIA offers multiple application frameworks to help companies adopt AI in vertical domains such as autonomous driving, drug discovery, low latency machine learning for fraud detection, or robotics, leveraging our full stack accelerated computing platform. We estimate that data center revenue contribution of the automotive vertical through the cloud or on-prem exceeded a billion dollars last year. NVIDIA drive infrastructure solutions include systems and software for the development of autonomous driving, including data ingestion, creation, labeling, and AI training, plus validation through simulation. Almost 80 vehicle manufacturers across global OEMs, new energy vehicles, trucking, robotaxi, and tier one suppliers are using NVIDIA's AI infrastructure to train LLMs and other AI models for automated driving and AI cockpit applications. In effect, nearly every automotive company working on AI is working with NVIDIA. As AV algorithms move to video transformers and more cars are equipped with cameras, we expect NVIDIA's automotive data center processing demand to grow significantly. In healthcare, digital biology and generative AI are helping to reinvent drug discovery, surgery, medical imaging, and wearable devices. We have built deep domain expertise in healthcare over the past decade, creating the NVIDIA Clara Healthcare Platform and NVIDIA BioNemo, a generative AI service to develop, customize, and deploy AI foundation models for computer aided drug discovery. BioNemo features a growing collection of pre-trained biomolecular AI models that can be applied to the -to-end drug discovery processes. We announced Recursion is making available for the proprietary AI model through BioNemo for the drug discovery ecosystem. In financial services, customers are using AI for a growing set of use cases from trading and risk management to customer service and fraud detection. For example, American Express improved fraud detection accuracy by 6% using NVIDIA AI. Shifting to our data center revenue by geography. Growth was strong across all regions except for China, where our data center revenue declined significantly following the U.S. government export control regulations imposed in October. Although we have not received licenses from the U.S. government to ship restricted products to China, we have started shipping alternatives that don't require a license for the China market. China represented a mid-single digit percentage of our data center revenue in Q4, and we expect it to stay in a similar range in the first quarter. In regions outside of the U.S. and China, sovereign AI has become an additional demand driver. Countries around the world are investing in AI infrastructure to support the building of large language models in their own language, on domestic data, and in support of their local research and enterprise ecosystems. From a product perspective, the vast majority of revenue was driven by our Hopper architecture, along with InfiniBand networking. Together, they have emerged as the de facto standard for accelerated computing and AI infrastructure. We are on track to ramp H200 with initial shipments in the second quarter. Demand is strong as H200 nearly doubles the inference performance of H100. Networking exceeded a $13 billion annualized revenue run rate. Our -to-end networking solutions define modern AI data centers. Our quantum InfiniBand solutions grew more than 5x -on-year. NVIDIA Quantum InfiniBand is the standard for the highest performance AI dedicated infrastructures. We are now entering the Ethernet networking space with the launch of our new SpectrumX -to-end offering, designed for an AI optimized networking for the data center. SpectrumX introduces new technologies over Ethernet that are purpose-built for AI. Technologies incorporated in our Spectrum Switch, Bluefield, DPU, and Software Stack deliver 1.6x higher networking performance for AI processing compared with traditional Ethernet. Leading OEMs, including Dell, HPE, Lenovo, and Supermicro, with their global sales channels, are partnering with us to expand our AI solution to enterprises worldwide. We are on track to ship SpectrumX this quarter. We also made great progress with our software and services offerings, which reached an annualized revenue run rate of $1 billion in Q4. We announced that NVIDIA DGX Cloud will expand its list of partners to include Amazon's AWS, joining Microsoft Azure, Google Cloud, and Oracle Cloud. DGX Cloud is used for NVIDIA's own AI R&D and custom model development, as well as NVIDIA developers. It brings the CUDA ecosystem to NVIDIA CSP partners. Okay, moving to gaming. Gaming revenue was $2.87 billion with flat sequentially and up 56% -on-year. Better than our outlook on solid consumer demand for NVIDIA GeForce RTX GPUs during the holidays. Fiscal year revenue of $10.45 billion was up 15%. At CES, we announced our GeForce RTX 40 Super Series family of GPUs. Starting at $599, they deliver incredible gaming performance and generative AI capabilities. Sales are off to a great start. NVIDIA AI Tensor Cores and the GPUs deliver up to 836 AI tops. Perfect for powering AI for gaming, creating an everyday productivity. The rich software stock we offer with our RTX GPUs further accelerates AI. With our DLSS technologies, 7 out of 8 pixels can be AI generated, resulting up to 4x faster ray tracing and better image quality. And with the Tensor RT-LLM for Windows, our open source library that accelerates inference performance for the latest large language models, generative AI can run up to 5x faster on RTX AI PCs. At CES, we also announced a wave of new RTX 40 Series AI laptops from every major OEM. These bring high performance gaming and AI capabilities to a wide range of form factors, including 14-inch and thin and light laptops. With up to 686 tops of AI performance, these next generation AI PCs increase generative AI performance by up to 60x, making them the best performing AI PC platforms. At CES, we announced NVIDIA Avatar Cloud Engine Microservices, which allow developers to integrate -the-art generative AI models into digital avatars. ACE won several Best of CES 2024 awards. NVIDIA has an -to-end platform for building and deploying generative AI applications for RTX PCs and workstations. This includes libraries, SDKs, tools, and services developers can incorporate into their generative AI workloads. NVIDIA is fueling the next wave of generative AI applications coming to the PC. With over 100 million RTX PCs in the install base and over 500 AI-enabled PC applications and games, we are on our way. Moving to Pro Visualization. Revenue of 463 million was up 11% sequentially and up 105% -on-year. Fiscal year revenue of 1.55 billion was up 1%. Sequential growth in the quarter was driven by a rich mix of RTX Ada architecture GPUs continuing to ramp. Enterprises are refreshing their workstations to support generative AI-related workloads such as data preparation, LLM, fine-tuning, and retrieval-augmented generation. These key industrial verticals driving demand include manufacturing, automotive, and robotics. The automotive industry has also been an early adopter of NVIDIA Omniverse as it seeks to digitalize workflows from design to build, simulate, operate, and experience their factories and cars. At CES, we announced that creative partners and developers, including Brickland, WPP, and ZeroLite, are building Omniverse-powered car configurators, leading automakers like Lotus are adopting the technology to bring new levels of personalization, realism, and interactivity to the car-buying experience. Moving to Automotive. Revenue was $281 million, up 8% sequentially and down 4% -on-year. Fiscal year revenue of 1.09 billion was up 21%, crossing the 1 billion mark for the first time on continued adoption of the NVIDIA Drive platform by automakers. NVIDIA Drive Orin is the AI car computer of choice for software-defined AV fleets. Its successor, NVIDIA Drive Thor, designed for vision transformers, often offers more AI performance and integrates a wide range of intelligent capabilities into a single AI compute platform, including autonomous driving and parking, driver and passenger monitoring, and AI cockpit functionality, and will be available next year. There were several automotive customer announcements this quarter. LiAuto, Great Wall Motor, Zekr, the premium EV subsidiary of Geely, and Xiaomi EV all announced new vehicles built on NVIDIA. Moving to the rest of the P&L. Gap growth margins expanded sequentially to 76% and non-gap growth margins to .7% on strong data center growth and mix. Our growth margins in Q4 benefited from favorable component costs. Sequentially, gap operating expenses were up 6% and non-gap operating expenses were up 9%, primarily reflecting higher compute and infrastructure investments and employee growth. In Q4, we returned $2.8 billion to shareholders in the form of share repurchases and cash dividends. During fiscal year 24, we utilized cash of $9.9 billion towards shareholder returns, including $9.5 billion in share repurchases. Let me turn to the outlook for the first quarter. Total revenue is expected to be $24 billion, plus or minus 2%. We expect sequential growth in data center and ProViz partially offset by seasonal decline in gaming. Gap and non-gap growth margins are expected to be .3% and 77%, respectively, plus or minus 50 basis points. Similar to Q4, Q1 growth margins are benefiting from favorable component costs. Beyond Q1, for the remainder of the year, we expect growth margins to return to the mid 70s percent range. Gap and non-gap operating expenses are expected to be approximately $3.5 billion and $2.5 billion, respectively. Fiscal year 2025 gap and non-gap operating expenses are expected to grow in the mid 30% range as we continue to invest in the large opportunities ahead of us. Gap and non-gap other income and expenses are expected to be an income of approximately $250 million, excluding gains and losses from non-affiliated investments. Gap and non-gap tax rates are expected to be 17%, plus or minus 1%, excluding any discrete items. Further financial details are included in the CFO commentary and other information available on our IR website. In closing, let me highlight some upcoming events for the financial community. We will attend the Morgan Stanley Technology and Media and Telecom Conference in San Francisco on March 4, and the TD Cohen's 44th Annual Healthcare Conference in Boston on March 5. And of course, please join us for our annual GTC Conference starting Monday, March 18 in San Jose, California. To be held in person for the first time in five years, GTC will kick off with Jensen's keynote, and we will host a Q&A session for financial analysts the next day, March 19. At this time, we are now open for call for questions. Operator, would you please poll for questions?
spk09: At this time, I would like to remind everyone in order to ask a question, press star, then the number one on your telephone keypad. We'll pause for just a moment to compile the Q&A roster. As a reminder, please limit yourself to one question. Your first question comes from the line of Toshihari from Goldman Sachs. Your line is open.
spk10: Hi, thank you so much for taking the question and congratulations on the really strong results. My question is for Jensen on the data center business. You know, clearly, you know, you're doing extremely well in the business. I'm curious how your expectations for calendar 24 and 25 have evolved over the past 90 days. And as you answer the question, I was hoping you can touch on, you know, some of the newer buckets within data center, you know, things like software, sovereign AI. I think you've been pretty vocal about how to think about that medium to long term. And recently there was an article about Nvidia potentially participating in the ASIC market. Is there any credence to that? And if so, how should we think about you guys playing in that market over the next several years? Thank you.
spk11: Thanks, Toshia. Let's see. There were three questions. One more time. First question was.
spk10: Well, I guess your expectations for data center, how they've evolved. Thank you.
spk11: OK, yeah. Well, you know, we guide one quarter at a time, but fundamentally the conditions are excellent for continued growth. Calendar 24, calendar 25 and beyond. And let me tell you why. We're at the beginning of two industry wide. Transitions and both of them are industry wide. The first one is a transition from general to accelerated computing. General purpose computing, as you know, is starting to run out of steam. And you could tell by the CSP's extending and many data centers, including our own for general purpose computing, extending the depreciation from four to six years. There's just no reason to update with more CPUs when you can't fundamentally and dramatically enhance its throughput like you used to. And so you have to accelerate everything. This is what Nvidia has been pioneering for some time. And with accelerated computing, you can dramatically improve your energy efficiency. You can dramatically improve your cost in data processing by 20 to one. Huge numbers. And of course, the speed. That speed is so incredible that we enabled a second industry wide transition called Generative AI. Generative AI, we can, I'm sure we're going to talk plenty plenty about it during the call. But remember, generative AI is a new application. It is enabling a new way of doing software, new types of software being created. It is a new way of computing. You can't do generative AI on traditional general purpose computing. You have to accelerate it. And the third is it is enabling a whole new industry. And this is this is something worthwhile to take a step back and look at. And it connects to your last question about sovereign AI, a whole new industry in the sense that for the very first time, the data center is not just about computing data and storing data and serving the employees of a company. We now have a new type of data center that is about AI generation and AI generation factory. And you've heard me describe it as AI factories. But basically, it takes raw material, which is data. It transforms it with these AI supercomputers that Nvidia builds and it turns them into incredibly valuable. Tokens. These tokens are what people experience on the amazing the amazing chat GPT or mid journey or, you know, Search these days are augmented by that. All of your recommender systems are now augmented by that. The hyper personalization that goes along with it. All of these incredible startups in digital biology. Generating proteins and generating chemicals and the list goes on. And so all of these tokens are generated in a very specialized type of data center. And this data center we call AI supercomputers and AI generation factories. But we're seeing diversity. One of the one of the other reasons the so at the foundation is that the way it manifests into new markets is in all of the diversity that you're seeing us in. One, the amount of inference that we do. Is just off the charts now. Almost every single time you interact with chat GPT, you know that we're inferencing every time you use mid journey. We're inferencing every time you see amazing the sort of videos that are being generated or runway the videos that they're editing firefly Nvidia doing inferencing. The inference part of our business has grown tremendously. We estimate about 40 percent. The amount of training is continuing because these models are getting larger and larger. The amount of inference is increasing. But we're also diversifying into new industries. The large CSP's are still continuing to build out. You could see from their capex and their their discussions. But there's a whole new category called GPU specialized CSP's. They specialize in video and video AI infrastructure. See it. GPU specialized CSP's. You're seeing enterprise software platforms deploying AI. Service now is just a really, really great example. You see Adobe, they see others, SAP and others. You see consumer Internet services that that are now augmenting all of their services of the past with generative AI. So they can have even more hyper personalized content to be created. You see us talking about industrial generative AI. Now our industries represent a multi billion dollar businesses. Auto health, financial services in total are vertical industries are multi billion dollar businesses now. And of course, sovereign AI. The reason for sovereign AI has to do with the fact that the language, the knowledge, the history, the culture of each region are different. And they own their own data. They would like to use their data, train it with to create their own digital intelligence and provision it to harness that raw material themselves. It belongs to them. Each one of the regions around the world. The data belongs to them. The data is most useful to their society. And so they want to protect the data. They want to transform it themselves. Value added transformation into into AI and provision those services themselves. So we're seeing sovereign AI infrastructures being built in in Japan, in Canada, in France, so many other regions. And and so my expectation is that what is being experienced here in the United States in the West will will surely be replicated around the world. And these AI generation factories are going to be in every industry, every company, every region. And so so I think the last the last this last year, we've seen generative AI really becoming a whole new application space, a whole new way of doing computing, a whole new industries being formed. And that's driving our growth.
spk09: Your next question comes from a line of Joe Moore from Morgan Stanley. Your line is open.
spk02: Great. Thank you. I wanted to follow up on the 40 percent of revenues coming from inference. That's a bigger number than I expected. Can you give us some sense of where that number was maybe a year before? How much you're seeing growth around LLMs from inference and how are you measuring that? Is that I assume it's in some cases the same GPUs you use for training and inference. How solid is that measurement? Thank you.
spk11: I'll go backwards. The the estimate is probably understated and but we estimated it. And let me tell you why. I. Whenever a year ago, a year ago, the recommender systems that people are, you know, when you run the Internet, the news, the videos, the music, the products that are being recommended to you, because as you know, the Internet has trillions. You know, I don't know how many trillions, but trillions of things out there. And your phone is, you know, three inches squared, you know. And so so the ability for them to fit all of that information down to something such a small real estate is through a system, an amazing system called recommender systems. These recommender systems used to be all based on CPU CPU approaches. But the recent migration to deep learning and now generative AI has really put these recommender systems now directly into the path of GPU acceleration. It needs to be acceleration for the embeddings. It needs GPU acceleration for the nearest neighbor search. It needs GPU accelerating for the re ranking and needs GPU acceleration to generate the augmented information for you. So GPUs are in every single step of a recommender system now. And as you know, recommender system is the single largest software engine on the planet. Almost every major major company in the world has to run these large recommender systems. But whenever you use chat GPT as being inference, whenever you hear about mid journey and just the number of things that they're they're generating for for consumers, when you when you see Getty, the work that we do with Getty and Firefly from Adobe, these are all generative models. The list goes on. And and none of these, as I mentioned, existed a year ago. 100 percent new.
spk09: Your next question comes from a line of Stacy Raskin from Bernstein Research. Your line is open.
spk12: Hi, guys. Thanks for taking my question. I wanted to call it. I wanted to touch on your comment that you expected the next generation of products. I see them at Blackwell to be supply constrained. Can you dig into that a little bit? What is the driver of that? What wire? Why does that get constrained as Hopper is easing up? And how long do you expect that to be constrained? Do you expect the next generation to be constrained like like all the way through calendar 25? Like when do those start to ease?
spk11: Yeah, the first thing is. Overall, our supply is improving. Overall, our supply chain is just doing an incredible job for us. Everything from, of course, the wafers, the packaging, the memories, all of the power regulators to to transceivers and networking and cables and you name it. The list of components that we ship, as you know, people think that Nvidia GPUs is like a chip, but the Nvidia Hopper GPU has 35000 parts. It weighs 70 pounds. These things are really complicated things. We've built people call it an AI supercomputer for good reason. If you ever look in look in the back of the data center, the systems, the cabling system is mind boggling. It is the most dense, complex cabling system for networking the world's ever seen. Our InfiniBand business grew 5x year over year. The supply chain is really doing fantastic supporting us. And so so overall, the the supply is improving. We expect that demand will continue to be stronger than our supply provides and and through the year and we'll do our best. The the cycle times are improving and we're going to continue to do our best. However, whenever we have new products, as you know, it ramps from zero to a very large number. And you can't do that overnight. You know, everything everything is ramped up. It doesn't step up. And so whenever we have a new generation of products and right now we are ramping H200s. There's no way we can reasonably keep up on demand in a short term as we ramp. We're ramping Spectrum X. We're doing incredibly well with Spectrum X. It's our brand new product into the world of Ethernet. InfiniBand is the standard for AI dedicated. Systems. Ethernet with Spectrum X. Ethernet is just not a very good scale out system. But with Spectrum X, we've augmented layered on top of Ethernet. Fundamental new capabilities like adaptive routing, congestion control, noise isolation or traffic isolation. So that we can optimize Ethernet for AI. And so InfiniBand will be our AI dedicated infrastructure. Spectrum X will be our AI optimized networking. And that is ramping. And so with all of new products, demand is greater than supply. And that's just kind of the nature of new products. We work as fast as we can to capture with the demand. But overall, overall NetNet, overall our supply is increasing very nicely.
spk09: Your next question comes from a line of Matt Ramsey from TD Kawa. Your line is open.
spk05: Good afternoon, Jensen Collette. Congratulations. I wanted to ask, I guess, a two part question. And it comes at what Stacey was just getting at on your demand being significantly more than your supply, even though the supply is improving. And I guess the two sides of the question are, I guess, first for Collette. How are you guys thinking about allocation of product in terms of customer readiness to deploy and sort of monitoring if there's any kind of buildup of product that might not yet be turned on? And then I guess, Jensen, for you, I'd be really interested to hear you speak a bit about the thought that you and your company are putting into the allocation of your product across customers, many of which compete with each other across industries to smaller startup companies, to things in the health care arena, to governments. It's a very, very unique technology that you're enabling. And I'd be really interested to hear you speak a bit about how you think about quote unquote fairly allocating sort of for the good of your company, but also for the good of the industry. Thanks.
spk07: Let me first start with your question, thanks, about how we are working with our customers as they look into how they are building out their GPU instances and our allocation process. The folks that we work with, our customers that we work with, have been partners with us for many years, as we have been assisting them both in what they set up in the cloud, as well as what they are setting up internally. Many of these providers have multiple products going at one time to serve so many different needs across their end customers, but also what they need internally. So they are working in advance, of course, thinking about those new clusters that they will need and our discussions with them continue, not only on our Hopper architecture, but helping them understand the next wave and getting their interest and getting their outlook for the demand that they want. So it's always a moving process in terms of what they will purchase, what is still being built, and what is in use for end customers. But the relationships that we've built and their understanding of the sophistication of the build has really helped us with that allocation and both helped us with our communications with them.
spk11: First, our CSPs have a very clear view of our product roadmap and transitions. And that transparency with our CSPs gives them the confidence of which products to place and where and when. And so they know the timing to the best of our ability and they know quantities and of course allocation. We allocate fairly. We allocate fairly. Do the best we can to allocate fairly and to avoid allocating unnecessarily. As you mentioned earlier, why allocate something when a data center is not ready? Nothing is more difficult than to have anything sit around. And so allocate fairly and to avoid allocating unnecessarily. And where we do, the question that you asked about the end markets, you know that we have an excellent ecosystem with OEMs, ODMs, CSPs, and very importantly, end markets. What NVIDIA is really unique about is that we bring our customers, we bring our partners, CSPs and OEMs, we bring them customers. The biology companies, the healthcare companies, financial services companies, AI developers, large language model developers, autonomous vehicle companies, robotics companies, there's just a giant suite of robotics companies that are emerging.
spk00: Their
spk11: warehouse robotics to surgical robotics to humanoid robotics, all kinds of really interesting robotics companies, agriculture robotics companies. All of these startups, large companies, healthcare, financial services, and auto and such, are working on NVIDIA's platform. We support them directly. And oftentimes, we can have a twofer by allocating to a CSP and bringing the customer to the CSP at the same time. And so this ecosystem, you're absolutely right that it's vibrant. But at the core of it, we want to allocate fairly with avoiding waste and looking for opportunities to connect partners and end users. We're looking for those opportunities all the time.
spk09: Our next question comes from a line of Timothy R. Curry from UBS. Your line is open.
spk08: Thanks a lot. I wanted to ask about how you're converting backlog into revenue. Obviously, lead times for your products have come down quite a bit. Collette, you didn't talk about the inventory purchase commitments, but if I sort of add up your inventory plus the purchase commits and your prepaid supply, sort of the aggregate of your supply, it was actually down a touch. How should we read that? Is that just you saying that you don't need to make as much of a financial commitment to your suppliers because the lead times are lower? Or is that maybe you're reaching some sort of steady state where you're closer to filling your order book and your backlog things?
spk07: Yes. Let me highlight on those three different areas of how we look at our suppliers. You're correct. Our inventory on hand, given our allocation that we're on, we're trying to, as things come into inventory, immediately work to ship them to our customers. I think our customer appreciates our ability to meet the schedules that we've looked for. The second piece of it is our purchase commitments. Our purchase commitments have many different components into it, components that we need for manufacturing, but also often we are procuring capacity that we may need. The lengths of that need for capacity or the length of the components are all different. Some of them may be for the next two quarters, but some of them may be for multiple years. I can say the same regarding our prepaid. Our prepaid are predesigned to make sure that we have the reserved capacity that we need at several of our manufacturing suppliers as we look forward. So, would it read into anything regarding approximately about the same numbers as we are increasing our supply? All of them just have different lengths, as we have sometimes had to buy things in long lead times or things that needed capacity to be built for us.
spk09: Your next question comes from a line of Ben Wrights from Milius Research. Your line is open.
spk04: Yeah, thanks. Congratulations on the results. Collette, I wanted to talk about your comment regarding gross margins and that they should go back to the mid-70s. If you don't mind unpacking that. And also, is that due to the HBM content in the new products? And what do you think are the drivers of that comment? Thanks so much.
spk07: Yeah, thanks for the question. We highlighted in our opening remarks really about our Q4 results and our outlook for Q1. Both of those quarters are unique. Those two quarters are unique in their gross margin, as they include some benefits from favorable component costs in the supply chain, kind of across both our compute and networking. And also in several different stages of our manufacturing process. So looking forward, we have visibility into a mid-70s gross margin for the rest of the fiscal year, taking us back to where we were before this Q4 and Q1 peak that we've had here. So we're really looking at just a balance of our mix. Mix is always going to be our largest driver of what we will be shipping for the rest of the year. And those are really just the drivers.
spk09: Your next question comes from a line of CJ Mews from Cantor Fitzgerald. Your line is open.
spk13: Yeah, good afternoon. Thank you for taking the question. I have a picture question for you, Jensen. When you think about the million X improvement of GPU compute over the last decade and expectations for similar improvements in the next, how do your customers think about the long-term usability of their Nvidia investments that they're making today? Do today's training clusters become tomorrow's inference clusters? How do you see this playing out? Thank you.
spk11: Hey, CJ. Thanks for the question. Yeah, that's the really cool part. If you look at the reason why we're able to improve performance so much, it's because we have two characteristics about our platform. One is that it's accelerated. And two, it's programmable. It's not brittle. Nvidia is the only architecture that has gone from the very, very beginning, literally the very beginning when CNN's and Alex Kruschevsky and Ilya Suskova and Jeff Hinton first revealed AlexNet all the way through RNN's to LSTM's to every RL's to deep learning RL's to transformers to every single version. Every single version, every species that have come along, vision transformers, multimodality transformers, every single and then our time sequence stuff and every single variation, every single species of AI that has come along, we've been able to support it, optimize our stack for it, and deploy it into our installed base. This is really the great amazing part. On the one hand, we can invent new architectures and new technologies like our tensor cores, like our transformer engine for tensor cores, improve new numerical formats and structures of processing like we've done with the different generations of tensor cores, meanwhile supporting the installed base at the same time. And so as a result, we take all of our new software algorithm inventions, all of the inventions, new inventions of models of the industry, and it runs on our installed base on the one hand. On the other hand, whenever we see something revolutionary, we can, like transformers, we can create something brand new, like the Hopper transformer engine and implement it into future. And so we simultaneously have this ability to bring software to the installed base and keep making it better and better and better. So our customers installed base is enriched over time with our new software. On the other hand, for new technologies, create revolutionary capabilities. Don't be surprised if in our future generation, all of a sudden, amazing breakthroughs in large language models were made possible. And those breakthroughs, some of which will be in software because they run CUDA, will be made available to the installed base. And so we carry everybody with us on the one hand, we make giant breakthroughs on the other hand.
spk09: Your next question comes from a line of Aaron Rakers from Wells Fargo. Your line is open.
spk03: Yeah, thanks for taking the question. I wanted to ask about the China business. I know that in the prepared comments, you said that you started shipping some alternative solutions into China. You also pointed out that you expect that contribution to continue to be about a single digit center of your data center business. So I guess the question is, what is the extent of products that you're shipping today into the China market? And why should we not expect that maybe other alternative solutions come to the market and expand your breadth to participate in that opportunity again? Thank you.
spk11: At the core, remember, the US government want to limit the latest capabilities of invasive accelerated computing and AI to the Chinese market. And the US government would like to see us be as successful in China as possible. Within those two constraints, within those two pillars, if you will, are the restrictions. And so we had to pause when the new restrictions came out. We immediately paused. So that we understood what the restrictions are, reconfigured our products in a way that is not software hackable in any way. And that took some time. And so we reset our product offering to China. And now we're sampling to customers in China. And we're going to do our best to compete in that marketplace and succeed in that marketplace within the within the specifications of the of the restriction. And so that's it. You know, we this last quarter, we our business significantly declined as we as we paused in the marketplace. We stopped shipping in the marketplace. We expect this quarter to be about the same. But after that, hopefully we we can go compete for our business and do our best. And we'll see how it turns out.
spk09: Your next question comes from a line of harsh Kumar from Piper Sandler. Your line is open.
spk01: Yeah. Hey, Jensen Collette and video team. First of all, congratulations on a stunning quarter and guide. I wanted to talk about a little bit about your software business. And it's pleasing to hear that it's over a billion dollar. But I was hoping Jensen Collette, if you could just help us understand what the different parts and pieces are for the software business. In other words, just help us unpack it a little bit so we can get a better understanding of where that growth is coming from.
spk11: Let me take a step back and explain the fundamental reason why Nvidia will be very successful software. So first, as you know, accelerated computing really grew in the cloud. In the cloud, the cloud service providers have really large engineering teams and we work with them. In a way that allows them to operate and manage their own business. And whenever there are any issues, we have large teams assigned to them. And their engineering teams are working directly with our engineering teams and we enhance, we fix, we maintain, we patch the complicated stack of software that's involved in accelerated computing. As you know, accelerated computing is very different than general purpose computing. You're not starting from a program like C++. You compile it and things run on all your CPUs. The stacks of software necessary for every domain from data processing, SQL versus SQL structured data versus all the images and text and PDF, which is unstructured, to classical machine learning, to computer vision, to speech, to large language models, all of recommender systems. All of these things require different software stacks. That's the reason why Nvidia has hundreds of libraries. If you don't have software, you can't open new markets. If you don't have software, you can't open and enable new applications. Software is fundamentally necessary for accelerated computing. This is the fundamental difference between accelerated computing and general purpose computing that most people took a long time to understand. And now people understand that the software is really key. In the way that we work with CSPs, that's really easy. We have large teams that are working with their large teams. However, now that generative AI is enabling every enterprise and every enterprise software company to embrace accelerated computing. And when it is now essential to embrace accelerated computing because it is no longer possible, no longer likely anyhow, to sustain improved throughput through just general purpose computing. And all of these enterprise software companies and enterprise companies don't have large engineering teams to be able to maintain and optimize their software stack to run across all of the world's clouds and private clouds and on-prem. So we are going to do the management, the optimization, the patching, the tuning, the install-based optimization for all of their software stacks. And we containerize them into our stack. We call it Nvidia AI Enterprise. And the way we go to market with it is think of that Nvidia AI Enterprise now as a runtime like an operating system. It's an operating system for artificial intelligence. And we charge $4,500 per GPU per year. And my guess is that every enterprise in the world, every software enterprise company that are deploying software in all the clouds and private clouds and on-prem will run on Nvidia AI Enterprise, especially obviously for our GPUs. And so this is going to likely be a very significant business over time. We're off to a great start. And Collette mentioned that it's already at a billion dollar run rate. And we're really just getting started.
spk09: Thank you. I will now turn the call back over to Jensen Hwang, CEO, for closing remarks.
spk11: The computer industry is making two simultaneous platform shifts at the same time. The trillion dollar install base of data centers is transitioning from general purpose to accelerated computing. Every data center will be accelerated so the world can keep up with the computing demand with increasing throughput while managing cost and energy. The incredible speed up of Nvidia enabled that Nvidia enabled a whole new computing paradigm, generative AI, where software can learn, understand, and generate any information from human language to the structure of biology and the 3D world. We are now at the beginning of a new industry where AI dedicated data centers process massive raw data to refine it into digital intelligence. Like AC power generation plants of the last industrial revolution, Nvidia AI supercomputers are essentially AI generation factories of this industrial revolution. Every company in every industry is fundamentally built on their proprietary business intelligence and in the future, their proprietary generative AI. Generative AI has kicked off a whole new investment cycle to build the next trillion dollars of infrastructure of AI generation factories. We believe these two trends will drive a doubling of the world's data center infrastructure install base in the next five years and will represent an annual market opportunity in the hundreds of billions. This new AI infrastructure will open up a whole new world of applications not possible today. We started the AI journey with the hyperscale cloud providers and consumer internet companies. And now every industry is on board from automotive to healthcare to financial services to industrial to telecom, media, and entertainment. Nvidia's full stack computing platform with industry specific applications frameworks and a huge developer and partner ecosystem gives us the speed, scale, and reach to help every company to help companies in every industry become an AI company. We have so much to share with you at next month's GTC in San Jose. So be sure to join us. We look forward to updating you on our progress next quarter.
spk09: This concludes today's conference call. You may now disconnect.
Disclaimer