Duolingo, Inc.

Good evening, everyone. Welcome to Duolingo's fourth quarter and full year 2023 earnings webcast. Today, after market close, we released this quarter shareholder letter, a copy of which you can find on our IR website at investors.duolingo.com. On today's call, we will have Luis Van On, our co-founder and CEO, and Matt Scaruba, our CFO. They'll begin with some brief remarks before opening the call to questions. Analysts will be able to ask a question by using the raise hand feature. And please note this event is being recorded and all attendees are in listen-only mode. Just a reminder that we'll make forward-looking statements regarding future events and financial performance, which are subject to material risks and uncertainties. Some of these risks have been set forth in the risk factors of our filings with the SEC. These forward-looking statements are based on assumptions we believe to be reasonable as of today, and we have no obligation to update these statements as a result of new information or future events. Additionally, we'll present both GAAP and non-GAAP financial measures on today's call. These non-GAAP measures are not intended to be considered in isolation from, a substitute for, or superior to our GAAP results, and we encourage you to consider all measures when analyzing our performance. And with that, I'll turn it over to Luis.

Thank you, Debbie, and welcome, everyone. We delivered stellar 2023, surpassing the ambitious expectations we set out for ourselves at the beginning of the year. This was capped off by a record user growth, bookings and revenue profitability, and free cash flow in the fourth quarter. Stepping back, I'd like to put our 2023 performance in context by talking about how far we've come in the last few years. When we went public in July 2021, we laid out a plan showing rapid growth with increasing profitability over time. In 2021 and 2022, we delivered 55% and 45% year-over-year revenue growth, respectively, and had about break-even adjusted EBITDA margins. In 2023, we reached an inflection point, demonstrating our ability to get operating leverage and added over 13 points of adjusted EBITDA margin. That took our margin to over 17%. In short, we've been able to demonstrate that we can turn our incredible product into a profitable business. Now, how did we do this? We did this by making our app more fun, engaging, and effective, which encourages learners to tell their friends and family about us. The more learners we attract to our platform, the more learners we convert to subscribers. And the more subscribers we have, the more money we have to invest in our courses to make them even more fun, engaging, and effective, and so on. Since our IPO, we've added about 18 million daily active users and over 50 million monthly active users, most of whom have come to our platform through word of mouth. We've supplemented that organic growth with a cost-effective social-first marketing strategy, which earned us 3 billion social media impressions last year alone. Now, we accelerated DAU growth for 10 straight quarters, from Q3 2021 through Q4 2023, and I'm proud of that. But as we've said before, we can't accelerate user growth forever. This Q1, we expect DAU growth to be closer to the mid-50s, which is still impressive given how large our user base has become. For the full year 2024, we expect strong top-line performance from rapid user growth and continued improvements in free-to-paid conversion. As an example of the work we're doing around conversion and monetization this year, we're experimenting with ways to help free users select the best subscription plan for them. We will test different names, appearances, and packages to help users choose between our free, super, and max subscription tiers. We're also putting more resources behind our family plan, which has higher retention and increases our platform LTV. Today, our family plan has grown to about 18% of our subscriber base, and this year we started a dedicated family plan team who will look to capitalize on its organic momentum. We will also make additional strategic investments to drive long-term growth. We will continue developing advanced content for English learners who make up the largest part of our addressable market. We will also continue to develop our math and music courses by expanding their content and making them even more fun, engaging, and effective for learners of all ages. Last year, we reached an incredible milestone. Our learners completed their 100 billionth lesson. Perhaps even more impressive is that we have about 90% share of global online language learning MAUs. And yet, we still see so much more potential and opportunity ahead of us. There are hundreds of millions of language, math, and music learners out there who have yet to sign up for Duolingo. And we're working on winning them over. So while we're proud of how far we've come, I speak for everyone who works at Duolingo when I say we want to have more impact and we want to move faster. And that's what you'll see from us in 2024 and beyond as we continue to build our 100-year company. We're just getting started. And with that, I'll turn it over to Matt.

Thanks, Luis. I'll provide some additional color on what drove our outperformance this quarter, and then I'll discuss our guidance for the year. As Luis shared, we had a fantastic year capped off with record bookings and profitability in Q4. We exceeded our bookings forecast in part because of the continued acceleration in user growth in the fourth quarter, because we saw strength in our family plan throughout the quarter, and because we saw better than expected performance in our New Year's promotion. Our continued strength in user and subscriber growth drove bookings and revenue growth of 51 and 45% year-over-year, respectively, or 49 and 43% on a constant currency basis. Now, turning to 2024, as Luis said, we want to continue doing this year what worked so well in 2023. And we have strong momentum, which is why we feel good about our 2024 bookings outlook, which has bookings growth of 28% year-over-year at the midpoint. This growth comes even as we lap the really extraordinary growth we had in 2023. To give a bit more detail on our outlook, we are guiding to a Q1 bookings growth of about 35% year over year. We expect our bookings growth rate to gradually step down throughout the year from Q1 to Q4. And as usual, we expect that Q4 will be our biggest quarter in terms of dollar bookings. More specifically, from Q1 to Q2, we expect bookings growth to step down by about five points as we lap our exceptional results from last year. At current prevailing exchange rates, we expect foreign currency to have no material impact on Q1 or on full year 2024 bookings growth rates. and we'll continue to make progress towards our long-term profit target. We expect to add an additional 500 basis points of adjusted EBITDA margin this year to reach 22.5% at the midpoint. Our adjusted EBITDA margin will vary a bit quarter to quarter, given our bookings and hiring seasonality. Specifically, we expect adjusted EBITDA margin for Q2 to be lower than Q1, Q3 to be about the same as Q1, and Q4 to be the highest. For the full year, we are targeting an incremental margin at or slightly above our long-term adjusted EBITDA margin target of 35%. This year, we expect to achieve our adjusted EBITDA margin expansion by getting operating leverage across all three cost categories of non-GAAP OPEX. As to those categories of spend, R&D will remain our largest category because we have several areas in which to invest this year, because R&D is effectively a growth lever that drives word-of-mouth user acquisition for us, and it's how we make our app more fun, engaging, and effective over time. For sales and marketing, we plan to continue improving efficiency by being creative and scrappy, evidence of which you saw at the opening of this call with our five-second Super Bowl ad. We spent $700,000 on that in total and yet earned over 60 million social media impressions. For G&A, we expect to continue to get operating leverage as we scale. As to how our operating leverage will spread throughout the year sequentially, starting in Q1, we expect to see slight leverage in total non-GAAP OPEX as a percentage of revenue compared to Q4 2023. In Q2, we'll de-lever by a couple points, mostly in R&D, given the timing of our hiring and the seasonality of our bookings. And then we plan to see leverage again in both Q3 and Q4. Finally, we ended the year with approximately 49 million fully diluted shares outstanding using the year-end closing price. In 2024, we expect to end the year with about 1% net dilution from equity issued to employees, which is similar to the dilution we had in 2023. And with that, I'll turn it back to Luis.

Thank you, Matt. I want to close by congratulating our marketing team and our design department for their ingenuity to cheekily insert us into the most watched program in U.S. television history with our Super Bowl ad, which generated a lot of social buzz and brand love. And now we would be happy to take your questions. I'll turn it back to Debbie to manage the queue.

Okay, thanks, Luis. And as I mentioned earlier, if you have a question, just use the raise hand feature. And the first question comes from Ralph Shackert of William Blair.

Good afternoon, Luis and Matt. How's it going? Just a couple questions if I could. In the letter and on the call, you talked about the family terror. I think you're at about 18% now, and you talked about having higher retention rates. Maybe if you kind of frame the retention here versus the rest of the business, and then more broadly, how should we think about retention rates going forward versus how we trended in 2023? Then I have a follow-up.

Sure. Yeah, happy to talk about the family plan retention rate. So Ralph, as you know, we manage the business to LTV. So that's why retention is important. The family plan does have a materially higher retention rate on an annual basis compared to the other to the annual plan. And so and it also has a higher price point. So it's just all around a higher LTV product. So as we shift more towards family plan, we're just really trying to optimize the LTV of the platform over time. And we think there's a lot of opportunity to do that this year.

Right. And then historically, I think you've talked about adjusting regional pricing. Maybe sort of give us a reminder of your strategy for the rollout for the share. You know, we'll be phased approach. We'll be sort of country by country. Just any color you could add on that. Be great. Thank you.

Yeah. Yeah. So, again, pricing is another lever that we use from time to time. We experiment with this year. I think the pricing story will be less around regional pricing. So if you remember, we rolled out a pretty broad based around the world regional pricing change in twenty twenty two. We've basically lapped that in a revenue perspective throughout the course of 2023. If we change prices this year, we will from time to time with experiments. But the bigger... overall price change for this year will be as we experiment with the three tiers. So we saw a lot of demand at higher prices for our max offering. And we're going to experiment with that this year and see what happens. And that's where I would expect to see more impact on pricing throughout the year as we roll that out. Thank you.

Thanks, Ralph. And the next question comes from Aaron Kessler of Seaport Research.

Great. Thanks, guys. A couple of questions. Maybe just first, maybe on the in-app purchases, if you can give us your thoughts on growth there, how we should be thinking about that for 2024, as well as maybe some of the other revenue lines within that, including doing English tests and advertising. And then just anything, ways we should be thinking about paid subconversion as well for 2024.

Sure. I'm happy to start and Louise can jump in. So, you know, again, Aaron, as you know, the biggest line item of our business is subscriptions. That's going to continue to be the focus, both of revenue growth, bookings growth this year, but then also of resourcing. And so when we look at ads, ads grew a lot slower than subscriptions in 2023. I expect that kind of ad growth delta to be relatively similar in 2024. I don't I don't see ads picking up speed compared to our subscription product. DET is still early in its journey. It's had enormous growth over the past several years. It's 30x. It's a little bit harder to forecast, but it's typically grows slower than our subscriptions as well. And then IAP is the last remaining piece. In 2023, it grew really impressively. And in 2024, I would expect it to grow nicely as well. But, you know, it grew so rapidly in 2023, hundreds of percent. I don't think it can grow as fast as that. So I'd expect it to grow probably more in line with all the other revenue lines.

Great. And just that paid sub-conversion, any good ways to think about that for 2024?

Yeah. So the way we think about paid sub conversion internally is on a cohort basis. And throughout 2023, essentially every cohort of new users had higher free to paid conversion. So we we felt that that was evidence of really adding high quality users to the platform. we don't see any reason that that's likely to change in 2024 as of now. What that means at the aggregate level on a, if you do the subs to last 12 months MAU ratio that we publish, I wouldn't expect that to move all that much this year, just given how rapidly our MAU bases scale.

Great.

Thank you.

Okay. Your next question comes from Zach Morrissey of Wolfe.

Great. Thank you. I guess first, just on the 2024 outlook on the user side of things, just only kind of expecting a slight deceleration. Historically, we've seen you've called out kind of these one-off events like Barbie or House of Dragons. It's kind of been a nice tailwind for users. So just curious kind of what you're seeing today or kind of have line of sight to throughout the course of the year that kind of gives you comfort on the user growth kind of sustaining these really strong growth rates going forward.

Yeah, thanks for the question. So, you know, we're the majority of our growth comes from just making our product better. I mean, it's mainly word of mouth. And because of that, it's actually quite predictable. I mean, it's not perfectly predictable. It's quite predictable because we just know that our product just keeps getting better and better. So we expect that to be the case in this and throughout this year. You know, we're, of course, very proud of the fact that for 10 quarters in a row, we accelerated user growth. And, you know, that that's what's kind of surprising that we just we always kept on thinking, well, maybe this is, you know, we're going to kind of not accelerate user growth anymore. But we did that for 10 quarters in a row. This time around, we expect kind of mid-50s going forward. And part of the thing that also helps us feel comfortable about this is we just have so much more of a TAM. I mean, there's about 2 billion people in the world learning a foreign language. We have close to but slightly under 100 million MAUs. So there's just a lot more room to grow. So we feel pretty good about that.

Great, thanks. And then just one on, you know, I think you're leaning into AI to kind of help generate kind of content creation and personalization of some of these courses. Just curious for like a progress update there and kind of, you know, I think there were press reports earlier this year in terms of that kind of helping also drive kind of cost efficiencies in the business as well. Just curious how you're thinking about the kind of opportunities to see kind of further kind of leverage from AI there.

Yeah. Um, well, first of all, the press reports, uh, you know, they're kind of a trigger point for me. Uh, the press reported that we did layoffs based on AI. That is actually not what happened. Um, we, you know, we we've, we've always had a contractor force that these are some of, you know, hourly workers doing some stuff like translation and stuff like that for some of our content. Uh, we did reduce our contractor force, but that this was not like full-time employee layoffs or anything like that. Um, And yeah, probably the biggest reason for the reduction of the contractor force was the use of AI. I mean, wherever we can in the company, if something can be done by AI, we're going to take the opportunity. The places where we're using AI, there's kind of two big places. One is just in our content creation. And not only are we reducing costs there, but probably even more importantly, we're able to do things a lot faster. And what's good about that is it also allows us to experiment faster. See, it used to be the case, for example, we have this feature that we're rolling out that's called Duo Radio that requires the generation of a bunch of data. If somebody had asked me to do Duo Radio five years ago, I would have told them, you're crazy. It's going to take us 10 years to generate that data. Now we know that it'll take us a few months to generate that data. So now we're actually willing to create a feature based on it. So the fact that we've accelerated this just opens the doors for a lot of stuff. That's what I'm most excited about. That's one place for AI. And the other place is just generating features or putting out features that are interactive based on AI. So we have role play. We have explain my answer. We're starting to experiment with actually having a spoken conversation with one of our characters. And it's a really cool feature. So that's the type of stuff that you'll see us do. I mean, we're leaning very hard on this. And it's, you know, it's a great technology.

Great.

Thank you.

Okay. The next question comes from Andrew Boone of JMP Securities.

Great. Thanks so much for taking my questions. I wanted to ask about top of funnel trends as it relates to the mid 50s percent growth guidance that you guys gave. Understood last year had a bunch of moments in terms of Barbie and everything else. The clip you guys showed at the beginning. Can you just talk about top of funnel and maybe download growth as it relates to 23 versus 22 and then extrapolate that into 24? Whatever top of funnel metric you want, Matt.

Yeah, I mean, you know, I could let Matt talk about some of the stuff, but, you know, we feel pretty good about Top of Funnel. Like I said, the vast majority of our growth comes from just word of mouth. And these are, you know, there's some nice events like the Barbie and stuff like that, and they're good. But still, it is the case that most of it just comes from people telling their friend or family member to download Duolingo. And that just remains pretty constant. So, you know, we see from what we see just looks very strong. I don't know, Matt, if you have anything else to say.

No, I think that's right. I think we're getting, you know, we have visibility obviously into Q1 and that's the mid fifties and being in the 50 to 60% range and seeing that go up or down. The point we are trying to make is just that it's not always going to accelerate from here in terms of top of funnel. I think I just remind everyone that like there's brand new to the platform users and then there's resurrected users, which we call folks. We call folks who haven't been using the platform for the past 30 days, but come back. resurrected. Those are about an equal proportion on any given day. And so it's, it's word of mouth that Louise talked about, but then it's also just making sure that folks are reminded that they like Duolingo and they'll come back even if they haven't been using it for a while. And that's a big portion of this. So like Louise said, like we feel pretty good about it. And you know, I don't, I don't, we don't see anything right now that says it's going to be all that different than, than what we're talking about.

And then I wanted to ask about the tiers that you guys are testing. Understood that you guys are going to have, you know, a premium kind of standard and a free model. But what about the opportunity to just take price within the U.S.? Right. Understood you guys were regionally. How do you guys think about pricing more broadly for kind of U.S. where you guys are seeing that strong demand? Thanks.

Yeah, generally with pricing, I mean, we're going to experiment. I mean, we're pretty open to price experimentation and we do that. And, you know, just to remind you in terms of our... are improvements in monetization we just have a lot of levers where we can pull and we try to order them by kind of return on investment pricing is one lever we have the multi-tier strategy as another lever we have the family plan as another lever we have all these and so the teams that are working on this uh have a long list of things and it's ordered by uh return on investment pricing we will probably see us experiment pricing not just in the u.s but you know worldwide and I just can't tell you what the results of those experiments are going to be because I just don't know myself, but you'll see us experiment for sure. Thank you.

Okay, the next question comes from Alex Sklar, Raymond James.

Great, thank you. Luis, I know it's a bit early to talk about the results from having some of the advanced English content that you had talked about in the shareholder letter, but 17 courses now with advanced English available How do you plan to kind of grow the awareness of any formal marketing plans behind that and then think about broader monetization now that you have that in there?

It's an excellent question because it's something that we are really talking about. So just to put things in context, if you look at the larger language learning market, like the market as a whole, by far, the largest number of learners and also the largest amount of spent comes from English learners. It's like 80%, give or take. that is not quite true in our platform. So this is why we see this as a major opportunity. Now, the reason that hasn't been quite true in our platform is because Our English courses have not had very advanced content. We actually have a different English course based on your native language. So we have an English course for Spanish speakers, an English course for Chinese speakers, et cetera. And they went to varying degrees of proficiency. The first thing we needed to do if we really wanted to increase our business among English learners is take all of these courses to a more advanced level, at least have the content there. I'm very happy to say that we have now put the content there. That's good. And we, in fact, see that the number of users, you know, this is one of the nicest graphs that we have in the company is the number of users that are interacting with our advanced English learner is basically up and to the right. So we see that users are starting to interact with it. And we think there's a lot more room there now. adding the content was just the first step in a multi-step strategy because first you have to add the content. The second thing, the second problem we needed to solve, and that is one we are currently solving, it has not yet been solved, is it turns out English learners are a little different than learners of most other languages. For most other languages, learners of French, learners of Spanish, we have a pretty good idea of what they know before they come to Duolingo. And usually, by the way, they know very little. And we have a pretty good idea of what they know, so it's relatively easy to place them in the course. English learners, because English is such a cultural language for the world, people know this weird patchwork of knowledge where they, you know, most of them took some amount of English in like middle school or high school, but also they watched some movies, but also they've listened to some Taylor Swift songs, but also they, so they have, they just have this weird patchwork of knowledge and we have not done a great job when they come in and placing them at the right spot. So that's one thing that we're working on. And when we're able to do that, I think that we're going to be a much better product for people who come in to learn English because the vast majority of English learners have some prior proficiency in this kind of weird patchwork way. So that's step number two, and that's what we're working on. Step number three is what you mentioned. We do have to get the word out that we're good for advanced English learners. That is not currently as well known as, you know, for either beginner English learners or other languages. So you're probably going to see us do some amount of marketing for that. And then, of course, the last step is being able to capitalize in terms of getting them to subscribe. But we need to do the first few steps before we do that. So my sense is that it's going to be 2024 and 2025 where you see us kind of really grow this user base. And somewhere in 2025, we'll start really capitalizing on this. You may see some amount this year, but my sense is more will come in about a year.

That's great context. Just as a follow up, Matt, just given that what you've talked about tonight in terms of the family plan booking success, you're going to lean into that a little bit more. It sounds like in the coming year, continued international growth. How can we think about the shape of kind of the blended ARPUM heading into 2024?

Yeah, it's a great question. So I'll just give you my normal disclaimer, which is we don't run the business on ARPU. We run the business on platform LTV and experiments to drive bookings. That said, ARPU obviously comes out of that and we pay attention to it. In 2023, the ARPU, because as I mentioned, we were lapping... the price change we did in 2022, ARPU about every quarter went down between 7% and 8%, more or less in 2023, except for Q4, which went down by about 4%. And then we expect Q1 to be a little closer to zero and then, you know, lap it throughout the rest of the year. So that's roughly our trend. Now that will change depending on the experiments, right? So if we have a successful set of experiments on a three-tier strategy, that could raise ARPU. Luis and I, Luis already mentioned pricing experiments as well. So, but that's the current course in speed. Awesome. Thank you both.

Thank you.

All right, next question comes from Ryan McDonald of Needham.

Thanks for taking my questions, and congrats on yet another great year. Luis, I'm curious, so you obviously launched math and music into the Core app late in 23. I'm curious, as you're sort of monitoring the progress there, I think learners have the capability to sort of complete their Duolingo each day, you know, not just from language, but in math and music, and just curious what you're seeing sort of the early days, um, on the progress there. And if we're getting to a stage yet, especially with math, where you can start to then see enough usage where you kind of turn the screw on, on, on monetization there.

Yeah, it's a great question. So, so yes, to put things in context, we did, we added math and music as courses into the main language app into our main app, the Duolingo app, uh, really about a quarter ago. Um, uh, And what that means is that it's just, as you said, basically all of our growth mechanics work for math and music. So you can complete your streak by doing a math lesson, you know, with math users compete in the leaderboards, et cetera, and musically. Basically, all the growth mechanics come for free by having added math and music to the main app. This is why we did that. We're very happy with the results so far. These courses obviously are much smaller than our language courses because we're well-known worldwide as a language learning app. We're not yet as well-known as a math app or a music app. So they're much smaller than our language courses. But even if that's the case, and even if it's only been for like three months, our belief is that we're either already the largest or among the top largest in terms of DAUs of apps where you can learn math or music. And that just shows you the power of our platform. Now, Even though that's true, these are so much smaller than language learning that for, you know, for my sense is for this whole year, you're probably just not going to see a lot of impact. I mean, these are growing quite a bit. It took us 12 years to get there for language learning. The hope is it won't take us 12 years to get there for math and music, but it'll probably take us a few years. I mean, these things are still in the oven, but the results that we have so far, we're very happy with and they are much better than the results we had before. after we launched language learning. So if you rewind 10 years ago and you look at language learning, these courses are just way ahead. So we're very happy with that. But again, these things are still in the oven.

So cool. Maybe this one's a bit more qualitative, I guess. Obviously, you talked about the success you've had with sort of large viral moments or cultural moments over the past year. And maybe some of that came by chance, some of that being strategic. But Are you taking any learnings from that this in 23 and applying that to 24 to maybe be more proactive in how you're creating that marketing strategy around, you know, let's say you've got a large dune release, you know, coming up this weekend. That seems to be highly anticipated to try to position yourself better for some of those moments moving forward.

Yeah, I mean, it's an excellent question, I think. It's true that some of these things we just can't control. I mean, it comes from us. We get a lot of inbound. We're in a very nice position where brands or movies or TV shows think of us and they come to us. We can't control that much, but it's awesome that that happens. That said, our marketing team has just gotten so good at knowing where to get involved, what to comment on, that even though some of these things we can control, many others we can. And many of the other things that may just seem like they were just out of the blue were things that were fully planned by our marketing team. And so we're just going to continue doing that. I mean, I've seen the plans. I don't want to spoil the surprises, but we have a robust plan for the rest of the year in terms of viral moments. Now, not all of them will work. You know, we'll try some stuff that will probably flop, but some of it will work. And we feel very good about that. So I think just the team has just gotten really good at being in the zeitgeist. And so, yeah, I'm very happy with that. My meetings with our CMO are usually awesome because he always has really funny videos to show me of things that they're preparing.

I can only imagine. Well, congrats again. Thanks for taking the questions. Thank you.

Thanks, Ryan. And the next question comes from Mark Mahaney of Evercore.

I'll ask two questions, please. First, on the incremental margins that you're guiding to for this upcoming, for this year, 35%. So those are very intrinsically robust EBITDA margins. They are lower than what you did in 2023. Is there anything to read into that? Is there any sort of structural change in the business in terms of cost requirements of new growth areas or something like that? And then secondly, you've given interesting disclosures in the past on how growth in terms of bookings or revenue in your most mature markets, the U.S. compares with that on your global average. Any update you could provide there? How does the U.S. bookings growth of North American bookings growth compare with that of the business as a whole? Thank you very much.

Yeah. Thanks, Mark. So the adjusted incremental adjusted EBITDA comment in the guide. You know, look, our belief is that we want to make every year progress towards our long-term margin. To do that, you have to be at or above your long-term margin in terms of incremental margin. That's what we're doing this year. As we talked about on some calls last year, companies that we respect in our industry that go from being kind of not profitable to then materially profitable usually make a big jump in their first year where the incremental margins are a lot higher. And then that usually comes back down towards their long term margins. I don't think we're paving new ground there. I think that's normal course. In terms of why that is, though, I just want to remind you, like, the reason is, is because we have a ton of runway ahead of us in our core markets and we're adding math and music and, you know, we're just excited about that investment in our R&D function. And so there's really nothing else to read into it other than we're excited about the opportunity ahead of us and we're going to continue to invest in kind of our core R&D and in business in that regard and still make progress, though, every year towards our long-term margin. Yeah. And then can you remind me that the second question was the disclosure around geography? So historically, we've talked about usually is the DAU growth. And so what we're looking at is when we grow so rapidly, is that what we call consider high quality and broad based, broad based, meaning, you know, countries that are big for us like the US or some European countries? Are those growth rates close to the average growth rate or not? And they can they still are close. And then we look at the conversion from free to paid to see how high quality those users are. And are those cohorts globally trending the right way over time? And they have been. And so our growth in Q4 was still broad-based and high quality.

And then would you, one last question, would you call out any interesting international markets? You know, English language can have such a material impact on, you know, earnings generation for people in multiple countries outside of the U.S. I know some of us here can improve our English. I do. But are there particular international markets you'd want to call out as showing particularly interesting organic growth for Duolingo?

Yeah, the we bucket the the world into kind of four big segments. And one of our segments is, you know, Southeast Asia and Japan and then including China as well. And then Europe. Both of those have shown really robust growth. Japan in particular has grown really nicely. You know, we've seen a lot of countries in Europe grow nicely. So it's hard to single out one particular country, just given how broad based it's been. But but those are a couple I'd say have grown really nicely over the past year. Thank you, Matt. No problem.

So our next question comes from Justin Patterson of KeyBank, who I understand is driving and not going to be on video.

Be careful, Justin. Yeah, but thank you very much. And I'd also like to echo Luis's thanks to the marketing team for allowing me to cheekily insert myself into the call with this avatar while I was in transit. So thank you. I try, Matt. I try. So just a big picture one for you and Luis. You've had the new user interface out for over a year now. How much more of a ceiling do you think you have to go here with the product and growth teams as you just look at the opportunity to improve KPIs? It just feels like you have a much broader canvas to A-B test against, and you also have a much larger DAU base that's grown over the past year.

Yeah, it's an excellent question. I mean, we're The teams that are dedicated to trying to figure out how to grow faster are just, they're firing on all cylinders. They, you know, what you'll see, you'll see us, we have a portfolio approach where you'll see us try a lot of kind of these really small A-B tests that end up compounding a lot. So we're definitely going to do that. But we also see us try bigger things. I mean, one of the things that, you probably see more of in the, in the coming months or years, it's just our app becoming more and more social. So you, you, you'll see that we're, we're spending effort on that. Um, you're also going to see, uh, uh, us experimenting with placing people better. This is what I was talking about with the English learners. Um, you're also going to see us experimenting with just teaching, uh, conversation a lot better. Um, And so these are kind of the big things that we're doing, but really there's a lot of stuff that they're working on with, you know, literally hundreds of A-B tests per month. That pace has not decreased at all since, you know, since the last few years. In fact, the pace is increasing.

Got it. Thank you.

Okay, great. Next question comes from Chris Kuntarich of UBS.

Great. Thanks for taking the question. Can we just unpack some of the strengths? Yeah, just a little bit more color on the strength in the family plan that you saw in 4Q. And maybe can you just talk about how we should think about or what you all are seeing as far as family plan adoption from English learners versus non-English learners?

Yeah, I'm happy to start. Then Luis, you can jump in on the last one. So when we talk about the strength in the family plan, What's been surprising is that we haven't actually had a ton of resources devoted to taking that product and adding and doing our normal A-B testing on that as a tier or as a subscription bucket. What we did was we released it. We were excited about it, and it's grown really naturally organically. Um, so when we talk about strengthening Q4, you know, it grew over a hundred percent year over year. Uh, so just an enormous amount of organic demand for that product, because it's a fun product. You know, you want to do, uh, you know, duolingo with friends and family. You want to do math and music with friends and family. It's just kind of a natural fit. And that's why this year, you know, I can't lay out specific roadmaps other than what Luis has already talked about generally, like making it more social, just making it a more engaging experience. But we're going to have more devoted resources to it this year, which gives us confidence that it could really, you know, grow nicely, even above and beyond kind of that organic demand that we're seeing in the platform.

Yeah, I'm generally very excited by the roadmap of, it'll just be a much better, I mean, right now, we just put a plan out there. And, you know, there were all kinds of things. For example, we just solved a really dumb bug that was, in the family plan, your children were there, but you actually couldn't see their name. It's just, that was just dumb. So, you know, this is, we're just starting with that, but you're going to see us just making it a much more robust product. And, you know, you asked about the difference between, you know, English learners or not in terms of adoption of the family plan. I don't think there's anything different in terms of family plan versus the rest of our subscriptions. I mean, generally, we see higher penetration of subscription in wealthier countries. Certainly the US has higher penetration and usually English learners come from less wealthy countries. So there's probably a, you know, basically family plan is no different than the other subscriptions.

Got it. Very helpful. Maybe just one follow up. Any way to think about kind of the shape of marketing spend or sales and marketing expense throughout the year?

Thanks. Yeah, for sure. So, I mean, in general, you should continue to expect two things from our sales and marketing spend. The first one is that it should increase on absolute dollars, but it should grow obviously slower than bookings. And so historically, I don't think there's going to be anything from a seasonality perspective this year that would be all that different than last year. So you typically see us spend a bit more in like the Q3 timeframe, for example. Um, that's usually our summer campaign back to school area, but I think the seasonality for sales and marketing should grow, should go roughly as it has in the past couple of years. Okay. Thank you.

And our next question comes from, uh, Curtis Nagel at B of a, who is also not able to be on camera. Uh, do we lose Curtis? Okay. Well, I don't see Curtis in the queue anymore. So that looks like our last question. I think I'll turn it back to Luis to wrap up.

Well, thank you, Debbie. And just thank you all for joining us. And we look forward to speaking to you next quarter. Please do your Duolingo lessons. We expect you to have a perfect streak next quarter. Have a great evening.

Thanks, everyone.

See you guys.