# OpenRouter CEO on AI Infrastructure, Multi-Model Strategy & Market Dynamics

**Podcast:** The Twenty Minute VC (20VC): Venture Capital | Startup Funding | The Pitch
**Published:** 2026-08-10

## Transcript

This is going to be like the biggest, biggest market in tech ever.
A lot of companies are making routers because it's fashionable.
The model labs have several incentives to go after you eventually.
In July, we launched 70 models, about one model every 10 hours.
America is very, very behind still.
But GLM 5.2 was a really big.
big step for open weight models.
There are reports that you are selling to Stripe for $10 billion.
Is that going to happen?
This is 20VC with me, Harry Stebbings.
Now, the only thing that I really care about anymore is providing the best, most relevant interviews at the right time to you.
So today we have Alex Atala, co-founder and CEO of OpenRouter, the gateway to the world of LLMs.
They reportedly have had offers from Stripe for $10 billion.
They've raised at a valuation of over a billion and a half.
They are the market leader.
And this interview could not come at a more prescient time.
It'll be very interesting.
to see whether the company chooses to stay private or sell to Stripe.
We shall see.
But this interview was recorded before, so we will check back in a couple of weeks.
This was an incredible show, and it was awesome to have Alex in the studio.
But before we dive into the show today, founders face a different set of challenges at every stage of growth.
For Sid Shait, co-founder and CEO of Dematrix, JPMorgan delivered the guidance and expertise to help navigate what came next.
He credits JPMorgan's high-touch approach with supporting Dematrix as it grew and expanded internationally.
Whether you're in the early days or expanding into new markets, JPMorgan helps startups navigate complexity with real confidence, offering personalized guidance and deep sector expertise.
Find out how JPMorgan helps...
founders at jpmorgan.com forward slash grow without limits.
JPMorgan is the bank of the innovation economy.
While JPMorgan supports growth, Corgi protects it.
My word, what an arresting first line.
Get your ass covered with Corgi insurance.
And I'll tell you why.
If you're running a business right now, you already know this pain all too well.
Getting insurance, it's really slow.
It's confusing.
And my word, it's full of paperwork.
Well, that's exactly why Corgi is here to change the game.
Corgi is the first and only insurance carrier designed specifically for tech companies, allowing you to get covered in minutes instead of days.
Corgi provides essential coverages for all growth stages, such as...
D&O, E&O liability, cyber, commercial, general liability, and more.
Get your ass covered.
I love the way we say ass with Corgi Insurance alongside thousands of other startups at corgi.com forward slash 20VC today.
That's corgi.com forward slash 20VC.
You won't regret it.
While Corgi covers risk, Flex gives you room to move.
Business owners run their whole financial life on Flex.
One platform from business revenue to their personal spend.
Float every purchase for 60 days.
Tap capital that grows with your revenue and pay vendors in 170 countries across 32 currencies.
Plus, the whole back office.
Bills, expenses, accounting, all in one place.
So you spend less time reconciling and more time growing.
That's why thousands of owners use Flex, named one of Fast Company's most innovative companies of 2026.
Visit flex.one, that's F-L-E-X dot O-N-E, and use the code 20VC.
You have now arrived at your destination.
Alex, I am so excited for this, dude.
I have wanted to make this one happen for a while.
I've heard so many things from Matt at Menlo.
I've stalked the shit out of you speaking to Anjni, even your roommate before this show.
So thank you for joining me, dude.
Thank you.
It's great to be here.
Now, I want to start with a little bit pre-OpenRooter and start on OpenSea.
It was a pretty incredible journey.
What did you take with you to OpenRooter, having seen all that you saw with OpenSea?
Yeah.
So OpenSea started as the first NFT marketplace.
Similar to OpenRouter, it was very small for a long time.
We kept the team very small until the series A roughly, a little bit afterwards.
And this was before AI.
Right after NFTs started blowing up in 2020, October of 2020, we were like, oh my.
goodness, we are understaffed.
The servers are melting.
Our search index was exploding.
We had a couple big outages.
It was tough to keep the site up.
And it was like, oh my God, we're going to become the Twitter fail whale, but applied to crypto.
My biggest goal was to have us not be the Twitter fail whale for crypto.
And it took a little bit to create the team, get platform and infrastructure under control, make sure we We could predictably scale.
In other words, do load testing to help the site sustain 10x load, even when we weren't seeing that load.
Because with crypto, you just don't know.
There were these moments where we would get these incredible traffic spikes, and it would be very dependent on the content and the community.
So I built a lot of infrastructure and scaling responsibilities then that I took to OpenRouter and spent a lot of time thinking about, okay, how do we make something that is going to basically be always up and that people can really count on from an infrastructure point of view, even when there are huge surges in tumultuous markets, which has been very helpful for AI, of course, because all companies, especially in Thropic, have seen unpredictable growth, and we have as well.
And we've had a couple bumps, but overall, it's been significantly better.
And OpenSea just kind of like drilled that into me in a way where I could like take it productively to OpenRouter.
Can I ask you, when you go back to the founding thesis of the company, what has happened in the ecosystem, in the model landscape that you did not expect to happen?
Well, one thing that we did not expect was that an ecosystem of companies would emerge to host and serve the open weight models.
Like early on, it wasn't clear that that market wasn't going to be a monopoly where like just the three hyperscalers serve all the open weight models and startups don't, you know, they're really far behind.
In reality, you know, how often do you hear people running?
GLM on a hyperscaler.
Never.
Like they're using the inference providers like Fireworks and Together.
And there's like big lists that we see doing the best job of hosting all the open weight models.
In the early days, we had...
I think we called it Provider 1 and Provider Fallback.
We didn't show which providers were actually doing the hosting because we weren't really a marketplace.
We were kind of an exploration tool for finding and discovering new LLMs.
And we wanted to build a marketplace of model labs, but the inference provider layer, we weren't sure would actually be a marketplace.
And it turned out that those companies were doing a way better job than the hyperscalers, were way faster to host the models.
and figure out these edge cases to hosting them.
And uptime was just going to be a constant problem.
It wasn't going to magically get solved by the supply side of the market.
A lot of people suggest that that inference provider layer is a commoditizable element or layer that will be removed or see margin reduction competed out over time.
What would you say to that theory?
Right now, we're in a massively supply-constrained market.
And it's likely going to be supply-constrained for a while, where all the inference providers are short, pretty much constantly short.
And you're like, OK, so GPUs are really, really beneficial.
And why doesn't Google or Amazon or Azure run around and buy up all the GPUs and take all these inference providers out of business?
Well, the people making the GPUs don't want that.
One of NVIDIA's top priorities is not having customer concentration.
They want lots of customers to all have separate allocations of GPUs.
They want the heterogeneity of the market.
competition on the compute layer.
And this is good for the ecosystem.
Users also want this.
It's good for NVIDIA and it's good for end users as well.
It allows these inference providers to come up with new innovations on how to serve the models better.
Even a single model, like Kimi K3, Moonshot just posted a benchmark showing all the inference providers and how well they're serving Kimi K3.
They're pretty different numbers for benchmarks that are really static, that are well known.
We post this continuously all the time.
We always are like benchmarking all the models on all of the inference providers, all the open weight providers, and finding really different results.
constantly.
The results change over time.
These models are like very, they're very emotional.
They're very non-deterministic.
I had Lynn on the show from Fireworks and she said that, you know, I said about Gavin Baker and a token is a token is what he said.
And she kind of corrected me that a token is not a token actually because one provider can make a token go so much further than another token.
It's like, how do you get to the store where you can drive around the whole block or you can drive straight to the store?
Tokens can be made more efficient.
and go further.
And that's the job of the provider.
Yeah, I agree with that.
I think that in some ways we are providing a service to help people discover providers.
Ultimately, when one provider is making a token go further.
We spend an enormous amount of time on our router, central router tech, so that that provider immediately gets more traffic.
As soon as we detect that there's a quality improvement or a speed up or a price reduction happening, immediately starts getting more traffic.
This stuff happens 24-7.
Every five minutes, there are big changes for the big models.
And so it actually does make the experience better.
You can only invest in one inference provider.
Which one do you invest in?
I probably have to stay neutral on this.
I really like the inference providers that are doing custom hardware and very, very low-level optimizations.
I like providers that are also trying to figure out how to make customization easier.
Today, you fine-tune models, and you create this new, fully independent model from the base model.
Many inference providers are creating these Lora's or some call them cartridges that are much more portable potentially between models.
And we might see a future where like when you do a fine tune and you want to like change the base model layer, it only costs like maybe a few hundred dollars, maybe a few dozen dollars to change it.
It's okay.
I understood that Fireworks is your favorite.
It's okay.
I get it.
Mine too.
My question is that when Lynn was on the show, she was like, oh, you don't want to rent your intelligence.
You want to own it.
And we're going to see companies have specialized models, which is trained on their own data and proprietary to them.
In a world of every company having specialized models that's really tuned to them and their preferences, is that good for an open route of business or not?
Oh.
Definitely.
I mean...
Why?
Because you'd stick on one model, which is yours, proprietary, trained on yours, and not be open to the diaspora of models that is available.
No, I disagree.
I think our mission from the very beginning has been to increase neurodiversity in AI for the whole ecosystem.
And we really believe that a multi-model future is inevitable.
When you start...
Let's say there's one model that like, you know, hypothetically, let's say you're right.
Let's say there's one model that fulfills all of your desires, either within your company or like as a consumer.
More and more people start using that model.
And then someone decides, you know what, I'm going to like create a neurodivergent model.
I'm going to create a model that's like a little bit different, that like talks a little differently, that has ideas that the first model like could never have come up with because it's like completely different data that's being used to train it.
Then it kind of creates inevitable demand to use both models.
But creativity is not verifiable.
You can't really put an easy number on creative ideas.
And when you use two models together, you're more likely to get creative ideas than if you just use one.
It's just if that other model was trained in a different way on a different data set or has made a big update.
Consolidation on one model just seems like it just doesn't make any sense to me.
Totally get you.
So you'll have companies which have a core workflow or their core, which is their own specialized model, and then they'll use a plethora of other models and they'll use OpenRouter for those other model selection.
Yes.
And I think that when companies make...
To get back to your question, when they make their own model trained on their own data, the ecosystem around you is all doing the same thing.
You have to play out the game theory for these things a little bit.
If everybody is doing this as well, and all the model labs are creating new models constantly, using new data that they've acquired, that they've bought from other companies, that's all potentially data that's valuable to you, what is in your best interest?
It's to go and try out those other models and see if you can be more productive.
with them, if you can merge them together to get better state-of-the-art performance, if you can reduce your costs using these other models.
Whether your goal is to improve your margins or grow your company, you are incentivized to go use what the ecosystem creates.
So the model that you made, you're going to have to continuously improve it to keep up.
It's never going to win the whole market.
So this is going to be a massive market.
This is going to be like the biggest, biggest market in tech ever and biggest market probably in human history.
No one's going to win all of it.
You're not going to build a model that wins all of it.
So you might as well build a model that is known to specialize in something very useful and that's very important to your company and your business and be known.
for that specialty.
And I think a lot of enterprises are going to move that direction, make their own models, make their own branded intelligence.
Your brand is a big part of your moat.
And that model will be a way your brand carries around.
You mentioned the immense time that you spend on the routing technology that you have.
A lot of people are thinking that we're seeing the commoditization of the routing technology.
You're seeing ramp release products like this.
I mentioned earlier of Merge, a company we invest in has released that product.
Several are releasing kind of routing technology.
similar or claiming to be similar.
Are we seeing the commoditization of this layer?
I think a lot, yeah, a lot of companies are making routers because it's fashionable.
You know, they're seeing growth happen here or they're making gateways at least.
There's two issues with that.
First, it immediately puts you in the mindset of copying instead of like, you know, winning something.
You're playing to play or you're playing to exist rather than playing to win.
And maybe you're just trying to like play to serve your existing customer base.
and you want to see some AI growth happen.
I think, you know, immediately kind of like puts that gateway many, many months behind the companies that are fully focused on it.
Like I am...
100% focused on building the best router and gateway and LLM marketplace.
And it shows in our product and the benchmarks that we create internally and how we see ourselves compared to the competition.
This is not a side quest for us, like it may be for some other companies.
The other problem is that it reduces the leverage of all of your users.
Like I really deeply believe in giving users and developers more leverage.
Fundamentally, giving them access to more models is about giving them more leverage over all the innovations that happen in AI.
You want to be able to like access them all.
You want to reduce your dependency on any individual one.
If you build on top of a router or a gateway that...
doesn't give you access to the full market or full flexibility or full customizability, it doesn't give you the full leverage of the whole ecosystem, then you're kind of being cut out.
You're cutting out all your employees at your company of things that they need.
And so Open Router is fundamentally about giving people more choice because that gives them more leverage.
You do that at a price at 5.5% take?
That was sort of our pay-go plan.
like a totally different pricing model and it's been very successful so far it's kind of based on like committed spend and then uh you know no fees on that committed spend because that was going to be my question ultimately companies will like love it small and then as you scale you're like this is really freaking expensive i'll just build my own rooting tech now because it's become such a significant part of my cost base actually i mean i kind of figured like some of those companies you know just haven't realize we have like an enterprise plan and some of it is like our fault for not having like a better, I think more detailed pricing model.
We're soon going to introduce like a kind of a business self-serve plan that also just makes it make a lot more sense.
And if you, if you have your own inference, like if you bring your own inference to open router, if you bring your own keys, that fee goes away.
For inference that we are providing you, like when you go into open routers capacity and you're not on our enterprise plan.
that's when that fee comes in.
Otherwise, we need to be able to predict demand a little bit.
So that's why we do these committed spend.
What will be the main revenue line of open router in three years time?
I think it's going to depend on the economy in so many ways.
If the overall AI market keeps growing the way it's been growing over the next four years with like 10 to 15x every year or potentially more.
It's a lot of growth.
I think under that world, I would expect people to continue to underestimate how much inference they're going to need.
And thus, our revenue is going to be dominated by...
You know, the same things as Dominate today, which is like us helping people with an unplanned inference capacity, both enterprises and startups.
That's what OpenRouter is best at.
Like when you need to try models that you weren't expecting you need to try, when you're like using more inference than you thought you were going to use on particular models.
Like we make sure that that is not going to be an issue for your company by providing the best failover and best uptime.
And this is really, really a good thing to do when the market is like, continuously underestimating its inference needs and growing at this rate.
If this growth rate continues over the next four years, it's going to be a wild amount of growth and the economy has some limits to it.
I can see major SMB SaaS growing for us if growth does not keep going 10x, 12, 15x per year.
We've seen token prices fall 90% people take in like 18 months.
Is the reduction of token prices helpful or hurtful to your business?
Because obviously you have a take on spend.
If they come down and spend is more efficient, seemingly it's bad for your business.
You have a shrinking pie to take from.
Well, a lot of people talk about the Jevons paradox, that when prices go down by 10x, the usage increases by more than 10x.
But no one has really done a great job modeling it.
We do have a lot of spot stories that confirm it.
For example, GPT 5.6 Luna on Open Router.
OpenAI cut prices by 5x and then in coordination with us by another 2x.
So in total, the price of Luna has dropped 10x on Open Router over the last two weeks.
Guess how much usage has grown?
13x.
It's a close to perfect Jevons paradox story where you drop prices 10x and usage grows by more than 10x, just a bit more.
And also the usage is pretty stable.
It grew, it flattened out at 13x, and then it's been kind of growing at the same rate that it was growing before it hit the 13x multiple.
So that's pretty interesting.
And it's a pretty...
low variable, like there are a few other confounding variables in the story.
And it was also done in the middle of DeepSeq launching and having a really, really good price and GLM having a really good price.
Like now Luna is being used more than GLM on Open Router.
GLM used to be like one of the top three, four models by token volume.
And now Luna is past it.
This is the first time OpenAI has had a model on our platform in the top.
three to five models by token volume in an extremely long time.
So it was a really big and interesting move.
How reflective of the market are your token volumes?
Because it's about, I may get this wrong, about maybe one and a half, two percent of, say, token volumes.
And so how reflective are they?
Because a lot of people, when I say, oh, the top five models, when I look at Open Router, are all Chinese.
What does that mean?
They'll go, oh, well, Harry, no offense to Open Router, but it's not reflective of the market.
And most people who use Frontier, it doesn't go through that.
They use front-end APIs, and so it's not counted.
To what extent are your rankings reflective of true token usage?
Yeah, it's a really good question.
We try to estimate how they're off by just surveying people sometimes or looking at the surveys other people have done.
We definitely have a bias to...
people who believe our thesis, which is that the future is multi-model, and companies who want multiple models.
And there are still companies out there.
I basically very rarely run into them now.
But there are still companies out there that are just like, oh, yeah, we're an open AI shop.
We only do open AI models.
And so we're not going to see any of those companies.
And I think those companies are primarily focused on the hyperscalers, open AI, Anthropic, and Gemini.
So we do probably undercount the frontier models.
But I think over time, our thesis is becoming more and more common to see in other companies.
And the moment that they're like, oh, yeah, we need to use other models, then our data becomes more representative.
And as we scale up, the data becomes more representative in general.
So my hope is that it just becomes better and better data over time.
Alex Karp said on CNBC in his rather wonderfully energetic way that companies are terrified of working with frontier model providers.
Do you think they are?
I haven't seen what he talked about there when I talked to our customers.
But there was definitely like a little, there was some skittishness that the, particularly when Claude Design came out around Figma.
And that part I did see.
And I do think that there are.
like real concerns like figma is very different but if like a startup is only building a like go to market wrapper around intelligence like hey we are We're a company that kind of like brings AI to this market and does so by like doing the right integrations and like customizing the system prompt.
You're going to be fine if the model labs don't care about that market, which there will be many markets like that.
But the model labs have several incentives to go after you eventually.
One is getting multiple teams within companies they do care about to be dependent on them.
This is my theory behind why I like Claude design.
was strategic.
While it's not like a massive amount of revenue for Anthropic, like it's not probably not a significant amount of revenue, it does get the design team to really care about Anthropic models.
And so the companies that like they want, they now have another.
team that really wants to stick to Anthropic.
So that team strategy can make you compete with the model labs.
And so I think companies like that that find themselves like, oh, we're building a product for a team that has now become strategic for the model labs for companies they actually care about, that's where I see probably the most near-term threat.
Do you think Claude Design will have a meaningful impact on the Figma business?
I speak to many founders today who are bluntly switching from Figma to Claude Design, and it's cannibalizing their Figma usage.
Do you think that will happen?
So I saw a lot of designers try out Claude Design, including our own.
But so far, I haven't heard of the repeat story.
I don't know.
Honestly, I have not talked to very many designers about this.
I certainly haven't heard a lot of chatter about Claude Design.
And if you just look at the numbers for Figma.
They're quite good.
Like, they had a very, very incredible earnings.
This is why you don't want to be public, dude.
You see, like, great numbers.
Figma, down.
And, like, poor Dylan.
Like, give a fuck what?
Yeah, that was crazy.
Do you know what I mean?
It's like, really?
Come on.
We were talking about, like, the different models that we have on offer and whether companies are willing to work with Frontier models.
The rate of model development feels immense.
Do you think we will see the same rate of model development continue over the next year, two years, three years?
Frontier model development or general model?
General model, both frontier and open.
Just because, I mean, every single day there's two, three, four new models.
In July, we launched 70 models.
About one model every 10 hours.
There's some agent labs starting, too, that are all going to kind of like...
probably make models eventually.
Like Jeff Dean is starting an agent lab right now from Google.
The companies that are known for making agents have an incentive to create their own model, a very clear incentive to create their own models and distribute it through the agent.
And we haven't even seen the start of that.
Sorry, we've seen the start of it, but we haven't seen it really pick up.
Like Cognition has a model.
Cursor has a model.
Does Lovable have a model yet?
I don't think so.
Not publicly.
Yeah.
The agent labs are going to, I think, develop models.
This pressure from both the GPU makers like NVIDIA to create more competition in the space and create more diversity in the space, plus us, plus investors who just want to try new things that all could improve intelligence in some neurodivergent way.
I think those are strong incentives.
I think that...
They're enough to incentivize more founders to make Neolabs.
And if American open weight models pick up in steam, then it gives these Neolabs a base to train on.
That's not Chinese, which will then probably create more American Neolabs.
Do you think we should be concerned by the rate and quality of Chinese open models?
We should.
We're behind.
America is very, very behind.
Still, I think things are picking up.
I think we have poolside, we have thinking machines, we have RC.
Do you feel a sense of responsibility for that?
And what I mean by that is you are a routing business and you could route a company to a Chinese model that, who knows, people are worried about backdoors, CCP involvement.
You could be the deliverer of that to those models.
Do you feel a sense of responsibility for that?
safe access for all of these models.
Like customer trust is like our paramount goal.
If one of these models is unsafe to use, generally considered unsafe, we pull it from the platform.
If there's like a way to use it in an unsafe way, I mean, there's a way to use all the models in an unsafe way.
And then we believe in using technology to make it safe and to work with the model labs themselves to figure out how they're doing it on their side so that we can be state-of-the-art or better.
We spend an enormous amount of time making sure that our practices match the best things that we're seeing coming out of the labs or are better.
Because we're a way of exploring all the models and finding them for the first time, we're a good focal point for deploying.
safety measures across your whole company.
For example, we have prompt injection protection.
You can just turn it on and immediately flag prompts that look like prompt injection that's trying to happen.
We have PII redaction.
We have We have a couple different things that you can automatically just turn on with a click and get an added safety layer on top of all of your inference.
And we build that so that enterprises feel like they can safely deploy new models and that their employees can try them out.
I think of the models a little bit like the internet.
You can't just ban the internet at your company because there's some bad things on the internet.
You can create guardrails.
And you should.
You need to use AI to build the best possible guardrails that you can.
I'm with you, but do you think you actually know what's going on within Moonshot or Alibaba with Quan?
These are incredibly secretive organizations in the depths of China.
Can't pretend I know what's going on inside of them.
As a U.S.
company, we're going to follow the best practices of what happens in the U.S.
to make sure that...
We're not doing something irresponsible.
What do you think U.S.
companies are more nervous of, frontier models or Chinese models?
I think they're more nervous about frontier models usually, in part because there's just like much more confusion around the data policy, about what's like actually happening to the props that I'm sending and where they're being stored and how they're being looked at.
And you can't run them on your own machine or in a provider of your choice.
And so that just immediately creates all of this uncertainty in a lot of enterprises.
And it's uncertainty that they can also pattern match.
It's very similar to like, you know, running on their own infra versus running in their VPC and knowing like who can see the data.
How extraordinary is that though?
Like they're more nervous of like US companies headquartered in Silicon Valley where you can see and touch and feel the headquarters and the leaders.
It's just like, what a strange world to be in.
Yeah, it is very strange, especially with the frontier models having the biggest cyber posture right now.
What do you make of every company kind of posturing, ha ha, we hacked someone?
First you had OpenAI, then you had Anthropik, and then you had Zuck coming out.
I don't want to miss the party.
We did too.
Yeah, well, I think they have to talk about it.
The right thing to do is to reveal when there's been a cyber incident involving your model, covering it up doesn't work.
It's not going to work in the long term.
And it certainly looks like they're all bragging about it.
But really, if you were in their position and something happened with one of the models and you had to make the choice about whether to publish it or not, I think the right thing to do is to publish it, regardless of how people are going to spin it.
So I doubt that they're actually thinking of the felony bench or whatever it's called.
How significant was the latest Kimi model, which got so much attention?
Was it as significant as everyone thought?
It's quite good.
It's not cyber capable in the same way the frontier models are.
And long horizon tasks, I think it's still a bit behind the frontier models.
But GLM 5.2 was a really big, big step for open weight models.
Kimi was kind of like moonshot.
getting up to that step.
That's a little bit how I see it.
And Kimmy's also a very good writer.
Like the voice and tone are both pretty good.
Whereas like...
Some of the frontier models have voice degradation that happens when they get better at coding, especially.
And I was like, oh my god, I can't read this output anymore.
The output sounds like three of the four arguments you made are right, and one is a turning point.
And da-da-da-da-da, here's the rub.
It's sometimes just impossible to read what they're saying, and this stuff is fixable.
But Kimmy, I think, has always had pretty interesting writing.
12 months, will the chasm between US open source and Chinese open source be bigger or smaller than it is today?
My fear is that it will be bigger because when you have DeepSeek, it becomes a national champion in China.
And I mean, Xi Jinping is going, this is our AI horse.
I will concentrate all of my money and efforts behind this and I will supplement this ecosystem to the end.
This is the winner.
And then when you see another moonshot come out, suddenly...
All regulation gets moved aside.
All policy gets pushed aside.
All funding becomes available.
Everything is allowed.
You are free to run.
And these guys are unabridged in their ability to do whatever they want to get to the end goal.
Whereas OpenAI and Anthropic and all the other providers in the US, especially open source, fuck, you got to try raising billions of dollars for a US open source model.
Bit tough.
Actually, not impossible at all, but tougher, business model questionable, AI research is super expensive, and you're competing against open and anathropic.
I think the comparative landscapes they sit in mean that the Chinese open source providers are just inherently advantaged, sadly.
They have very, very good researchers, and I think Americans underestimate that a lot.
I do think they're going to be concerned about the cyber posture of their models, and they do seem very concerned about...
like censoring the models and censoring the information that the models can provide to people.
So, you know, while today people complain about American models censoring more due to cyber, I'm not sure that's always going to hold.
And as like the Chinese models like grow in importance for China, what are they going to do?
Are they going to like drop the great firewall?
Are they going to like give up on putting the firewall around the models?
I don't know that much about China, but it does seem like kind of strange that they don't seem to care more that the models or I've never seen anyone do a profile of like what you can do with DeepSeek that you can't do with the internet in China that's available to you within the border.
Like what information you can access.
I've never seen anyone kind of like do a real deep dive.
Like how far past the firewall does DeepSeek go?
If the firewall matters to China.
If it's going to matter in 10 years, like, something's going to change.
Well, what's interesting is, like, obviously the abilities of the Chinese models outside of China is immense.
The abilities of the Chinese models inside China is actually relatively limited.
The guardrails.
The guardrails are incredibly stringent and prohibitive.
It's ironic that they are incredibly superior to us.
Shit domestically.
Terrible.
Interesting.
I literally just had my dear friend Jason Lampkin, who runs SaaS, to come back and be like, couldn't figure out what time Starbucks opened on DeepSeek.
Like, wasn't on offer.
Would say, like, not allowed.
Wild.
Wow.
Very basic rudimentary requests.
We're speaking about all of these different models.
And the thing I think is, like, what about loyalty?
And you have this incredible seat in the ecosystem where you can see everything.
Do we see any developer loyalty today with models?
Honestly, we do see some.
We try to make switching costs close to zero so that when new models come out, people can try them out really easily.
But we also measure retention and churn from all the models.
We share this data with model labs, too, when they ask for it so they can know, like, oh, for my model that just came out, which models drove traffic to it?
And for those users, when they leave, which models are they leaving to?
And we'll make this more and more available to the world soon.
And we do notice in the churn data, there are developers who continuously stick to models even when there are better models out there, better models for their use cases.
I think it's a combination of a couple.
probably root factors.
One is my app works and I don't want to break it.
You know, if the support bot starts saying something weird that I didn't expect, why add more headache?
I've already done all this optimization and like I've already put all these garb rails around it.
Another is new models are not necessarily going to make your pricing better.
In fact, In general, what happens is that the current models, like price goes down over time.
And especially when new advancements in the labs happen, you'll see like intelligence jump, but like the price curve like also jumps and then we'll start going down over time.
So it's not necessarily the most like price effective thing to do to like shift over to the newest model, even for open weights.
The third reason, it's just fundamental like trust in the outputs.
Like if I'm using a model to do my work and I like the way it talks, I probably have some eval, like a personal eval.
A lot of people have these personal evals that are just these random tests that they give the models.
And if the random test doesn't look really good on the new model, they'll just be like, good.
I liked Kimi K 2.6 anyway.
People thought before.
that memory would be the retentive mechanism.
While OpenAI has all of my previous prompts, it knows that I live in London, I do podcasting, and that will make it a better model for me moving forward.
Is memory no longer a retentive mechanism?
Memory is really interesting.
I've always thought it is a retentive mechanism, and the question is where it lives.
Is it going to live with the model?
Is it going to live with the inference provider?
Is it going to live with the app?
Is it going to live with the infrastructure provider, the router?
My guess is that all of those layers are going to try to own memory in different ways.
And there are going to be advantages to sticking your memory in each layer.
You know, if you stick it with the app, then the memory has like the most app-related context and is model agnostic.
If you stick it with the model, the memory might perform the best on personalized benchmarks.
have the best ultimate intelligence and i think the model labs are going to work on memory and then the ultimate thing might be like is there a good combination can i use memory in the model and memory at the infrastructure layer or the app layer at the same time like is that going to confuse the model we don't know yet i do think that like It's impossible for one layer to capture all valuable memory because the apps own so much important context that the model labs don't have.
And the model labs, in order to get this to work, they'll have to incentivize the apps to give them that context.
Speaking of the apps in the model set, claw code, cursor, bundle, model, and harness, is the router absorbed into the agent framework before it ever has the chance to be independent when you have the agent and the harness together?
The harnesses are pretty interesting because in our early days, one of our early bets was that most apps were underestimating the desire for users to choose the model.
Most apps in the very early days, in like 2023 and 2024, it wasn't even clear which model was being used under the hood.
They were like, oh, people are not going to care about that.
They just want AI.
And one of our strong convictions then was that...
No, like people are going to want to use particular models.
They're going to care about who they're talking to.
It's like, I want to know which employees I'm talking to when I'm trying to solve a problem.
And models will be kind of like that.
And that has played out, you know, like.
In Notion, you can choose the model that you talk to, even though you would think an app like that might want to obscure it completely.
A similar thing happened with harnesses, where particularly with developers, they started to build an affinity to different harnesses.
And that's because it's a user experience.
So I think that is my favorite argument for why harnesses are going to stick around.
Not that they're being bundled with the models, because in fact, as models get better, they get more resourceful.
the junk that gets thrown in the system prompt just becomes a handicap.
Anthropic, I think, published a good article about this where they showed that, oh, we got rid of stuff from the system prompt, and suddenly fewer contradictions showed up later on with user prompts, and the model performed better.
And we're seeing a lot of the harnesses right now are deleting code in order to perform better with the latest frontier models.
That, I don't think, means that...
harnesses are bad.
In fact, I think we'll see more harnesses come up in the future because it's a way of building a user experience on top of models.
It's a way for developers who are not model labs to own a user relationship.
And that is just going to be incredibly valuable for the economy to have that layer.
I'm going to get killed for this.
What's the difference between a harness and an app?
Feels like it's word wank.
of like everyone talking about harnesses and harness.
I'm like, is that not an app?
Hello?
The nice thing about the harnesses compared to the apps is that they're more composable.
I can have a harness call another harness.
I can have a harness spin up another harness in a sandbox in the cloud.
Is that not what APIs did for apps?
Yes, but it's much more reliable and deterministic and sort of easy for users to grok with a harness.
because the harnesses are unix based they all have and and the models are so well trained on unix on bash commands whereas like you know if i'm like telling a harness to go orchestrate an app in the cloud it's going to be like oh Boy, does this app, like how do you log into this app?
Like, do I need your password?
Do I need to fire up a virtual browser?
It's gonna be pretty slow.
I'll figure it out.
Okay, I like fired up a browser and like now I need your password and I'm gonna like try to find the input where to put it in and apparently there's probably an API in this app somewhere.
I need to like look up the docs to figure it out and okay, now I've got the API.
But there's so many like unknown unknowns when you're composing around an app.
Very, very, very, very few unknown unknowns when you're composing around a harness.
So I think it just gives developers more flexibility and flexibility that they can inspect.
Like API calls, you're just seeing a whole bunch of code flying around the screen.
A harness, oh, I can like jump into the harness and like look at what's going on and talk in English about it.
So it's much more user friendly.
We've seen Meta and Muse really be a focus for Zuck.
We've seen Alex Wang front and center much more.
Were you impressed by what Meta delivered with Muse?
They've been doing a good job, yeah.
I mean, it takes a while to set up a whole new model lab from scratch.
And I'm sure a lot of organizational debt to deal with.
Do you think they will be a serious challenger?
I do.
I think they have the resources.
I think there's some competitive things they can do.
around the model that helps people in ways that the model labs are not as interested in doing.
Like just having like a social network and like a focus on people, you know, it's like something for the brand that maybe Grok and like SpaceX AI have it too, but they do need to find their niche.
I think people don't quite know what to do with MuseSpark yet, like when to use it or when to go for it or what its core advantages.
They just released a coding harness.
They're trying to be like a generally capable model right now.
I expect that in the future, they're going to be like, look, we are way better at this thing.
And that's going to be a really important moment for them.
Fascinating.
I was impressed by it, actually.
Do you know what I use now?
Maybe plug in one of our mutual friends, but Anastasios and Arena.
And it's so weird.
So I'll put my prompt in Arena.
And then, obviously, it comes back with a load of different model options.
Yeah.
And, you know, I come back with, I used one the other day, Pergamum.
Pergamum.
Yeah.
It was like Kimi and Pergamum.
And they offer you four different options.
And it takes me to models that I would never have used before.
And actually, Muses come up a couple of times for being pretty impressive.
But I love that in terms of this like discovery mechanism to models that I would never have used.
I would never get a Kimmy, honestly, dude.
I just get a fucking chat GPT.
It's really interesting.
It basically goes to the point of the model layer just becoming a utility layer.
What do you mean by that?
Well, actually, I have no loyalty to them.
I have no affiliation with brand.
I go to Arena and I want to see what you got for me.
Show me the results.
I don't care if it's Kimmy or Muse or Claude or Sonnet or do you know what I mean?
And actually.
I just want to see the options you got, and I'll pick the best from there.
I'd rather run four in parallel.
Do you buy this whole we're going to have one frontier model run four open models?
And the frontier model might be 160 IQ points, and the open models might be 120 IQ points, but that will be a model infrastructure or structure that we'll work with.
Totally think that that is a great architecture that everybody needs to explore.
We've been helping lots of developers do this.
You have sub-agents.
We have a sub-agent server tool that we tune to be really, really good at using models generally.
And then you have an orchestrator model that calls out to the sub-agents when it wants particular tasks to get done.
And these sub-agents are just very, very low cost, and they're focused on deterministic tasks.
This is what open weight models are generally really good at compared to frontier models.
When you have a deterministic task where you know the shape of the output, you know the type of problem that you're working on, and it's a type of problem that has been solved, like classifying some text, for example, then you should definitely use a low-cost...
model from Open Router and then have the orchestrator model read the results and then go and continue working on the unknown, non-deterministic task that it was set out to do.
I want to create an open American ecosystem.
Yeah?
More amazing open American models.
And I make you head of this program.
What would you do to encourage, incentivize the open US ecosystem to compete more vociferously with the Chinese?
I think I would.
spend time talking to the current American labs a little bit more to figure out what distilling the Chinese models looks like for them and how effective it is.
You can probably get pretty far distilling the Chinese models.
The nice thing about the open weight models and the Chinese models is that they allow distillation, like most of them, and that means that you can take the outputs of these models to do reinforcement learning on top of the model that you're building.
This is just a very important and common practice in AI that all labs do.
And also, when you distill, you see the output.
So you can inspect them to make sure that they're aligned.
So if there's anything about the open-weight models that you're worried about not being aligned with the voice or constitution of the model you're creating, you have a much better shot at catching it when you're doing these RL rollouts.
The other thing I would try to figure out is the compute question.
Compute is just a huge advantage that I think we still have relative to China.
And these Neolabs need a shot.
And there needs to be an easier way to get compute to the right talent in all countries.
But especially if we're trying to create a competitive American Neolab system.
NVIDIA has been doing a good job of this.
But there's Google, there's TPUs, there's Tranium from Amazon.
I would work with all of the hardware companies and also the Neo chips to help with compute.
I don't think we will have that compute advantage for long.
I think you see DeepSeek and ByteDance both aggressively pursuing their own chips now.
The export controls mean that they have to.
And this is the number one problem for Xi Jinping in his race to win the AI war.
If they build a bridge in four weeks, I think they'll manage a chip in six months.
Yeah, like staying ahead on the chip war is critical for America.
Is distillation wrong?
I mean, distillation is a technique to build models.
But people view it with cynicism and shade.
Well, they're just distilled models.
It's a technique to build models.
The closed-weight model labs distill models too.
Like Sonnet is a partially distilled version of Opus.
And this is how you make smaller models out of bigger models.
It's an important way to just teach your model new things when you find something useful in the ecosystem.
We do think that labs have a right to...
say it's not allowed in their terms of service.
A company can cut off access to someone who is trying to build a competitive model.
If you're just trying to build a smaller model that's really focused on doing one specific thing that's not competitive, most of the frontier labs don't prohibit that, to my knowledge.
But there are going to be markets for companies that allow it and companies that don't.
And we make sure that we help both companies uphold their terms of service.
I have to ask you one question before we do a quickfire round.
I'm going to get killed if I don't ask it.
There are reports that you are selling to Stripe for $10 billion.
Is that going to happen?
I can't comment, but whatever happens, we're going to execute on the vision.
What we're doing is critical for the ecosystem, and we believe for safe access to AI where one monopoly doesn't take over.
where we have a vibrant ecosystem of models that everyone can explore.
And when new providers and new server tools and new inference-adjacent tech comes online, there's a really easy way to discover it and connect it with all of your existing AI.
I was thinking in these situations, my response would be like, well, I own 22% of the company, $10 billion, $2.2 billion.
Now I'm a venture capitalist.
But is it hard not to think like that?
I don't really think about it.
Do you know?
I don't spend a lot personally.
What I think about when I do with personal capital, I really want to help people work on problems that just don't lend themselves very well to venture capital.
They're sort of falling in this gray area of problems that people need to solve, but are really tough to fund because they don't come with a business model attached.
And I think they're very cool things to do now in the nonprofit space because you can use AI to review way more data than you ever could before.
I'm not quite ready to talk about it publicly yet, but I do want to do something that helps researchers work on those problems and get grants to do it.
One really cool example I think of this is David Fialcow, who's one of the founders of General Catalyst, who basically finds incredible stories that won't get funded.
for movies and funds them to shine a light on them because he thinks they're very important.
So like The Dissident, which obviously told the story of Khashoggi and Khashoggi being, you know.
And then, you know, Icarus, which is the story of the Russian doping.
And these were films that would not get funded had it not been for his funding because they were politically sensitive, charged.
And he's like, I'm going to enable the stories of these forbidden tales.
Yeah, it's kind of like that.
I love that stuff.
He's great.
He's fucking awesome.
Anyway, are you ready for a quick fire round?
Sure.
Okay.
What is the most underrated model on OpenRouter today?
Ooh, good one.
I mean, first, like, poolside's models are great.
I'd probably like my fire round answer.
Like, new American lab, building interesting coding models that are small, highly effective, and they're building a lot of useful tools for accessing them.
Good team.
70% of Neo Labs will die in the next three years.
Agree or disagree?
Disagree.
70 seems very high.
Of Neo Labs, there aren't that many Neo Labs.
If like getting acquired by one of the model labs counts as die, I do think there'll probably be some like potential consolidation.
But if you include the consolidation, I'd say 50.
Do you think Dario should be less negative and more positive as a voice in AI?
I think it's important to have somebody who is very paranoid about the future and how things are going to shake up.
And I personally appreciate Anthropik's paranoia.
Obviously, there are areas where I want other model labs to not feel like they're just being pushed off the table.
But I'm a big believer in neurodiversity.
And Anthropic is a part of the neurodiversity map that really matters.
And if no one is being extremely paranoid, then no one is offering that voice.
And so I appreciate that they're doing it.
What's the craziest thing that you see in your seat, on top of everyone's usage, that you don't think people talk about enough?
I mean, a lot of companies are obviously worried about cost management.
and freaking out about the amount of inference they're spending, and they don't know how to think about it.
It's like a whole new way of doing business and thinking about your OpEx.
The old way of thinking about how much you give your employees, you give them a salary, and you kind of forget about it.
Someone knows what everyone's making, but it's a static number that gets readjusted on a quarterly basis maybe after performance reviews.
Really, your employees all cost Totally dynamic, different amounts now.
I think a lot of companies are putting it on them to do routing.
And I think in the future, there's a good chance that it will get pushed downwards to the employee level.
Your employees should figure out which tools and models to use that are best for their tasks.
And then we should...
Figure out how much you're costing, like due to the choices that you make as an employee.
Your cost as an employee is going to be a dynamic number and it's going to be dependent on how much that employee is like effectively using expensive and cheap models to do their job.
I advise companies to kind of like still do their normal management work, like have their managers kind of assess how effective and productive employees are, but also line it up with how much their employees cost.
and then kind of come up with a quadrant of celebration.
Like these employees are like doing a good job and they're pretty price effective or cost effective.
And then a quadrant of concern.
These employees are kind of maybe doing a so-so job and whoa, they are not cost effective at all.
Their AI psychosis is off the charts.
And then you address the quadrant of concern.
So I don't think people talk about like basically how you think of like employee cost in the age of AI and that it's really, it should be a dynamic.
number and not a static thing that like only a few people know about and it's gone.
Wonderful.
But can you imagine going to someone, oh, I'm sorry, you were worth 100 grand last month.
Now you're worth 50.
I think it would make planning and personal.
They're in control of how much they cost.
That's the great thing.
Like all employees are in control of how much they cost and can like influence that.
Now you get to think like, okay, how good am I as an employee and how efficient am I being as well?
Final one, when you look at the landscape today, there are so many things to be excited about.
What are you singly most excited about?
Two things come to mind.
One is rare disease research, which I think is one of those things that has been intelligence bottlenecked or really just the inference bottlenecked.
It involves trying out lots of ideas and seeing if they work.
The other is...
Crowdsourcing, productive, urban life improvements.
For example, imagine if someone was curious about finding every lead pipe in America or every lead pipe in the UK and had an approach to it, but they really need to make it mature and stress test it.
Now you can use AI to do that.
And we just might solve some weird problems that everyone's just kind of given up on because...
You need like a crazy idea to come from somewhere.
Brilliant ideas are sort of evenly distributed all over the world.
They can come from anywhere.
And now you just give them leverage to actually work.
So I'm excited about sort of very like broad kind of urban or rural quality of life improvements that we'll be able to make.
Alex, dude, I've wanted to do this one for a while.
I'm so glad we could do it in person as well.
I was worried that we were going to have to do it remote.
It is so much nicer to do it in person.
You've been fantastic.
So thank you so much for doing it with me.
Likewise.
This was great.
But before we leave you today, founders face a different set of challenges at every stage of growth.
For Sid Shait, co-founder and CEO of D-Matrix, J.P.
Morgan delivered the guidance and expertise to help navigate what came next.
He credits J.P.
Morgan's high-touch approach with supporting D-Matrix as it grew and expanded internationally.
Whether you're in the early days or expanding into new markets, J.P.
Morgan helps startups navigate complexity with real confidence, offering personalized guidance and deep sector expertise.
Find out how J.P.
Morgan helps...
founders at jpmorgan.com forward slash grow without limits.
JPMorgan is the bank of the innovation economy.
While JPMorgan supports growth, Corgi protects it.
My word, what an arresting first line.
Get your ass covered with Corgi insurance.
And I'll tell you why.
If you're running a business right now, you already know this pain all too well.
Getting insurance, it's really slow, it's confusing, and my word, it's full of paperwork.
Well, that's exactly why Corgi is here to change the game.
Corgi is the first and only insurance carrier designed specifically for tech companies, allowing you to get covered in minutes instead of days.
Corgi provides essential coverages for all growth stages, such as...
D&O, E&O liability, cyber, commercial, general liability, and more.
Get your ass covered.
I love the way we say ass with Corgi Insurance alongside thousands of other startups at corgi.com forward slash 20VC today.
That's corgi.com forward slash 20VC.
You won't regret it.
While Corgi covers risk, Flex gives you room to move.
Business owners run their whole financial life on Flex.
One platform from business revenue to their personal spend.
Float every purchase for 60 days.
Tap capital that grows with your revenue and pay vendors in 170 countries across 32 currencies.
Plus, the whole back office, bills, expenses, accounting, all in one place.
So you spend less time reconciling and more time growing.
That's why thousands of owners use Flex, named one of Fast Company's most innovative companies of 2026.
Visit flex.one, that's F-L-E-X dot O-N-E and use the code 20VC.