AI startup Decart has introduced Oasis 3, an interactive world model designed to generate photorealistic driving environments in real time, according to TechCrunch. This model is primarily aimed at autonomous vehicle companies needing to simulate rare driving scenarios at scale. Decart plans to expand its use to robotics and other physical AI applications.
Developer Ecosystem and Pricing
Decart is offering Oasis 3 via API, hoping to cultivate a developer community similar to what OpenAI achieved with language models. Dean Leitersdorf, co-founder and CEO of Decart, envisions a robust developer ecosystem emerging around this technology. The model is priced at $0.02 per second, with enterprise pricing varying by use case.
Competitive Landscape
The world model arena is becoming increasingly competitive. Last year, Google released Genie 3 in research preview, while World Labs launched Marble for commercial use. Other companies like Luma and Runway are also adapting their video models into world models. Decart differentiates itself with the photorealism and efficiency of its models, powered by the Decart Optimization Stack (DOS), which allows models to run efficiently on Nvidia, Amazon, and Google hardware.
Technical Challenges
Despite its advantages, Oasis 3 faces challenges in maintaining thematic consistency and simulating physics accurately. The model is auto-regressive, generating one frame at a time and looking back at previous frames to decide the next. This method is compute-intensive and can lead to inconsistencies, such as environments changing unexpectedly and cars driving through each other.
Future Developments
To address these issues, Decart is working on improving the model's memory length and exploring ways to compress memory into fewer tokens. Leitersdorf anticipates that future versions will allow users to generate worlds based on video rather than images, potentially solving some of the current limitations.
"It takes me back to the early days of LLMs, when OpenAI invented the API for models," said Leitersdorf, highlighting the potential for developers to create new applications with Oasis 3.
Funding and Strategic Partnerships
Recently, Decart raised $300 million, increasing its valuation to nearly $4 billion. Strategic investors include Toyota, Adobe, and eBay, all potential customers. Nvidia also participated in the funding round, underscoring the strategic importance of Decart's technology.
| Company | Product | Feature |
|---|---|---|
| Decart | Oasis 3 | Photorealistic driving simulations |
| Genie 3 | Research preview world model | |
| World Labs | Marble | Commercial use world model |
Decart's Oasis 3 represents a significant step forward in the simulation of driving environments, offering potential cost savings and efficiency improvements for autonomous vehicle developers. However, the model's current limitations highlight the ongoing challenges in the field of world models.
Sources:
