Virtual Worlds for Physical AI Systems
The MapScaping Podcast - GIS, Geospatial, Remote Sensing, earth observation and digital geographyShow Notes
In this episode I'm joined by Apurva Shah, co-founder and CEO of Duality AI, a company building virtual worlds — or "world models" for robots and physical AI systems. Apurva's path here is an unusual one. He spent most of his career in animation, first at Pacific Data Images (which later became DreamWorks) and then over a decade at Pixar. His co-founder, Mike Taylor, comes from the other end of the spectrum entirely: a controls engineer who led field robotics at Caterpillar, deploying house-sized haul trucks at Australian mines. As Apurva puts it, if he's the pixels, Mike is the atoms. We talk about why real-world data, as valuable as it is, is never enough on its own — and how synthetic data can be used to deliberately fill the gaps and biases that creep into any collected dataset. Some of the things we get into:
The difference between digital twins and 3D assets and why Duality treats twins as modular building blocks you compose into scenarios, rather than as one monolithic environment How they build environments from the ground up using DEM data, satellite imagery, photogrammetry and biome catalogues and why building them this way means everything is annotated from the start Calibrating virtual sensors against real ones, including synthetic aperture radar, and why sensor noise characteristics matter as much as physics Predicting how a material will behave across the spectrum (infrared, SAR) just from its visual response — and when that prediction breaks down Why "clutter" only becomes clutter once you know what you're looking for, and why it doesn't need to be perfect Modelling star fields for localisation in space, where there are no roads or buildings to navigate by Explicit versus generative world models, and why you need both A project with AWS simulating emergency ambulance routing through a city, complete with autonomous vehicles, traffic control and teleoperated human agents Where Duality is not the right tool molecular scale, virtual patients, drug discovery And yes, a story about robotics companies renting Airbnbs, trashing them, and leaving
Towards the end we get into the bigger questions: whether AI takes our jobs or makes us better at them, where the line sits between "good enough" and slop, and why Apurva — a self-described humanist — thinks virtual environments are the one place where human and machine intelligence can genuinely learn from each other. Find out more at duality.ai, or dig into their technical writing at duality.ai/blogs
More from The MapScaping Podcast - GIS, Geospatial, Remote Sensing, earth observation and digital geography
Point clouds still feel a little bit like magic to me. You walk through a room, a city, or even just your living room with a scanner or your phone, and you can recreate it afterwards. But on their own, point clouds aren't actually that smart. So what would it mean for every single point to know not just where it is, but what it is, and how it relates to everything around it? My guest this week is Dr. Florent Poux, an adjunct professor, director of the 3D GeoData Academy, and author of 3D Data Science with Python. Florent has spent around 15 years on this one problem, and he developed the idea of the smart point cloud. And, as he pointed out just before we hit record, he's also a human, which we can't take for granted these days. In this conversation, we get into:
Cloud-Native Geospatial for Small Teams: How the Utah Geological Survey Did It What happens when a small, technical team at a state agency decides to go cloud native? They don't have terabytes of satellite imagery. They have lots of small datasets, lots of scientists and lots of people who just want to get at the data. In this episode, I talk with Marshall Robinson and Clinton Lunn from the Data Management Program at the Utah Geological Survey. They moved from a traditional ArcGIS Server setup to Postgres and GeoServer, and then to a cloud-native pipeline built on GeoParquet, PMTiles, and a STAC catalog. What I really wanted from this conversation was recipes. Picture a GIS person at a local council (say, here in New Zealand) who's curious about this stuff and needs a proof of concept to take to their manager. Where do they start? We talk about:
We already have a map. Actually, we have lots of maps. So why did Overture build another one? My guest in this episode is Amy Rose, CTO of the Overture Maps Foundation, and she makes a pretty compelling case. Overture isn't trying to replace OpenStreetMap — it sits downstream from it, and from hundreds of other sources, doing the unglamorous work of standardising all of that into something you can actually put into production. A light touch, as Amy puts it. Enough structure to be usable, not so much that the dataset starts trying to be everything for everybody. We spend a good chunk of the conversation on GERS — the Global Entity Reference System. It's a persistent ID stamped on buildings, roads, places, and addresses, which means the same building in OpenStreetMap, Google, Microsoft, and the City of Vancouver all share one identifier. If you've ever wrestled a messy spatial join into submission at 11pm, you'll understand immediately why this matters. And because Overture keeps all the source records, you're not stuck with their choice of polygon. You can go and pick your own. We also get into metadata, which Amy points out has been a dirty word for most of our careers — everybody wants it, nobody wants to write it. Except now it matters more than ever, because the biggest users of geospatial data aren't people anymore. They're machines. Humans are good at filling in missing context. Machines just produce a plausible answer and move on. That's a problem when there's critical infrastructure or human lives involved. Plus: whether "authoritative" still means anything, how signals and evidence might replace traditional contribution models, why there's no best representation of anything — only fit for purpose — and what Amy would add to Overture next if every other problem were magically solved. A really enjoyable conversation, and one that changed how I think about what a map actually is.
Republished Episode - I wanted to resurface this episode because positioning is everything, and it's a great overview of how it works.
Earlier this year I ran a small experiment called the Geospatial Launchpad — six weeks of working closely with a couple of people to help them push their geospatial projects forward. West was one of them. His project is Sentinel Bird (sentinelbird.com): an archive of every Sentinel-2 visit over the Gaza Strip since 2015, with 10-meter resolution imagery for each district, interactive comparison sliders, change-over-time timelapses, and a downloadable press pack — all free, no accounts, no paywall, licensed for anyone to use for anything. In this conversation, we get into what Sentinel Bird is, why West built it, and everything he ran into along the way — the marketing, the SEO, the feedback, all the stuff that has nothing to do with the tech but everything to do with whether a project actually goes anywhere. We talk about: