Bilawal Sidhu+

IronSight: Turning 2D Videos Into 4D Reconstructions of Reality

I vibe coded terminator vision replays with no LiDAR or IMU, just 2D videos from Ray-Bans, GoPros, and iPhones — all fused into a 4D reconstruction of my shooting range sessions. Full pipeline in the video ft. audio-waveform sync, SAM3 masked colmap & pi3 solves, 3D gaussian splats, and gemini as the hit/miss judge. I absolutely love the convergence of augmented reality and artificial intelligence, and can’t wait to share more experiments like this with you all. I openly share my workflows and processes, so you can use your own agents to Replicate whatever I create and remix it. Have fun! A

Fable 5 Is Nuts. I Vibe Coded a Baby Anduril for My Range.

I vibe coded a defense tech style 4D shooting analysis system in my browser, from nothing but flat 2D video off Meta Ray-Bans, iPhones, and GoPros. Every shot tracked and classified as a hit or miss, every target mapped in 3D -- and a god's eye view replay of the whole range session you can fly a camera through, even seeing targets through walls. A swarm of AI agents powered by Fable 5 and Codex 5.6 did the heavy lifting while I slept. In this video, I give you the full recipe so you can turn your own 2D videos into 4D reconstructions. ⭐ God's Eye View — the open-source release a lot of you

IronSight Can Now See Through Walls With 4D Replays - Dev Diary 2

Loving how this turned out! IronSight turns Meta Ray-Ban clips (from the range) into 4D reconstructions you can replay from any angle -- including an AR view that sees targets straight through walls. It 3D tracks both runs, auto locates every target, and scores hits vs misses using audio cues + Gemini for multimodal reasoning. Full breakdown coming to the channel. The test below is where this started, and then Fable showed up and I blitzed through my whole roadmap in a few days.

IronSight Turns 2D Videos Into 4D Replays - Dev Diary 1

This is IronSight - a 4D reconstruction built by fusing footage from two pairs of meta ray-bans. A google research buddy saw the prototype and joked this would've been a siggraph paper a few years ago. Today it's a weekend build with fable. Stay tuned for more mad science experiments with artificial intelligence and augmented reality. Happy 4th of July and 250th America!

Hollywood Imagined It. The Military Actually Built it.

In 1998, Enemy of the State imagined a satellite that could track anyone, anywhere. A few years later, engineers built a real version of it, not in space, but in the skies above Iraq. This video traces the actual history of WAMI (Wide Area Motion Imagery): how it was developed by the Air Force, DARPA, and the CIA to track insurgent networks, how it quietly came home to police departments in cities like Baltimore, what a federal appeals court ultimately ruled about it, and where the technology stands today as it merges with AI and 3D reconstruction. We look at documented cases where it helped

Schrodinger’s Strait - Both Open & Closed At The Same Time

Strait of Hormuz vessel traffic is going up. Oil futures are going down. And of course there's now a reported drone strike on a Singapore flagged cargo vessel. At this point we should call it Schrodinger’s Strait -- it's both open and closed at the same time. God's eye view open source release next month: github.com/bilawalsidhu/gods-eye-view #osint #straitofhormuz

Apple Maps Just Got Insanely Realistic — Here's The Tech Behind It

Apple just did something nobody expected; they beat Google at Google's own game. At WWDC 2026, Apple quietly announced that Flyover in Apple Maps is getting a complete visual overhaul powered by 3D Gaussian Splatting, a technology that came out of a research lab in France just two years ago and has now made it into your Maps app. No more melted buildings. No more broccoli trees. No more blobby power lines. Just photorealistic city-scale 3D that actually looks real. And here's what makes this wild, Google has Street View, aerial lidar, satellite coverage, and the world's largest geospatial da

Police Drew a Circle on a Map. Here's What Google Sent Them.

Most people think surveillance means cameras on street corners. They're wrong. Your phone knows where you sleep, where you work, where you travel, and everywhere in between. And today, law enforcement can use something called a geofence warrant to identify every device inside a specific area — even if you're not a suspect. In this video, we break down how geofence warrants work, why the Supreme Court is reviewing them, and how location data from Google, cell carriers, ride-sharing apps, connected vehicles, Waymo, Tesla, and other systems can be combined into a detailed map of your life. The

Insane 3d replay of the winning tip-in from the Knicks game last night - OG Anunoby POV

OG Anunoby is too sick. Here is the full point-of-view 3d reconstruction of his winning tip-in from the Knicks game last night. You can literally relive it from his perspective. Built with viewpoint pro using stadium tracking cameras and unreal engine.

I used claude fable to make this city block simulator

Just used claude fable (aka mythos) to create this city block simulator complete with multi-agent traffic, live detection boxes + tracks, and day to night cycle. And it just one shotted it. This is gonna be fun -- the gap between idea and execution just keeps collapsing. The lines between code and content keep blurring.

Apple Beat Google To It! 3D Gaussian Splats Are Coming to Maps

Holy crap! Apple just beat Google to the punch -- 3D Gaussian splatting is coming to Apple Maps. These 3D scenes are made from oblique aerial imagery. But unlike blobby photogrammetry -- no more broccoli trees, no more melted powerlines -- ground level detail that actually holds up. Here's hoping Google Maps/Earth follows suit soon -- they have a significantly larger corpus of sensor data to work with. Time to splat the world!

I Accidentally Started an AI Video Trend

A few days ago, I conducted a simple experiment. I scribbled a chaotic drone path over a map, fed it into Google’s newly released Gemini Omni model, and asked it to simulate a first-person drone view following that exact trajectory. What happened next completely broke AI Twitter. Creators across the US, China, and the global AI community took this "scribble-to-video" concept and turned it into the ultimate stress test, pitting Google’s new foundational model against ByteDance’s powerful Seedance 2.0. In this video, we are looking at the wildest community iterations, analyzing the results,

The Craziest Mapping Breakthrough Since Google Earth

Google Earth has looked the same for 15 years. This is the year that changes — and not just for humans. Gaussian splatting just got an open standard. That means the same photoreal 3D capture that Zillow puts in a home listing is the same file a delivery robot uses to navigate a sidewalk, a drone uses to fly without GPS, and AR glasses use to anchor a virtual sign to a building — centimeter-precise, no GPS required. In this video, I break down who's scaling this new map of Earth, why an open standard changes everything, and what gets unlocked when humans and machines share the same captured w

How a 2009 Paper Built Rome in a Day

In 2009, a team at the University of Washington downloaded thousands of Flickr photos of Rome and reconstructed the city in a single day. The toolkit that paper introduced is still the backbone of Street View today. #StructureFromMotion #StreetView #ResearchPaper #GoogleMaps #BundleAdjustment #CVPaper

Your TV Camera Is Watching You Back

Google has patents for the TV camera to watch you. Apple's VR patents go further -- eye tracking that reads your pupils to classify your mood. Feedback loops aren't a thought experiment anymore. #EyeTracking #VRPrivacy #BiometricSurveillance #AppleVisionPro #PatentFiling #ClockworkOrange

This Trick Just Unlocked 3D Everywhere

The trick: throw away most of the photos from a famous landmark, frame the rest as a hard problem with a stolen answer key, and fine-tune the model on that. Pi-cube went from 75% to 86% on the hardest scenes. The long tail of the world just opened up. #3DAI #ResearchBreakthrough #LongTail #VGGT #FoundationModel #FineTuning

Your TV Knows Your Credit Score

Samsung Ads has a direct pipe to Experian. Your viewing data joins your credit file, your phone search, and your laptop history -- all stitched together through one home IP. #DataBrokers #Experian #CrossDeviceTracking #IPTracking #DigitalIdentity #HouseholdGraph

The Mannequin Challenge Trained an AI

The 2016 mannequin challenge was a perfect training set hiding in plain sight -- people frozen, camera moving, humans embedded. UW researchers scraped 2,000 videos off YouTube and trained the first depth model that actually worked on moving people. #MachineLearning #DepthEstimation #YouTubeAI #AITrainingData #MannequinChallenge #ViralData

The Reason TVs Got So Cheap

The TV in your living room isn't a TV -- it's an ad platform with a screen attached. Here's how Roku and Vizio quietly turned hardware losses into multi-billion-dollar data businesses. #ConnectedTV #AdTech #Roku #Vizio #StreamingWars #CTV

Google Just Turned Street View Into a Video Game

Google's Genie 3 has turned Street View into a playable video game -- and I've had early access. At Google I/O 2026, DeepMind shipped Maps Imagery Grounding for Genie 3 -- their real-time world model can now generate interactive 3D worlds conditioned to any of the 280 billion Street View images Google has captured over 20 years. Pick a location on Google Maps, choose a style, drop in a character, and walk around. As a former Google Maps PM who who led the ARCore Geospatial API and Immersive View, this is the exact convergence I've been waiting years for. In this video I demo it, stress-te

A God's Eye Map of Earth From Instagram

A single photo is enough to geolocate you. But what happens when you fuse every photo ever uploaded from a given area into one 3D model? A paper this year made that real. #3DReconstruction #ComputerVision #Photogrammetry #GodsEye #OSINT #SpatialAI

Samsung Is Watching Your HDMI Ports

Your TV captures a screenshot of your screen every half-second -- and it doesn't stop at what you're streaming. Whatever's plugged into the HDMI port gets seen too. #ACR #SmartTV #Surveillance #PrivacyMatters #SamsungTV

How the US Used AI to Hit 90 Targets at Once

Day 1 of the Iran war: 900 targets. Kharg Island, March 13: 90 military targets struck simultaneously. Maven pre-computes Orient, Decide, Act -- the entire kill chain runs in parallel. #MavenSmartSystem #OperationEpicFury #IranWar #KhargIsland #Pentagon #Palantir #OODALoop

The Internet's Hidden 3D Model of the World

Today, one paper can take random tourist photos of basically anywhere on Earth and turn them into a 3D model. That wasn't possible a month ago. For 17 years, the field could only do it for famous landmarks: the Eiffel Tower, the Coliseum, the places everyone photographs. Everywhere else -- "the long tail" -- was a hollow shell. Chapters: 0:00 The God's Eye View Hiding in Your Photos 0:40 Building Rome in a Day (2009) 2:09 The Long Tail Problem 3:18 MegaDepth and the Mannequin Challenge 4:44 NeRFs and 3DGS 7:19 MegaScenes, Doppelgangers, and Foundation Models 10:00 MegaDepth-X Punches Through

The Fusion Layer Behind Maven Also Runs Airbus

The fusion layer behind Maven also runs the NHS, the World Food Programme, Airbus's supply chain, and money-laundering detection at banks. Same OODA loop. Different problems. #Palantir #MavenSmartSystem #ProjectMaven #NHS #DataFusion #SpatialIntelligence #OSINT

Why Claude is Central to the U.S. War On Iran

Claude is central to the US campaign in Iran. Anthropic drew a line at autonomous weapons. The Trump administration called them a "supply chain risk." #Anthropic #Claude #ProjectMaven #MavenSmartSystem #AISafety #Pentagon #DefenseAI

Microsoft Office Was the Original War OS

The Pentagon used to track targets in Excel. PowerPoint for network maps. Google Earth for zooming. Then Maven replaced all of it. #MavenSmartSystem #ProjectMaven #Palantir #Pentagon #DefenseAI #OODALoop #SpatialIntelligence

The Real Reason Smart TVs Are So Cheap

Your smart TV is a loss leader. Roku loses 14% on every device they sell. Vizio runs hardware at an $8.6M annual loss. Both make it back -- many times over -- by selling what you watch. The TV is the trojan horse. The ad business is the actual product. The engine that powers it is called ACR -- Automatic Content Recognition -- and it takes a screenshot of your screen every 500 milliseconds. Here's how it works, where the data goes, and what's already patented for the next horizon. Chapters: 0:00 -- Your TV Takes a Screenshot Every 500ms 0:30 -- ACR: Shazam for Your Screen 1:23 -- The Trojan

Palantir's Al Targeting System Running the Iran War

In the first 12 hours of the Iran war, the US struck nearly 900 targets. Over 13,000 in 38 days. The software making that possible is called Maven Smart System — and almost every layer of it maps to capabilities you can build with off-the-shelf tools. I take it apart end-to-end: the OODA loop it was built to compress, the sensor stack feeding it, the Anthropic standoff over Claude inside the classified system, and the speed-accuracy tradeoff nobody in the Pentagon wants to answer for. Then I show you the civilian roadmap I'm building. Chapters: 0:00 What the Heck Does Palantir Actually Do? 1

Making Wall Hacks in Real Life

$300 Meta Ray-Bans + a 3D map = Anduril EagleEye-style see-through-walls. Once the glasses are tracked in 3D space, every other camera in the room — your friend's phone, a security cam — anchors to the same coordinate system. Suddenly the unseen becomes seen. #MetaRayBans #Anduril #EagleEye #VPS #MultiSet #SpatialAI #SeeThroughWalls

100 Strikes in 10 Minutes — From a Zoom Call?

The day after the US/Iran ceasefire, Israel hit 100+ targets in Lebanon in 10 minutes — Operation Eternal Darkness. To do that, you have to know where all your targets are at the same time. The OSINT rumor: a Zoom call. Hezbollah's biggest security lapse since the pagers. #OSINT #Lebanon #Hezbollah #EternalDarkness #SpatialIntelligence #Geopolitics

You Can See Through Walls with $300 Ray-Bans?

Anduril's Eagle Eye headset lets soldiers see through walls, overlay mini-maps, and auto-tag targets with AI. In this episode of Mad Science Experiments, I tried recreating a chunk of that with $300 Ray-Ban Meta glasses and commercial visual positioning technology. #AR #MilitaryTech #RayBanMeta #Anduril #MadScienceExperiments #VPS

Iran's Toll Booth on the Strait of Hormuz Explained

Before the closure, ships transited through the deepest part of the Strait of Hormuz. Now the ones getting through are going far closer to Iran — and paying for the privilege. Iran has set up a toll booth on one of the most important waterways on the planet. #straitofhormuz #iran #osint #oilcrisis #geopolitics #spatialintelligence #godseye #hormuz

They Mapped Inside a Pyramid From Space

Researchers used SAR Doppler Tomography from the Italian COSMO-SkyMed satellite to map the interior of the Great Pyramid of Giza from space. Not by seeing through stone, but by reading the micro-vibrations of the pyramid itself. They mapped a 4,500-year-old pyramid by listening to it vibrate. #SAR #syntheticapertureradar #pyramid #giza #satellite #radar #space #spatialintelligence

How Satellites See Through Clouds, Darkness, Smoke and Rain

Synthetic Aperture Radar. Satellites fire radar pulses at the ground and fake a massive antenna using orbital motion to get 25cm resolution — through clouds, darkness, smoke, and rain. And with InSAR, you can detect sub-millimeter ground movement over time. No camera on Earth can do this. #SAR #syntheticapertureradar #satellite #radar #InSAR #spatialintelligence #osint #remotesensing

Why the Strait of Hormuz Keeps Closing

Is the Strait of Hormuz open? There's been a lot of mixed messaging since the ceasefire was announced. I loaded up the latest open source intelligence to see what's actually going on. #straitofhormuz #iran #ceasefire #osint #oilcrisis #geopolitics #spatialintelligence #godseye

This Shouldn't Be Possible With an iPhone

Anduril built a military headset that lets soldiers see through walls, overlay drone feeds, and track targets with AI. It costs a defense contract and $30k+ per unit. I wanted to see how close I could get with a $300 pair of Meta Ray-Bans and off-the-shelf visual positioning technology. Turns out, you can get surprisingly close. A camera is all you need — no depth sensors, no LiDAR, no SLAM. Just a pre-scanned 3D map and a pair of consumer glasses. This video covers how VPS works, why GPS can't solve this problem, what it looks like when you can track someone through walls using a smartphone,

Ex-Google PM Uses God's Eye to Expose Reality of US–Iran Ceasefire

A ceasefire was announced. The Strait of Hormuz was supposed to reopen. So I loaded up God's Eye with the latest open source intelligence to see what's actually happening -- and the data tells a very different story than the headlines. Before the conflict, roughly 135 ships transited per day. On the first day of the ceasefire, 15 got through. The day after, about 6. Iran confirmed mines in the normal shipping lanes. Insurance prices have skyrocketed. And the ceasefire itself is already fracturing on multiple fronts. 0:00 - Is the Strait of Hormuz open? 0:44 - What the shipping data actually

This Satellite Revealed Things We Were Never Meant to See

Synthetic Aperture Radar (SAR) sees through clouds, darkness, smoke, and rain from orbit. It doesn't need light, it doesn't need clear skies, and you can access it for free. In this video I cover how SAR actually works, from the physics of synthesizing a giant antenna from orbital motion to the military constellation that will track every moving vehicle on Earth by the 2030s. Along the way we look at researchers mapping the inside of the Great Pyramid from space, why North American bridges are in worse shape than anywhere else on the planet, and how an AI caught a relocated village in Nepal si

Tracking Iran's Chokehold on the World's Oil with God's Eye #Iran #OSINT

Iran shut down the most important waterway on Earth. I updated God's Eye View with ship tracking data, dark vessel detection, pipeline routes, and the ongoing bombing campaigns to give you a real operational picture of what's happening at the Strait of Hormuz. Full breakdown on the channel. #StraitOfHormuz #hormuz #OilCrisis #OSINT #SpatialIntelligence #GodsEyeView #futuretech