Every mobile robot — humanoid, AMR, quadruped, drone — needs two things nobody on its core team wants to build: persistent spatial memory that survives reboots, shift changes, and software updates, and an LLM that can reason about it in plain English. RakuAI delivers both as a service: a per-facility Gaussian splat captured once, hosted by us, queryable by any LLM you choose via 17 native MCP tools. We don't build robots, SLAM, or motion planning — we sit alongside them.
This page is written for engineers and partnerships leads at warehouse-automation, humanoid, delivery, and inspection robotics companies. It tries to be honest about where we sit in the stack, what we do and don't build, and where foundation-model robotics firms are customers, not competitors.
ABOVE perception (we consume images, depth, and poses), BELOW high-level task planning (we serve queries to your planner's LLM). We are the scene-memory + scene-QA layer — nothing more, nothing less. That focus is the pitch.
The wedge in one sentence: a per-facility splat that lives forever + an MCP API any LLM can query — sold per-capture and per-query, hosted, no infra burden on the customer. The moat isn't the splat — it's that the LLM is not vendor-locked, which matters to robot CTOs who already have an LLM relationship and don't want to be told which one to use.
The read-only scene-query API is the Phase-1 robotics focus. It answers object-relationship and path-clearance questions over the stored per-facility scene — relative position between two named objects, free space along a planned segment, who's near a waypoint — and returns structured JSON your planner acts on directly, not prose. Every response below is the real shape these endpoints return today.
The example scene is one captured world, warehouse-aisle-7 — 42 objects: pallets, racks, fixtures (a dock and two charging bays), and two people. Distances are in the engine's world_units, calibrated to the facility's metric scale at capture time. An unknown world returns 404 (existence is never disclosed); an empty world returns honest zeros, never a fabricated obstacle.
These endpoints layer over the 5 read-only scene-memory MCP tools the planner's LLM calls; the runtime returns structured JSON and your LLM and planner interpret it however they choose. Every call is metered — per-query counts persist to durable usage records, with per-pilot rollups and SLA-grade p50/p95/p99 latency + error-rate read back from /scene-query/usage/{summary,by-caller,sla}. That measured volume is what the 90-day pilot converts on: the meter, not the price — pricing stays your decision. Scene-delta ("what changed since shift T") is on the Phase-2 roadmap, not yet shipped — we don't show it as live. The MCP surface also exposes 12 audited mutation tools (anchors, sessions, transforms) — covered in the safety section below.
The runtime is the authority over physics, collision volumes, transforms, and the canonical scene state. An LLM assistant proposes actions through the MCP mutation tools; it does not silently rewrite the scene. Every mutation is audited.
Your robot's planner (or its LLM) talks to RakuAI's MCP surface over HTTPS — or via a stdio bridge from an on-robot Jetson Orin client. The runtime answers in spatial primitives: anchors, poses, scene queries, splat handles, object deltas.
Both halves are real and shipping. The production MCP server exposes 17 native tools (5 read-only + 12 mutation) plus a passthrough surface for LLM-specific extensions — see spatial-engine.html for the full inventory and mcp.html for the documented scene tools. The hosted MCP runs on Azure Container Apps in East US. The LLM is yours to pick — that vendor-neutrality is the moat.
Four segments, one shared pain: robots collect terabytes of spatial data that get dumped into storage and never queried again. Lead with warehouse for revenue stability; humanoid for visibility.
Robots already have SLAM. What they lack is a clean way to answer "what changed in zone B since last shift?" without writing a custom analytics pipeline. Per-site splat unifies QA across the fleet.
Example targetsSymbotic, Locus Robotics, Fetch / Zebra, GreyOrange, Geek+
Series B–D startups racing to ship a Fortune 500 pilot in 6–9 months. They buy anything that removes a 6-month engineering line item without locking them into one vendor's LLM stack.
Example targetsFigure, 1X Technologies, Apptronik, Agility Robotics, Unitree
Sidewalk and last-mile fleets operate across changing urban environments. Persistent scene memory of routes, drop points, and obstacles complements existing navigation without re-instrumenting the robot.
Example targetsStarship Technologies, Serve Robotics
Spot and quadruped fleets generate massive datasets dumped to storage and never opened. Customers pay per-site for auditable, time-stamped, queryable assets: "show me every valve flagged red in Q3."
Example targetsBoston Dynamics Spot ecosystem, ANYbotics, Cognite
RakuAI's NVIDIA Inception membership (accepted May 2026) and pending startup-credit programs compound here. Each is honestly labelled by status — we don't claim approvals we don't have.
Sim · Lab · Perceptor · Manipulator · ROS
World Foundation Models
USD digital-twin simulation
Inference Microservices
Inception benefits
Training & engineering office hours
Cloud sim · G5 / G6e · Greengrass
Where things actually stand
We're not replacing your perception stack. We're replacing the persistent-memory subsystem nobody wants to own and the scene-QA LLM bridge that gets pushed to "next quarter" forever.
Net savings, year 1: $250K–$1M in engineering cost displaced. Honest caveat: if a prospect already has a happy persistent-memory + LLM-bridge stack, we don't have a sale — and we won't pretend otherwise.
Free for the full 90 days. The output is a published, co-marketed case study — the deliverable that makes pilots #2, #3, and #4 easier to land.
Weeks 1–2
Free splat capture (we scan, or coach your team) plus MCP relay live for 5–10 of your facilities. Start with read-only scene queries — zero invoice during this window.
Weeks 3–8
Integration support — your engineers hook the MCP client into your planner. We sit in your Slack. NVIDIA Innovation Lab office hours booked weekly once approved.
Weeks 9–12
Audit log review: which queries ran, how many, what changed, engineer-hours displaced. Then a joint published case study — co-marketed via Inception channels.
Conversion offer: per-facility license OR per-capture + per-query metering — we let the first 3 pilots tell us which pricing model wins. The pilot stays free regardless.
Pilot slots are open. No real-robot pilots have completed yet — you would be in the first cohort. The commitment is a 90-day integration effort and co-publishing the findings. We supply the MCP surface, capture support, and integration help.
Use our contact form. Include your company name and robot type. We respond within one business day.
The honest version. Foundation-model robotics firms are integration partners and customers, not competitors.
Adjacent, not competitive
Customers, not competitors
Consumer / real-estate capture
Waymo · Tesla FSD · Wayve
The pages robotics teams read most before a first call.
Microsoft for Startups
RakuAI is an NVIDIA Inception member (accepted May 2026). The same NVIDIA-accelerated 3D Gaussian splatting stack we ship in Raku Capture is what powers the per-facility scene memory described above — complementary to NVIDIA Isaac, not competitive with it. Read more →
NVIDIA Inception is a free program for AI startups; RakuAI's membership does not imply that NVIDIA endorses RakuAI's products. Learn more at nvidia.com/startups.
RakuAI is built on AWS and an AWS Activate participant. Production reconstruction runs on Azure today; AWS GPU capacity (G5 / G6e) is on our roadmap, honestly gated until quota lands.
“AWS” and “AWS Activate” are trademarks of Amazon.com, Inc. or its affiliates. RakuAI’s participation does not imply that AWS endorses RakuAI’s products.