SDK Developer Preview
XR

Spatial Engine SDK

16 modules. 2,718 API functions. AI-native architecture. Build spatial games for PC, console, and XR from a single codebase.

5 Granted Patents 19 MB Runtime 100% Test Pass Rate 0 Cloud Dependencies
Game Studios Console Manufacturers XR Platforms AI Companies Indie Developers

How RakuAI Works

RakuAI separates game definition from engine execution. AI generates the game logic. The runtime executes it in real-time through 16 compiled native modules.

AI Generates

.raku JSON file
Game logic, entities,
AI behaviors, scenes

Runtime Interprets

16 native DLLs
Parse → Validate →
Execute at 60+ FPS

Player Experiences

Adaptive gameplay
On-device AI personalization
XR-ready output

Execution Pipeline ───────────────────────────────────────────────────────────────────────── ChatGPT / Claude / Gemini Raku Runtime (16 Modules) ┌───────────────────────┐ ┌──────────────────────────────────┐ │ Developer describes │ │ RakuCore ── Memory, Threading │ │ game in natural │ .raku │ RakuScene ── Scene Graph, CSG │ │ language │ JSON │ RakuRenderer ── D3D11, PBR, Post │ │ │ ────────► │ RakuXR ── OpenXR 1.1, Track │ │ AI generates valid │ │ RakuPhysics ── Rigid, Soft, CCD │ │ .raku game file │ │ RakuAudio ── HRTF, Adaptive │ └───────────────────────┘ │ RakuAnimation── Skeletal, IK, BT │ │ RakuAI ── DDA, Profiling │ On-Device AI LoopRakuSLM ── ML Inference │ ┌───────────────────────┐ │ RakuNetwork ── WebRTC, UDP, LAN │ │ Player Input ──────► │ │ RakuVoice ── VAD, AEC, STT │ │ Behavior Analysis │ │ RakuInput ── Gamepad, Gesture │ │ │ │ │ RakuUI ── 2D/3D, A11y │ │ ▼ │ │ RakuAssets ── GLTF, Stream, LOD │ │ DDA ◄─► Profiler │ │ RakuEditor ── Inspector, Debug │ │ │ │ │ RakuScripting── Lua VM, Sandbox │ │ ▼ │ └──────────────────────────────────┘ │ Adapt Difficulty │ │ │ Adapt Audio │ ┌────────────▼─────────────────────┐ │ Adapt NPC Behavior │ │ Output: 60+ FPS Native Game │ │ Emotional Response │ │ PC │ Console │ XR │ AR Glasses │ └───────────────────────┘ └──────────────────────────────────┘

16-Module Architecture

Each module compiles to a standalone native DLL. Load only what you need. Total runtime: 19 MB.

RakuCore

1,744 KB

Engine lifecycle, memory pools, multi-threaded job system, signal/slot event bus, structured logging, ECS.

RakuScene

6,866 KB

Hierarchical scene graph, CSG boolean operations, GridMap tiling, node-based world composition.

RakuRenderer

1,478 KB

PBR materials, dynamic lighting, post-processing (bloom, SSAO, TAA, volumetric fog), variable-rate shading, GPU particles.

RakuXR

994 KB

OpenXR 1.1, hand tracking (26 joints), eye tracking, spatial anchors, passthrough AR, foveated rendering.

RakuPhysics

535 KB

Rigid body, soft body, continuous collision detection, joint constraints, raycasting, vehicle physics.

RakuAudio

610 KB

Spatial 3D with HRTF, adaptive music system, voice assistant, audio occlusion, multi-channel mixing.

RakuAnimation

809 KB

Skeletal animation, blend trees, IK solvers, animation state machines, motion matching, spring bones.

RakuAI

382 KB

Dynamic difficulty adjustment, player profiling, emotional state detection, behavior trees, NavMesh pathfinding.

RakuSLM

798 KB

On-device small language model inference. Emotion recognition, gesture detection, procedural dialogue. No cloud calls.

RakuNetwork

691 KB

WebRTC peer-to-peer, authoritative replication, lobby management, matchmaking, NAT traversal, cloud sync.

RakuVoice

137 KB

Voice chat with echo cancellation, voice activity detection, speech processing, push-to-talk.

RakuInput

291 KB

Unified input for keyboard, mouse, gamepad, touch, and gesture. Action bindings, dead zones, haptic feedback.

RakuUI

673 KB

2D and 3D widget system, runtime theming, accessibility (screen reader, high contrast, remappable controls).

RakuAssets

1,427 KB

GLTF 2.0 and FBX loading, texture streaming, asset caching with LRU, hot-reload for rapid iteration.

RakuEditor

432 KB

Scene inspector, property editor, debug visualization, performance profiler, entity hierarchy browser.

RakuScripting

1,787 KB

Embedded Lua VM with sandboxed execution, hot-reload, C API auto-bindings, coroutine support, visual scripting.

SDK Architecture

Clean separation between the public SDK interface and the compiled runtime. Your application links against the SDK. The SDK calls the runtime.

SDK ↔ Runtime Separation ───────────────────────────────────────────────────────────────────────── Your Application ┌──────────────────────────────────────────────────────────────────────┐ │ Unity C# Game │ Unreal C++/Blueprint │ Native C/C++ Engine │ └────────┬────────┴───────────┬─────────────┴────────┬───────────────┘ │ │ │ ▼ ▼ ▼ Raku SDK (Public API Layer) ┌──────────────────────────────────────────────────────────────────────┐ │ HeadersBindingsSamples │ │ C API headers │ Unity package │ HelloAR, Space │ │ Type definitions │ Unreal plugin │ Battleship Defense, │ │ Error codes │ Blueprint nodes │ GazeSelect, Anchors │ └────────────────────────────┬─────────────────────────────────────────┘ │ Calls via loader ▼ Raku Runtime (Compiled Native Modules) ┌──────────────────────────────────────────────────────────────────────┐ │ 16 DLLs │ NONAME exports │ Symbol-stripped │ Patent-protected │ │ │ │ All implementation details compiled to native code. │ │ No source exposure. No algorithm visibility. │ └──────────────────────────────────────────────────────────────────────┘

Companion Gaming Architecture

Build once. Play on any screen. Optionally extend with AR glasses for spatial overlay experiences. No separate VR port required.

Companion Gaming Model ───────────────────────────────────────────────────────────────────────── Primary Display AR Glasses Overlay ┌─────────────────────────────┐ ┌─────────────────────────┐ │ │ SDK │ │ │ Full game runs on │ ◄───────► │ HUD elements │ │ PC / Console / Mobile │ Low-latency │ Minimap / radar │ │ │ stream │ Health / ammo status │ │ Rendered at native res │ │ Objective markers │ │ Main gameplay loop │ │ AI companion overlay │ │ │ │ │ └─────────────────────────────┘ └─────────────────────────┘ Supported Primary Platforms Supported AR Devices ├── PlayStation 5 ├── Meta Quest 3 (Passthrough) ├── Xbox Series X|S ├── OpenXR-compatible glasses ├── Nintendo Switch └── Future XR devices ├── Windows PC └── Mobile (iOS / Android)

Platform & Integration Support

Unity

Full C# package with samples, Blueprint-style API

Production Ready

Unreal Engine

C++ and Blueprint support, editor integration

Production Ready

Native C/C++

Cross-platform headers, minimal dependencies

Production Ready

OpenXR 1.1

Hand tracking, eye tracking, spatial anchors

Production Ready

Networking

WebRTC, UDP/TCP sessions, avatar sync

Beta

Scene Understanding

Plane detection, spatial mesh, environment lighting

Beta

Voice AI

Intent recognition, assistant UI, voice commands

Preview

LearnAPI (ML)

On-device adaptive learning, TFLite integration

Preview

Why Raku SDK

Capability Raku SDK Traditional Engines
AI-native difficulty adjustment Built-in (DDA + Profiler) Plugin / custom code
On-device ML inference RakuSLM, no cloud Requires cloud APIs
XR support OpenXR 1.1, every game Separate VR build
Companion gaming (AR overlay) Single codebase Not supported
Emotional state detection Built-in profiler Not available
Adaptive music system HRTF + intensity-driven Manual scripting
Total runtime size 19 MB 500 MB – 2 GB+
Royalties None. Zero. Revenue share above threshold

Global SDK Support

SDK documentation and samples available in 8 languages.

EN
English
日本
Japanese
FR
French
DE
German
ES
Spanish
PT
Portuguese
Chinese (Simplified)
Chinese (Traditional)

Get the SDK

Free for indie developers. No royalties. No license fees. Includes Unity, Unreal, and C/C++ bindings with complete sample projects.

2,718
API Functions
16
Native Modules
10+
Sample Projects
3
Engine Integrations

Using the SDK? We want your feedback.

Enterprise licensing and partnership inquiries: hello@rakuai.com