# Multimodal & Spatial Computing

> Vision, pose, voice, generation, on-device intelligence, robotics, spatial interfaces, and human-computer interaction.

Canonical: https://learn.significanthobbies.com/curriculum/tracks/multimodal-spatial

Vision, pose, voice, generation, on-device intelligence, robotics, spatial interfaces, and human-computer interaction.

This track contains 8 connected concepts. Mastery means explaining each
mechanism, predicting its failure modes, and supporting decisions with code,
measurements, or a reviewable design artifact.

## Roadmaps

- [12-Week Multimodal & Spatial Computing](https://learn.significanthobbies.com/curriculum/roadmaps/multimodal-spatial-12w) — Connect vision, audio, generation, on-device intelligence, robotics, spatial interfaces, and HCI.

## Concepts

- [Multimodal Models](https://learn.significanthobbies.com/curriculum/concepts/multimodal-models) (core) — Joint text, image, audio, and video representations, encoders, projectors, fusion, generation, and cross-modal evaluation.
- [Vision Models](https://learn.significanthobbies.com/curriculum/concepts/vision-models) (core) — Classification, detection, segmentation, embeddings, vision transformers, data augmentation, and visual evaluation.
- [Pose & Motion Tracking](https://learn.significanthobbies.com/curriculum/concepts/pose-motion-tracking) (core) — Landmarks, skeletons, optical flow, temporal smoothing, identity tracking, calibration, occlusion, and latency.
- [Voice & Audio Systems](https://learn.significanthobbies.com/curriculum/concepts/voice-audio-systems) (core) — Capture, codecs, streaming, speech recognition, synthesis, turn detection, noise handling, latency, and conversational UX.
- [Image & Video Generation](https://learn.significanthobbies.com/curriculum/concepts/image-video-generation) (core) — Diffusion and transformer generation, conditioning, latent spaces, control, consistency, safety, and media evaluation.
- [Robotics Systems](https://learn.significanthobbies.com/curriculum/concepts/robotics-systems) (core) — Sensing, localization, mapping, planning, control, simulation, safety, real-time loops, and hardware interfaces.
- [Spatial Interfaces](https://learn.significanthobbies.com/curriculum/concepts/spatial-interfaces) (core) — Coordinate systems, anchors, tracking, depth, occlusion, hand/eye input, world understanding, and spatial UI.
- [Human-Computer Interaction](https://learn.significanthobbies.com/curriculum/concepts/human-computer-interaction) (core) — Human perception, cognition, motor control, interaction techniques, accessibility, evaluation, and responsible design.