core practice · system design prompt
Design exercise: Multimodal Models
Joint text, image, audio, and video representations, encoders, projectors, fusion, generation, and cross-modal evaluation. Implement designOutline() returning non-empty values for: modalityEncoders, fusion, crossModalEval. Each value must name a concrete mechanism or decision.
The mechanism
Multimodal models align different signal spaces through shared or connected representations. Data alignment, modality-specific encoders, fusion, and cross-modal evals are central.
Expected evidence
A design outline with modalityEncoders, fusion, crossModalEval plus an explicit failure mode or trade-off.
Try this drill in the practice workspace →
Hints when you need them
- Name the failure mode before selecting the mechanism.