Create Sound Design

Workflow Rounds

Round 1: Scene Analysis

• Parse script JSON for action lines, environments
• Parse storyboard YAML for audio_cues field
• Categorize cues: foley, ambient, impact, transition, vocal, nature
• Questions: Confirm extracted cues are correct

Round 2: Sound Search

• Query sfx-catalog for each cue
• Rank by semantic similarity + category match
• Recall prior successful usage from memory
• Questions: Select preferred sound for each cue

Round 3: Timing & Levels

• Calculate timestamps avoiding conflicts
• Set volume based on intensity and competing audio
• Generate fade curves for smooth transitions
• Questions: Approve mix decisions

Round 4: Export

• Generate SoundDesignSpec manifest per scene
• Record usage in memory for future learning
• Output JSON manifest for Assemble phase

Integration with create-movie

This skill integrates into Phase 4 (Generate) of create-movie:

from create_sound_design import run_sound_design_session

result = run_sound_design_session(
    script_path="script.json",
    storyboard_path="storyboard.yaml",
    output_dir="audio/sfx/",
    auto_approve=True,  # For pipeline mode
)

Output Format

The manifest JSON consumed by Assemble phase:

{
  "project": "Dark Horizon",
  "session_id": "sounddesign-20240115-103000-abc123",
  "scenes": {
    "scene_01": {
      "duration": 45.0,
      "events": [
        {
          "sfx_id": "sfx_door_creak_01",
          "sfx_path": "/path/to/door_creak.wav",
          "timestamp": 2.5,
          "duration": 1.2,
          "volume": 0.6,
          "pan": -0.3,
          "fade_in": 0.1,
          "fade_out": 0.2
        }
      ]
    }
  }
}

Dependencies

• sfx-catalog: Sound library and query engine
• memory: For learning storage (via sfx-catalog bridge)