Visual and Audio Alternatives for Music

Alternative representations of music may be beneficial for some learners.

MIDI Visualization

3D MIDI visualizations provide another way to explore musical structure by combining synchronized audio with dynamic visual representations of pitch, rhythm, note duration, and multiple instrument tracks. Tools such as MIDITrail use color coding, customizable viewpoints, and playback controls to help learners better understand musical relationships. These visualizations can benefit all students by reinforcing concepts through multiple modes of representation, while also supporting learners who benefit from visual cues.

MIDITrail is available on both MacOS and Windows. If you choose to use MIDITrail, whether you create your own or use an existing score video, review all materials for accuracy before sharing them with students. When possible, provide a .MIDI file instead of a prerecorded MIDITrail video, as this allows the student to directly engage with the musical events in real time.

Figure 1: MIDITrail PianoRoll3D interface. Screenshot from MIDITrail for macOS Ver. 2.1.0 User Manual by WADA Masashi, 2026, https://www.yknk.org/miditrail/manual/macos/MANUAL.en.html

MIDITrail PianoRoll3D interface.

Figure 2: MIDITrail PianoRoll3D interface. Screenshot from MIDITrail for macOS Ver. 2.1.0, September 2026.

Screenshot of black screen with receding rows of piano keys and vertical colored strips in patterns moving down to keys on the keyboards.

Talking Scores

You may also consider creating a “talking score”. In talking scores, music notation is described verbally in sections with details that may include the octave, key changes, repeated sections, instrument changes, or common rhythms. In between these sections, the notation is often played aloud for the listener.

Talking scores can also be helpful for individuals with neurological disabilities that make processing print content challenging. For examples of talking scores generated using a conversation program, check out the Talking Scores open source project. This project converts MusicXML files into a combination of text description and audio playback files in an HTML format that can be navigated by assistive technologies.

Resources