How do I turn my phone into MIDI?

What is MIDI?

MIDI stands for Musical Instrument Digital Interface. It is a technical standard protocol that allows digital musical instruments, controllers, computers, tablets, smartphones and other electronic devices to connect and communicate with each other to convey musical performance data and control signals.

As explained in the Introduction to the MIDI Standard, MIDI acts as a common language that enables electronic instruments and devices from different manufacturers to connect using standard cables and connectors. The MIDI protocol translates performance information such as which notes are played, for how long, how loud, etc. into digital data that can be understood by other MIDI devices. This allowssynthesizers, computers, sequencers and other hardware to control one another and work together to play, record, and edit music.

Why Turn Your Phone into a MIDI Controller?

Turning your phone into a MIDI controller has some key advantages over buying a separate device:

Convenience – You can use a device you already own and carry with you everywhere. This avoids having to purchase, transport, and set up a separate MIDI keyboard or pad controller (Source).

Leveraging Existing Hardware – Modern smartphones have large, high-resolution touch screens that can be mapped to musical keys, pads, faders and other controls. They also have built-in motion sensors that allow for expression through movement (Source).

Portability – Turning your phone into a MIDI controller creates a highly portable music production setup. This makes it easy to make music anywhere inspiration strikes (Source).

Cost Savings – With the right software, you can transform your phone into a MIDI controller for free or very low cost. This allows you to save money compared to buying a dedicated hardware controller.

What You’ll Need

To turn your phone into a MIDI controller, you will need:

Compatible Phone

Most newer Android phones support MIDI over USB with the right software and cable, but you’ll want to confirm your specific model is compatible. Samsung Galaxy and Google Pixel phones generally work well (https://source.android.com/docs/core/audio/midi). iPhones do not support MIDI natively.

MIDI Software App

You’ll need to download a dedicated MIDI software app like MIDI Commander or midimux to connect your phone to your computer. These apps allow you to customize your phone’s interface into MIDI controllers.

Optional Accessories

A USB to MIDI cable can provide a more stable wired connection between your phone and computer. Some MIDI apps also support wireless connections over WiFi or Bluetooth. Devices like the iRig BlueBoard ($30) provide additional tactile controls.

Setting Up MIDI Software

The first step to using your phone as a MIDI controller is to download a compatible MIDI app. Some popular options include Perfect Piano, TouchDAW, FL Studio Mobile, and GarageBand. These apps allow you to route MIDI data from your phone to your computer or tablet.

Once you’ve installed your chosen MIDI app, you’ll need to configure the MIDI input and output settings. Most MIDI apps have a settings section where you can enable MIDI input and output over USB or wireless. For USB connections, make sure USB debugging is enabled on your Android device. For wireless, you’ll want to setup a MIDI network between your phone and computer.

It’s also important to set the MIDI channel on your phone app and DAW software to match. This allows the MIDI data to be transmitted properly between the devices. You may need to consult your DAW or MIDI software’s documentation to locate the setting.

With the app installed and MIDI input/output enabled, your phone is now ready to start controlling MIDI instruments and software on your computer or tablet. The next step is connecting the two devices.

Connecting Your Phone

There are a few different ways to connect your phone to use it as a MIDI controller:

WiFi: Many MIDI and synth apps allow you to connect via WiFi. This allows you to connect wirelessly to computers, MIDI devices, synths, and more that are on the same network. Just make sure your phone and the device you want to connect are on the same WiFi network. Look for a WiFi or wireless connection option in your MIDI app settings. [1]

Bluetooth: Bluetooth MIDI can be used to connect your phone wirelessly to MIDI devices, synthesizers, and computers within range (usually 30+ feet). Enable Bluetooth on your phone and pair it with the device you want to connect. Some MIDI apps have specific Bluetooth pairing options. [2]

Cable: Connect via a cable using the USB port or headphone jack on your phone. Use a USB to host cable or MIDI to headphone jack adapter. This provides the most reliable and lowest latency connection. Make sure to enable USB or MIDI connection in your app settings.

The key is getting your phone paired and connected with whatever MIDI device, synth, or computer you want to use. Check your app and device documentation for specifics on how to enable each connection type.

Using Touch Screen as MIDI Controller

One of the most convenient ways to turn your phone into a MIDI controller is by using the touch screen. The touch screen can be mapped to different instruments like keys, pads, and faders. This allows you to trigger MIDI notes and control parameters directly from the screen.

Most MIDI apps will include options to customize the layout and sensitivity of the touch screen interface. You’ll be able to adjust the size and position of the keys, pads, and faders on screen. The sensitivity can also be tweaked to suit your playing style and avoid accidental triggers.

For an optimal experience, spend some time customizing the interface to your needs. Make sure the instrument buttons and faders are large enough for accurate playing, while retaining enough space for all the functions. It may take some trial and error, but setting up an efficient layout can greatly improve your MIDI performances.

Some tips for touch screen mapping:

Place drum pads along bottom for easy access
Map a keyboard across multiple octaves
Add pitch and mod wheels in a convenient area

Include transport buttons for controlling playback
Add faders for mixing levels and effects

The touch screen offers versatile MIDI control – take advantage by fully optimizing the layout and sensitivity to suit your phone and playing style.

Using Motion Sensors

One of the most useful features of turning your phone into a MIDI controller is utilizing the built-in motion sensors. Smartphones contain accelerometers and gyroscopes that detect movement and orientation in 3D space. Apps like MusiKraken allow you to map device motions to MIDI control messages.

You can tilt, shake, or rotate your phone to manipulate MIDI parameters in real time. For example, tilting your phone left to right could control a filter sweep, while shaking it could trigger drum hits or effects. The gyroscope provides precise measurement of rotational motion on 3 axes to control pitch, modulation, or any CC message.

These apps offer customizable gesture mapping so you can fine tune the motion sensitivity and MIDI assignments. This makes it easy to dial in the perfect gesture response for your needs. The possibilities are endless for musical expression using the motion sensors on your smartphone.

Recording and Syncing MIDI Data

Once you have your phone set up as a MIDI controller, the next step is to record the MIDI data into a digital audio workstation (DAW) or synth. There are a few ways to go about this:

You can record MIDI directly into your DAW by connecting your phone via USB or WiFi. This will allow you to capture the MIDI data in real-time as you play. Make sure to arm a MIDI track in your DAW first to ensure it is recording the input. Popular DAWs like Ableton Live, Logic Pro, and Studio One have straightforward MIDI recording capabilities.

Alternatively, you can use a MIDI recording app on your phone to capture the MIDI data, and then transfer the MIDI file to your computer later for importing into a DAW. Apps like MIDI Mittr, midiBridge, and Lightning MIDI Recorder offer advanced MIDI recording and sync features.

Once the MIDI data is captured, you can quantize and edit it within your DAW. Quantizing will snap the notes to the nearest grid subdivision for timing. You can also tweak individual notes and adjust the velocity as needed. This allows you to clean up any playing imperfections and tighten the timing.

Syncing the MIDI clock between your phone and DAW is crucial for aligning recording and playback. Apps like Ableton Link, Korg SyncKontrol, or Link MIDI can facilitate wireless MIDI sync over WiFi.

Advanced Features and Customization

Once you have the basics set up, there are many advanced features you can use to customize and enhance your phone’s MIDI capabilities. One powerful option is MIDI scripting and programming. This allows you to create custom scripts and code to control MIDI parameters and automate functions.

You can also integrate your phone MIDI setup with other music apps for even more flexibility. Many MIDI apps have API support or plugins to connect with DAWs, synthesizers, sequencers and more. This allows you to route MIDI data between various programs.

Most MIDI apps also provide extensive options for designing custom MIDI layouts and interfaces. You can create your own virtual knobs, faders, buttons, keyboards and other controllers tailored to your needs. Apps like Synido TempoPad make it easy to sketch out controller layouts visually.

By diving into these advanced features, you can build a highly customized MIDI environment on your phone with intricate control capabilities and deep integration with other music software and hardware.

Limitations and Troubleshooting

Turning your phone into a MIDI controller can provide a lot of convenience and flexibility, but it also comes with some limitations to be aware of:

Latency Challenges

Latency refers to a slight delay between pressing a control on your phone and hearing the MIDI note played by your computer or synthesizer. This is often caused by wireless connectivity issues like poor WiFi signal, Bluetooth interference, or lack of proper software optimization (https://source.android.com/docs/core/audio/midi). Using a wired connection can help minimize latency.

Limited Expression

While touch screens provide a lot of control, they don’t offer the same level of precise expression as physical MIDI keyboards and controllers. Subtle modulation and aftertouch control may be difficult on a phone screen (https://eimearclarke.wordpress.com/2015/03/13/limitations-of-midi-technology/).

App and Device Compatibility

Not all music apps and hardware synthesizers fully support MIDI control from phones. There may be limited options for customizing controls and routing MIDI signals. Older devices may lack the connectivity or latency performance needed for mobile MIDI control.

Troubleshooting Tips

If experiencing latency, interference, or connection issues:

Try using a wired USB connection instead of wireless

Close other apps using Bluetooth or WiFi resources
Ensure operating systems and MIDI apps are updated
Adjust audio buffer settings to optimize latency

Try connecting devices to a different WiFi network