How would you approach making an iPad app to upload a music sheet and then play along with it?

Question

What packages/ APIs/ tools are needed to implement with Swift successfully?
My understanding is having an OMR parse music sheet images/ pdfs to music xml files, then render the notations using some notation library, then maybe play with MIDI?

Imran Khan · Accepted Answer

The reference is great. Trying to build something like this. I guess I can make a webapp and turn it into a PWA or use it in WebView for native apps.

Juan Alvarez · Answer

AFAIK there are a number of libraries to transform sheets into MusicXML, not sure how well they work, but what you say makes sense initially. That said:

* iPad only might be very limiting, most people doesn't have one. 
* Play along a music sheet has been done already; not sure if that is the end goal, or just a learning project (which is fine), but if you want a chance at capturing interest I think you need to offer something more. 

For inspiration / reference, Adrian Holovaty's Soundslice is pretty great: https://www.soundslice.com/

Go to Homepage	`g` `h`
Go to Done Todos	`g` `d`
Compose a New Todo	`n`
Go to Search	`/`
Show this dialog	`?`

How would you approach making an iPad app to upload a music sheet and then play along with it?

Keyboard Shortcuts