Hey Alexa, meet Music

A BTS of making the winner entry for Alexa India Hackers League, 2019.

Introduction

This story will talk about our experience at Alexa India Hackathon, held at Amazon during my tenure there as an intern in June 2019. I teamed up with two of my experienced colleagues Srini and Abhishek for the hackathon. There was no problem statement defined, but the idea proposed had to involve developing a skill for Alexa. Enough intro, onto the fun part now!

Inception of the idea

A lot of us learn or want to learn music out of hobby. A major setback of traditional music learning experience is that an instructor has to guide you not only through your learning phase, but also in the practicing phase. This part is time consuming and has the potential to be automated by Alexa.
Through our proposed Alexa skill, we wanted Alexa to act as the feedback provider during your practicing phase. In short, Learn music from a tutor, and practice it with Alexa! (This idea was a brainchild of Srini)

Overview of the proposed Solution

The high level flow of practicing with Alexa

Scoring Mechanism

There are a whole lot of complexities in coming up with a similarity criterion for audio. Direct comparison will not work here ( what if your audio is 100% similar, but there is a time lag of a millisecond? Yes, it will be scored as 0% similar). Also, factors like noise and difference in calibration of instruments has to be taken into account. This was a problem which left music producer companies scratching their head for a long time. They simply could not afford a manual workforce to moderate all the copyrighted music floating around internet!

WebApp for similarity score for audio files

Happy Ending :)

About a week and a half after the demo presentation, we received a mail stating we were the WINNERS of the hackathon!

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store