Musicment

 

About   |   How To Use   |   Features   |   Technologies   |   Requirements   |   Starting   |   Other Docs   |   Made By   |   Author

🎯 About

Software plays Musical Notes based on the Hand Gestures. The Notes of an Octave plays as we move our hand in front of the Primary Camera. It uses Machine Learning to infer 21 3-Dimensional Landmarks of our hand using Mediapipe's State-of-the-art techniques.

Detailed Article explaining the code is on my Medium Accout

🎯 How To Use

Basic Interface of Window:-

🎶Playing the Notes:-

Demo.mp4

Controls of the Program:-

After running the program, you may read the main window's instructions.

You may press q/Q anytime to Quit.

For continuing, press 'Enter'

After that, show the hand you want to use for Octaves (Don't Worry, it will show you as Hand for Notes), then show your other hand used for Notes (Now it will show you correct Notations).

Now Close both your hands to make a fist.

For Octave Hand:

Starting from the thumb to the little finger, by adding each finger, the octaves start to increase. (C4->C5->C6->C7->C8)  here adding a finger means opening up a finger.

For Notes Hand:

a close fist means " Sa/C "

just opening the thumb means " Re/D "

just opening the index finger means " Ga/E "

just opening the middle finger means " Ma'/F# "

opening index and thumb indicates " Pa/G "

opening index and middle indicates " Dha/A "

opening index, middle, and thumb indicates " Ni/B "

opening the little only means " Sa'/C' "

✨ Features

✔️ Uses Open Computer Vision (OpenCV)
✔️ Notes from C3 to C7
✔️ Control Notes by one Hand and Octaves by other

🚀 Technologies

The following tools were used in this project:

• Mediapipe
• PySineWave
• OpenCV

✅ Requirements

Before starting, you need to have Git

🏁 Starting

# Clone this project
$ git clone https://github.com/manipta/Musicment.git

# Access
$ cd Musicment

# Install dependencies
$ pip install -r requirements.txt

# Run the project
$ python main.py

📑 Other Docs

Table with Frequency and Wavelength Values for Particular Note

Click Here

📝 Made By

Made with ❤️ by Mani Garg
Inspired by this  

Back to top