voice4ixd

Voice Assistant 4 Interaction Design This repository will serve as an exchange with the students of the MAInD during the Multimodal UX in Products from the academic year 2022/2023.

You can find more information here: Voice 4 IxD - Notion page

Picovoice Rhino + Porcupine and Arduino Nano 33 BLE Sense V2

Inside the folder picovoiceOfflineArduino you will find a folder PicovoiceParrot that contains the .ino file and the params.h

To use the system you need to follow these steps:

1. Open the PicovoiceParrot.ino file;
2. Update the file inserting as many conditions as your commands from Picovoice Rhino;

if(intent == "yourCommand"){
 //Insert here the actions to perform with Arduino
};

4. Upload the code to your Arduino;

Python + Picovoice Rhino and Arduino

Inside the folder picovoiceRhinoPythonArduino you will find:

1. A folder called arduinoReadingFromPython that contains the .ino file for any Arduino Board;
2. A folder called pythonPicovoice that contains the library that you can create and download from Rhino Picovoice Console;
3. A file called triggerRhinoPicovoice.py that contains the script to check intents from voice and send it to Arduino.

To use the system you need to follow these steps:

1. Follow the comments on the triggerRhinoPicovoice.py file and install the libraries using pip;
2. Open the arduinoReadingFromPython.ino file;
3. Update the file inserting as many conditions as your commands from Picovoice Rhino;

if(value == "yourCommand"){
 //Insert here the actions to perform with Arduino
};

4. Upload the code to your Arduino;
5. If you encounter any conflicts is because of serial ports: if you need to see the serial port on Arduino IDE please start the python script and then open the serial monitor.

Python + Picovoice Porcupine and Arduino

Inside the folder picovoicePorcupinePythonArduino you will find:

1. A folder called arduinoReadingFromPython that contains the .ino file for any Arduino Board;
2. A folder called pythonPicovoice that contains the library that you can create and download from Rhino Picovoice Console;
3. A file called triggerPorcupinePicovoice.py that contains the script to check wake word from voice and send it to Arduino.

To use the system you need to follow these steps:

1. Follow the comments on the triggerPorcupinePicovoice.py file and install the libraries using pip;
2. Open the arduinoReadingFromPython.ino file;
3. Update the file inserting the condition as your command from Picovoice Porcupine;

if(value == "yourCommand"){
 //Insert here the actions to perform with Arduino
};

4. Upload the code to your Arduino;
5. If you encounter any conflicts is because of serial ports: if you need to see the serial port on Arduino IDE please start the python script and then open the serial monitor.

Python + Picovoice Complete and Arduino

Inside the folder picovoiceCompletePythonArduino you will find:

1. A folder called arduinoReadingFromPython that contains the .ino file for any Arduino Board;
2. A folder called pythonPicovoice that contains the library that you can create and download from Rhino Picovoice Console;
3. A file called triggerPicovoice.py that contains the script to check wake word from voice and send it to Arduino.

To use the system you need to follow these steps:

1. Follow the comments on the trigger.py file and install the libraries using pip;
2. Open the arduinoReadingFromPython.ino file;
3. Update the file inserting as many conditions as your commands from Picovoice;

if(value == "yourCommand"){
 //Insert here the actions to perform with Arduino
};

4. Upload the code to your Arduino;
5. If you encounter any conflicts is because of serial ports: if you need to see the serial port on Arduino IDE please start the python script and then open the serial monitor.