Skip to content

riddhihalade/DubWiz

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 

Repository files navigation

DubWiz | Transformers-driven Video Dubbing

Overview

DubWiz is a video dubbing website that leverages advanced technologies to significantly reduce manual editing efforts. By integrating React.js for the frontend and Flask for the backend, this project automates and enhances the video dubbing process, achieving a notable reduction in manual editing by 80%.

Features

  • Video Dubbing: Streamlines the process of dubbing videos with minimal manual intervention.
  • Audio-to-Text Conversion: Utilizes OpenAI Whisper for accurate audio-to-text conversion.
  • Multilingual Translation: Employs Hugging Face MBart for translating text into 10+ Indian languages.
  • High Accuracy: Achieves 90% accuracy in audio conversion and lip-sync using Silero and Wave2Lip.

Tech Stack

  • Frontend: React.js, Tailwind CSS, Vite
  • Backend: Flask
  • Audio-to-Text: OpenAI Whisper
  • Multilingual Translation: Hugging Face MBart
  • Lip-sync and Audio Conversion: Silero, Wave2Lip

Installation

Prerequisites

  • Node.js (for frontend)
  • Python 3 (for backend)
  • pip (for Python package management)

Frontend Setup

  1. Clone the repository:

    git clone https://github.com/yourusername/DubWiz.git cd DubWiz

About

AI-ML powered video dubbing platform

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors