PulsePoint AI is an automated video-to-reel engine built for the ByteSize Sage Hackathon. It transforms long-form educational content into high-impact, 9:16 vertical reels using local audio analysis and speech-to-text.
During the hackathon, we found that relying on cloud-based LLMs (like Gemini) created a massive bottleneck due to strict rate limits and 429 RESOURCE_EXHAUSTED errors. We needed a solution that was fast, free, and worked 100% offline.
PulsePoint AI bypasses cloud limitations by using a Hybrid Local Processing approach:
- Audio Energy Peak Detection: Uses
librosato analyze the mathematical "Pulse" of the audio. It detects loudness spikes (RMS analysis) to automatically find where the speaker is most engaging. - Local Transcription: Runs OpenAI's Whisper (Tiny) model locally to generate timestamped transcripts without any API keys.
- Smart 9:16 Cropping: Automatically centers and crops 16:9 landscape video into mobile-ready vertical reels using
MoviePy. - Dynamic Captions: Synchronizes Whisper’s timestamps to overlay bold, social-media-style captions directly onto the video.
- Frontend: Streamlit
- Audio Analysis: Librosa & NumPy
- Transcription: OpenAI Whisper (Local)
- Video Engine: MoviePy
- Environment: Python 3.9+
- ImageMagick: Required for rendering text captions.
- Windows: Install ImageMagick and update the
IMAGEMAGICK_BINARYpath inmain.py.
- Windows: Install ImageMagick and update the
- Clone the Repo:
git clone [https://github.com/Blessy7-eng/ByteSize_Sage-Hackathon.git](https://github.com/Blessy7-eng/ByteSize_Sage-Hackathon.git) cd ByteSize_Sage-Hackathon - Install Dependencies:
pip install -r requirements.txt
- Run the App:
streamlit run main.py
App Working video : https://drive.google.com/file/d/1LNqH5f7-TEmuNp5KUZCja4fLVVOCBUNv/view?usp=sharing
reel 1 : https://drive.google.com/file/d/1uqT_qrceuJb6LR6oUxgmzl8C_tCNkBUq/view?usp=sharing reel 2 : https://drive.google.com/file/d/1uqT_qrceuJb6LR6oUxgmzl8C_tCNkBUq/view?usp=sharing reel 3 : https://drive.google.com/file/d/1iSHfnAJDrtbPzFyoOV0fHLwjRvFyCOAg/view?usp=sharing reel 4 : https://drive.google.com/file/d/1c4ZENq3olUbAqoguqxJ9UBgYLoZnNDgx/view?usp=sharing