This notebook provides a suite of interactive widgets designed to streamline the entire process of preparing and uploading files to your Hugging Face repositories.
Each step has been enhanced with "smart" features to provide clear feedback, prevent common errors, and accelerate your workflow.
This notebook is organized into a simple, step-by-step process. Just run the cells in order.
- ⚙️ Setup & Validate Environment: The first cell installs all necessary packages and then validates the environment, confirming that all tools and the
hfCLI are ready to use. - 🔑 Secure Authentication: The login cell checks your current login status first. If you need to log in, it will then validate your token to ensure it has the correct
writepermissions required for uploading. - 🗂️ (Optional) Zip Your Images: Use the Smart Image Zipper to prepare your image datasets. It allows you to filter by file type and analyze a folder to see a preview of the archive size before zipping.
- 🚀 Upload to the Hub: The Smart Uploader widget provides a powerful interface for uploading your files, supporting concurrent uploads, single-commit mode, and automatic repository creation.
- Interactive Widgets: Manage your entire workflow without writing complex scripts.
- Environment Validation: Confidence that your setup is correct from the very beginning.
- Secure Login with Permission Checks: Prevents upload failures due to incorrect token permissions.
- Pre-Zip Analysis: Analyze image folders to know the size and file count before you zip.
- Advanced Upload Options: Choose between single-commit mode for clean history or concurrent uploads for speed.
- Fast Uploads: Automatically uses
hf_transferto speed up large file transfers. - Live Progress Bars: Monitor progress during both zipping and uploading.
PREVIOUS NOTEBOOKS AND COLAB NOTEBOOKS TO 2025 SEPTEMBER ARE REMOVED FOR SECURITY.
- This tool is continuously updated and improved.
- For the latest updates, fixes, and community contributions, please visit the GitHub repository.
We hope this tool simplifies your Hugging Face uploads! For questions or suggestions, please reach out.
We are a diverse system of 300+ alters, navigating life with DID, ADHD, Autism, and CPTSD. We believe in the positive potential of AI for mental health and creativity and are excited to explore this intersection.
This project is managed by Ktiseos Nyx, the programming division of Earth & Dusk.
| Platform | Link |
|---|---|
| Website | End Media |
| Discord | Discord Community |
| Hugging Face | HuggingFace Space |
| YouTube | YouTube Channel |
| DeviantArt | DeviantArt Group |
| Subreddit | Subreddit |
You can support our work and future development through Ko-fi.
If you encounter a bug or need assistance, please reach out through:
- GitHub Pull Requests & Bug Tracker
- CivitAi Direct Messages/Comments
- Earth & Dusk Discord
We extend our sincere gratitude to the original creators and contributors who laid the foundation for this project:
- EVERYDREAM2 TRAINER: https://github.com/victorchall/EveryDream2trainer
- LINAQRUF
- NOCRYPT:
Explore the original Stable Diffusion Colab notebook:
- 🔧 Enhanced with EveryDream2Trainer's Python widget integration.
- 🌟 Maintained and highlighted Nocrypt's valuable contributions.
- 📦 Integrated essential functionalities into a single Jupyter Notebook.
- 🤓 Improved file handling with proper file extensions (*.safetensors).
- 📝 Created user-friendly and accessible instructions.
- 🤖 Utilized GPT assistance to enhance clarity and readability.
- 🎨 Improved the visual presentation of the Jupyter Notebook edition.
- 🔄 Synchronized Colab and Jupyter Notebook versions for consistency.
- 🧹 Optimized dependencies by removing unnecessary transformers.
- ✨ Added advanced folder upload capabilities.
- 🔄 Refined and updated the Colab notebook for improved performance.
- 🚀 Implemented more concise widget features and restored Colab functionality.
- 💎 Underwent a Gemini-assisted overhaul for improved quality.
- ➕ Expanded supported file types in Colab, streamlined instructions, and introduced command-line functionality (Note: Command-line section removed as per request).
We acknowledge that we are not professional programmers, and appreciate community contributions. Pull requests are always welcome for improvements! 🎉
