You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+13-2Lines changed: 13 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -36,7 +36,8 @@ With Open-Sora, our goal is to foster innovation, creativity, and inclusivity wi
36
36
</div>
37
37
38
38
## 📰 News
39
-
-**[2024.01.20]** 🔥 We released **Open-Sora 1.3**. With the upgraded VAE and Transformer architecture, the quality of our generated videos has been greatly improved 🚀. [[checkpoints]](#open-sora-13-model-weights)[[report]](/docs/report_04.md)[[demo]](https://huggingface.co/spaces/hpcai-tech/open-sora)
39
+
40
+
-**[2024.02.20]** 🔥 We released **Open-Sora 1.3**. With the upgraded VAE and Transformer architecture, the quality of our generated videos has been greatly improved 🚀. [[checkpoints]](#open-sora-13-model-weights)[[report]](/docs/report_04.md)[[demo]](https://huggingface.co/spaces/hpcai-tech/open-sora)
40
41
-**[2024.12.23]** 🔥 [The development cost of video generation models has saved by 50%! Open-source solutions are now available with H200 GPU vouchers](https://company.hpc-ai.com/blog/the-development-cost-of-video-generation-models-has-saved-by-50-open-source-solutions-are-now-available-with-h200-gpu-vouchers)[[code]](https://github.com/hpcaitech/Open-Sora/blob/main/scripts/train.py)[[vouchers]](https://colossalai.org/zh-Hans/docs/get_started/bonus/)
41
42
-**[2024.06.17]** 🔥 We released **Open-Sora 1.2**, which includes **3D-VAE**, **rectified flow**, and **score condition**. The video quality is greatly improved. [[checkpoints]](#open-sora-12-model-weights)[[report]](/docs/report_03.md)[[blog]](https://hpc-ai.com/blog/open-sora-from-hpc-ai-tech-team-continues-open-source-generate-any-16-second-720p-hd-video-with-one-click-model-weights-ready-to-use)
42
43
-**[2024.04.25]** 🤗 We released the [Gradio demo for Open-Sora](https://huggingface.co/spaces/hpcai-tech/open-sora) on Hugging Face Spaces.
@@ -61,7 +62,6 @@ With Open-Sora, our goal is to foster innovation, creativity, and inclusivity wi
@@ -106,6 +107,7 @@ see [here](/assets/texts/t2v_samples.txt) for full prompts.
106
107
</details>
107
108
108
109
## 🔆 New Features/Updates
110
+
109
111
- 📍 **Open-Sora 1.3** released. Model weights are available [here](#model-weights). See our **[report 1.3](docs/report_04.md)** for more infomation.
110
112
- ✅ Upgraded model architecture, delivering enhanced performance and efficiency.
111
113
- ✅ Incorporated more high-quality training data, significantly improving overall results.
@@ -146,6 +148,8 @@ see [here](/assets/texts/t2v_samples.txt) for full prompts.
146
148
147
149
</details>
148
150
151
+
Since Open-Sora is under active development, we remain different branchs for different versions. The latest version is [main](https://github.com/hpcaitech/Open-Sora). Old versions include: [v1.0](https://github.com/hpcaitech/Open-Sora/tree/opensora/v1.0), [v1.1](https://github.com/hpcaitech/Open-Sora/tree/opensora/v1.1), [v1.2](https://github.com/hpcaitech/Open-Sora/tree/opensora/v1.2).
152
+
149
153
### TODO list sorted by priority
150
154
151
155
<details>
@@ -366,6 +370,7 @@ For more advanced usage, you can refer to [Gradio README](./gradio/README.md#adv
@@ -630,14 +637,18 @@ All the evaluation code is released in `eval` folder. Check the [README](/eval/R
630
637
## VAE Training & Evaluation
631
638
632
639
### Open-Sora 1.3 VAE Training
640
+
633
641
We implement and train a unified spatial-temporal VAE for better compress videos as well as preserve details. For more detailes, refer to [Open-Sora 1.3 VAE Documentation](docs/vae_v1_3.md). Before you run the following commands, follow our [Installation Documentation](docs/installation.md) to install the required dependencies for VAE and Evaluation.
0 commit comments