|
4 | 4 |  |
5 | 5 | [](https://github.com/keras-team/keras-cv/issues) |
6 | 6 |
|
7 | | -# Vision |
8 | | -A computer vision library dedicated for auto-driving, robotics and on device applications. |
9 | 7 |
|
10 | 8 | # Mission |
11 | 9 |
|
12 | | -KerasCV is a layered repository consisting of core components and modeling components. |
| 10 | +KerasCV is a computer vision library of modular computer vision oriented Keras components. |
| 11 | +These components consist of models, layers, metrics, losses, callbacks, and utility functions. |
13 | 12 |
|
14 | | -On the core components, it is made of modular building blocks (ops, functions, layers, metrics, losses, callbacks) that standardizes APIs for computer vision concepts such as data-augmentation pipeline, bounding boxes, keypoints, point clouds, feature pyramid network, etc, so applied computer vision engineers can leverage to quickly assemble production-grade, state-of-the-art |
15 | | -training and inference pipelines for common tasks such as image classification, object detection and segmentation, image data augmentation, etc. |
| 13 | +The goal of the library is to provide standardized Keras native APIs for common computer vision tasks such as data-augmentation, classification, object detection, image generation, and more. |
| 14 | +Applied computer vision engineers can leverage KerasCV to quickly assemble production-grade, state-of-the-art training and inference pipelines for all of these common tasks. |
16 | 15 |
|
17 | | -On the modeling components, it provides the most widely used models for each task such as ResNet family, MobileNet family, transformer-based models, anchor-based and anchor-free meta architectures, unet models, that are built on top of core components, highly composable and compatible with the Keras trainer (`model.fit`). It aims to provide pre-built models that are mixed-precision compatible, QAT compatible, and xla compilable during training, and generic model optimization tools for deployment on devices such as onboard GPUs, mobile, edge chips. |
18 | | - |
19 | | -KerasCV provides the following values for users: |
20 | | -- modular mid-level APIs and composable meta architectures |
21 | | -- mixed-precision and xla enabled components |
22 | | -- highly optimized, quantization aware training (QAT) enabled models, compatible between GPUs and TPUs. |
23 | | -- reproducible training results and leaderboard |
24 | | -- useful tools for evaluation, visualization and explanation. |
25 | | -- source for inference conversion (TFLite, edge devices, TensorRT, etc) and optimization at model level. |
26 | 16 |
|
27 | 17 | KerasCV can be understood as a horizontal extension of the Keras API: the components are new first-party |
28 | 18 | Keras objects (layers, metrics, etc) that are too specialized to be added to core Keras, but that receive |
29 | 19 | the same level of polish and backwards compatibility guarantees as the rest of the Keras API and that |
30 | 20 | are maintained by the Keras team itself. |
31 | 21 |
|
| 22 | +In addition to API consistency, KerasCV components are built to be mixed-precision compatible, QAT compatible, xla compilable, and TPU compatible. |
| 23 | +In the near term, we aim to provide pre-trained models for common tasks such as on-device object detection and NSFW classification. |
| 24 | +We also aim to provide generic model optimization tools for deployment on devices such as onboard GPUs, mobile, edge chips. |
| 25 | + |
32 | 26 | KerasCV's primary goal is to provide a coherent, elegant, and pleasant API to train state of the art computer vision models. |
33 | 27 | Users should be able to train state of the art models using only `Keras`, `KerasCV`, and TensorFlow core (i.e. `tf.data`) components. |
34 | 28 |
|
35 | | -Different from Keras IO, this product focus on meta architectures and training scripts to help users reproduce result from open datasets. |
36 | | - |
37 | 29 | To learn more about the future project direction, please check the [roadmap](.github/ROADMAP.md). |
38 | 30 |
|
39 | 31 | ## Quick Links |
|
0 commit comments