Skip to content

Dl/yolo12 main #4

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open

Dl/yolo12 main #4

wants to merge 2 commits into from

Conversation

daniil-lyakhov
Copy link
Owner

@daniil-lyakhov daniil-lyakhov commented Apr 14, 2025 •
edited
Loading

Summary

[PLEASE REMOVE] See CONTRIBUTING.md's Pull Requests for ExecuTorch PR guidelines.

[PLEASE REMOVE] If this PR closes an issue, please add a Fixes #<issue-id> line.

[PLEASE REMOVE] If this PR introduces a fix or feature that should be the upcoming release notes, please add a "Release notes: " label. For a list of available release notes labels, check out CONTRIBUTING.md's Pull Requests.

Test plan

[PLEASE REMOVE] How did you test this PR? Please write down any manual commands you used and note down tests that you have written if applicable.

TODO

  • Add performance counter to the run to compare backends
  • Clear Readme with the clear building procedure
  • Find a way to compile XNNPACK and OpenVINO together without the work arounds
  • Do not build openvino_backend target twice
  • Fix OpenVINOQuantization
  • Report problem with the XNNPACK quantization
  • Expand openvino quantization on other YOLO12 models

@daniil-lyakhov daniil-lyakhov force-pushed the dl/yolo12_main branch 4 times, most recently from cbf970d to 853a16e Compare April 15, 2025 16:03
@daniil-lyakhov daniil-lyakhov force-pushed the dl/yolo12_main branch 2 times, most recently from 794cf64 to 546c939 Compare June 4, 2025 17:43
@daniil-lyakhov daniil-lyakhov had a problem deploying to upload-benchmark-results June 6, 2025 17:43 — with GitHub Actions Error
@daniil-lyakhov daniil-lyakhov had a problem deploying to upload-benchmark-results June 6, 2025 17:43 — with GitHub Actions Error
@daniil-lyakhov daniil-lyakhov had a problem deploying to upload-benchmark-results June 6, 2025 17:43 — with GitHub Actions Error
@daniil-lyakhov daniil-lyakhov had a problem deploying to upload-benchmark-results June 6, 2025 17:43 — with GitHub Actions Error
@daniil-lyakhov daniil-lyakhov had a problem deploying to upload-benchmark-results June 12, 2025 14:18 — with GitHub Actions Error
@daniil-lyakhov daniil-lyakhov had a problem deploying to upload-benchmark-results June 12, 2025 14:18 — with GitHub Actions Error
@daniil-lyakhov daniil-lyakhov had a problem deploying to upload-benchmark-results June 12, 2025 14:18 — with GitHub Actions Error
@daniil-lyakhov daniil-lyakhov had a problem deploying to upload-benchmark-results June 12, 2025 14:18 — with GitHub Actions Error
@daniil-lyakhov daniil-lyakhov had a problem deploying to upload-benchmark-results June 29, 2025 14:20 — with GitHub Actions Error
@daniil-lyakhov daniil-lyakhov had a problem deploying to upload-benchmark-results June 29, 2025 14:20 — with GitHub Actions Error
@daniil-lyakhov daniil-lyakhov had a problem deploying to upload-benchmark-results June 29, 2025 14:20 — with GitHub Actions Error
@daniil-lyakhov daniil-lyakhov had a problem deploying to upload-benchmark-results June 29, 2025 14:20 — with GitHub Actions Error
@daniil-lyakhov daniil-lyakhov had a problem deploying to upload-benchmark-results July 2, 2025 09:30 — with GitHub Actions Error
@daniil-lyakhov daniil-lyakhov had a problem deploying to upload-benchmark-results July 2, 2025 09:30 — with GitHub Actions Error
@daniil-lyakhov daniil-lyakhov had a problem deploying to upload-benchmark-results July 2, 2025 09:30 — with GitHub Actions Error
@daniil-lyakhov daniil-lyakhov had a problem deploying to upload-benchmark-results July 2, 2025 09:30 — with GitHub Actions Error
@daniil-lyakhov daniil-lyakhov force-pushed the dl/yolo12_main branch 3 times, most recently from 818e75a to f7997a6 Compare July 2, 2025 11:32
@daniil-lyakhov
[Example] Yolo12 Detection sample with OpenVINO/XNNPACK backend (pyto…
4926cdc 
…rch#10156)

### Summary
Ultralytics Yolo12 Detection sample to expand example models with the
detection task:

1) Export script to get executorch yolo model lowered to
OpenVINO/XNNPACK
2) Demo app which gets a model and a video as an input and outputs an
annotated video

Changes in the OpenVINO backend:
* OpenVINO repo branch is updated to support yolo12 models (Commit to
Openvino master WIP)
* Minor fixes in quantizer.py

### Test plan

#### Warning:
OpenCV should be installed in the environment.

OpenVINO:
```
./.ci/scripts/test_yolo12.sh  -model yolo12n -mode openvino -pt2e_quantize OFF -upload tmp_ov_run -video_path  path/to/mp4/file
```
XNNPACK:
```
./.ci/scripts/test_yolo12.sh  -model yolo12n -mode xnnpack -pt2e_quantize OFF -upload tmp_xnnpack_run -video_path  path/to/mp4/file
```

### Issues:

* Quantization does not work in both backends, issues WIP. Marked by
NonImplemented error by now
* OpenVINO is being build twice because it is not present in the
[executorch-config.cmake](https://github.com/pytorch/executorch/blob/main/tools/cmake/executorch-config.cmake)
file. Perhaps we could add the OpenVINO backend to the config file?


CC: @ynimmaga @suryasidd @alexsu52
@daniil-lyakhov
[Yolo12] The big gif file is removed
f7997a6
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@daniil-lyakhov