Skip to content

Conversation

@mayavijx
Copy link

  • Added CPP sample for IO Buffer Optimization Feature and updated the documentation for the same.
  • Updated csharp sample script to use OS specific font family.
  • Updated readme for csharp sample
  • Replaced the label file for Windows squeezenet cpp sample with the link to same file in Linux folder


/*If you want to create CPU Folders
Ort::MemoryInfo memoryInfo = Ort::MemoryInfo::CreateCpu(

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@sfatimar @mayavijx Is this change required, which is commented out here.
so, the code in the comment indicates, if they want to use this feature for CPU?

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You can keep CPU Folders and it will work. What will not work is Remote Buffers with Raw Device Pointers and Running without IOBuffering. We do not have support to copy From Remote Buffers to CPU

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated the script by removing the commented section.

```
./run_squeezenet --use_cpu <path_to_onnx_model> <path_to_sample_image> <path_to_labels_file>
```
- To Run the sample for IO Buffer Optimization feature

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@mayavijx this sample using IO Buffer will only work with OpenVINO and not MLAS. so thats why we are not passing any flags like --use_openvino or --use_cpu to run this sample. is my understanding correct and the sample directly runs on openvino.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes Maajid

@MaajidKhan MaajidKhan force-pushed the uep_v3.4.1_updates branch 2 times, most recently from 595647a to 1b8c1f9 Compare December 9, 2021 03:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants