Is this the right way to switch the GPU in c++?

[seungtaek94]

Hi, Im trying to switch the GPU.

I wrote the code for switching GPU, but Im not sure this is right way.

Ort::Env env = Ort::Env(OrtLoggingLevel::ORT_LOGGING_LEVEL_WARNING, "Test");
OrtCUDAProviderOptions cudaProviderOptions{0};
Ort::SessionOptions session_options;

session_options.AppendExecutionProvider_CUDA(cudaProviderOptions);
session_options.SetGraphOptimizationLevel(GraphOptimizationLevel::ORT_ENABLE_EXTENDED);
Ort::Session session(env, (void*)modelData, modelSize, session_options);

session.release();
session_options.release();

cudaProviderOptions.device_id = 1;
session_options = Ort::SessionOptions();
session_options.AppendExecutionProvider_CUDA(cudaProviderOptions);
session_options.SetGraphOptimizationLevel(GraphOptimizationLevel::ORT_ENABLE_EXTENDED);
session = Ort::Session(env, (void*)modelData, modelSize, session_options);