Skip to content
This repository was archived by the owner on Feb 3, 2025. It is now read-only.

Commit 77afa50

Browse files
committed
[Benchmarking CPP] Turn off graph optimizers for CPP benchmark
Signed-off-by: Meenakshi Venkataraman <[email protected]>
1 parent 783c15f commit 77afa50

File tree

1 file changed

+6
-0
lines changed

1 file changed

+6
-0
lines changed

tftrt/benchmarking-cpp/main.cc

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -67,6 +67,12 @@ Status LoadModel(const string& model_dir, const string& signature_key,
6767
std::vector<tensorflow::TensorInfo>* output_info) {
6868
tensorflow::RunOptions run_options;
6969
tensorflow::SessionOptions sess_options;
70+
71+
tensorflow::OptimizerOptions* optimizer_options =
72+
sess_options.config.mutable_graph_options()->mutable_optimizer_options();
73+
optimizer_options->set_opt_level(tensorflow::OptimizerOptions::L0);
74+
optimizer_options->set_global_jit_level(tensorflow::OptimizerOptions::OFF);
75+
7076
sess_options.config.mutable_gpu_options()->force_gpu_compatible();
7177
TF_RETURN_IF_ERROR(tensorflow::LoadSavedModel(sess_options, run_options,
7278
model_dir, {"serve"}, bundle));

0 commit comments

Comments
 (0)