make bazel openroad give same results as docker built openroad

[oharboe]

Description

Even with the default design nangate45/gcd there are some differences.

First:

bazelisk test src/drt/...

Then, from ORFS:

 make clean_all

Finally:

make OPENROAD_EXE=../tools/OpenROAD/bazel-out/k8-opt-exec-ST-d57f47055a04/bin/openroad metadata

[INFO] cts__flow__warnings__count:RSZ-0062 pass test: 1 <= 1
[INFO] detailedroute__flow__warnings__count:GRT-0246 pass test: 1 <= 1
[INFO] floorplan__flow__warnings__count:EST-0027 pass test: 1 <= 1
[INFO] floorplan__flow__warnings__count:IFP-0028 pass test: 1 <= 1
[INFO] globalroute__flow__warnings__count:GRT-0246 pass test: 1 <= 1
[INFO] globalroute__flow__warnings__count:RSZ-0062 pass test: 1 <= 1
[INFO] synth__design__instance__area__stdcell pass test: 650.104 <= 725.6
[INFO] constraints__clocks__count pass test: 1 == 1
[INFO] placeopt__design__instance__area pass test: 699.314 <= 743
[INFO] placeopt__design__instance__count__stdcell pass test: 599 <= 677
[INFO] detailedplace__design__violations pass test: 0 == 0
[INFO] cts__design__instance__count__setup_buffer pass test: 35 <= 59
[INFO] cts__design__instance__count__hold_buffer pass test: 0 <= 59
[INFO] cts__timing__setup__ws pass test: -0.0462199 >= -0.0696
[INFO] cts__timing__setup__tns pass test: -0.372671 >= -0.536
[INFO] cts__timing__hold__ws pass test: 0.0551753 >= -0.023
[INFO] cts__timing__hold__tns pass test: 0 >= -0.092
[INFO] globalroute__antenna_diodes_count pass test: 0 <= 100
[INFO] globalroute__timing__setup__ws pass test: -0.0701942 >= -0.0841
[ERROR] globalroute__timing__setup__tns fail test: -1.56171 >= -0.66
[INFO] globalroute__timing__hold__ws pass test: 0.0537275 >= -0.023
[INFO] globalroute__timing__hold__tns pass test: 0 >= -0.092
[ERROR] detailedroute__route__wirelength fail test: 5055 <= 4515
[INFO] detailedroute__route__drc_errors pass test: 0 <= 0
[INFO] detailedroute__antenna__violating__nets pass test: 0 <= 0
[INFO] detailedroute__antenna_diodes_count pass test: 0 <= 100
[INFO] detailedroute__timing__setup__ws pass test: -0.0296703 >= -0.0525
[ERROR] detailedroute__timing__setup__tns fail test: -0.345357 >= -0.322
[INFO] detailedroute__timing__hold__ws pass test: 0.0610778 >= -0.023
[INFO] detailedroute__timing__hold__tns pass test: 0 >= -0.092
[INFO] finish__timing__setup__ws pass test: -0.0624952 >= -0.0769
[ERROR] finish__timing__setup__tns fail test: -1.28204 >= -0.57
[INFO] finish__timing__hold__ws pass test: 0.0544798 >= -0.023
[INFO] finish__timing__hold__tns pass test: 0 >= -0.092
[INFO] finish__design__instance__area pass test: 965.58 <= 980
Metadata check warnings: 0
Failed metadata checks: 4 out of 35
make: *** [/home/oyvind/OpenROAD-flow-scripts/flow/util/utils.mk:23: metadata-check] Error 1

Suggested Solution

make it same

Additional Context

No response

[maliberty]

Probably some compiler nastiness

[oharboe]

Probably some compiler nastiness

Actually, come to think of it:

• build_openroad.sh no longer works on my machine and I'm not investing into fixing it as oss_cad_suite + ORFS docker image has binary releases of yosys
• hence I start with probably not the same version of yosys as ORFS master

The ORFS flow does output hashes of each stage, so it should be possible for someone who is running build_openroad.sh successfully locally to do an A/B comparison of openroad built by build_openroad.sh and by bazel.