Question about SPEC2006 Evaluation in Bi-Weekly Report Dated 20231127

[Mygithub0N]

[ORIGINAL TITLE] 关于双周报20231127期spec2006测评问题

认真看了双周报，有以下几个问题需要请教一下

1. 测试平台介绍：周报中只提供了core信息以及DRAMsim3, 能否再提供一些详细的关于平台的信息呢，比如哪些是真实的硬件(比如core)，哪些是虚拟硬件(比如DRAMsim3), 希望提供一下SoC level的全部介绍，这个测试平台与真实芯片的差异？
2. 使用Simpoint分析spec2006，后面是如何checkpoint到该平台上运行，是否可以介绍一下？
3. 整个测试是bare-metal还是带有一个mini linux系统？

能否回答一下我这几个疑问， 非常感谢！

[TRANSLATION]
After carefully reviewing the bi-weekly report, I have several questions that I would like to inquire about:

1. Introduction to the Testing Platform: The report only provided information about the core and DRAMsim3. Could you provide more detailed information about the platform? For instance, which components are real hardware (such as the core), and which ones are virtual (like DRAMsim3)? I'd appreciate a comprehensive introduction to the entire SoC level. Additionally, what are the differences between this testing platform and an actual chip?
2. Using Simpoint for SPEC2006 analysis: How was the checkpoint created to run it on this platform? Could you provide some insights into this process?
3. Is the entire testing conducted bare-metal or does it involve a mini Linux system?

I would greatly appreciate it if you could answer these questions. Thank you very much!

[cebarobot]

1. 我们使用 Verilator 对整个处理器核仿真（包括L2、L3 Cache），使用DRAMsim3来模拟内存延迟，没有额外特殊的部分了。
2. 请参考我们此前有关使用 SimPoint 分析 SPEC2006 的报告（视频, 演示文稿）。
3. 是完整的 Linux 。

[TRANSLATION]

1. We use Verilator for simulating the entire processor core, including L2 and L3 cache, while employing DRAMsim3 to simulate memory latency. There are no additional specialized components.
2. Please refer to our previous reports (videos, slides) on using SimPoint to analyze SPEC2006.
3. This is a complete Linux setup.

[Mygithub0N]

hi， 如果我想复现一遍，是全部都在虚拟模型上进行吗？能否给一些详细的步骤或资料，谢谢！

…

-----原始邮件----- 发件人:ceba ***@***.***> 发送时间:2023-11-28 11:04:25 (星期二) 收件人: OpenXiangShan/XiangShan ***@***.***> 抄送: Junior ***@***.***>, Author ***@***.***> 主题: Re: [OpenXiangShan/XiangShan] Question about SPEC2006 Evaluation in Bi-Weekly Report Dated 20231127 (Discussion #2511) 我们使用 Verilator 对整个处理器核仿真（包括L2、L3 Cache），使用DRAMsim3来模拟内存延迟，没有额外特殊的部分了。 请参考我们此前有关使用 SimPoint 分析 SPEC2006 的报告（视频, 演示文稿）。 是完整的 Linux 。 — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: ***@***.***>

[cebarobot]

我们目前没有复现 SPEC CPU 2006 分数的详细步骤，您可以参考香山官方文档做尝试。
We have not documented the detail of how to reproduce SPEC CPU 2006. Please refer to XiangShan Document.

[Mygithub0N]

hi, 我有关注你们发双周报，会报告spec2006在模型上做simpoint仿真结果，因此，也想试试这个流程！香山性能模型我能拿到吗？ 多谢！

…

-----原始邮件----- 发件人:ceba ***@***.***> 发送时间:2024-02-01 21:42:14 (星期四) 收件人: OpenXiangShan/XiangShan ***@***.***> 抄送: Junior ***@***.***>, Author ***@***.***> 主题: Re: [OpenXiangShan/XiangShan] Question about SPEC2006 Evaluation in Bi-Weekly Report Dated 20231127 (Discussion #2511) 我们目前没有复现 SPEC CPU 2006 分数的详细步骤，您可以参考香山官方文档做尝试。 We have not documented the detail of how to reproduce SPEC CPU 2006. Please refer to XiangShan Document. — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: ***@***.***>

[cebarobot]

双周报展示的性能结果，是香山处理器在仿真环境下通过 simpoint 技术评估的性能结果，是直接对香山 RTL 仿真得到的，并非单独的软件（如 C++）性能模型。您直接根据文档对香山 RTL 源码进行仿真即可。

The performance results presented in the bi-weekly report are evaluations of the Xiangshan processor conducted in a simulation environment using the Simpoint technology. These results are directly derived from simulating the Xiangshan RTL codes and are not based on separate software (such as C++) performance models. You can simulate the Xiangshan RTL source code directly according to the documentation.

[Mygithub0N]

Hi Expert, 关于Simpoint方法，还有一些疑问，整个流程其实了NEMU和RTL仿真，其实benchmark profiling/checkpoint都在NEMU上进行的，我有注意到xiangshang最新架构支持的指令集如下： i, m, a, f, d, c, b, v, h, sdtrig, sha, shcounterenw, shgatpa, shlcofideleg, shtvala, shvsatpa, shvstvala, shvstvecd, smaia, smcsrind, smdbltrp, smmpm, smnpm, smrnmi, smstateen, ss1p13, ssaia, ssccptr, sscofpmf, sscounterenw, sscsrind, ssdbltrp, ssnpm, sspm, ssstateen, ssstrict, sstc, sstvala, sstvecd, ssu64xl, supm, sv39, sv48, svade, svbare, svinval, svnapot, svpbmt, za64rs, zacas, zawrs, zba, zbb, zbc, zbkb, zbkc, zbkx, zbs, zcb, zcmop, zfa, zfh, zfhmin, zic64b, zicbom, zicbop, zicboz, ziccamoa, ziccif, zicclsm, ziccrse, zicntr, zicond, zicsr, zifencei, zihintntl, zihintpause, zihpm, zimop, zkn, zknd, zkne, zknh, zksed, zksh, zkt, zvbb, zvfh, zvfhmin, zvkt, zvl128b, zvl32b, zvl64b 参考：指令集 - 香山开源处理器用户手册，已经全面支持RVA23, 我的问题是，NEMU是否也是全面支持了RVA23,从网上并没有得到相关的信息，想确认一下，谢谢！ BR Junior

…

-----原始邮件----- 发件人:田进军 ***@***.***> 发送时间:2024-02-01 21:13:26 (星期四) 收件人: OpenXiangShan/XiangShan ***@***.***> 抄送: OpenXiangShan/XiangShan ***@***.***>, Author ***@***.***> 主题: Re: Re: [OpenXiangShan/XiangShan] Question about SPEC2006 Evaluation in Bi-Weekly Report Dated 20231127 (Discussion #2511) hi， 如果我想复现一遍，是全部都在虚拟模型上进行吗？能否给一些详细的步骤或资料，谢谢！

-----原始邮件----- 发件人:ceba ***@***.***> 发送时间:2023-11-28 11:04:25 (星期二) 收件人: OpenXiangShan/XiangShan ***@***.***> 抄送: Junior ***@***.***>, Author ***@***.***> 主题: Re: [OpenXiangShan/XiangShan] Question about SPEC2006 Evaluation in Bi-Weekly Report Dated 20231127 (Discussion #2511) 我们使用 Verilator 对整个处理器核仿真（包括L2、L3 Cache），使用DRAMsim3来模拟内存延迟，没有额外特殊的部分了。 请参考我们此前有关使用 SimPoint 分析 SPEC2006 的报告（视频, 演示文稿）。 是完整的 Linux 。 — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: ***@***.***>

[cebarobot]

是的，作为与香山功能对齐的指令集模拟器，NEMU 支持的指令集与香山相同，也全面支持 RVA23。
Yes, as a emulator which aligns with XiangShan in features, NEMU supports the same ISA as XiangShan, which means it fully supports RVA23.