Skip to content

Commit 3d32fd3

Browse files
authored
Merge pull request #48 from osg-htc/fix/install-perfsonar-fences
fix(docs): repair fences & admonition lists in install-perfsonar-testpoint.md (includes automated lint fixes)
2 parents 6eb87da + 89be394 commit 3d32fd3

File tree

51 files changed

+21055
-115
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

51 files changed

+21055
-115
lines changed

docs/network-troubleshooting/osg-debugging-document.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@
99
```text
1010
This document is old but still may have useful information. Many tools it references may no longer be supported or available.
1111
12-
```
12+
```
1313

1414
# Abstract
1515

docs/perfsonar/CONTAINER_RESTART_ISSUE.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -60,7 +60,7 @@ If you have an existing deployment with the restart loop issue:
6060
cd /opt/perfsonar-tp
6161
podman-compose down
6262

63-
```
63+
```
6464

6565
1. Update the docker-compose.yml file to use the recommended configuration from:
6666

@@ -70,14 +70,14 @@ If you have an existing deployment with the restart loop issue:
7070

7171
-o /opt/perfsonar-tp/docker-compose.yml
7272

73-
```
73+
```
7474

7575
1. Restart the service:
7676

7777
```bash
7878
systemctl restart perfsonar-testpoint
7979

80-
```
80+
```
8181

8282
## Verification
8383

docs/perfsonar/FIX_SUMMARY.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -168,13 +168,13 @@ To apply these fixes to other perfSONAR testpoint deployments:
168168
-o /tmp/install-systemd-service.sh
169169
sudo bash /tmp/install-systemd-service.sh /opt/perfsonar-tp
170170

171-
```
171+
```
172172

173173
1. **Automated deployment with Ansible**:
174174

175175
```bash
176176
ansible-playbook -i inventory ansible/playbooks/deploy-testpoint-container.yml
177-
```
177+
```
178178

179179
1. **Fix existing deployments with restart issues**:
180180

docs/perfsonar/deployment-models.md

Lines changed: 8 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ each focused on specific set of tests. The following deployment options are curr
1010

1111
* **Bare metal** - preffered option in one of two possible configurations:
1212

13-
```text
13+
```text
1414
1515
* Two bare metal servers, one for latency node, one for bandwidth node
1616
@@ -20,21 +20,22 @@ each focused on specific set of tests. The following deployment options are curr
2020

2121
* **Virtual Machine** - if bare metal is not available then it is also possible to run perfSONAR on a VM, however there are a set of additional requirements to fulfill:
2222

23-
```text
23+
```text
24+
2425
* Full-node VM is strongly preferred, having 2 VMs (latency/bandwidth node) on a single bare metal. Mixing perfSONAR VM(s) with others might have an impact on the measurements and is therefore not recommended.
2526
* VM needs to be configured to have SR-IOV to NIC(s) as well as pinned CPUs to ensure bandwidth tests are not impacted (by hypervisor switching CPUs during the test)
2627
* Succesfull full speed local bandwidth test is highly recommended prior to putting the VM into production
2728
```
2829

2930
* **Container** - perfSONAR has supported containers from version 4.1 (Q1 2018) and is documented at <https://docs.perfsonar.net/install_docker.html> but is not typically used in the same way as a full toolkit installation.
3031

31-
```text
32+
```text
3233
3334
* Docker perfSONAR test instance can however still be used by sites that run multiple perfSONAR instances on site for their internal testing as this deployment model allows to flexibly deploy a testpoint which can send results to a local measurement archive running on the perfSONAR toolkit node.
3435
3536
```
3637

37-
### perfSONAR Toolkit vs Testpoint
38+
## perfSONAR Toolkit vs Testpoint
3839

3940
The perfSONAR team has documented the types of installations supported at
4041
<https://docs.perfsonar.net/install_options.html>. With the release of version 5, OSG/WLCG sites have a new option:
@@ -45,7 +46,7 @@ instead of installing the full Toolkit sites can choose to install the Testpoint
4546
```text
4647
* Simpler deployment when a local web interface is not needed and a central measurement archive is available.
4748
* Less resource intensive for both memory and I/O capacity.
48-
```
49+
```
4950

5051
* Cons
5152

@@ -54,7 +55,7 @@ instead of installing the full Toolkit sites can choose to install the Testpoint
5455
* No web interface to use for configuration or adding local tests
5556
* Unable to show results in MaDDash
5657

57-
```
58+
```
5859

5960
While sites are free to choose whatever deployment method they want, we would like to strongly recommend the use of
6061
perfSONAR's containerized testpoint. This method was chosen as a "best practice" recommendation because of the reduced
@@ -83,7 +84,7 @@ taking into account the amount of testing that we perform, we recommend at least
8384

8485
* NVMe or SSD disk (128GB should be sufficient) if using full Toolkit install with Opensearch.
8586

86-
<a id="multiple-nic-network-interface-card-guidance"></a>
87+
<!-- anchor removed; heading provides an automatic id -->
8788

8889
### Multiple NIC (Network Interface Card) Guidance
8990

docs/perfsonar/install-testpoint.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -130,15 +130,15 @@ Recommended: use the helper script to generate and apply NetworkManager profiles
130130
```bash
131131
/opt/perfsonar-tp/tools_scripts/perfSONAR-pbr-nm.sh --generate-config-debug
132132

133-
```
133+
```
134134

135135
1. Generate the config file automatically:
136136

137137
```bash
138138
139139
/opt/perfsonar-tp/tools_scripts/perfSONAR-pbr-nm.sh --generate-config-auto
140140
141-
```
141+
```
142142

143143
Note: The auto-generator intentionally skips NICs that have neither an IPv4 nor an IPv6 gateway (e.g., management-only
144144
NICs) to avoid writing non-functional NetworkManager profiles. To include such a NIC in the configuration, set an
@@ -151,14 +151,14 @@ Review and adjust /etc/perfSONAR-multi-nic-config.conf if needed.
151151
```bash
152152
/opt/perfsonar-tp/tools_scripts/perfSONAR-pbr-nm.sh --dry-run --debug
153153
154-
```
154+
```
155155

156156
1. Apply changes:
157157

158158
```bash
159159
/opt/perfsonar-tp/tools_scripts/perfSONAR-pbr-nm.sh --yes
160160
161-
```
161+
```
162162

163163
The script backs up current NetworkManager profiles and logs actions to /var/log/perfSONAR-multi-nic-config.log.
164164

@@ -276,7 +276,7 @@ If you want the container to use a specific NIC, adjust the docker-compose.syste
276276
277277
Check containers:
278278
279-
```
279+
```
280280
281281
podman ps
282282

docs/perfsonar/installation.md

Lines changed: 23 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -48,10 +48,13 @@ You can see more details about EL supported installs at <<https://docs.perfsonar
4848

4949
!!! note
5050

51-
```text
51+
<!-- markdownlint-disable MD040 -->
52+
<!-- markdownlint-disable MD040 -->
53+
```text
5254
In all cases, we strongly recommend keeping auto-updates enabled. With yum auto-updates there is a possibility that updated packages can "break" your perfSONAR install but this risk is accepted in order to have security updates quickly applied.
5355

54-
```
56+
```
57+
<!-- markdownlint-enable MD040 -->
5558

5659
The following *additional* steps are needed to configure the toolkit to be used in OSG/WLCG in addition to the steps
5760
described in the official guide:
@@ -62,7 +65,8 @@ described in the official guide:
6265

6366
* You will need to configure your instance(s) to use the OSG/WLCG mesh-configuration. Please follow the steps below:
6467

65-
```text
68+
```text
69+
6670
* For toolkit versions 5.0 and higher run: `psconfig remote add https://psconfig.opensciencegrid.org/pub/auto/<FQDN>` replacing `<FQDN>` with your host (e.g. `psum01.aglt2.org`). Verify with `psconfig remote list`.
6771
```
6872

@@ -74,15 +78,21 @@ described in the official guide:
7478
"configure-archives" : true
7579
}
7680
]
77-
```
81+
```
7882

7983
* Please remove any old/stale URLs using `psconfig remote delete <URL>`
8084

81-
* If this is a **new instance** or you have changed the node's FQDN, you will need to notify `wlcg-perfsonar-support 'at' cern.ch` to add/update the hostname in one or more test meshes, which will then auto-configure the tests. Please indicate if you have preferences for which meshes your node should be included in (USATLAS, USCMS, ATLAS, CMS, LHCb, Alice, BelleII, etc.). You could also add any additional local tests via web interface (see [Configuring regular tests](http://docs.perfsonar.net/manage_regular_tests.html) for details). Please check which tests are auto-added via central meshes before adding any custom tests to avoid duplication.
85+
* If this is a **new instance** or you have changed the node's FQDN, you will need to notify
86+
`wlcg-perfsonar-support 'at' cern.ch` to add/update the hostname in one or more test meshes, which
87+
will then auto-configure the tests. Please indicate if you have preferences for which meshes your
88+
node should be included in (USATLAS, USCMS, ATLAS, CMS, LHCb, Alice, BelleII, etc.). You could also
89+
add any additional local tests via web interface (see [Configuring regular tests](http://docs.perfsonar.net/manage_regular_tests.html) for details).
90+
Please check which tests are auto-added via central meshes before adding any custom tests to avoid
91+
duplication.
8292

8393
!!! note
8494

85-
```text
95+
```text
8696
Until your host is added on https://psconfig.opensciencegrid.org to one or more meshes by an administrator the automesh configuration above will not return any tests.
8797
8898
```
@@ -127,7 +137,7 @@ site or host firewalls. An overview of perfSONAR security is available at
127137
```text
128138
All perfSONAR instances must have port 443 accessible to other perfSONAR instances. Port 443 is used by pScheduler to schedule tests. If unreachable, tests may not run and results may be missing.
129139

130-
```
140+
```
131141

132142
For sites that are concerned about having port 443 open, there is a possiblity to get a list of hosts to/from which the
133143
tests will be initiated. However as this list is dynamic, implementing the corresponding firewall rules would need to be
@@ -140,7 +150,8 @@ network administrators to debug network issues.
140150
```text
141151
If you have a central/campus firewall verify required port openings in the perfSONAR security documentation.
142152

143-
```
153+
```
154+
<!-- markdownlint-enable MD040 -->
144155

145156
## Enabling SNMP plugins
146157

@@ -167,6 +178,7 @@ filling the information please follow those simple guidelines:
167178

168179
* For each form (service type) fill at least:
169180

181+
<!-- markdownlint-disable MD040 -->
170182
```text
171183
172184
* Hosting Site
@@ -175,7 +187,8 @@ filling the information please follow those simple guidelines:
175187
* Host IP (optional)
176188
* Description (optional label used in MaDDash; keep short and unique)
177189
178-
```
190+
```
191+
<!-- markdownlint-enable MD040 -->
179192
180193
* Check "N" when asked "Is it a beta service"
181194
@@ -186,8 +199,7 @@ filling the information please follow those simple guidelines:
186199
<!-- -->
187200
188201
* GOCDB screen shot for creating a Service Endpoint:
189-
<img src="../../img/Screen_shot_2013-02-19_at_15.26.52.png" alt="GOCDB screen shot for creating a Service Endpoint"
190-
width="1024">
202+
![GOCDB screen shot for creating a Service Endpoint](../../img/Screen_shot_2013-02-19_at_15.26.52.png)
191203
192204
## Register perfSONAR in OSG Topology
193205

docs/perfsonar/packet-pacing.md

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -419,11 +419,11 @@ setsockopt(sockfd, SOL_SOCKET, SO_MAX_PACING_RATE,
419419
420420
### ESnet Fasterdata Documentation
421421
422-
- **DTN Tuning Guide**: https://fasterdata.es.net/DTN/tuning/
422+
- **DTN Tuning Guide**: <https://fasterdata.es.net/DTN/tuning/>
423423
424-
- **Packet Pacing Guide**: https://fasterdata.es.net/host-tuning/linux/packet-pacing/
424+
- **Packet Pacing Guide**: <https://fasterdata.es.net/host-tuning/linux/packet-pacing/>
425425
426-
- **FQ Pacing Research Results**: https://fasterdata.es.net/assets/fasterdata/FQ-pacing-results.pdf
426+
- **FQ Pacing Research Results**: <https://fasterdata.es.net/assets/fasterdata/FQ-pacing-results.pdf>
427427
428428
### Linux Kernel Documentation
429429
@@ -433,23 +433,23 @@ setsockopt(sockfd, SOL_SOCKET, SO_MAX_PACING_RATE,
433433
434434
- **tc man page**: `man 8 tc`
435435
436-
- **LWN Article on FQ**: https://lwn.net/Articles/564978/
436+
- **LWN Article on FQ**: <https://lwn.net/Articles/564978/>
437437
438438
### Tools and Testing
439439
440-
- **iperf3**: https://iperf.fr/ (with `--fq-rate` support)
440+
- **iperf3**: <https://iperf.fr/> (with `--fq-rate` support)
441441
442-
- **perfSONAR**: https://www.perfsonar.net/ (pscheduler with pacing)
442+
- **perfSONAR**: <https://www.perfsonar.net/> (pscheduler with pacing)
443443
444444
- **mtr** (traceroute tool): `mtr <destination>`
445445
446446
### Related Tuning
447447
448448
- **SYSCTL Tuning**: See `fasterdata-tuning.sh` for buffer sizing recommendations
449449
450-
- **100G+ Tuning**: https://fasterdata.es.net/host-tuning/linux/100g-tuning/
450+
- **100G+ Tuning**: <https://fasterdata.es.net/host-tuning/linux/100g-tuning/>
451451
452-
- **BBR Congestion Control**: https://fasterdata.es.net/host-tuning/linux/recent-tcp-enhancements/bbr-tcp/
452+
- **BBR Congestion Control**: <https://fasterdata.es.net/host-tuning/linux/recent-tcp-enhancements/bbr-tcp/>
453453
454454
---
455455

docs/perfsonar/register-ps-in-gocdb.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,7 @@ both service types (use the same hostname in the "host name" field).
1818

1919
- For each form (i.e. for each service type) fill at least the important informations:
2020

21-
```text
21+
```text
2222
2323
- Hosting Site (drop-down menu, mandatory)
2424
- Service Type (drop-down menu, mandatory)

docs/perfsonar/tools_scripts/README.md

Lines changed: 8 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -63,7 +63,7 @@ After installation:
6363
/opt/perfsonar-tp/tools_scripts/install-systemd-service.sh /opt/perfsonar-tp
6464
systemctl enable --now perfsonar-testpoint.service
6565

66-
```
66+
```
6767

6868
- Manual installs: After `podman-compose up -d`, install and enable the service as shown above.
6969

@@ -138,7 +138,7 @@ sha256sum -c /tmp/fasterdata-tuning.sh.sha256 --status && echo "OK" || echo "Che
138138

139139
- `--dry-run`: Preview the changes that would be made (GRUB edits and sysfs writes) without applying them. Use for validation and audits.
140140

141-
## Usage examples
141+
## Usage examples (fasterdata tuning)
142142

143143
Audit (default) a measurement host:
144144

@@ -277,7 +277,11 @@ bash perfSONAR-pbr-nm.sh --yes
277277

278278
## Gateway requirement, inference, and generator warnings
279279

280-
- Any NIC with an IPv4 address should have a corresponding IPv4 gateway; likewise for IPv6. If a NIC lacks a gateway, the generator will attempt conservative inference (below). If a device has no IPv4 or IPv6 gateway (e.g., a management-only NIC), the generator will intentionally skip that NIC when creating an _auto-generated_ config to avoid generating unusable NetworkManager profiles unless you explicitly set the device as `DEFAULT_ROUTE_NIC`.
280+
- Any NIC with an IPv4 address should have a corresponding IPv4 gateway; likewise for IPv6. If a NIC lacks a
281+
gateway, the generator will attempt conservative inference (below). If a device has no IPv4 or IPv6 gateway
282+
(e.g., a management-only NIC), the generator will intentionally skip that NIC when creating an
283+
_auto-generated_ config to avoid generating unusable NetworkManager profiles unless you explicitly set the
284+
device as `DEFAULT_ROUTE_NIC`.
281285

282286
- Conservative gateway inference: if a NIC has an address/prefix but no gateway, the tool will try to reuse a gateway from another NIC on the SAME subnet.
283287

@@ -351,7 +355,7 @@ cd docs/perfsonar
351355
./tests/run_tests.sh
352356
```
353357

354-
## Notes
358+
## Notes (script details)
355359

356360
- The script requires Bash (uses `local -n` namerefs). Run tests on a system
357361
with Bash 4.3+.

0 commit comments

Comments
 (0)