ci: add fio-tests workflow integration

Integrate fio-tests into the modular GitHub Actions CI infrastructure.
The kdevops CI system uses a reusable action-based architecture that
makes adding new workflows straightforward through a simple three-step
process.

The modular CI architecture separates concerns into discrete actions
located in the .github/actions directory. The configure action handles
defconfig selection and kdevops setup. The bringup action provisions
VMs using the configured parameters. The build-test action installs
workflow-specific test infrastructure. The test action executes tests
and collects results. The archive action stores results for analysis.
Finally the cleanup action destroys VMs and cleans up resources.

Workflow-specific behavior is controlled through simple mapping files
in the .ci directory. Each workflow needs two files. The build-test
file specifies the make target for installing test infrastructure. The
test file specifies the make target for establishing baselines or
running tests. These mapping files are looked up by workflow name at
runtime.

For fio-tests the build-test mapping executes make fio-tests to install
fio and generate test job files. The test mapping executes make
fio-tests-baseline to run tests and establish performance baselines.

The test action automatically selects appropriate quick tests for
kdevops-ci validation mode based on workflow type. For fio-tests it
runs a single randread test providing rapid validation in under one
minute. For fstests workflows it runs generic/003. For blktests it runs
block/003. For selftests it runs kmod/test_001. In linux-ci mode the
TESTS variable remains unset allowing full test suite execution.

Result collection is workflow-specific with dedicated logic in the test
action. The fio-tests implementation parses JSON output files to extract
IOPS and bandwidth metrics. This enables performance regression
detection across kernel versions. The system reports sample results
including job names and read/write performance statistics.

Four fio-tests configurations are now available in the CI workflow
selection menu. The fio-tests-quick option provides minimal validation
for rapid iteration. The fio-tests-fs-xfs option tests XFS with 16K
block sizes and modern features. The fio-tests-fs-ext4-bigalloc option
tests ext4 with bigalloc and 32K clusters. The fio-tests-fs-btrfs-zstd
option tests btrfs with zstd compression.

Adding additional fio-tests configurations requires only adding a
defconfig file in the defconfigs directory and adding the workflow name
to the ci_workflow choice list in kdevops.yml. The existing CI
infrastructure automatically handles the rest through the modular action
architecture.

This demonstrates the power of the modular CI design where workflows
share common infrastructure for provisioning, build, test, and cleanup
while maintaining workflow-specific customization through simple mapping
files and conditional logic in the test action.

Generated-by: Claude AI
Signed-off-by: Luis Chamberlain <[email protected]>

Author: mcgrof

.ci/build-test/fio-tests

@@ -0,0 +1 @@
+make fio-tests

.ci/test/fio-tests

@@ -0,0 +1 @@
+make fio-tests-baseline

.github/actions/test/action.yml

@@ -47,6 +47,9 @@ runs:
             selftests*|*modules*|*kmod*|*firmware*|*mm*)
               TESTS="kmod/test_001"
               ;;
+            *fio-tests*)
+              TESTS="randread"
+              ;;
             *)
               TESTS="generic/003"
               ;;
@@ -74,6 +77,7 @@ runs:
           *ext4*) wpath="workflows/fstests" ;;
           tmpfs*) wpath="workflows/fstests" ;;
           *xfs*) wpath="workflows/fstests" ;;
+          *fio-tests*) wpath="workflows/fio-tests" ;;
           *) wpath="workflows/selftests" ;;
         esac
 
@@ -88,6 +92,39 @@ runs:
 
         # Workflow-specific result collection
         case "${{ inputs.ci_workflow }}" in
+          *fio-tests*)
+            # fio-tests workflows: Collect JSON results
+            echo "Collecting fio-tests results..." > ci.commit_extra
+
+            if [ -d "$wpath/results/last-run" ]; then
+              echo -e "\nfio-tests summary:" >> ci.commit_extra
+
+              # Count JSON result files
+              json_count=$(find "$wpath/results/last-run" -name "*.json" -type f | wc -l)
+              echo "Found $json_count fio result files" >> ci.commit_extra
+
+              # Extract basic metrics from first JSON file as sample
+              sample_json=$(find "$wpath/results/last-run" -name "*.json" -type f | head -1)
+              if [ -n "$sample_json" ] && [ -f "$sample_json" ]; then
+                echo -e "\nSample result:" >> ci.commit_extra
+                # Extract job name and basic IOPS/BW stats
+                python3 -c "import json; import sys; data=json.load(open('$sample_json')); print(f\"Job: {data['jobs'][0]['jobname']}\"); print(f\"IOPS: {data['jobs'][0]['read']['iops']:.2f} read, {data['jobs'][0]['write']['iops']:.2f} write\"); print(f\"BW: {data['jobs'][0]['read']['bw']:.2f} KB/s read, {data['jobs'][0]['write']['bw']:.2f} KB/s write\")" >> ci.commit_extra 2>/dev/null || echo "Could not parse JSON" >> ci.commit_extra
+              fi
+
+              # Success if we have at least one JSON result file
+              if [ $json_count -gt 0 ]; then
+                echo "ok" > ci.result
+              else
+                echo "no results found" > ci.result
+                echo "::warning::No fio-tests JSON results found"
+                exit 1
+              fi
+            else
+              echo "no results found" > ci.result
+              echo "::warning::No fio-tests results directory found"
+              exit 1
+            fi
+            ;;
           *xfs*|*btrfs*|*ext4*|tmpfs*|*fstests*)
             # fstests workflows: Use xunit_results.txt for rich summary
             echo "Collecting fstests results..."

.github/workflows/kdevops.yml

@@ -30,6 +30,10 @@ on:
           - blktests_scsi
           - blktests_srp
           - blktests_zbd
+          - fio-tests-quick
+          - fio-tests-fs-xfs
+          - fio-tests-fs-ext4-bigalloc
+          - fio-tests-fs-btrfs-zstd
           - lbs-xfs
           - lbs-xfs-bdev-large-nvme
           - lbs-xfs-bdev-nvme

playbooks/roles/fio-tests/tasks/main.yaml

@@ -44,6 +44,7 @@
         'btrfs-zstd' if 'btrfs-zstd' in inventory_hostname else
         'xfs-4k'
       }}
+  when: fio_tests_requires_filesystem | default(false) | bool
 
 - name: Set filesystem-specific mkfs and mount options
   tags: [ 'setup' ]
@@ -67,6 +68,7 @@
     fio_tests_fs_device: "{{ fio_tests_fs_device | default('/dev/disk/by-id/virtio-kdevops2') }}"
     fio_tests_fs_mount_point: "{{ fio_tests_fs_mount_point | default('/mnt/fio-tests') }}"
     fio_tests_fs_label: "{{ fio_tests_fs_label | default('fio-tests') }}"
+  when: fio_tests_requires_filesystem | default(false) | bool
 
 - name: Set derived configuration variables
   tags: [ 'setup' ]
@@ -124,15 +126,15 @@
   register: mountpoint_stat
   failed_when: false
   changed_when: false
-  when: fio_tests_requires_mkfs_device | bool
+  when: fio_tests_requires_mkfs_device | default(false) | bool
 
 - name: Unmount {{ fio_tests_fs_device }} if mounted
   tags: [ 'setup', 'run_tests' ]
   become: yes
   become_method: sudo
   command: umount {{ fio_tests_fs_device }}
   when:
-    - fio_tests_requires_mkfs_device | bool
+    - fio_tests_requires_mkfs_device | default(false) | bool
     - mountpoint_stat.stdout != ""
 
 - name: Create filesystem on {{ fio_tests_fs_device }}
@@ -144,7 +146,7 @@
     {{ fio_tests_mkfs_cmd }}
     -L {{ fio_tests_fs_label }}
     {{ fio_tests_fs_device }}
-  when: fio_tests_requires_mkfs_device | bool
+  when: fio_tests_requires_mkfs_device | default(false) | bool
 
 - name: Create mount point directory
   tags: [ 'setup' ]
@@ -154,7 +156,7 @@
     path: "{{ fio_tests_fs_mount_point }}"
     state: directory
     mode: '0755'
-  when: fio_tests_requires_mkfs_device | bool
+  when: fio_tests_requires_mkfs_device | default(false) | bool
 
 - name: Mount filesystem
   tags: [ 'setup' ]
@@ -166,7 +168,7 @@
     fstype: "{{ fio_tests_mkfs_type }}"
     opts: "{{ fio_tests_mount_opts }}"
     state: mounted
-  when: fio_tests_requires_mkfs_device | bool
+  when: fio_tests_requires_mkfs_device | default(false) | bool
 
 - name: Set filesystem mount ownership
   tags: [ 'setup' ]
@@ -177,7 +179,7 @@
     owner: "{{ data_user }}"
     group: "{{ data_group }}"
     mode: '0755'
-  when: fio_tests_requires_mkfs_device | bool
+  when: fio_tests_requires_mkfs_device | default(false) | bool
 
 - name: Create results directory
   tags: [ 'setup' ]
@@ -233,8 +235,8 @@
     block_size: "{{ item.1 }}"
     io_depth: "{{ item.2 }}"
     num_jobs: "{{ item.3 }}"
-    test_directory: "{{ fio_tests_fs_mount_point if fio_tests_requires_mkfs_device else '' }}"
-    test_device: "{{ fio_tests_device if not fio_tests_requires_mkfs_device else '' }}"
+    test_directory: "{{ fio_tests_fs_mount_point if fio_tests_requires_mkfs_device | default(false) else '' }}"
+    test_device: "{{ fio_tests_device if not (fio_tests_requires_mkfs_device | default(false)) else '' }}"
   with_nested:
     - "{{ fio_tests_patterns }}"
     - "{{ fio_tests_effective_block_sizes }}"
@@ -413,5 +415,5 @@
   mount:
     path: "{{ fio_tests_fs_mount_point }}"
     state: unmounted
-  when: fio_tests_requires_mkfs_device | bool
+  when: fio_tests_requires_mkfs_device | default(false) | bool
   ignore_errors: yes