Implement hierarchical console output with comprehensive test result display #1290

tienquocbui · 2025-08-27T17:25:26Z

Implement hierarchical console output with comprehensive test result display

Modifications:

Implemented a tree structure using Unicode box-drawing characters (┌─, ├─, ╰─, │) that properly displays the relationship between modules, test suites, and individual tests with ASCII fallback
Test Result Summary:
- Right-aligned duration formatting in consistent x.xxs format
- Updated summary format: "X tests completed in Y.ZZs (pass: A, fail: B, skip: C)"
- Concise failure summaries in hierarchy for quick scanning
Detailed Failure Section:
- Complete hierarchical path display for failed tests
- Comprehensive failure analysis with test count: "FAILED TEST DETAILS (3)"
- Detailed expectation failure messages with actual vs expected values
- Source location information with file and line numbers
- Progress tracking with error counters [1/3], [2/3], [3/3]
- Support for multiple expectations per test with individual analysis
Unit Tests: Added automated tests following established patterns to validate output formatting, hierarchy generation, and failure handling

Checklist:

Code and documentation should follow the style of the Style Guide.
If public symbols are renamed or modified, DocC references should be updated.

…ting - Implement Event.AdvancedConsoleOutputRecorder with beautiful tree structure - Add SF symbols support with colors (play.circle, checkmark.circle, x.circle, etc.) - Right-aligned timing display with 80-column fixed width - Unicode box-drawing characters for hierarchical test output - Issues displayed as sub-nodes under failed tests - Enhanced start message with test count and running status - Thread-safe parallel execution support - Color-coded final summary with status icons - Replace basic ConsoleOutputRecorder with enhanced version - Add demo test files for validation Features: ✅ Hierarchical tree structure with proper indentation ✅ SF Symbols on macOS with Unicode fallback ✅ Right-aligned timing information ✅ Color-coded status icons and output ✅ Issues as expandable sub-nodes ✅ Enhanced start/end messages ✅ Thread-safe concurrent test execution

…al tree display

…corder

Implementing progress bar with live update

- Add experimental AdvancedConsoleOutputRecorder activated via environment variable - Implement clean skeleton structure for incremental PR development - Fix terminal width hardcoding with 80-char safe fallback - Follow HumanReadableOutputRecorder delegation pattern - Update style guide compliance (80-char comment wrapping) - Re-enable AttachmentTests and disable slow demo test suites - Remove Foundation dependencies and signal handling - Prepare foundation for PR #1 (Skeleton), PR #2 (Hierarchy), PR #3 (Progress)

- Update to latest main branch from upstream/main - Integrate new ABI version handling and entry point improvements - Preserve AdvancedConsoleOutputRecorder skeleton implementation - Ready for first PR submission

Complete skeleton PR #1 preparation: - Clean AdvancedConsoleOutputRecorder framework - Environment variable activation integrated - Latest upstream changes merged - Ready for first PR submission

- Use upstream conditional compilation directives - Match upstream verbosity check (> .min instead of >= 0) - Simplify AdvancedConsoleOutputRecorder options for skeleton - Fix event handler ordering to match upstream pattern - Maintain zero impact on default behavior

The Environment.flag(named:) function returns Bool? but was being used directly in an if statement. Changed to explicit comparison with true to handle the optional properly.

- Change handle() to record() for consistency with other recorders - Update documentation to use proper DocC reference (Event/ConsoleOutputRecorder) - Remove unused configuration options (useHierarchicalOutput, showSuccessfulTests) - Simplify LiveUpdatingLine documentation - Remove future capability descriptions from main documentation

Since we cannot control the output stream, the LiveUpdatingLine functionality is not usable in practice and should be removed from the skeleton implementation.

- Convert from Event to ABI.EncodedEvent for internal processing - Add test storage dictionary keyed by test ID string - Handle test discovery events to populate test storage - Add ABI event processing placeholder for future enhancements - Add missing SendableMetatype protocol definition This refactor follows Stuart's guidance to prepare for future harness process separation by using ABI data types throughout.

- Remove SendableMetatype protocol (not needed, provided by Swift stdlib) - Use ABI.HighestVersion instead of CurrentVersion for forward compatibility - Remove explicit verbosity parameter (uses default from eventContext.configuration) - Fix DocC style for single parameter documentation - Refactor storage into Context struct for extensibility - Use _context.withLock instead of _testStorage for cleaner organization Ready for public PR as requested.

…nsoleOutputRecorder setup) - Resolved conflicts in Event.AdvancedConsoleOutputRecorder.swift (kept full hierarchical implementation)

- Remove ┌─ symbol for single module testing (flush left rendering) - Preserve ┌─ symbol for multiple module testing (full tree structure) - Add isSingleRoot parameter to _renderHierarchyNode

stmontgomery · 2025-08-27T21:37:05Z

@swift-ci please test

stmontgomery · 2025-08-28T12:40:02Z

@swift-ci please test

Sources/Testing/Events/Recorder/Event.AdvancedConsoleOutputRecorder.swift

Sources/Testing/ABI/EntryPoints/EntryPoint.swift

Sources/Testing/Events/Recorder/Event.AdvancedConsoleOutputRecorder.swift

Sources/Testing/ABI/EntryPoints/EntryPoint.swift

…simplify Swift file detection logic

tienquocbui and others added 30 commits July 7, 2025 21:30

Merge remote-tracking branch 'upstream/main'

1786cbf

Merge branch 'swiftlang:main' into main

b067a9a

Add advanced console output recorder with progress bar and hierarchic…

73a60ae

…al tree display

Merge branch 'swiftlang:main' into feature/advanced-console-output-re…

87425d9

…corder

Implementing progress bar with live update

bea236d

Merge pull request #1 from tienquocbui/kelvin/new-console-output

fd9a811

Implementing progress bar with live update

Fix: Signal Handling System and Live Failure Reporting

042438f

Merge main branch with latest upstream changes

6a1c6db

- Update to latest main branch from upstream/main - Integrate new ABI version handling and entry point improvements - Preserve AdvancedConsoleOutputRecorder skeleton implementation - Ready for first PR submission

Fix trailing newline in AdvancedConsoleOutputRecorder

f6c46fa

Complete skeleton PR #1 preparation: - Clean AdvancedConsoleOutputRecorder framework - Environment variable activation integrated - Latest upstream changes merged - Ready for first PR submission

Add experimental AdvancedConsoleOutputRecorder skeleton

c82be0b

Merge upstream/main into gsoc-development

7eb599a

Fix Environment.flag optional unwrapping in EntryPoint.swift

16e581a

The Environment.flag(named:) function returns Bool? but was being used directly in an if statement. Changed to explicit comparison with true to handle the optional properly.

Remove LiveUpdatingLine.swift and its CMakeLists.txt reference

0a496ac

Since we cannot control the output stream, the LiveUpdatingLine functionality is not usable in practice and should be removed from the skeleton implementation.

Merge upstream/main into gsoc-development2 for ABI refactor work

23b6dee

Fix typo error

9f67472

Make AdvancedConsoleOutputRecorder generic over ABI.Version

c113964

Fix naming convention: Context -> _Context

ddf12ae

Implement basic failure summary for AdvancedConsoleOutputRecorder

06c4a91

Enhance failure summary with Unicode box-drawing and better formatting

0874e2e

feat: Complete hierarchical console output

52c9f90

Resolved conflicts in EntryPoint.swift (kept comprehensive AdvancedCo…

d6048e0

…nsoleOutputRecorder setup) - Resolved conflicts in Event.AdvancedConsoleOutputRecorder.swift (kept full hierarchical implementation)

refactor: Consolidate test data storage

6452fb1

feat: Context-aware tree rendering for single vs multiple modules

d88f72f

- Remove ┌─ symbol for single module testing (flush left rendering) - Preserve ┌─ symbol for multiple module testing (full tree structure) - Add isSingleRoot parameter to _renderHierarchyNode

docs: Add comprehensive documentation

a92f12a

stmontgomery added this to [Swift Testing] Console Experience Aug 27, 2025

stmontgomery added this to the Swift 6.x (main) milestone Aug 27, 2025

stmontgomery moved this to Todo in [Swift Testing] Console Experience Aug 27, 2025

stmontgomery moved this from Todo to In Progress in [Swift Testing] Console Experience Aug 27, 2025

stmontgomery added the gsoc ☀️ Google Summer of Code contributions label Aug 27, 2025

tienquocbui added 2 commits August 28, 2025 15:08

feat: Add ASCII fallback for Unicode box-drawing characters

e0099f6

refactor: Replace custom hierarchy with Graph<K,V> structure

41ef090

tienquocbui requested a review from grynspan August 28, 2025 09:13

Add 1 line at the end

892c707

stmontgomery reviewed Aug 28, 2025

View reviewed changes

Sources/Testing/Events/Recorder/Event.AdvancedConsoleOutputRecorder.swift Outdated Show resolved Hide resolved

stmontgomery reviewed Aug 28, 2025

View reviewed changes

Sources/Testing/Events/Recorder/Event.AdvancedConsoleOutputRecorder.swift Outdated Show resolved Hide resolved

stmontgomery reviewed Aug 28, 2025

View reviewed changes

Sources/Testing/ABI/EntryPoints/EntryPoint.swift Outdated Show resolved Hide resolved

Backtick-aware parsing, rawIdentifierAwareSplit utility

8df34ba

tienquocbui requested a review from stmontgomery August 31, 2025 20:41

stmontgomery reviewed Sep 4, 2025

View reviewed changes

tienquocbui force-pushed the gsoc-development3 branch from 8a6d3d5 to 8df34ba Compare September 5, 2025 07:48

grynspan reviewed Sep 10, 2025

View reviewed changes

Sources/Testing/Events/Recorder/Event.AdvancedConsoleOutputRecorder.swift Outdated Show resolved Hide resolved

grynspan reviewed Sep 10, 2025

View reviewed changes

Sources/Testing/Events/Recorder/Event.AdvancedConsoleOutputRecorder.swift Outdated Show resolved Hide resolved

grynspan reviewed Sep 10, 2025

View reviewed changes

Sources/Testing/ABI/EntryPoints/EntryPoint.swift Outdated Show resolved Hide resolved

tienquocbui added 4 commits September 15, 2025 02:23

Rename non-idiomatic 'get' functions to follow Swift conventions and …

8dd42b1

…simplify Swift file detection logic

Resolve conflict

4e89a8f

Remove Indentation Issues

859f155

Merge latest changes from main branch

40a345a

tienquocbui requested review from grynspan and stmontgomery September 15, 2025 01:09

stmontgomery approved these changes Sep 19, 2025

View reviewed changes

stmontgomery merged commit e4e0b88 into swiftlang:main Sep 19, 2025
35 of 36 checks passed

github-project-automation bot moved this from In Progress to Done in [Swift Testing] Console Experience Sep 19, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Implement hierarchical console output with comprehensive test result display #1290

Implement hierarchical console output with comprehensive test result display #1290

Uh oh!

tienquocbui commented Aug 27, 2025 •

edited

Loading

Uh oh!

stmontgomery commented Aug 27, 2025

Uh oh!

stmontgomery commented Aug 28, 2025

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Implement hierarchical console output with comprehensive test result display #1290

Implement hierarchical console output with comprehensive test result display #1290

Uh oh!

Conversation

tienquocbui commented Aug 27, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Modifications:

Checklist:

Uh oh!

stmontgomery commented Aug 27, 2025

Uh oh!

stmontgomery commented Aug 28, 2025

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

tienquocbui commented Aug 27, 2025 •

edited

Loading