sort: deduplicate file descriptors in merge mode

[nonontb]

What This Does

This PR makes sort -m (merge mode) use less (minimum?) opened files.

The Problem

Before:

If you ran sort -m file.txt file.txt file.txt, the program opened file.txt three times eagerly — once for every time it appeared on the command line.
With lots of duplicates or a tight system limit on open files, this could fail.

If you tried to merge a file that was also your output file, the program had to create a temporary copy behind the scenes, using one more file.

GNU version has no issue running the test in #5714

The Fix

Now the program opens each unique file only once and Lazily and use Mmap (memmap2 - unsafe) to manage one FD for all input file duplicates including re-use of output file as inputs.

Result

Fix #5714

[github-actions]

GNU testsuite comparison:

GNU test failed: tests/misc/sync. tests/misc/sync is passing on 'main'. Maybe you have to rebase?
Skipping an intermittent issue tests/cut/bounded-memory (passes in this run but fails in the 'main' branch)
Note: The gnu test tests/printf/printf-surprise is now being skipped but was previously passing.
Congrats! The gnu test tests/unexpand/bounded-memory is now passing!
Skip an intermittent issue tests/pr/bounded-memory (was skipped on 'main', now failing)

[codspeed-hq]

Merging this PR will not alter performance

✅ 309 untouched benchmarks
⏩ 46 skipped benchmarks¹

---

_{Comparing nonontb:feature/sort-input-fd-optimization (563ddcf) with main (6b16cc9)}

Footnotes

1. 46 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

[sylvestre]

please generate the files on the fly

[nonontb]

Done

[sylvestre]

please generate this one the fly too

[nonontb]

Yes, I forgot to delete it but the test is "on the fly"

#[test]
fn test_merge_mixed_stdin_and_files() {
    let (at, mut ucmd) = at_and_ucmd!();
    at.write("merge_duplicates_1.txt", "1\n3\n5\n");
    // Verify that sort -m allows mixing stdin with files (GNU Coreutils compatible)
    ucmd.arg("-m")
        .arg("-")
        .arg("merge_duplicates_1.txt")
        .pipe_in("apricot\nelderberry\nkiwi\n")
        .succeeds()
        .stdout_is("1\n3\n5\napricot\nelderberry\nkiwi\n");
}

[sylvestre]

maybe move this into a function?

[sylvestre]

did you look if we have a benchmark covering this? thanks

[nonontb]

did you look if we have a benchmark covering this? thanks

I just did and it seems there not relevant benchmark test in src/uu/sort/benches/sort_bench.rs even there is some doc to explain how to do it in src/uu/sort/BENCHMARKING.md or I miss something.

I suppose it would be better to add this bench test in another issue to have some reference numbers before benchmarking this PR ?