Unable to redirect output to file in `--output-format human` on windows

[zacharyshale95]

When redirecting output to a file in human format, the following error occurs:

python -m johnnydep johnnydep --output-format human -f ALL > johnnydep.log

Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "C:\py3.13.2_test\Lib\site-packages\johnnydep\__main__.py", line 4, in <module>
    main()
    ~~~~^^
  File "C:\py3.13.2_test\Lib\site-packages\johnnydep\cli.py", line 140, in main
    print(rendered, file=stdout)
    ~~~~~^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\py3.13.2_test\Lib\site-packages\colorama\ansitowin32.py", line 47, in write
    self.__convertor.write(text)
    ~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "C:\py3.13.2_test\Lib\site-packages\colorama\ansitowin32.py", line 177, in write
    self.write_and_convert(text)
    ~~~~~~~~~~~~~~~~~~~~~~^^^^^^
  File "C:\py3.13.2_test\Lib\site-packages\colorama\ansitowin32.py", line 205, in write_and_convert
    self.write_plain_text(text, cursor, len(text))
    ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\py3.13.2_test\Lib\site-packages\colorama\ansitowin32.py", line 210, in write_plain_text
    self.wrapped.write(text[start:end])
    ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
  File "C:\py3.13.2\Lib\encodings\cp1252.py", line 19, in encode
    return codecs.charmap_encode(input,self.errors,encoding_table)[0]
           ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
UnicodeEncodeError: 'charmap' codec can't encode characters in position 5138-5140: character maps to <undefined>

Add another argument to allow writing the output to a file, which then can handle this

[wimglenn]

Please include your:

• platform
• shell
• johnnydep version

[zacharyshale95]

Windows, Python 3.13.2
CMD-Prompt
1.20.6

I just added a pull request

I noticed a couple of other things as well:

1. When a package has a HUGE list of versions (like pip) and you --format ALL it doesn't output correctly, so I bumped that dict up to 100,000 columns which fixed that issue
2. For my use-case, I also would like to get the sha1 and md5 hashes, so I added those, which I now see is causing a failure in the tests, I just pushed the fix for the tests

This additional functionality will greatly assist me, so I hope it isn't too much to add

[wimglenn]

Regarding the UnicodeEncodeError, do you see the same issue in main branch (i.e. unreleased 2.x) or is it specific to johnnydep 1.x? Does it also happen in Powershell?

I'd check myself, but I don't have a Windows box avail right at this moment.

[zacharyshale95]

I get it on the main branch as well

Windows encodes by default in cp1252, so it couldn't handle the tree symbols

Adding support for the --output-file argument allows us to force the file write to utf-8 which resolves the issue

Apologies for the wild commits going on, I couldn't get the test environment to work locally

[wimglenn]

I would rather find a way to fix the redirection issue than add an --output-file argument.

[zacharyshale95]

There is a way, by using this combo in the cmd-prompt:

chcp 65001
set PYTHONIOENCODING=utf-8

I felt the --output-file would be the more ideal solution since it will just work "out of the box" for all OSs, I'm curious why you prefer not to add this argument?

[zacharyshale95]

My Pull Request (#147) has passed everything, so if merged, we get:

1. --output-file argument
2. sha1 and md5 checksums (This is extremely useful for me)
3. 100,000 columns in the dict (which prevents missing output when there are many items in a column, like pip's versions)

[WadeLewis]

+1 for additional hashes on the output, this would allow me to deprecate some silly workarounds in my CICD pipeline.