Skip to content

Not able to run at all with any of the models. #2

@zoltan-dulac

Description

@zoltan-dulac

Hi there.

Every time I try to use the --models option, the program fails. I am not sure, but it may be because it can't download the model, even though the README.md says it can. I am running this on a non-Intel Mac running Sequoia (Mac OSX 15.5), if that makes any difference.

Here are the outputs of the various command lines I have tried (Note that XXXXXXX is my user account on my machine, obfuscated):

Open Clip:

((venv) ) (base) XXXXXXX@WKMZT871E5E9 auto-alt-text % python -m aat --image ~/tmp/alt-text-demo-images/s-l1600.jpg --model openclip
Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "/Users/XXXXXXX/git/auto-alt-text/aat/__main__.py", line 8, in <module>
    sys.exit(process_pptx())
             ^^^^^^^^^^^^^^
  File "/Users/XXXXXXX/git/auto-alt-text/aat/process.py", line 540, in process_pptx
    err = generate_alt_text_image(image_file_name, settings, args.verbose, args.debug)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/XXXXXXX/git/auto-alt-text/aat/process.py", line 380, in generate_alt_text_image
    alt_text, err = generate_description(
                    ^^^^^^^^^^^^^^^^^^^^^
  File "/Users/XXXXXXX/git/auto-alt-text/aat/powerpoint.py", line 1102, in generate_description
    alt_text, err = openclip(image_file_path, extension, settings, verbose)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/XXXXXXX/git/auto-alt-text/aat/models.py", line 192, in openclip
    img = preprocess(img).unsqueeze(0)
          ^^^^^^^^^^^^^^^
TypeError: 'NoneType' object is not callable
((venv) ) (base) XXXXXXX@WKMZT871E5E9 auto-alt-text %

Kosoms:

((venv) ) (base) XXXXXXX@WKMZT871E5E9 auto-alt-text % python -m aat --image ~/tmp/alt-text-demo-images/s-l1600.jpg --model kosmos-2
Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "/Users/XXXXXXX/git/auto-alt-text/aat/__main__.py", line 8, in <module>
    sys.exit(process_pptx())
             ^^^^^^^^^^^^^^
  File "/Users/XXXXXXX/git/auto-alt-text/aat/process.py", line 540, in process_pptx
    err = generate_alt_text_image(image_file_name, settings, args.verbose, args.debug)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/XXXXXXX/git/auto-alt-text/aat/process.py", line 380, in generate_alt_text_image
    alt_text, err = generate_description(
                    ^^^^^^^^^^^^^^^^^^^^^
  File "/Users/XXXXXXX/git/auto-alt-text/aat/powerpoint.py", line 1100, in generate_description
    alt_text, err = kosmos2(image_file_path, extension, settings, for_notes, verbose)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/XXXXXXX/git/auto-alt-text/aat/models.py", line 94, in kosmos2
    processor:str = settings["kosmos2-processor"]
                    ~~~~~~~~^^^^^^^^^^^^^^^^^^^^^
KeyError: 'kosmos2-processor'

Am I supposed to do something else here? Please let me know. Thanks for your time.

Cheers,
Zoltan

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions