Skip to content

WinError 5 when a llm inquiry is issued #7

@DW413

Description

@DW413

I believe I got the test script from your site. In running it, the loading of the model does not issue any errors. Therefore, I believe that the model loaded correctly. However, when the statement "response = llm.ask("Explain the term 'ilm' in AI context.")" is executed, I get this error message:

RuntimeError: Error during generation: [WinError 5] Access is denied

It is actually being triggered by

File "C:\Users\DPW\git-repository\VulkanIlm\vulkan_ilm\simple_llama.py", line 143, in generate
raise RuntimeError(f"Error during generation: {e}")

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions