Skip to content

gpt test fails #1

@behrica

Description

@behrica

I created an apparnetly working GPU environemnt, a lot of tests pass.
But I get an error on this:

FAIL GPT inference test. at (cuda_test.clj:179)
Expected:
[8642 562 318 407 262 691 835 284 8642 562 318 407 262 691]
Actual:
[8642 562 318 0 0 0 0 0 0 0 0 0 0 0]
Diffs: in [3] expected 407, was 0
              in [4] expected 262, was 0
              in [5] expected 691, was 0
              in [6] expected 835, was 0
              in [7] expected 284, was 0
              in [8] expected 8642, was 0
              in [9] expected 562, was 0
              in [10] expected 318, was 0
              in [11] expected 407, was 0
              in [12] expected 262, was 0
              in [13] expected 691, was 0

sometimes I see "random numbers instead of 0.
It is consistently failing, if I run the test-class alone.

I think I saw it passing(from time to time), when running "lein test", so all tests.

In repl, so executing the code in the GPT test, I never could it get running successfully.
Either it falls with various Ort errors about "not initialized" or similar.

I played with (init), (init-ort-api) and (with-context), but could never find a clear pattern

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions