M5Stack LLM-8850AI M.2 Acceleration Card (AX8850) Memory issues

[stevef1uk]

[2026-01-25 15:16:37.641][5765][E][engine][invoke][97]: Decode api(4) response failed.
87% | ████████████████████████████ | 27 / 31 [26.65s<30.60s, 1.01 count/s] init 20 axmodel ok,devid(0) remain_cmm(3567 MB)[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:16:38.446][5765][E][engine][invoke][97]: Decode api(4) response failed.
90% | █████████████████████████████ | 28 / 31 [27.05s<29.94s, 1.04 count/s] init 13 axmodel ok,devid(0) remain_cmm(3627 MB)[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:16:39.595][5765][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:16:40.353][5765][E][engine][invoke][97]: Decode api(4) response failed.
93% | ██████████████████████████████ | 29 / 31 [28.63s<30.60s, 1.01 count/s] init 6 axmodel ok,devid(0) rema 96% | ███████████████████████████████ | 30 / 31 [28.64s<29.60s, 1.05 count/s] init 27 axmodel ok,devid(0) rem100% | ████████████████████████████████ | 31 / 31 [34.23s<34.23s, 0.91 count/s] init post axmodel ok,remain_cmm(3302 MB)Working directory: /home/stevef/dev/Qwen3-1.7B
Starting tokenizer server on port 12300...
Server running on port 12300
Starting main API application...
[I][ Init][ 130]: LLM init start
[I][ Init][ 34]: connect http://127.0.0.1:12300 ok
[I][ Init][ 57]: uid: 997ab961-ad35-4d01-9c3e-9d859c888d37
bos_id: 151643, eos_id: 151645
3% | ██ | 1 / 31 [0.88s<27.19s, 1.14 count/s] tokenizer init ok[I][ Init][ 45]: LLaMaEmbedSelector use mmap
6% | ███ | 2 / 31 [0.88s<13.59s, 2.28 count/s] embed_selector init ok
[I][ run][ 30]: AXCLWorker start with devid 0
[2026-01-25 15:17:01.818][6014][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:17:02.770][6014][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
9% | ████ | 3 / 31 [3.57s<36.86s, 0.84 count/s] init 14 axmodel ok,devid(0) rema 12% | █████ | 4 / 31 [4.21s<32.65s, 0.95 count/s] init 21 axmodel ok,devid(0) remain_cmm(5117 MB)[2026-01-25 15:17:03.575][6014][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:17:04.332][6014][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
16% | ██████ | 5 / 31 [5.13s<31.81s, 0.97 count/s] init 0 axmodel ok,devid(0) remai 19% | ███████ | 6 / 31 [5.15s<26.60s, 1.17 count/s] init 7 axmodel ok,devid(0) remain_cmm(5048 MB)[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:17:05.485][6014][E][engine][invoke][97]: Decode api(4) response failed.
[2026-01-25 15:17:06.242][6014][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
22% | ████████ | 7 / 31 [7.04s<31.18s, 0.99 count/s] init 22 axmodel ok,devid(0) rema 25% | █████████ | 8 / 31 [7.06s<27.35s, 1.13 count/s] init 15 axmodel ok,devid(0) remain_cmm(4919 MB)[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:17:07.397][6014][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:17:08.154][6014][E][engine][invoke][97]: Decode api(4) response failed.
29% | ██████████ | 9 / 31 [8.95s<30.84s, 1.01 count/s] init 8 axmodel ok,devid(0) remai 32% | ███████████ | 10 / 31 [8.97s<27.82s, 1.11 count/s] init 1 axmodel ok,devid(0) remain_cmm(4789 MB)[2026-01-25 15:17:09.305][6014][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:17:10.061][6014][E][engine][invoke][97]: Decode api(4) response failed.
35% | ████████████ | 11 / 31 [10.86s<30.61s, 1.01 count/s] init 16 axmodel ok,devid(0) rem 38% | █████████████ | 12 / 31 [10.88s<28.10s, 1.10 count/s] init 23 axmodel ok,devid(0) remain_cmm(4660 MB)[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:17:11.213][6014][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:17:11.969][6014][E][engine][invoke][97]: Decode api(4) response failed.
41% | ██████████████ | 13 / 31 [12.77s<30.44s, 1.02 count/s] init 2 axmodel ok,devid(0) rema 45% | ███████████████ | 14 / 31 [12.78s<28.31s, 1.10 count/s] init 9 axmodel ok,devid(0) remain_cmm(4531 MB)[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:17:13.123][6014][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:17:13.927][6014][E][engine][invoke][97]: Decode api(4) response failed.
48% | ████████████████ | 15 / 31 [14.72s<30.43s, 1.02 count/s] init 24 axmodel ok,devid(0) rem 51% | █████████████████ | 16 / 31 [14.74s<28.56s, 1.09 count/s] init 17 axmodel ok,devid(0) remain_cmm(4402 MB)[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:17:15.080][6014][E][engine][invoke][97]: Decode api(4) response failed.
54% | ██████████████████ | 17 / 31 [16.20s<29.54s, 1.05 count/s] init 3 axmodel ok,devid(0) remain_cmm(4213 MB)[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:17:15.884][6014][E][engine][invoke][97]: Decode api(4) response failed.
58% | ███████████████████ | 18 / 31 [17.01s<29.29s, 1.06 count/s] init 10 axmodel ok,devid(0) remain_cmm(4273 MB)[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:17:17.034][6014][E][engine][invoke][97]: Decode api(4) response failed.
61% | ████████████████████ | 19 / 31 [18.17s<29.65s, 1.05 count/s] init 25 axmodel ok,devid(0) remain_cmm(4084 MB)[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:17:17.839][6014][E][engine][invoke][97]: Decode api(4) response failed.
64% | █████████████████████ | 20 / 31 [18.96s<29.39s, 1.05 count/s] init 18 axmodel ok,devid(0) remain_cmm(4144 MB)[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:17:18.987][6014][E][engine][invoke][97]: Decode api(4) response failed.
67% | ██████████████████████ | 21 / 31 [20.17s<29.78s, 1.04 count/s] init 4 axmodel ok,devid(0) remain_cmm(3954 MB)[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:17:19.792][6014][E][engine][invoke][97]: Decode api(4) response failed.
70% | ███████████████████████ | 22 / 31 [20.91s<29.47s, 1.05 count/s] init 11 axmodel ok,devid(0) remain_cmm(4014 MB)[2026-01-25 15:17:20.943][6014][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
74% | ████████████████████████ | 23 / 31 [22.17s<29.89s, 1.04 count/s] init 26 axmodel ok,devid(0) remain_cmm(3825 MB)[2026-01-25 15:17:21.748][6014][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
77% | █████████████████████████ | 24 / 31 [22.87s<29.54s, 1.05 count/s] init 19 axmodel ok,devid(0) remain_cmm(3885 MB)[2026-01-25 15:17:22.898][6014][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
80% | ██████████████████████████ | 25 / 31 [24.17s<29.98s, 1.03 count/s] init 5 axmodel ok,devid(0) remain_cmm(3696 MB)[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:17:23.704][6014][E][engine][invoke][97]: Decode api(4) response failed.
83% | ███████████████████████████ | 26 / 31 [24.83s<29.60s, 1.05 count/s] init 12 axmodel ok,devid(0) remain_cmm(3756 MB)[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:17:24.855][6014][E][engine][invoke][97]: Decode api(4) response failed.
87% | ████████████████████████████ | 27 / 31 [26.17s<30.05s, 1.03 count/s] init 27 axmodel ok,devid(0) remain_cmm(3567 MB)[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:17:25.660][6014][E][engine][invoke][97]: Decode api(4) response failed.
90% | █████████████████████████████ | 28 / 31 [26.78s<29.65s, 1.05 count/s] init 20 axmodel ok,devid(0) remain_cmm(3627 MB)[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:17:26.808][6014][E][engine][invoke][97]: Decode api(4) response failed.
93% | ██████████████████████████████ | 29 / 31 [28.17s<30.12s, 1.03 count/s] init 6 axmodel ok,devid(0) remain_cmm(3567 MB)[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:17:27.612][6014][E][engine][invoke][97]: Decode api(4) response failed.
96% | ███████████████████████████████ | 30 / 31 [28.73s<29.69s, 1.04 count/s] init 13 axmodel ok,devid(0) rem100% | ████████████████████████████████ | 31 / 31 [34.31s<34.31s, 0.90 count/s] init post axmodel ok,remain_cmm(3302 MB)Working directory: /home/stevef/dev/Qwen3-1.7B
Starting tokenizer server on port 12300...
Server running on port 12300
Starting main API application...
[I][ Init][ 130]: LLM init start
[I][ Init][ 34]: connect http://127.0.0.1:12300 ok
[I][ Init][ 57]: uid: 49789d6e-6680-49d2-9b54-9149ea5a20d9
bos_id: 151643, eos_id: 151645
3% | ██ | 1 / 31 [0.88s<27.12s, 1.14 count/s] tokenizer init ok[I][ Init][ 45]: LLaMaEmbedSelector use mmap
6% | ███ | 2 / 31 [0.88s<13.56s, 2.29 count/s] embed_selector init ok
[I][ run][ 30]: AXCLWorker start with devid 0
[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:17:49.515][6234][E][engine][invoke][97]: Decode api(4) response failed.
[2026-01-25 15:17:50.274][6234][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
9% | ████ | 3 / 31 [3.57s<36.86s, 0.84 count/s] init 21 axmodel ok,devid(0) rema 12% | █████ | 4 / 31 [3.67s<28.43s, 1.09 count/s] init 7 axmodel ok,devid(0) remain_cmm(5117 MB)[2026-01-25 15:17:51.075][6234][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
16% | ██████ | 5 / 31 [4.69s<29.07s, 1.07 count/s] init 14 axmodel ok,devid(0) remain_cmm(5117 MB)[2026-01-25 15:17:51.878][6234][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
19% | ███████ | 6 / 31 [5.50s<28.41s, 1.09 count/s] init 0 axmodel ok,devid(0) remain_cmm(4983 MB)[2026-01-25 15:17:53.228][6234][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:17:53.985][6234][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
22% | ████████ | 7 / 31 [7.28s<32.24s, 0.96 count/s] init 8 axmodel ok,devid(0) remai 25% | █████████ | 8 / 31 [7.67s<29.71s, 1.04 count/s] init 22 axmodel ok,devid(0) remain_cmm(4859 MB)[2026-01-25 15:17:54.789][6234][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:17:55.744][6234][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
29% | ██████████ | 9 / 31 [9.04s<31.14s, 1.00 count/s] init 1 axmodel ok,devid(0) remai 32% | ███████████ | 10 / 31 [9.06s<28.07s, 1.10 count/s] init 15 axmodel ok,devid(0) remain_cmm(4789 MB)[2026-01-25 15:17:56.901][6234][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
35% | ████████████ | 11 / 31 [10.67s<30.07s, 1.03 count/s] init 9 axmodel ok,devid(0) remain_cmm(4600 MB)[2026-01-25 15:17:57.706][6234][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
38% | █████████████ | 12 / 31 [11.33s<29.26s, 1.06 count/s] init 23 axmodel ok,devid(0) remain_cmm(4660 MB)[2026-01-25 15:17:58.858][6234][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
41% | ██████████████ | 13 / 31 [12.67s<30.21s, 1.03 count/s] init 2 axmodel ok,devid(0) remain_cmm(4471 MB)[2026-01-25 15:17:59.662][6234][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
45% | ███████████████ | 14 / 31 [13.28s<29.41s, 1.05 count/s] init 16 axmodel ok,devid(0) remain_cmm(4531 MB)[2026-01-25 15:18:00.810][6234][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
48% | ████████████████ | 15 / 31 [14.67s<30.32s, 1.02 count/s] init 10 axmodel ok,devid(0) remain_cmm(4342 MB)[2026-01-25 15:18:01.616][6234][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
51% | █████████████████ | 16 / 31 [15.24s<29.52s, 1.05 count/s] init 24 axmodel ok,devid(0) remain_cmm(4402 MB)[2026-01-25 15:18:02.766][6234][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
54% | ██████████████████ | 17 / 31 [16.67s<30.40s, 1.02 count/s] init 3 axmodel ok,devid(0) remain_cmm(4213 MB)[2026-01-25 15:18:03.571][6234][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
58% | ███████████████████ | 18 / 31 [17.19s<29.61s, 1.05 count/s] init 17 axmodel ok,devid(0) remain_cmm(4273 MB)[2026-01-25 15:18:04.722][6234][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
61% | ████████████████████ | 19 / 31 [18.67s<30.46s, 1.02 count/s] init 11 axmodel ok,devid(0) remain_cmm(4084 MB)[2026-01-25 15:18:05.528][6234][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
64% | █████████████████████ | 20 / 31 [19.15s<29.68s, 1.04 count/s] init 25 axmodel ok,devid(0) remain_cmm(4144 MB)[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:18:06.678][6234][E][engine][invoke][97]: Decode api(4) response failed.
67% | ██████████████████████ | 21 / 31 [20.67s<30.52s, 1.02 count/s] init 4 axmodel ok,devid(0) remain_cmm(3954 MB)[2026-01-25 15:18:07.483][6234][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
70% | ███████████████████████ | 22 / 31 [21.10s<29.74s, 1.04 count/s] init 18 axmodel ok,devid(0) remain_cmm(4014 MB)[2026-01-25 15:18:08.634][6234][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
74% | ████████████████████████ | 23 / 31 [22.67s<30.56s, 1.01 count/s] init 12 axmodel ok,devid(0) remain_cmm(3825 MB)[2026-01-25 15:18:09.439][6234][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
77% | █████████████████████████ | 24 / 31 [23.06s<29.78s, 1.04 count/s] init 26 axmodel ok,devid(0) remain_cmm(3885 MB)[2026-01-25 15:18:10.588][6234][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:18:11.347][6234][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
80% | ██████████████████████████ | 25 / 31 [24.64s<30.56s, 1.01 count/s] init 19 axmodel ok,devid(0) rem 83% | ███████████████████████████ | 26 / 31 [24.66s<29.40s, 1.05 count/s] init 5 axmodel ok,devid(0) remain_cmm(3756 MB)[2026-01-25 15:18:12.500][6234][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:18:13.258][6234][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
87% | ████████████████████████████ | 27 / 31 [26.55s<30.49s, 1.02 count/s] init 27 axmodel ok,devid(0) rem 90% | █████████████████████████████ | 28 / 31 [26.57s<29.41s, 1.05 count/s] init 13 axmodel ok,devid(0) remain_cmm(3627 MB)[2026-01-25 15:18:14.403][6234][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
[2026-01-25 15:18:15.160][6234][E][engine][invoke][97]: Decode api(4) response failed.
[E][ init][ 421]: AX_ENGINE_CreateHandle
93% | ██████████████████████████████ | 29 / 31 [28.46s<30.42s, 1.02 count/s] init 6 axmodel ok,devid(0) rema 96% | ███████████████████████████████ | 30 / 31 [28.47s<29.42s, 1.05 count/s] init 20 axmodel ok,devid(0) rem100% | ████████████████████████████████ | 31 / 31 [34.10s<34.10s, 0.91 count/s] init post axmodel ok,remain_cmm(3302 MB)Working directory: /home/stevef/dev/Qwen3-1.7B
Starting tokenizer server on port 12300...
Server running on port 12300
Starting main API application...
[I][ Init][ 130]: LLM init start
[I][ Init][ 34]: connect http://127.0.0.1:12300 ok
[I][ Init][ 57]: uid: 7605065a-517d-48fc-83bb-e63e828d8f9b
bos_id: 151643, eos_id: 151645
3% | ██

Never ending!