Gigahorse 1.1.8-217b8ba sporadic park_delta(): LP_1 < LP_0 (2183940545018, 2199560346605), park_delta_split(): small_delta > 255 , ans_encode_sym(): index out of bounds: 32694, double free or corruption (!prev), signal 6

[bladeuserpi]

Hi,
when testing various C levels one run terminated with signal 6.
Rerunning with same parameters (K32 -C 3) it works fine.

Error message (also see below):
59 park_delta(): LP_1 < LP_0 (2183940545018, 2199560346605) (x = 501, y = 0)
60 park_delta_split(): small_delta > 255 (786) (x = 500, y = 0, stub = 26)
61 ans_encode_sym(): index out of bounds: 32694
62 double free or corruption (!prev)
63 Command terminated by signal 6

I would like to rerun with the same PlotID to see if this reproduces.
Is that possible or would this need a new (debug) option?
P.S. Can you explain what -Z/--unique does?

[root@287c4448ccc0 data1]# cat -n giga1169.cuda_plot_k32_834ee25.27247.out
     1	Sun Jan 29 10:12:46 2023       
     2	+-----------------------------------------------------------------------------+
     3	| NVIDIA-SMI 525.85.05    Driver Version: 525.85.05    CUDA Version: 12.0     |
     4	|-------------------------------+----------------------+----------------------+
     5	| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
     6	| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
     7	|                               |                      |               MIG M. |
     8	|===============================+======================+======================|
     9	|   0  Quadro M4000        Off  | 00000000:84:00.0 Off |                  N/A |
    10	| 82%   59C    P0    47W / 120W |      0MiB /  8192MiB |      1%      Default |
    11	|                               |                      |                  N/A |
    12	+-------------------------------+----------------------+----------------------+
    13	                                                                               
    14	+-----------------------------------------------------------------------------+
    15	| Processes:                                                                  |
    16	|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
    17	|        ID   ID                                                   Usage      |
    18	|=============================================================================|
    19	|  No running processes found                                                 |
    20	+-----------------------------------------------------------------------------+
    21	    Product Name                          : Quadro M4000
    22	Sun Jan 29 10:12:47 UTC 2023
    23	8fbbd13e2321599f221f2f289b7316c2  cuda_plot_k32_834ee25
    24	Calling /cuda_plot_k32_834ee25 -c xxx -f xxx -x 11337 -t ./ -C 3
    25	Chia k32 next-gen CUDA plotter - 217b8ba
    26	Plot Format: v2.4
    27	Network Port: 11337 [MMX] (unique)
    28	No. GPUs: 1
    29	No. Streams: 4
    30	Final Destination: ./
    31	Shared Memory limit: unlimited
    32	Number of Plots: 1
    33	Initialization took 0.151 sec
    34	Crafting plot 1 out of 1 (2023/01/29 10:12:48)
    35	Process ID: 1177
    36	Pool Puzzle Hash:  xxx
    37	Farmer Public Key: xxx
    38	Working Directory:   ./
    39	Working Directory 2: @RAM
    40	Compression Level: C3 (xbits = 13, final table = 3)
    41	Plot Name: plot-mmx-k32-c3-2023-01-29-10-12-xxx
    42	[P1] Setup took 0.871 sec
    43	[P1] Table 1 took 21.87 sec, 4294967296 entries, 16791110 max, 66551 tmp, 0 GB/s up, 1.55465 GB/s down
    44	[P1] Table 2 took 49.297 sec, 4294867239 entries, 16789748 max, 66891 tmp, 0.649127 GB/s up, 1.03455 GB/s down
    45	[P1] Table 3 took 86.297 sec, 4294707539 entries, 16787530 max, 66630 tmp, 0.556206 GB/s up, 1.32971 GB/s down
    46	[P1] Table 4 took 92.214 sec, 4294364423 entries, 16784491 max, 66738 tmp, 0.867495 GB/s up, 1.29048 GB/s down
    47	[P1] Table 5 took 80.065 sec, 4293720114 entries, 16786710 max, 66611 tmp, 0.999048 GB/s up, 1.27397 GB/s down
    48	[P1] Table 6 took 67.752 sec, 4292403787 entries, 16780888 max, 66627 tmp, 0.944347 GB/s up, 1.25458 GB/s down
    49	[P1] Table 7 took 47.582 sec, 4289820387 entries, 16771351 max, 66486 tmp, 1.00818 GB/s up, 0.98252 GB/s down
    50	Phase 1 took 446.442 sec
    51	[P2] Setup took 0.469 sec
    52	[P2] Table 7 took 6.994 sec, 4.56987 GB/s up, 0.075958 GB/s down
    53	[P2] Table 6 took 6.212 sec, 5.14825 GB/s up, 0.08552 GB/s down
    54	[P2] Table 5 took 5.983 sec, 5.34693 GB/s up, 0.0887932 GB/s down
    55	[P2] Table 4 took 5.9 sec, 5.42297 GB/s up, 0.0900424 GB/s down
    56	Phase 2 took 25.827 sec
    57	[P3] Setup took 0.635 sec
    58	[P3] Table 3 LPSK took 7.099 sec, 3439413469 entries, 14270566 max, 56421 tmp, 4.01881 GB/s up, 7.18414 GB/s down
    59	park_delta(): LP_1 < LP_0 (2183940545018, 2199560346605) (x = 501, y = 0)
    60	park_delta_split(): small_delta > 255 (786) (x = 500, y = 0, stub = 26)
    61	ans_encode_sym(): index out of bounds: 32694
    62	double free or corruption (!prev)
    63	Command terminated by signal 6
    64	167.79user 116.78system 8:49.11elapsed 53%CPU (0avgtext+0avgdata 196450004maxresident)k
    65	0inputs+200outputs (0major+50260110minor)pagefaults 0swaps

[madMAx43v3r]

should be fixed in latest version. the park_delta(): LP_1 < LP_0 can still happen sometimes, but it should not crash.

[bladeuserpi]

I will try the new version, however it did not reproduce for another 20 plots with current version.

Would the problem reproduce with the same PlotID?
If yes, what do you think about a new flag so I can test the same PlotID.

[madMAx43v3r]

this issue happens randomly, but yeah it's possible to reproduce with same plot ID. I cant allow custom plot id, since that would compromise the plot format.

[madMAx43v3r]

I plotted around 500 K32 C7 without a crash before.

[bladeuserpi]

Now I can confirm it happened again and it did not terminate,
so the fix is OK.

    30	Chia k32 next-gen CUDA plotter - f2f0c31
...
 128	Crafting plot 3 out of 5)
   129	Process ID: 3303
   130	Pool Puzzle Hash:  xxx
   131	Farmer Public Key: xxx
   132	Working Directory:   ./
   133	Working Directory 2: @RAM
   134	Compression Level: C1 (xbits = 15, final table = 3)
   135	Plot Name: plot-mmx-k32-c1-xxx
   136	[P1] Setup took 1.001 sec
   137	[P1] Table 1 took 4.185 sec, 4294967296 entries, 16787752 max, 66716 tmp, 0 GB/s up, 8.12431 GB/s down
   138	Flushing to disk took 11.7 sec
   139	[P1] Table 2 took 10.381 sec, 4294881058 entries, 16787155 max, 66747 tmp, 3.08255 GB/s up, 4.91285 GB/s down
   140	[P1] Table 3 took 13.561 sec, 4294653942 entries, 16786759 max, 66580 tmp, 3.53949 GB/s up, 8.77518 GB/s down
   141	[P1] Table 4 took 13.753 sec, 4294285480 entries, 16785748 max, 66584 tmp, 5.81649 GB/s up, 8.65268 GB/s down
   142	[P1] Table 5 took 14.196 sec, 4293588711 entries, 16781272 max, 66654 tmp, 5.6345 GB/s up, 7.18514 GB/s down
   143	[P1] Table 6 took 14.017 sec, 4292083004 entries, 16776659 max, 66573 tmp, 4.56442 GB/s up, 6.06408 GB/s down
   144	[P1] Table 7 took 10.921 sec, 4289107159 entries, 16765100 max, 66466 tmp, 4.39225 GB/s up, 4.28077 GB/s down
   145	Phase 1 took 82.336 sec
   146	[P2] Setup took 0.303 sec
   147	[P2] Table 7 took 2.78 sec, 11.4951 GB/s up, 0.191097 GB/s down
   148	[P2] Table 6 took 2.785 sec, 11.4824 GB/s up, 0.190754 GB/s down
   149	[P2] Table 5 took 2.786 sec, 11.4823 GB/s up, 0.190686 GB/s down
   150	[P2] Table 4 took 2.786 sec, 11.4842 GB/s up, 0.190686 GB/s down
   151	Phase 2 took 11.55 sec
   152	[P3] Setup took 0.681 sec
   153	[P3] Table 3 LPSK took 5.272 sec, 3439314452 entries, 14272404 max, 56357 tmp, 6.17013 GB/s up, 9.67379 GB/s down
   154	park_delta(): LP_1 < LP_0 (562490732909282, 562984251605420) (x = 391, y = 0)
   155	ans_encode_sym(): index out of bounds: 27060
   156	WritePark(): ans_length (594) > max_ans_length (510) (y = 224, i = 0)
   157	[P3] Table 3 NSK took 6.433 sec, 3439314450 entries, 13447448 max, 56357 tmp, 5.97502 GB/s up, 9.25465 GB/s down
   158	[P3] Table 4 PDSK took 4.941 sec, 3465059887 entries, 13554481 max, 53768 tmp, 6.58291 GB/s up, 9.4617 GB/s down
   159	[P3] Table 4 LPSK took 6.172 sec, 3465059885 entries, 13860045 max, 55800 tmp, 9.90325 GB/s up, 8.26316 GB/s down
   160	[P3] Table 4 NSK took 6.165 sec, 3465059885 entries, 13546687 max, 55051 tmp, 6.28144 GB/s up, 9.65696 GB/s down
   161	[P3] Table 5 PDSK took 4.942 sec, 3531138140 entries, 13813409 max, 54904 tmp, 6.58053 GB/s up, 9.45978 GB/s down
   162	[P3] Table 5 LPSK took 6.197 sec, 3531138136 entries, 14248555 max, 57058 tmp, 10.0035 GB/s up, 8.22983 GB/s down
   163	[P3] Table 5 NSK took 6.184 sec, 3531138136 entries, 13806609 max, 56592 tmp, 6.38156 GB/s up, 9.62729 GB/s down
   164	[P3] Table 6 PDSK took 4.939 sec, 3710364253 entries, 14516644 max, 57598 tmp, 6.58226 GB/s up, 9.46553 GB/s down
   165	[P3] Table 6 LPSK took 6.271 sec, 3710364242 entries, 15085726 max, 60836 tmp, 10.2567 GB/s up, 8.13271 GB/s down
   166	[P3] Table 6 NSK took 6.262 sec, 3710364242 entries, 14506012 max, 59940 tmp, 6.62193 GB/s up, 9.50737 GB/s down
   167	[P3] Table 7 PDSK took 5.324 sec, 4289107159 entries, 16779317 max, 66466 tmp, 8.25319 GB/s up, 8.78104 GB/s down
   168	[P3] Table 7 LPSK took 6.867 sec, 4289107129 entries, 17195793 max, 68970 tmp, 10.4244 GB/s up, 7.42686 GB/s down
   169	[P3] Table 7 NSK took 6.673 sec, 4289107129 entries, 16765100 max, 68206 tmp, 7.18335 GB/s up, 8.9218 GB/s down
   170	Phase 3 took 83.633 sec
   171	[P4] Setup took 0.181 sec
   172	[P4] total_p7_parks = 2094291
   173	[P4] total_c3_parks = 428910, 2385 / 2452 ANS bytes
   174	Phase 4 took 5.312 sec, 6.01588 GB/s up, 3.44191 GB/s down
   175	Total plot creation time was 182.94 sec (3.04899 min)