Invalid JSON found

[sanikolaev]

Bug Description:

MRE:

mysql> drop table if exists t; create table t (s string, v float_vector knn_type='hnsw' knn_dims='2' hnsw_similarity='COSINE'); INSERT INTO t VALUES (5047479470261279290,'0000000000',(0.1, 0.2)); select id from t where knn(v,5,5047479470261279290);
--------------
drop table if exists t
--------------

Query OK, 0 rows affected (0.002 sec)

--------------
create table t (s string, v float_vector knn_type='hnsw' knn_dims='2' hnsw_similarity='COSINE')
--------------

Query OK, 0 rows affected (0.002 sec)

--------------
INSERT INTO t VALUES (5047479470261279290,'0000000000',(0.1, 0.2))
--------------

Query OK, 1 row affected (0.000 sec)

--------------
select id from t where knn(v,5,5047479470261279290)
--------------

ERROR 1064 (42000): Something went wrong

causes

[Tue Nov  4 07:53:13.711 2025] [114862749] [BUDDY] [X] <Thrown: Response:352> <Logged: EventHandler:90> <[6909b0e9abfee0.32809810] processing error> Invalid JSON found

in the log.

Interesting that the length of the string value and the ID matter.

Manticore Search Version:

Manticore 13.15.6 6cd1dbaa8@25102709 dev (columnar 8.1.0 e1522a2@25100213) (secondary 8.1.0 e1522a2@25100213) (knn 8.1.0 e1522a2@25100213) (embeddings 1.0.1)

Operating System Version:

macos

Have you tried the latest development version?

No

Internal Checklist:

^{To be completed by the assignee. Check off tasks that have been completed or are not applicable.}

• Implementation completed
• Tests developed
• Documentation updated
• Documentation reviewed

[sanikolaev]

Related PR #616

[KlimTodrik]

Fixed in manticoresoftware/manticoresearch#3983

[KlimTodrik]

I reviewed this issue in more detail and can confirm that searchd returns the correct structure.
The problem is in the Struct class, which breaks the JSON when bigint fields are involved.

For example, searchd returns:

{"id":5047479470261279290,"s":"0000000000"}

But after calling:

Struct::fromData($array, $struct->getBigIntFields())->toJson()

we get:

{"id":5047479470261279290,"s":0000000000} // invalid JSON

The string field becomes unquoted, producing non-valid JSON.

[KlimTodrik]

On review manticoresoftware/buddy-core#135