Skip to content
This repository was archived by the owner on Aug 22, 2025. It is now read-only.

Can't retrieve Many records and count(*) #402

@dbapramod882

Description

@dbapramod882

Scenario:
I have loaded a table with approximately 5 Million records and trying to fetch the records on a time stamp field.
CREATE CUSTOM INDEX tx_id ON arrow.history2 (lucene) USING 'com.stratio.cassandra.lucene.Index' WITH OPTIONS = {'refresh_seconds': '10', 'ram_buffer_mb': '3072', 'directory_path': '/data02/cassandra/data/arrow/history2/lucene.idx', 'schema': '{fields: { sent_date: {type: "date", pattern: "yyyy-MM-dd HH:mm:ss Z"}}}'};

Retrieving records as,
select tx_id,sent_date from arrow.history2 where lucene = '{filter:{type: "range", field: "sent_date", lower: "2018-08-22 18:47:09 +0000", upper: "2020-08-22 14:47:09 +0000", include_lower: true, include_upper: true},sort: {field: "sent_date", reverse: true}}';

Here the issue was, when I turn off the paging in cqlsh It was never returning any results and count(*) also not returning any thing. (I made sure that request time out is kept enough long, If I hit ctrl + c also the command was not exiting).

FYI: The same query when ran in DSE Search I am able to fetch the default 10 records even when the paging was off and count() returned the number of records.
`SELECT count(
) from texas.dallas where solr_query='{"q":"sent_date:[2018-08-22T18:47:09Z TO 2020-08-22T14:47:09Z] ","sort":"sent_date DESC","start":0}';

count

520939
`
Please advise, Thanks

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions