Large list performance impact

[timkgh]

What is the performance impact from very large lists, in particular when AGH runs on not so powerful consumer grade routers (e.g. Netgear R7800 running OpenWRT)?

This list has over 900K entries and it's ~21MB download for example: HaGeZi's Threat Intelligence Feeds

[timkgh]

And a followup question: does AGH deduplicate list rules in memory? There can be multiple lists that have some overlap.