Slow responses

[steffilazerte]

@denislepage and @cjardine-bsc,

As I've been working on the package in the last little while, I realize that querying the database has been getting slow. I have a number of tests that check if data can be downloaded. In the past these tests ran without a hitch, occasionally running in to a timeout but generally without problems.

Lately however, I'm constantly running into timeouts in the initial database query step, especially with regional filters (i.e statprov, subnational2, country etc.)

I got the impression that a lot more data has been added (I've had to modify previous test which only downloaded a little because now they download a lot), which is great!

However, perhaps this contributes to the slower responses? If it's just that there's more data so it will be slow as a result, I can modify things as needed. But since I've noticed most of the problems with the regional filters, I wondered if there was any indexing that could be done to speed things up? (To be clear, I have no idea what I'm really talking about, this is just something I've heard you mention in the past 😁).

Thanks!

[cjardine-bsc]

Thanks Steffi, we added 100million records to the DB recently. Yay?

Denis and I touched based about this today, we'll look into improving some indexes.