Error; Option to limit the number of items?

[jykim]

Hi,

Thanks for the wonderful plug-in. I ran into this error while trying it on my account.

Is it that my account with 12.3k items is too big to fetch with this?

If that's the case, can you add an option to limit the number of items? (i.e. last k recent items)

Thanks again.

(base) ➜ datasettes pocket-to-sqlite fetch pocket.db

[------------------------------------] 0/12317
Traceback (most recent call last):
File "/Users/lifidea/anaconda3/bin/pocket-to-sqlite", line 8, in
sys.exit(cli())
^^^^^
File "/Users/lifidea/anaconda3/lib/python3.11/site-packages/click/core.py", line 1157, in call
return self.main(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/lifidea/anaconda3/lib/python3.11/site-packages/click/core.py", line 1078, in main
rv = self.invoke(ctx)
^^^^^^^^^^^^^^^^
File "/Users/lifidea/anaconda3/lib/python3.11/site-packages/click/core.py", line 1688, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/lifidea/anaconda3/lib/python3.11/site-packages/click/core.py", line 1434, in invoke
return ctx.invoke(self.callback, **ctx.params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/lifidea/anaconda3/lib/python3.11/site-packages/click/core.py", line 783, in invoke
return __callback(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/lifidea/anaconda3/lib/python3.11/site-packages/pocket_to_sqlite/cli.py", line 101, in fetch
utils.save_items(bar, db)
File "/Users/lifidea/anaconda3/lib/python3.11/site-packages/pocket_to_sqlite/utils.py", line 9, in save_items
for item in items:
File "/Users/lifidea/anaconda3/lib/python3.11/site-packages/click/_termui_impl.py", line 344, in generator
for rv in self.iter:
File "/Users/lifidea/anaconda3/lib/python3.11/site-packages/pocket_to_sqlite/utils.py", line 119, in iter
items = list((page["list"] or {}).values())
~~~~^^^^^^^^
KeyError: 'list'

[beardedbritboston]

I came across this same problem recently in a Python app I've been working on; it looks as though within the last year or so the Pocket Retrieve API ( https://getpocket.cdn.mozilla.net/developer/docs/v3/retrieve ) has restricted the maximum page size to 30 (according to the docs), as my app would also throw a similar error when it tried to retrieve my 1000+ item list with a single HTTP request.

My guess is that the fix is to modify the the default page_size in the class utils.py#FetchItems. Hopefully the author will address this and push the fix to PyPi.