-
Notifications
You must be signed in to change notification settings - Fork 6
Expand file tree
/
Copy pathTODO
More file actions
28 lines (18 loc) · 629 Bytes
/
TODO
File metadata and controls
28 lines (18 loc) · 629 Bytes
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
Refactoring
- (more) testcases
- complete the documentation, publish generated jsdoc
Readability/Filters
- detect if the full article text is present in excerpts
- manage to use the readability dom tree for filtering
Proxy/Server
- cache the rss feed (use etag/since from server or own caching rules)
- support gzip content compression
- support etag caching
- detect images (and maybe other content) and download it locally so that the
proxy can serve it from cache.
- support http and socks proxies for urlopen
Cache
- gzip the cache files
- support database caching
Crawler
- fetch and respect the robots.txt file