Skip to content

Commit 6de2a2f

Browse files
committed
Updated Scraper Reference (markdown)
1 parent a004029 commit 6de2a2f

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

Scraper-Reference.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -65,6 +65,10 @@ Configuration is done via class attributes and divided into three main categorie
6565
* `root_path` [String] **(inherited)**
6666
The path from the `base_url` of the root URL.
6767

68+
* `initial_paths` [Array] **(inherited)**
69+
A list of paths (from the `base_url`) to add to the initial queue. Useful for scraping isolated documents.
70+
Defaults to `[]`. _(Note: the `root_path` is added to the array at runtime.)_
71+
6872
* `dir` [String] **(required, `FileScraper` only)**
6973
The absolute path where the files are located on the local filesystem.
7074
_Note: `FileScraper` works exactly like `UrlScraper` (manipulating the same kind of URLs) except that it substitutes `base_url` with `dir` in order to read files instead of making HTTP requests._

0 commit comments

Comments
 (0)