Florida scraper

[eabh]

Here is a scraper for Florida. I hope it helps.
Ed

[ajb]

Hey Ed, this is amazing, what a terrible site to parse, heh.

The scraper seems to be choking on two issues:

1. It tries calling split, trim, etc. methods on the undefined object.
2. When the --limit is not set, it calls .split(1,1), which returns an empty array.

You mind taking a look? :)

[eabh]

Hey Adam Thanks for pointing out that --limit might not be supplied. I added a default value for --limit and tested it by passing in an empty object for opts. However I am not able to replicate the issues you described. I tried running with various values for --limit and also with no limit and it would not fail. What data did you use?

[ajb]

Sorry for the delay, I'll try to be a bit more responsive so we can get this solved. Here's what's happening:

rocktop:openrfps-scrapers adamb$ bin/openrfps run scrapers/fl/rfps.coffee 

TypeError: Object 300 has no method 'trim'
  at Request._callback (/Users/adamb/repos/dobtco/openrfps-scrapers/scrapers/fl/rfps.coffee:133:9, <js>:128:58)
  at Request.self.callback (/Users/adamb/repos/dobtco/openrfps-scrapers/node_modules/request/request.js:121:22)
  at Request.EventEmitter.emit (events.js:98:17)
  at Request.<anonymous> (/Users/adamb/repos/dobtco/openrfps-scrapers/node_modules/request/request.js:978:14)
  at Request.EventEmitter.emit (events.js:117:20)
  at IncomingMessage.<anonymous> (/Users/adamb/repos/dobtco/openrfps-scrapers/node_modules/request/request.js:929:12)
  at IncomingMessage.EventEmitter.emit (events.js:117:20)
  at _stream_readable.js:920:16
  at process._tickCallback (node.js:415:13)

[eabh]

The page is essentially a mass of text and there are no obvious hard-and-fast rules as to when a particular element would be included or excluded. I still have not been able to find an example that makes it fail, but I recoded where you identified so if an element label is not found then it will not try to 'trim' the non-existent text.