- add support for socks proxies
- add rotating proxies
-pnow takesIP:PORTorDOMAIN:PORTwithhttp://,socks5://or nothing (default ishttp) or afilewith a list of proxies (http://orsocks5://or nothing).
- Added more intels (GENERIC_URL, BRACKET_URL, BACKSLASH_URL, HEXENCODED_URL, URLENCODED_URL, B64ENCODED_URL, IPV4, IPV6, EMAIL, MD5, SHA1, SHA256, SHA512, YARA_PARSE, CREDIT_CARD)
- proxy support with
-p, --proxyoption (http proxy only) - minor fixes and pep8 format
- Dropped Python < 3.2 support
- Removed Ninja mode
- Fixed a bug in link parsing
- Fixed Unicode output
- Fixed a bug which caused URLs to be treated as files
- Intel is now associated with the URL where it was found
- Added cloning ability
- Refactored to be modular
- Reuse TCP connection for better performance
- Handle redirect loops
- CSV export support
- Fixed
sitemap.xmlparsing - Improved regex
- fixed some minor bugs
- fixed a bug in domain name parsing
- added --headers option for interactive HTTP headers input
- Added
-voption - Fixed progress animation for Python 2
- Added
developer.facebook.comAPI for Ninja mode
- Added
--stdoutoption - Fixed a bug in
zap()function - Fixed crashing when target is an IP address
- Minor refactor
- Added
--wayback - Fixed progress bar for Python > 3.2
- Added
/core/config.pyfor easy customization --dnsnow saves subdomains insubdomains.txt
- Use of
ThreadPoolExecutorfor x2 speed (for Python > 3.2) - Fixed mishandling of urls starting with
// - Removed a redundant try-except statement
- Evaluate entropy of found keys to avoid false positives
- Added
--keysoption - Fixed a bug related to SSL certificate verification
- Code refactor
- Better identification of external URLs
- Fixed a major bug that made several intel URLs pass under the radar
- Fixed a major bug that caused non-html type content to be marked a crawlable URL
- added
--excludeoption - Better regex and code logic to favor performance
- Fixed a bug that caused dnsdumpster to fail if target was a subdomain
- Fixed a bug that caused a crash if run outside "Photon" directory
- Fixed a bug in file saving (specific to Python 3)
- Added
--timeoutoption - Added
--outputoption - Added
--user-agentoption - Replaced lxml with regex
- Better logic for favoring performance
- Added bigger and separate file for user-agents
- Fixed lot of bugs
- Suppress SSL warnings in MAC
- x100 speed by code optimization
- Simplified code of
exporterplugin
- Added
exporterplugin - Added seamless update ability
- Fixed a bug in update function
- Fixed an issue which caused regular links to be saved in robots.txt
- Simplified
flashfunction - Removed
-nas an alias of--ninja - Added
--only-urlsoption - Refactored code for readability
- Skip saving files if the content is empty
- Introduced plugins
- Added
dnsdumpsterplugin - Fixed non-ascii character handling, again
- 404 pages are now added to
failedlist - Handling exceptions in
jscanner
- Proper handling of null response from
robots.txt&sitemap.xml - Python2 compatibility
- Proper handling of non-ascii chars
- Added ability to specify custom regex pattern
- Display total time taken and average time per request
- Disabled colors on Windows and macOS
- Cross platform file handling
- First stable release