9efd3f6c5e
scanner/http/crawler: added ExcludePathPatterns opt
...
Option 'ExcludePathPatterns' allows users to specify which paths should
be excluded from the crawl (and which forms to ignore) by passing a
list of patterns (only allows '*' wildcards).
2013-02-12 21:47:12 +02:00
95948b9d7c
msftidy: remove $Revision$
2013-01-03 00:58:09 +01:00
ca890369b1
msftidy: remove $Id$
2013-01-03 00:54:48 +01:00
7795dc58f4
auxiliary/scanner/http/crawler#form_from_url: rescue => rescue URI::Error
2012-11-26 20:54:20 +02:00
c17cffdece
auxiliary/scanner/http: wrapped an exception-prone URL parse in a begin/rescue block
2012-11-26 18:58:06 +02:00
37a9c13c34
updated auxiliary/scanner/http/crawler to accept a callback for each page
2012-11-01 21:20:56 +02:00
aeb691bbee
Massive whitespace cleanup
2012-03-18 00:07:27 -05:00
ceb4888772
Fix up the boilerplate comment to use a better url
2012-02-20 19:40:50 -06:00
a9db05e53b
Fix regular expression
2011-12-10 13:24:58 -06:00
f2057f54a8
De-dup'ed get_link_filter() in the crawler module. Added some comment
...
docs on crawler_process_page(). Nothing exciting.
git-svn-id: file:///home/svn/framework3/trunk@12010 4d416f70-5f16-0410-b530-b9f4589650da
2011-03-17 21:21:21 +00:00
070f48e16a
Work around some weirdness between report_website and report_host not accepting hostnames as :host by forcing :host to be the address
...
git-svn-id: file:///home/svn/framework3/trunk@11723 4d416f70-5f16-0410-b530-b9f4589650da
2011-02-08 17:32:37 +00:00
32c26f18f3
style compliance fixes, set test exploits to manual rank, fix s/ranking/rank/ in some exploits
...
git-svn-id: file:///home/svn/framework3/trunk@11039 4d416f70-5f16-0410-b530-b9f4589650da
2010-11-14 19:03:24 +00:00
dc5116f9df
Move the crawler mixin to an auxiliary
...
git-svn-id: file:///home/svn/framework3/trunk@11026 4d416f70-5f16-0410-b530-b9f4589650da
2010-11-13 06:55:19 +00:00
f457ccb8f7
Add the crawler mixin and a sample form extractor crawler
...
git-svn-id: file:///home/svn/framework3/trunk@11025 4d416f70-5f16-0410-b530-b9f4589650da
2010-11-13 06:40:56 +00:00
Tasos Laskos
Christian Mehlmauer
sinn3r
HD Moore
HD Moore
Tod Beardsley
Joshua Drake