Commit Graph

151 Commits (2949ef24581d2b2ef642f50d1a3da961805b6638)

Author SHA1 Message Date
Tod Beardsley 7e247e2f29 db migration to convert services info from varchar(65535) to text, and save info as a yaml'ed form in order to preserve funny characters.
git-svn-id: file:///home/svn/framework3/trunk@9633 4d416f70-5f16-0410-b530-b9f4589650da
2010-06-28 22:42:50 +00:00
Tod Beardsley 4953b3b69f If the :fix_services option is used for nmap, actually fix the services, and in addition, skip hosts which only present filtered ports.
git-svn-id: file:///home/svn/framework3/trunk@9585 4d416f70-5f16-0410-b530-b9f4589650da
2010-06-22 22:37:14 +00:00
Tod Beardsley 3591143f3a When importing MSFX data, just report unique collateral once.
git-svn-id: file:///home/svn/framework3/trunk@9584 4d416f70-5f16-0410-b530-b9f4589650da
2010-06-22 20:30:43 +00:00
Tod Beardsley 50c59a9ab1 Skip nmap port imports where the result is unknown and the target is really localhost.
git-svn-id: file:///home/svn/framework3/trunk@9553 4d416f70-5f16-0410-b530-b9f4589650da
2010-06-18 03:03:11 +00:00
Tod Beardsley 9924a8d40e Incorporates a service name map that makes nmap scanning a little more useful for MSFX out of the gate.
git-svn-id: file:///home/svn/framework3/trunk@9536 4d416f70-5f16-0410-b530-b9f4589650da
2010-06-16 18:22:42 +00:00
Tod Beardsley 1b5e35b059 Fixes #2089. Getting rid of zip_requires() in favor of always loading Zip, Dirtmp, and FileUtils.
git-svn-id: file:///home/svn/framework3/trunk@9496 4d416f70-5f16-0410-b530-b9f4589650da
2010-06-11 21:21:59 +00:00
Tod Beardsley d4e6e75f7d Handle loot, tasks, and report times that come from a MSFX ZIP report.
git-svn-id: file:///home/svn/framework3/trunk@9493 4d416f70-5f16-0410-b530-b9f4589650da
2010-06-11 18:56:16 +00:00
Tod Beardsley 6f37ea2aeb Adding a 3rd party zip library (rubyzip by Thomas Sondergaard and Technorama Ltd, released under the Ruby license), and a method to import ZIP reports generated by Metasploit Express (still needs work, but is mildly functional right now).
git-svn-id: file:///home/svn/framework3/trunk@9478 4d416f70-5f16-0410-b530-b9f4589650da
2010-06-10 21:06:06 +00:00
Tod Beardsley d4e1da2fc9 Fixes amap log importing, hopefully once and for all.
git-svn-id: file:///home/svn/framework3/trunk@9454 4d416f70-5f16-0410-b530-b9f4589650da
2010-06-08 22:14:25 +00:00
Tod Beardsley 38674cf62f Implements callbacks for importing data from vulnerability scanners.
git-svn-id: file:///home/svn/framework3/trunk@9452 4d416f70-5f16-0410-b530-b9f4589650da
2010-06-08 19:16:20 +00:00
Tod Beardsley 432284ce5a Handle multiple versions of Metasploit Express XML files.
git-svn-id: file:///home/svn/framework3/trunk@9431 4d416f70-5f16-0410-b530-b9f4589650da
2010-06-04 18:54:50 +00:00
Tod Beardsley c6da645a93 First part of a db import overhaul. Next up: implementing callbacks so the user can follow along with the import to get a sense of where they're at.
git-svn-id: file:///home/svn/framework3/trunk@9426 4d416f70-5f16-0410-b530-b9f4589650da
2010-06-04 14:57:58 +00:00
Tod Beardsley 87ba4a9594 Fixes #1990. Turns out, we were counting on resolved hostnames, and skipping anything with an unresolved IP address.
git-svn-id: file:///home/svn/framework3/trunk@9327 4d416f70-5f16-0410-b530-b9f4589650da
2010-05-20 14:08:29 +00:00
Tod Beardsley 084a6e971c More nessus import fun. NBE files, this time.
git-svn-id: file:///home/svn/framework3/trunk@9297 4d416f70-5f16-0410-b530-b9f4589650da
2010-05-12 23:00:21 +00:00
Tod Beardsley dbbfec125e Adjusts more Nessus import foo.
git-svn-id: file:///home/svn/framework3/trunk@9296 4d416f70-5f16-0410-b530-b9f4589650da
2010-05-12 22:23:40 +00:00
Tod Beardsley 754a939f82 Skip non-IPv4 address in Nessus reports. Namely, this will allow imports that hit a SCAN-ERROR due to homefeed.
git-svn-id: file:///home/svn/framework3/trunk@9292 4d416f70-5f16-0410-b530-b9f4589650da
2010-05-12 18:10:37 +00:00
James Lee 4cfc84a2e4 fix data->info bug in msfe xml import
git-svn-id: file:///home/svn/framework3/trunk@9284 4d416f70-5f16-0410-b530-b9f4589650da
2010-05-11 15:39:24 +00:00
James Lee 2e9d342bf3 fix another missed data->info
git-svn-id: file:///home/svn/framework3/trunk@9275 4d416f70-5f16-0410-b530-b9f4589650da
2010-05-10 23:42:06 +00:00
James Lee afec0407c8 fix nessus and nexpose simplexml imports after the vuln.data->info change
git-svn-id: file:///home/svn/framework3/trunk@9271 4d416f70-5f16-0410-b530-b9f4589650da
2010-05-10 16:16:38 +00:00
James Lee abbd6aeef7 change vulns.data to vulns.info, fixes #1660
git-svn-id: file:///home/svn/framework3/trunk@9265 4d416f70-5f16-0410-b530-b9f4589650da
2010-05-09 23:32:43 +00:00
Tod Beardsley 7d9819a9df Altering the MSFE export format.
git-svn-id: file:///home/svn/framework3/trunk@9243 4d416f70-5f16-0410-b530-b9f4589650da
2010-05-07 21:59:35 +00:00
Tod Beardsley 044d7758d8 Sometimes, imported nmap hosts are all marked as "up," even if they're not, thanks to the "user-set" reason. Since that's not very trustworthy, only import hosts that actually have a port list.
git-svn-id: file:///home/svn/framework3/trunk@9240 4d416f70-5f16-0410-b530-b9f4589650da
2010-05-07 17:35:49 +00:00
Tod Beardsley cb7706f80d Normalizing report names for import.
git-svn-id: file:///home/svn/framework3/trunk@9231 4d416f70-5f16-0410-b530-b9f4589650da
2010-05-05 20:11:03 +00:00
Tod Beardsley 8632146be4 Adds imported file metadata to imported hosts as a "host.imported" note, indicating the source filename, the detected file type, and the imported time.
git-svn-id: file:///home/svn/framework3/trunk@9227 4d416f70-5f16-0410-b530-b9f4589650da
2010-05-05 19:45:48 +00:00
HD Moore df9ec8a08c Updates to the nessus parser. Closes #1715
git-svn-id: file:///home/svn/framework3/trunk@9211 4d416f70-5f16-0410-b530-b9f4589650da
2010-05-03 01:49:00 +00:00
HD Moore 59a0277ff5 Correct syntax
git-svn-id: file:///home/svn/framework3/trunk@9210 4d416f70-5f16-0410-b530-b9f4589650da
2010-05-03 01:19:36 +00:00
HD Moore c8b9edd2df Change 'r' to 'rb' read mode, will solve some encoding issues
git-svn-id: file:///home/svn/framework3/trunk@9209 4d416f70-5f16-0410-b530-b9f4589650da
2010-05-03 01:17:20 +00:00
HD Moore b10d68f3f9 Fixes #1791. Apply patch from jduck to fix bad returns from within proc
git-svn-id: file:///home/svn/framework3/trunk@9208 4d416f70-5f16-0410-b530-b9f4589650da
2010-05-03 01:03:49 +00:00
HD Moore 74e64c12fd Skip port-0 endpoints for now
git-svn-id: file:///home/svn/framework3/trunk@9207 4d416f70-5f16-0410-b530-b9f4589650da
2010-05-02 23:51:54 +00:00
HD Moore 7d737ccfba Remove certainty from service.info for now
git-svn-id: file:///home/svn/framework3/trunk@9206 4d416f70-5f16-0410-b530-b9f4589650da
2010-05-02 23:50:41 +00:00
HD Moore aea08c56b0 Put colons between each octet of the imported mac address
git-svn-id: file:///home/svn/framework3/trunk@9205 4d416f70-5f16-0410-b530-b9f4589650da
2010-05-02 23:43:41 +00:00
HD Moore 94d67d57f6 Append to the array, dont reset it to an int
git-svn-id: file:///home/svn/framework3/trunk@9204 4d416f70-5f16-0410-b530-b9f4589650da
2010-05-02 23:13:21 +00:00
James Lee bbc9c14b1e put hosts into the right workspace, change os_vendor back to :vendor
git-svn-id: file:///home/svn/framework3/trunk@9203 4d416f70-5f16-0410-b530-b9f4589650da
2010-05-02 22:23:43 +00:00
James Lee 1ab399d0ea use a stream parser to import NeXpose raw xml, short-circuit find_or_create_ref to avoid going to the task queue when possible
git-svn-id: file:///home/svn/framework3/trunk@9199 4d416f70-5f16-0410-b530-b9f4589650da
2010-05-02 19:16:52 +00:00
HD Moore bd928017de Use gsub over tr to handle binary strings better
git-svn-id: file:///home/svn/framework3/trunk@9157 4d416f70-5f16-0410-b530-b9f4589650da
2010-04-27 14:46:00 +00:00
Tod Beardsley 111f105117 Handle importing timestamps from Metasploit Express reports.
git-svn-id: file:///home/svn/framework3/trunk@9149 4d416f70-5f16-0410-b530-b9f4589650da
2010-04-26 21:51:29 +00:00
Tod Beardsley 3fa96688f2 Moved the common rexmlifier to its own function for consistency. Ensure that nulls stay null for MSFE import.
git-svn-id: file:///home/svn/framework3/trunk@9146 4d416f70-5f16-0410-b530-b9f4589650da
2010-04-26 20:25:42 +00:00
Tod Beardsley 1b910c1862 Expose a means to import MSFE reports to the user.
git-svn-id: file:///home/svn/framework3/trunk@9144 4d416f70-5f16-0410-b530-b9f4589650da
2010-04-26 19:10:40 +00:00
Tod Beardsley fab458579e Implements methods to import reports from Metasploit Express.
git-svn-id: file:///home/svn/framework3/trunk@9141 4d416f70-5f16-0410-b530-b9f4589650da
2010-04-26 18:40:49 +00:00
James Lee 016ec84531 fix auth lookups on mysql ('==' != '=')
git-svn-id: file:///home/svn/framework3/trunk@9126 4d416f70-5f16-0410-b530-b9f4589650da
2010-04-24 15:53:20 +00:00
HD Moore dff1132e08 Remove stderr
git-svn-id: file:///home/svn/framework3/trunk@9084 4d416f70-5f16-0410-b530-b9f4589650da
2010-04-15 15:29:28 +00:00
James Lee 086f82630a don't queue a task from within a task; error out earlier when we don't have a host
git-svn-id: file:///home/svn/framework3/trunk@9081 4d416f70-5f16-0410-b530-b9f4589650da
2010-04-15 09:00:16 +00:00
James Lee e1639ce853 truncate host and service info to the size of the database field, see #912
git-svn-id: file:///home/svn/framework3/trunk@9064 4d416f70-5f16-0410-b530-b9f4589650da
2010-04-13 21:15:15 +00:00
HD Moore 36836423d9 Add a warning, cosmetic comment to asm
git-svn-id: file:///home/svn/framework3/trunk@9037 4d416f70-5f16-0410-b530-b9f4589650da
2010-04-07 20:51:05 +00:00
HD Moore 724f980842 Make auth reports critical by default
git-svn-id: file:///home/svn/framework3/trunk@9022 4d416f70-5f16-0410-b530-b9f4589650da
2010-04-06 00:04:52 +00:00
HD Moore 987757246f Speed up the queue processing a little
git-svn-id: file:///home/svn/framework3/trunk@9019 4d416f70-5f16-0410-b530-b9f4589650da
2010-04-05 20:34:41 +00:00
HD Moore ca5963fbc7 Check for the host first
git-svn-id: file:///home/svn/framework3/trunk@9017 4d416f70-5f16-0410-b530-b9f4589650da
2010-04-05 19:58:18 +00:00
HD Moore 97026edee6 Aggressively update the host.updated_at during report_* calls
git-svn-id: file:///home/svn/framework3/trunk@9016 4d416f70-5f16-0410-b530-b9f4589650da
2010-04-05 19:38:51 +00:00
HD Moore ddc98a65a1 Support importing raw IP lists as well
git-svn-id: file:///home/svn/framework3/trunk@8950 4d416f70-5f16-0410-b530-b9f4589650da
2010-03-28 23:07:52 +00:00
HD Moore 09dd8c1fcc Adds portlist_to_portspec and portspec_to_portlist. Merges in Qualys XML support from Sertan Kolat
git-svn-id: file:///home/svn/framework3/trunk@8949 4d416f70-5f16-0410-b530-b9f4589650da
2010-03-28 23:02:28 +00:00