Commit Graph

434 Commits (514d6f94ecd5264628d958d6fc73b7df458bb0a0)

Author SHA1 Message Date
Ice3man543 c4428824b6 Misc work on restructuring + adding stuff 2020-12-23 20:46:42 +05:30
Ice3man543 de5f7e6ee6 Moved collaborator to internal 2020-12-22 04:11:07 +05:30
Ice3man543 5cbfa8eaba Misc modifications, cleaning up things 2020-12-22 03:54:55 +05:30
Ice3man543 e1bbb9d93d moved tracefile to pkg/output + misC 2020-12-21 11:58:33 +05:30
Ice3man543 4f5fb2baed Added vhost templating support 2020-12-19 00:10:58 +05:30
Ice3man543 bc14c2db00 Linting issues fix 2020-12-17 23:39:38 +05:30
Ice3man543 15708cb941 Added simple json based http metrics support 2020-12-17 20:33:42 +05:30
Ice3man543 2ae13d845a Max limit on execution of a workflow 2020-12-13 14:17:58 +05:30
Ice3man543 cf2a98b03d Added flag to control workflow sandboxing 2020-12-13 14:04:58 +05:30
Ice3man543 96049a32fa Sandboxed workflows to only run safe commands 2020-12-13 13:31:12 +05:30
bauthard e5d4c7a6d0 dev banner update 2020-11-23 11:58:12 +05:30
Dwi Siswanto 7e933972a4 🔨 Add randomly User-Agent header request 2020-11-22 17:07:40 +07:00
Mzack9999 9c38bd3891 fixing lint errors 2020-11-20 11:12:06 +01:00
Mzack9999 42d8198181 generic bugfix 2020-11-20 09:55:11 +01:00
bauthard d5665081c8 flag updates! 2020-11-19 15:15:48 +05:30
bauthard 9442cfb7a2 Flag updates!
Updated "json-requests" with "include-rr" indicating that JSON response will also include request / response in the output.

Updated "pbar" to "stats" that makes use of new lib "clistats" to display basis stats of the the running scan.
2020-11-19 13:06:43 +05:30
Mzack9999 764738cddc merging dev 2020-11-18 23:54:33 +01:00
Mzack9999 a53be9fbf1
Merge pull request #397 from projectdiscovery/feature-fastdialer
adding fastdialer
2020-11-18 23:49:03 +01:00
Mzack9999 0c04e5caf9 using stderr for stats 2020-11-16 23:31:38 +01:00
Mzack9999 63d92b7726 updating clistat version 2020-11-16 23:00:09 +01:00
Mzack9999 8eea7345bd targets hmap + global rate limit + clistats windows compatibility 2020-11-16 00:40:32 +01:00
Ice3man543 0a760a4a7f Fixed a panic with traceLog and fixed a tengo bug 2020-11-13 01:51:41 +05:30
Mzack9999 48d0b4c1bd adding fastdialer 2020-11-06 03:15:27 +01:00
Ice3man543 0453d6b7f0 Minor UI change 2020-11-01 22:04:55 +05:30
Ice3man543 99bfaf2227 Lint errors fix 2020-11-01 21:58:19 +05:30
Ice3man543 ff3481977a Merge branch 'iceman-progress-bar' of https://github.com/projectdiscovery/nuclei into iceman-progress-bar 2020-11-01 21:40:02 +05:30
Ice3man543 f232383c36 Fixed panic with dialer 2020-11-01 21:37:36 +05:30
Mzack9999 670d4cc8e7
Merge branch 'dev' into iceman-progress-bar 2020-11-01 16:09:32 +01:00
Ice3man543 0069847e63 Reworked progress bar with simpler stats 2020-11-01 19:42:25 +05:30
Mzack9999 ff2a6a551b fixing lint errors 2020-10-30 13:06:05 +01:00
bauthard bf02cb5bff version update for next release 2020-10-24 10:40:20 +05:30
Mzack9999 17827f4ab8 fixing global dealer 2020-10-24 01:27:46 +02:00
Mzack9999 717840dc27 merging master 2020-10-23 12:55:48 +02:00
Mzack9999 4f0dee69db fixing lint 2020-10-23 12:29:49 +02:00
Mzack9999 13b27c5e00 fix lint 2020-10-23 12:19:45 +02:00
Mzack9999 3affe2112c fix lint 2020-10-23 12:17:22 +02:00
Mzack9999 1b8174072b merging master 2020-10-23 12:07:48 +02:00
Mzack9999 7ff170221e merging master 2020-10-23 10:16:17 +02:00
Mzack9999 53e4b45479 adding burp collaborator support 2020-10-23 10:13:34 +02:00
Ice3man543 4aa2d493ca Misc 2020-10-22 16:20:34 +05:30
Ice3man543 4e48a5f147 Added type to specify type of request 2020-10-22 16:16:33 +05:30
Ice3man543 f5435e6c9a Added trace log feature to write execution log 2020-10-22 16:12:16 +05:30
Mzack9999 173b55af92 merging master 2020-10-20 19:21:11 +02:00
Ice3man543 c36b357d7e Fixed linter 2020-10-20 02:18:13 +05:30
Ice3man543 fefb028d2c Added -templates-version flag to list template version 2020-10-20 02:14:44 +05:30
Ice3man543 93946bcac2 Linter fix 2020-10-20 02:02:39 +05:30
Ice3man543 4ec229ef7f Added -no-meta flag to ignore meta 2020-10-20 01:57:38 +05:30
Ice3man543 1d04c06808 Added dynamic field in info key support 2020-10-19 11:37:58 +05:30
Mzack9999 5623fd4b36 poc working implementation 2020-10-18 03:09:24 +02:00
Mzack9999 d5cd01d43b wip 2020-10-17 02:10:47 +02:00
Mzack9999 1fba3b0637 wip 2020-10-16 01:51:57 +02:00
Mzack9999 3397f20dd8 begin of work on nuclei state/project file 2020-10-15 01:49:44 +02:00
Mzack9999 1f2959708b
Merge branch 'master' into read-ignoref-from-cwd 2020-10-13 02:13:04 +02:00
Mzack9999 a1cc52c3ff adding bulk-size 2020-10-12 20:15:21 +02:00
Víctor Zamanillo 5c00615c0d Fixed copylocks: return copies lock value: Result 2020-10-11 11:46:43 +02:00
Víctor Zamanillo b9cc87a361 Fixed maligned 2020-10-11 11:45:48 +02:00
Víctor Zamanillo 0901e37ee5 gofmt 2020-10-11 11:03:57 +02:00
Víctor Zamanillo c50a57ed72 Try to read ignore file from current working directory
Implements #350
2020-10-11 11:02:24 +02:00
Mzack9999 e91fd95e97
Merge branch 'master' into feature-turbo-intruder 2020-10-09 23:13:41 +02:00
Mzack9999 ac710e002d rate-limit rework 2020-10-09 23:11:07 +02:00
Mzack9999 e12003c471 adding stop at first http match cli option 2020-10-06 21:38:44 +02:00
Ice3man543 f26d518a83 Allow comments with # in nuclei-ignore 2020-10-02 15:02:11 +05:30
Víctor Zamanillo d515728bdd Handle data from char device on stdin 2020-09-28 12:50:00 +02:00
Mzack9999 207e78bf57 Merge branch 'rate-limit' of github.com:CasperGN/nuclei into CasperGN-rate-limit 2020-09-24 01:09:41 +02:00
Mzack9999 12c9ca7b12 fixing go mod 2020-09-23 22:38:59 +02:00
Víctor Zamanillo 60005290b1 Initial adoption of golangci-lint for CI 2020-08-25 23:33:20 +02:00
Víctor Zamanillo bcbfc33d26 Removed "Loaded template" in favour of "Loading templates..."
"Loaded template" it's a bit noisy and redundant, a single "Loading templates..." before template paths iteration looks much better.
2020-08-24 08:46:56 +02:00
Víctor Zamanillo a02cb66403 Fixed SIGSEGV if no templates config exists 2020-08-23 21:49:27 +02:00
bauthard a725e61c13 Update config.go 2020-08-24 00:28:59 +05:30
Ice3man543 320f312be0 Added nucleiignore feature 2020-08-24 00:16:18 +05:30
Ice3man543 9cf12c6d9a Don't delete previous nuclei directory 2020-08-23 23:20:16 +05:30
bauthard 2dfd245f54
Merge pull request #213 from Marmelatze/json-requests-dns
add json-requests for DNS
2020-08-13 17:41:42 +05:30
bauthard e22213f208
Merge pull request #219 from manuelbua/normalize-template-load-msg
Centralize template loaded info message, add output coloring
2020-08-10 11:55:06 +05:30
Manuel Bua 06eca0b2ea Fix minor issue where a dangling comma can cause any severity to match 2020-08-07 21:27:58 +02:00
Manuel Bua d752de530b Centralize template loaded info message, add output coloring 2020-08-07 14:30:57 +02:00
Florian Pfitzer 7a1aa770e9 add json-requests for DNS 2020-08-06 06:12:57 +02:00
Manuel Bua f339214f65 Merge branch 'master' into fix-180-support-template-exclusions 2020-08-04 21:43:06 +02:00
Manuel Bua 65d89d6d87 Use "warning" log-level, prevent too many informative messages 2020-08-02 20:06:45 +02:00
Manuel Bua da22532f81 Add support for severity filtering 2020-08-02 18:33:55 +02:00
Manuel Bua 4a355f0fc0 Add support for template exclusions 2020-08-02 15:48:10 +02:00
Manuel Bua c6df7fbd43 Refactor template resolution logic for reusability 2020-08-02 13:49:16 +02:00
bauthard a7fbf5c9e0
version update 2020-08-02 13:44:34 +05:30
Manuel Bua 87dc8bc650 Remove debug code 2020-08-01 23:01:28 +02:00
Manuel Bua a3c3875e38 Better wording in comments 2020-08-01 22:07:08 +02:00
Manuel Bua 63cfd354b9 Use global pipes for capturing, experimental unified rendering 2020-08-01 21:44:14 +02:00
Manuel Bua 29576f9ced Constrain rendering to a specific refresh rate 2020-08-01 15:07:04 +02:00
Manuel Bua 7088c9532e Merge branch 'master' into experimental-progressbar-live-results 2020-07-31 23:37:45 +02:00
Manuel Bua 02238c491b Use manual progressbar rendering to allow syncing with other output
Refactor into an interface to return a no-op impl, avoid the need to
conditionally invoke any of the methods.
2020-07-31 23:36:56 +02:00
Mzack9999 5d0e1b693e no-pbar to pbar 2020-07-31 18:46:23 +02:00
Manuel Bua 058c4ffbbf Experimental live results output with active progressbar
See 333809f3d6 for an early implementation of this.
2020-07-31 17:35:05 +02:00
Manuel Bua 2ebc0cf83e Merge branch 'master' into fix-175-results-highlight 2020-07-29 21:57:44 +02:00
Mzack9999 7edad4bb33 adding -no-pbar option 2020-07-29 20:07:13 +02:00
Manuel Bua 7d22f6cfb4 Merge branch 'master' into fix-175-results-highlight 2020-07-29 01:24:14 +02:00
Manuel Bua f8e52ced4e Add initial coloring support in output results 2020-07-29 00:43:05 +02:00
Mzack9999 db11acd7b2 version bump :) 2020-07-28 20:41:12 +02:00
Mzack9999 43a96b958a making progress bar respect silent flag 2020-07-28 20:39:07 +02:00
Manuel Bua 9d2539f856 Makes stdio capturing global
This dramatically lower chances of reaching max open files limit as it
works with two os.Pipe only, but it may be sub-optimal in some cases
such as with the `-debug` switch because there are no guarded writes
anymore when using `fmt.Fprintf` directly, such as when dumping request
or responses.
2020-07-27 21:35:24 +02:00
Manuel Bua ba75e35a4b Merge branch 'master' into enumeration-progressbar 2020-07-27 20:45:47 +02:00
Manuel Bua 6209b25d9a Ensure an empty progressbar is aborted 2020-07-27 20:39:13 +02:00
Manuel Bua 53b280cf32 Ensure workflows can be run alone as well 2020-07-27 20:38:48 +02:00
Mzack9999 a7c1f43b41 adding speed to workflows 2020-07-27 19:36:40 +02:00
Manuel Bua 8718d52546 Ensure input URLs and requests are present before tracking any progress 2020-07-27 18:47:23 +02:00
Manuel Bua 3916983bdb Merge branch 'master' into enumeration-progressbar 2020-07-27 00:25:36 +02:00
Manuel Bua 06cffee6aa Add support for workflows 2020-07-27 00:00:34 +02:00
Mzack9999 f45e01eda6 multi-matcher correction 2020-07-26 22:07:03 +02:00
Mzack9999 c659d432b3 hacky silent output within workflow 2020-07-26 21:30:03 +02:00
Mzack9999 573088450f adding missing input flag 2020-07-26 21:17:42 +02:00
Mzack9999 8c437fbd40 adding workflow's same directory path search for template variables 2020-07-26 20:14:05 +02:00
Manuel Bua 660c8420c1 Remove unused code 2020-07-26 16:57:19 +02:00
Manuel Bua baa1715c44 Better input sanitization, skip empty lines 2020-07-26 16:56:53 +02:00
Manuel Bua 4d8131c8d8 Add support for DNS requests 2020-07-26 16:36:01 +02:00
Manuel Bua ea6229300d Merge branch 'master' into enumeration-progressbar 2020-07-26 15:46:21 +02:00
Manuel Bua 3cc79c2c49 Properly close file after use 2020-07-26 15:35:26 +02:00
Manuel Bua 32e20b13e6 Use single progressbar, tweak styling 2020-07-26 15:31:31 +02:00
Manuel Bua b33a2b6d16 Update outdated comment 2020-07-25 23:22:09 +02:00
Manuel Bua a9560336f4 Refactoring and unused code removal 2020-07-25 23:13:58 +02:00
Manuel Bua 48cf65b563 Automatically de-duplicate supplied user input 2020-07-25 23:02:24 +02:00
Mzack9999 5eb92abb80
Merge pull request #174 from projectdiscovery/bugfix-engine-rework
engine parallelism fix
2020-07-25 22:48:48 +02:00
Manuel Bua 65d7246b2f Use custom formatter for percentage, ensure fixed string size is used 2020-07-25 22:15:45 +02:00
Manuel Bua d8e69cacf2 Pad bar name with spaces (approx. size due to escape codes) 2020-07-25 21:03:38 +02:00
Manuel Bua bb24061628 Merge branch 'bugfix-engine-rework' into enumeration-progressbar-next 2020-07-25 20:33:01 +02:00
Manuel Bua 436e7223d8 Update output coloring, set a maximum length for template names 2020-07-25 20:29:12 +02:00
Mzack9999 5fa309cb82 2nd race bugfix 2020-07-25 20:11:46 +02:00
Manuel Bua dad381e66e Cleanup pluralization 2020-07-25 19:58:17 +02:00
Manuel Bua 88e683c0b5 Always use a global progress bar, protect input file reading 2020-07-25 15:16:41 +02:00
Manuel Bua 3bfdd0c381 Increment progress instead of altering totals, wrap more std streams 2020-07-25 00:46:18 +02:00
Manuel Bua 8aecbeb821 Experimental support for new parallelism 2020-07-24 22:30:15 +02:00
Wyatt Dahlenburg 6362fad61f Updated runner to ensure relative path was respected in configuration file when using wildcards 2020-07-24 15:29:08 -05:00
Manuel Bua c7d234fe5a Merge branch 'bugfix-engine-rework' into enumeration-progressbar-next 2020-07-24 20:29:04 +02:00
Mzack9999 ab2f96c9e9 more experimental parallelism 2020-07-24 18:12:16 +02:00
Manuel Bua 362fee27a4 Initial update to latest updates 2020-07-23 20:19:19 +02:00
Wyatt Dahlenburg 959711edb0 Support template wildcarding 2020-07-23 13:06:58 -05:00
Manuel Bua 04875a55dd Merge branch 'master' into enumeration-progressbar-next
# Conflicts:
#	v2/internal/runner/runner.go
#	v2/pkg/executor/executer_http.go
2020-07-22 22:28:26 +02:00
Florian Pfitzer b3fb45d381 json-request option for request/response output in JSON matches 2020-07-22 11:17:58 +02:00
Mzack9999 c2433fdb34 merged master 2020-07-20 00:47:04 +02:00
Manuel Bua 838f844837 Better naming 2020-07-19 14:24:43 +02:00
Manuel Bua 0983e8b9fa Ensure path is resolved before using it 2020-07-19 14:04:49 +02:00
Mzack9999 57a496203f code refactor 2020-07-18 21:42:23 +02:00
Manuel Bua 97069afb3c Merge branch 'master' into fix-147-support-multiple-input-templates 2020-07-18 21:27:39 +02:00
Manuel Bua c161a385b0 Do not report per-template empty results 2020-07-18 20:32:00 +02:00
Manuel Bua 0833e21a17 Avoid adding empty array, ensure warning is shown to the user. 2020-07-18 18:55:52 +02:00
Manuel Bua 29cd509809 Merge branch 'master' into fix-147-support-multiple-input-templates 2020-07-17 18:21:40 +02:00
Mzack9999 66713434f8 added in-workflow cookie reuse 2020-07-16 16:32:42 +02:00
Mzack9999 a256a56993 adding in-template cookie reuse 2020-07-16 16:16:26 +02:00
Mzack9999 ef8146cfd5 typo global correction 2020-07-16 10:57:28 +02:00
Mzack9999 457cfe91ba
Merge pull request #142 from projectdiscovery/feature-workflow-improvement
improved workflow logic
2020-07-14 23:16:15 +02:00
bauthard 73832708fd
Update banner.go 2020-07-14 12:49:48 +05:30
Manuel Bua f376a7d9cd Move no-results logic as Workflows will not return any 2020-07-14 00:10:08 +02:00
Manuel Bua 9d7303549b Refactor enumeration driver and streamline input processing 2020-07-14 00:04:19 +02:00
Manuel Bua 54ada7735d Add generic multiStringFlag option flag, update usage string 2020-07-14 00:01:46 +02:00
Manuel Bua e9d27edf88 Fix #148
Include template name in error string when walking a template list.
2020-07-13 19:55:16 +02:00
bauthard 661c813fdc
Update banner.go 2020-07-13 15:55:41 +05:30
Manuel Bua d0174c047c Respect color output user flag, remove unused Progress WaitGroup 2020-07-12 18:09:29 +02:00
Manuel Bua e877d613e4 More clear comment wording 2020-07-11 23:52:45 +02:00
Manuel Bua de82c1617e Remove unused code 2020-07-11 23:50:59 +02:00
Manuel Bua 97901f36b4 Refactor code, add meaningful comments 2020-07-11 22:57:44 +02:00
Manuel Bua 002daadf46 Try avoid using time.After when reading captured output. 2020-07-10 23:42:49 +02:00
Mzack9999 b4bf6cf4ac improved workflow logic 2020-07-10 09:04:38 +02:00
Manuel Bua e5949c8eba Precompute total number of HTTP requests when using multiple templates 2020-07-09 21:21:37 +02:00
Manuel Bua 81eed093d2 Minor refactoring, rename mutex 2020-07-09 21:20:00 +02:00
Manuel Bua cbb8b11784 Use atomic operations to alter and track the progress 2020-07-09 21:18:06 +02:00
Manuel Bua 0ff138a477 Do not use mpb.Progress for logging
This will cause sync issues with very fast output and will defeat the
purpose of logging.

Instead, buffer both stdout/stderr and show their output at the end.
2020-07-09 20:57:24 +02:00
Manuel Bua 6c43aab488 Try use multiple mpb.Progress for distinct stdout/stderr output 2020-07-08 23:13:53 +02:00
Manuel Bua 333809f3d6 Safer stdio capturing 2020-07-08 23:13:05 +02:00
Manuel Bua 96f1f29328 Merge branch 'master' into enumeration-progressbar 2020-07-08 17:33:44 +02:00
Ice3man543 d6fb6bda51 Fixed update template issue 2020-07-08 17:25:29 +05:30
Manuel Bua 32db612f62 Merge branch 'master' into enumeration-progressbar 2020-07-07 22:51:40 +02:00
Manuel Bua bd274cf1d6 Remove unused code 2020-07-07 22:42:34 +02:00
Manuel Bua 9e1b39549f Minor refactoring, track count of aborted requests for better progress 2020-07-07 22:39:43 +02:00
Ice3man543 299a6d5194 Always check when update-templates passed 2020-07-07 18:33:35 +05:30
Ice3man543 5447387e71 Added feature to check for updates daily 2020-07-07 18:24:00 +05:30
bauthard 63b020f693
Update banner.go 2020-07-07 17:53:37 +05:30
bauthard d830294168
Update banner.go 2020-07-07 11:23:58 +05:30
bauthard 257d9685af Fixed error with auto-updates 2020-07-06 12:30:02 +05:30
Manuel Bua 6f894b718a Abort on error, bar will be properly recreated 2020-07-06 00:13:13 +02:00
Manuel Bua d03fbd1932 Encapsulate behavior and clean up 2020-07-05 23:38:58 +02:00
Manuel Bua 6afd949060 Clean up 2020-07-05 23:21:20 +02:00
Manuel Bua d903115634 Use simple average instead of ewma-based, reduce cpu/mem footprint 2020-07-05 22:46:34 +02:00
Manuel Bua 02bf957c13 Better handling of the timeout context 2020-07-05 21:39:04 +02:00
Manuel Bua 683de150bd Remove any completed bar so far 2020-07-05 20:11:53 +02:00
Manuel Bua e59ac01c65 Experimental single progress bar 2020-07-05 17:22:21 +02:00
Manuel Bua 9afd9bc4c2 Refactoring to compute workload in advance 2020-07-05 17:17:04 +02:00
Manuel Bua 6d68b09863 Initial progress bar implementation 2020-07-04 23:00:11 +02:00
Ice3man543 458dbc1b38 v2 update 2020-07-01 16:17:24 +05:30