Commit Graph

1334 Commits (6e71313d2b43bebda46946f8a204a5842708727a)

Author SHA1 Message Date
Sandeep Singh 3b68c29f48
Merge pull request #1288 from projectdiscovery/dynamic-value-reuse-http
Reusing dynamically extracted values as iterators in http request
2021-12-02 16:27:59 +05:30
mzack c807438ecd fixing memory allocation for boolean pointer 2021-12-02 11:19:37 +01:00
LuitelSamikshya 6d5146e540 validate flag updates 2021-12-01 10:35:18 -06:00
GitHub Action a9f6f04394 Auto Generate Syntax Docs + JSONSchema [Tue Nov 30 17:17:46 UTC 2021] 🤖 2021-11-30 17:17:46 +00:00
Ice3man543 c17aba8646 Misc fixes to part definitions 2021-11-30 22:41:02 +05:30
Sajad Parra 5b99921d75 add unit and integration tests for dsl variable #555 2021-11-30 20:20:43 +05:30
Sajad Parra 10e5595980 Merge branch 'dev' into dsl-variable-support 2021-11-30 18:41:18 +05:30
Sajad Parra de236379a1 remove stop-at-first-match info log #1188 2021-11-30 17:22:39 +05:30
Ice3man543 72a387c40a Merge from dev 2021-11-30 16:55:09 +05:30
Ice3man543 847e9d7c44 Misc changes to fix testa and lint 2021-11-30 16:26:29 +05:30
Ice3man543 eb7c704d36 Merging from dev 2021-11-30 16:23:39 +05:30
Sandeep Singh be66166b9d
Merge pull request #1282 from projectdiscovery/network-vars
Added additional variables for network + simplified logic
2021-11-30 12:10:26 +05:30
sandeep 684f332599 fix: {{Hostname}} to {{Host}} in test 2021-11-30 12:04:47 +05:30
Ice3man543 65a1858f94 fix #1303: speed regression due to missing goroutine in executer
Fixed speed regression introduced in dev due to missing go() statement when executing template input
2021-11-30 00:17:52 +05:30
mzack 2140ffa382 Adding stop-resume support 2021-11-29 14:38:45 +01:00
Sajad Parra a7ecadf189 add template level stop-at-first-match to workflows 2021-11-29 18:06:25 +05:30
Sajad Parra f60e93aae1 add template level stop at first match option 2021-11-29 16:01:06 +05:30
mzack a631262d91 Merge branch 'dev' into research-aws-signing 2021-11-29 09:36:12 +01:00
Sajad Parra d97aee01c3 Merge branch 'dev' of https://github.com/projectdiscovery/nuclei into dsl-variable-support 2021-11-29 13:36:09 +05:30
Sajad Parra 5deb454a81 merge Hostname variable to payloads in network request 2021-11-29 13:26:03 +05:30
GitHub Action 345a5a3de5 Auto Generate Syntax Docs + JSONSchema [Mon Nov 29 06:49:56 UTC 2021] 🤖 2021-11-29 06:49:56 +00:00
Sandeep Singh 95f31090dc
Merge pull request #1292 from projectdiscovery/improvements
Small refactorings and linter driven improvements
2021-11-29 12:18:28 +05:30
sandeep 5a1c7a62b2 missing goimports 2021-11-28 04:55:18 +05:30
Sandeep Singh 670f0d6775
Merge branch 'dev' into network-vars 2021-11-28 04:42:08 +05:30
LuitelSamikshya b3805999f3
Unsafe flag with base template (#1279)
* unsafe flag with base template
2021-11-28 04:40:27 +05:30
forgedhallpass c61ec5f673 feat: Improve DSL function UX #1295 2021-11-26 17:14:25 +02:00
Ice3man dfe284664c
Fixed a crash with http module (#1285) 2021-11-26 18:51:02 +05:30
mzack a3319930c0 code refactor + request dump fix
Fixes indirectly #844
2021-11-26 13:49:12 +01:00
Ice3man543 c720354be2 Added part definition information to docs + misc 2021-11-26 16:23:54 +05:30
forgedhallpass 5eca474c5e refactor(CR): better way of writing switch statement 2021-11-26 11:38:09 +02:00
forgedhallpass 7e22d70ded refactor/documentation: typos and grammatical errors 2021-11-25 18:54:16 +02:00
forgedhallpass ec6889931d refactor: linter driven fixes
* x = x + ""  => x += ""
* pre-allocating slice with known size
* added t.Helper() methods in test helpers
* complex if-else conditions replaced by switches
* errors should be checked using error.Is() instead of ==
* function parameter should start with lower case letter
* removed unnecessary type definition
* variable/label naming convention: camelCase instead of snake_case
2021-11-25 17:57:22 +02:00
forgedhallpass fdaa8e4539 refactor: removed redundant type conversion 2021-11-25 17:18:54 +02:00
forgedhallpass 47340f06b0 refactor: uniformly sorted imports 2021-11-25 17:09:20 +02:00
forgedhallpass 3fd1f57b96 refactor: godoc and comment uniformization
Adding space after // and before the godoc/comment
2021-11-25 17:03:56 +02:00
forgedhallpass c8d009654c fix: Receiver mismatch warnings 2021-11-25 16:57:43 +02:00
forgedhallpass bebe5cbcfd refactor: Remove redundant character escapes from regexes 2021-11-25 16:24:37 +02:00
forgedhallpass fdd22ab668 refactor: Wrap errors using %w in fmt.Errorf
see:
 * https://github.com/xxpxxxxp/intellij-plugin-golangci-lint/blob/master/explanation/goerr113.md
 * https://go.dev/blog/go1.13-errors#wrapping-errors-with-w
2021-11-25 16:24:37 +02:00
Ice3man543 caaa5c6594 Automatically generate docs for enum values 2021-11-25 19:34:01 +05:30
forgedhallpass 4bccb6cf8a fix: File and directory creation permission changes
Directories: 0755 (5 - group and other can read cd into the directory and read it's content)
Files: 0644 (4 - group and other can only read the created files)
Tests files: 0777
2021-11-25 14:37:57 +02:00
Sajad Parra 7e9272776d add variable support to dsl, remove dynamicValues from request struct 2021-11-25 16:19:42 +05:30
Ice3man543 f6072e9a95 Updating name of variable 2021-11-24 22:44:43 +05:30
Ice3man543 393babe3c3 Made iterate of values controllable with iterate-all-values flag in http 2021-11-24 22:40:17 +05:30
Ice3man543 273233bb81 Fixed a bug with mergemanymaps + misc lint fixes 2021-11-24 21:56:55 +05:30
Ice3man543 ef5b476c6d Reusing dynamically extracted values as iterators in http request
This PR adds the support in http module to iterate over the dynamically extracted data from extractors
and use it in other requests. This allows nuclei to follow links on pages, do operations with
multiple versions of the same extracted value, etc.
2021-11-24 21:08:08 +05:30
Ice3man543 a908a1515a Fixed example docs 2021-11-23 13:17:19 +05:30
Ice3man543 44e304179a Fixed a linter error 2021-11-23 13:15:24 +05:30
Ice3man543 831114bdbd Added default fields for DNS requests 2021-11-23 13:09:22 +05:30
Ice3man 1851e37aef
Merge pull request #1273 from projectdiscovery/fixed-missing-ip
fix #1220: no ip returned for dialers
2021-11-23 10:49:51 +05:30
Ice3man543 6c819d7917 Added additional variables for network + simplified logic 2021-11-23 10:44:31 +05:30
Ice3man 1581c96e4e
Added matched-status flag + template-path and url to output (#1272)
* Added matched-status flag + template-path and url to output
2021-11-22 17:53:25 +05:30
Ice3man543 ba67f8c8fe fix #1220: no ip returned for dialers 2021-11-22 09:51:13 +05:30
Mzack9999 ca9676f52e
Adding support for clustering within workflow (#1255)
* Adding support for clustering within workflow
2021-11-22 04:49:53 +05:30
Ice3man543 bdf1c2010b Fixed jsonschema for matchertype missing String() 2021-11-20 19:50:18 +05:30
Ice3man543 66dacccfb4 Fixed matcher type integer issue 2021-11-20 19:47:05 +05:30
Sajad f74ff3fc49
Tag based struct validation (#1256)
* Added tag based struct validation
2021-11-20 13:25:27 +05:30
mzack ed55de71d9 fixing internal normalized value 2021-11-20 02:26:16 +01:00
GitHub Action b8246ab8e5 Auto Generate Syntax Docs + JSONSchema [Fri Nov 19 10:55:27 UTC 2021] 🤖 2021-11-19 10:55:27 +00:00
LuitelSamikshya 4b8ec29d8d
struct to enums changes for Matchers (#1246)
* struct to enums changes for Matchers
2021-11-19 16:24:09 +05:30
forgedhallpass 09eba6c0cf
feat: In case of binary data, show a hexadecimal view as well #1080 (#1266)
Highlight the longest occurrences when there are matches that are substrings of each other
2021-11-19 15:45:43 +05:30
mzack 71d4e5318a . 2021-11-18 22:28:10 +01:00
mzack 359eb7c3d2 making iota zero based 2021-11-18 21:58:32 +01:00
mzack bdffa373cf solving linting issues 2021-11-18 21:54:24 +01:00
mzack b42f0d32ea Merge branch 'dev' into research-aws-signing 2021-11-18 21:50:49 +01:00
mzack ddb07ebb75 adding support for aws file credential 2021-11-18 21:44:58 +01:00
GitHub Action 5a0f483cd3 Auto Generate Syntax Docs + JSONSchema [Thu Nov 18 20:12:46 UTC 2021] 🤖 2021-11-18 20:12:46 +00:00
LuitelSamikshya 2856e7e247
Extractor + Headless Actions structures to enums (#1217)
* enum support for extractor
2021-11-19 01:41:10 +05:30
GitHub Action ccb588f383 Auto Generate Syntax Docs + JSONSchema [Thu Nov 18 13:53:42 UTC 2021] 🤖 2021-11-18 13:53:42 +00:00
Mzack9999 7f5f791e23
Adding dns trace support in dns templates (#1236)
* Adding dns trace support in dns templates + minor refactoring
2021-11-18 19:22:11 +05:30
LuitelSamikshya d078b72381
enum changes for http method (#1234)
* enum changes for http method
2021-11-18 19:20:21 +05:30
GitHub Action 25189c3ae7 Auto Generate Syntax Docs + JSONSchema [Thu Nov 18 13:50:07 UTC 2021] 🤖 2021-11-18 13:50:07 +00:00
LuitelSamikshya 64a93a4570
enum changes for network type (#1233)
* enum changes for network type
2021-11-18 19:18:47 +05:30
LuitelSamikshya 4ff90c1373
struct to enum changes for Dns Type (#1245)
* struct to enum changes for Dns Type
2021-11-18 19:17:34 +05:30
mzack 38ff8f75b1 adding signature syntax validation 2021-11-17 01:28:35 +01:00
mzack 0379afc748 Merge branch 'dev' into research-aws-signing 2021-11-17 00:03:00 +01:00
Ice3man eaa0d37065
feat #1092: Validate binary values + precompile them as well (#1213)
* Added validation for binary values + precompile them

* Changed name of the binary matcher field

Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2021-11-17 02:04:27 +05:30
sandeep f73b20e415 Merge branch 'dev' of https://github.com/projectdiscovery/nuclei into research-aws-signing 2021-11-17 02:02:07 +05:30
Ice3man 50a816fce9
Fixed a crash with uninitialized interactsh client (#1251)
* Fixed a crash with uninitialized interactsh client
2021-11-16 20:02:39 +05:30
Ice3man543 cc33366acb fixed a conditon with workflow type switch 2021-11-14 15:30:28 +05:30
mzack eb61c519c3 converting to post-processor prototype 2021-11-13 03:17:05 +01:00
mzack e517797cfa moving aws signing logic to helper library 2021-11-13 02:13:48 +01:00
mzack 34889d50f8 correcting variable name 2021-11-12 19:58:12 +01:00
mzack 882a156b63 Merge branch 'dev' into research-aws-signing 2021-11-12 19:55:35 +01:00
mzack 041361c45e Adding aws sign prototype 2021-11-12 19:29:45 +01:00
GitHub Action dc0c568cb8 Auto Generate Syntax Docs + JSONSchema [Thu Nov 11 23:16:47 UTC 2021] 🤖 2021-11-11 23:16:47 +00:00
Ice3man543 cdb08e0879 misc fixes to websocket 2021-11-12 04:44:02 +05:30
Ice3man543 90a0502b60 Misc fixes to default part 2021-11-11 17:30:25 +05:30
Ice3man543 c1a35b3ff9 Merge branch 'dev' of https://github.com/projectdiscovery/nuclei into more-protocols 2021-11-11 17:21:25 +05:30
sullo 1d74f6ada2
Typo (#1242) 2021-11-10 23:25:22 +05:30
Mzack9999 ac75d9aa9b
Improving error handling in client certificate library (#1237) 2021-11-10 22:42:49 +05:30
Mzack9999 09b5fb11e8
Better error handling for return value of helper http library (#1239) 2021-11-10 22:41:42 +05:30
mzack 56b7d78fed Fixing http test using local http mock server 2021-11-10 18:04:53 +01:00
LuitelSamikshya 0e46d3e041
feat: Checking socks5 proxy before launching a scan #1001 (#1225)
* Proxy validation and list input support

Co-authored-by: Sajad Parra <parrasajad@gmail.com>
Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2021-11-10 21:30:03 +05:30
Sandeep Singh 66074a1842
Merge pull request #1232 from projectdiscovery/fix-redirect-response-bug
fix #1173: perform matching on all redirect responses instead of final
2021-11-10 17:38:35 +05:30
Sandeep Singh f78ff42dbe
Merge branch 'dev' into more-protocols 2021-11-09 18:27:13 +05:30
Ice3man543 9b364080ea Fixed some edge cases with status codes in redirect chains 2021-11-09 17:55:42 +05:30
mzack 93060ec0e3 adding tests 2021-11-09 08:50:18 +01:00
Ice3man543 a9f586369a Misc fixes to request normalization 2021-11-09 06:20:10 +05:30
Ice3man543 155b8cfed9 fix #1173: perform matching on all redirect responses instead of final 2021-11-09 06:00:30 +05:30
mzack 9675efa680 Adding support for custom headers via CLI in raw http requests 2021-11-08 19:33:54 +01:00
Sandeep Singh 952a821c6c
Merge pull request #1208 from projectdiscovery/colored_hexdump
Enhance hexdump content highlighting
2021-11-08 18:30:00 +05:30
Ice3man543 5e6b6c6b14 Show errors on invalid URL typo 2021-11-08 17:56:14 +05:30
Ice3man543 7d0529aaf7 Fixed gzip encoding bug + added test case 2021-11-08 17:39:08 +05:30
Ice3man543 88a296c9a7 Adding gzip encoding helpers 2021-11-08 16:24:47 +05:30
Ice3man543 d442c51c1a Changed input to target in core 2021-11-08 16:14:47 +05:30
Ice3man543 ce7534112a Fixed linter issues 2021-11-08 16:10:04 +05:30
Ice3man543 d772dedef1 Make default part for new protocols to response 2021-11-08 16:01:45 +05:30
Ice3man543 213853c45d Merge from dev 2021-11-08 15:40:18 +05:30
Sandeep Singh 3c53e262e3
Merge pull request #1219 from projectdiscovery/uniq-interact
Unique Interactsh URL
2021-11-06 03:33:09 +05:30
sandeep 89c6e76772 Revert "feat: Checking socks5 proxy before launching a scan #1001 (#1169)"
This reverts commit c125df4ef6.
2021-11-05 20:09:00 +05:30
Sajad Parra 6d0d3e1c35 add unique check to test case 2021-11-05 20:00:46 +05:30
LuitelSamikshya c125df4ef6
feat: Checking socks5 proxy before launching a scan #1001 (#1169)
* "#issue1001"

* changes for #issue1001

* minor changes

* minor

* flag consolidation and proxy file #issue1001

* readme changes

* review changes

* enviroment variable changes

* review comment changes

* review changes

* removed commented out code
2021-11-05 09:21:52 -05:00
Ice3man543 e8197f127f Fixed rmeote url loader test cases 2021-11-05 17:24:23 +05:30
Ice3man543 1c360e0344 Fixed DSL test 2021-11-05 17:04:42 +05:30
Ice3man543 0a09b9e451 Added test + misc 2021-11-05 16:59:24 +05:30
Sajad Parra 4d8eaad0a3 add unit test for unique interactsh url #1068 2021-11-05 15:27:49 +05:30
Ice3man543 8ad3ebcd05 Made code changes as per review comments 2021-11-05 03:01:41 +05:30
Sajad Parra 41393fc09d unique payload per interactsh placeholder #1068 2021-11-04 17:13:47 +05:30
Ice3man543 f3675d547a URL parsing addition for websocket URLs 2021-11-04 03:02:29 +05:30
Ice3man543 12321c23af Splitting big function into small 2021-11-04 02:56:59 +05:30
Ice3man543 53164c3f3e Misc linter related changes 2021-11-04 02:44:47 +05:30
Ice3man543 a60b10afca Added an enum for attackType 2021-11-04 02:41:56 +05:30
Ice3man543 a7c8d0473c Removed duplicate attackType logic + move attackType to generators 2021-11-04 02:28:48 +05:30
Ice3man543 91a7b4df6a Validate opcode before proceeding with websocket 2021-11-03 20:08:11 +05:30
Ice3man543 645ae30a47 Moved to an enum for TemplateType in protocols 2021-11-03 19:53:45 +05:30
Ice3man543 390ca8b3c6 Merge from dev 2021-11-03 18:58:00 +05:30
Sandeep Singh 0f897a3977
Merge pull request #1186 from projectdiscovery/protocol-types
Added new type and exclude-type flag
2021-11-03 18:47:26 +05:30
Ice3man543 4a0229c13d Websocket protocol rename 2021-11-03 18:36:54 +05:30
Ice3man543 956fb9296c fix merge conflict 2021-11-03 17:20:03 +05:30
Ice3man543 47949c0b52 Use separate type enum for protocol types 2021-11-03 17:18:35 +05:30
Ice3man543 cf7628c450 Misc changes according to review 2021-11-03 02:34:48 +05:30
Ice3man543 b3162decff Merge branch 'engine-execution' of https://github.com/projectdiscovery/nuclei into more-protocols 2021-11-03 02:24:00 +05:30
Ice3man543 bdb415b0c7 Misc changes as per review 2021-11-03 02:23:48 +05:30
Ice3man c2df13ea22
Merge pull request #1185 from projectdiscovery/dns-variables
Added more variables for DNS requests
2021-11-02 17:54:45 +05:30
Ice3man 09cad2557c
Merge pull request #1123 from EndPositive/remote-template-workflow-lists
Remote template workflow lists
2021-11-02 16:12:29 +05:30
Ice3man 191797380e
bug: Bug in URL parsing for unsafe templates #830
Fixed raw request path not correct with unsafe
2021-11-02 10:42:59 +02:00
forgedhallpass 8f6280dc9d refactor: In case of binary data, show a hexadecimal view as well #1080
* small enhancements with regards to dumping responses
2021-11-01 20:45:54 +02:00
forgedhallpass b477508521 feat: In case of binary data, show a hexadecimal view as well #1080
* the ASCII column in the hex dump represents non-printable ASCII characters with a "." character, so in order to enable proper highlighting, those characters has to be replaced in the generated regex as well
2021-11-01 20:44:55 +02:00
Ice3man543 f8c6f0ba64 Added debug for SSL 2021-11-01 18:02:45 +05:30
Ice3man543 bb05be7b95 Added integration tests for websocket + misc fixes 2021-11-01 15:47:20 +05:30
forgedhallpass b91166a034 Merge remote-tracking branch 'origin/dev' into colored_hexdump 2021-11-01 11:57:45 +02:00
GitHub Action e1c39f255c Auto Generate Syntax Docs + JSONSchema [Mon Nov 1 09:46:34 UTC 2021] 🤖 2021-11-01 09:46:34 +00:00
Sandeep Singh 1863e8f76a
Merge pull request #1130 from zerodivisi0n/feature/case-insensitive-match
Add case-insensitive option to template
2021-11-01 15:15:22 +05:30
Ice3man 331ae0f03b
Merge pull request #1171 from kchason/client-cert-auth
Add Support for Client Certificate Authentication
2021-10-31 02:08:18 +05:30
forgedhallpass 38f2cf245e feat: In case of binary data, show a hexadecimal view as well #1080
* added Compact hex view to the output if the -vv flag is provided
2021-10-30 16:41:10 +03:00
Alexey Zhuchkov bccc8e921b Add test for output 2021-10-30 15:04:16 +03:00
Alexey Zhuchkov b8ebbc27f5 Use io.WriteCloser in output writer 2021-10-30 14:28:30 +03:00
Alexey Zhuchkov cd2db280bf Move output mutex to fileWriter 2021-10-30 14:28:30 +03:00
Alexey Zhuchkov 1eb0378952 Unwrap errors in json log output 2021-10-30 14:28:30 +03:00
Alexey Zhuchkov 463c1c0142 Use template path in output request 2021-10-30 14:28:30 +03:00