Commit Graph

1686 Commits (0682b485d01a412a0d8639c804786cffa1bb00f6)

Author SHA1 Message Date
forgedhallpass 7e22d70ded refactor/documentation: typos and grammatical errors 2021-11-25 18:54:16 +02:00
forgedhallpass ec6889931d refactor: linter driven fixes
* x = x + ""  => x += ""
* pre-allocating slice with known size
* added t.Helper() methods in test helpers
* complex if-else conditions replaced by switches
* errors should be checked using error.Is() instead of ==
* function parameter should start with lower case letter
* removed unnecessary type definition
* variable/label naming convention: camelCase instead of snake_case
2021-11-25 17:57:22 +02:00
forgedhallpass fdaa8e4539 refactor: removed redundant type conversion 2021-11-25 17:18:54 +02:00
forgedhallpass 47340f06b0 refactor: uniformly sorted imports 2021-11-25 17:09:20 +02:00
forgedhallpass 3fd1f57b96 refactor: godoc and comment uniformization
Adding space after // and before the godoc/comment
2021-11-25 17:03:56 +02:00
forgedhallpass c8d009654c fix: Receiver mismatch warnings 2021-11-25 16:57:43 +02:00
forgedhallpass bebe5cbcfd refactor: Remove redundant character escapes from regexes 2021-11-25 16:24:37 +02:00
forgedhallpass fdd22ab668 refactor: Wrap errors using %w in fmt.Errorf
see:
 * https://github.com/xxpxxxxp/intellij-plugin-golangci-lint/blob/master/explanation/goerr113.md
 * https://go.dev/blog/go1.13-errors#wrapping-errors-with-w
2021-11-25 16:24:37 +02:00
forgedhallpass f9c214a66f refactor: update logic refactor to make it more testable
Introduced logic to test for zip slip (path traversal)
2021-11-25 16:24:28 +02:00
Ice3man543 caaa5c6594 Automatically generate docs for enum values 2021-11-25 19:34:01 +05:30
forgedhallpass 4bccb6cf8a fix: File and directory creation permission changes
Directories: 0755 (5 - group and other can read cd into the directory and read it's content)
Files: 0644 (4 - group and other can only read the created files)
Tests files: 0777
2021-11-25 14:37:57 +02:00
Sajad Parra 7e9272776d add variable support to dsl, remove dynamicValues from request struct 2021-11-25 16:19:42 +05:30
Ice3man543 f6072e9a95 Updating name of variable 2021-11-24 22:44:43 +05:30
Ice3man543 393babe3c3 Made iterate of values controllable with iterate-all-values flag in http 2021-11-24 22:40:17 +05:30
Ice3man543 273233bb81 Fixed a bug with mergemanymaps + misc lint fixes 2021-11-24 21:56:55 +05:30
Ice3man543 ef5b476c6d Reusing dynamically extracted values as iterators in http request
This PR adds the support in http module to iterate over the dynamically extracted data from extractors
and use it in other requests. This allows nuclei to follow links on pages, do operations with
multiple versions of the same extracted value, etc.
2021-11-24 21:08:08 +05:30
Ice3man543 a908a1515a Fixed example docs 2021-11-23 13:17:19 +05:30
Ice3man543 44e304179a Fixed a linter error 2021-11-23 13:15:24 +05:30
Ice3man543 831114bdbd Added default fields for DNS requests 2021-11-23 13:09:22 +05:30
Ice3man 1851e37aef
Merge pull request #1273 from projectdiscovery/fixed-missing-ip
fix #1220: no ip returned for dialers
2021-11-23 10:49:51 +05:30
Ice3man543 6c819d7917 Added additional variables for network + simplified logic 2021-11-23 10:44:31 +05:30
Ice3man 1581c96e4e
Added matched-status flag + template-path and url to output (#1272)
* Added matched-status flag + template-path and url to output
2021-11-22 17:53:25 +05:30
Ice3man543 ba67f8c8fe fix #1220: no ip returned for dialers 2021-11-22 09:51:13 +05:30
Mzack9999 ca9676f52e
Adding support for clustering within workflow (#1255)
* Adding support for clustering within workflow
2021-11-22 04:49:53 +05:30
Ice3man543 bdf1c2010b Fixed jsonschema for matchertype missing String() 2021-11-20 19:50:18 +05:30
Ice3man543 66dacccfb4 Fixed matcher type integer issue 2021-11-20 19:47:05 +05:30
Sajad f74ff3fc49
Tag based struct validation (#1256)
* Added tag based struct validation
2021-11-20 13:25:27 +05:30
mzack ed55de71d9 fixing internal normalized value 2021-11-20 02:26:16 +01:00
GitHub Action b8246ab8e5 Auto Generate Syntax Docs + JSONSchema [Fri Nov 19 10:55:27 UTC 2021] 🤖 2021-11-19 10:55:27 +00:00
LuitelSamikshya 4b8ec29d8d
struct to enums changes for Matchers (#1246)
* struct to enums changes for Matchers
2021-11-19 16:24:09 +05:30
forgedhallpass 09eba6c0cf
feat: In case of binary data, show a hexadecimal view as well #1080 (#1266)
Highlight the longest occurrences when there are matches that are substrings of each other
2021-11-19 15:45:43 +05:30
mzack 71d4e5318a . 2021-11-18 22:28:10 +01:00
mzack 359eb7c3d2 making iota zero based 2021-11-18 21:58:32 +01:00
mzack bdffa373cf solving linting issues 2021-11-18 21:54:24 +01:00
mzack b42f0d32ea Merge branch 'dev' into research-aws-signing 2021-11-18 21:50:49 +01:00
mzack ddb07ebb75 adding support for aws file credential 2021-11-18 21:44:58 +01:00
GitHub Action 5a0f483cd3 Auto Generate Syntax Docs + JSONSchema [Thu Nov 18 20:12:46 UTC 2021] 🤖 2021-11-18 20:12:46 +00:00
LuitelSamikshya 2856e7e247
Extractor + Headless Actions structures to enums (#1217)
* enum support for extractor
2021-11-19 01:41:10 +05:30
GitHub Action ccb588f383 Auto Generate Syntax Docs + JSONSchema [Thu Nov 18 13:53:42 UTC 2021] 🤖 2021-11-18 13:53:42 +00:00
Mzack9999 7f5f791e23
Adding dns trace support in dns templates (#1236)
* Adding dns trace support in dns templates + minor refactoring
2021-11-18 19:22:11 +05:30
LuitelSamikshya d078b72381
enum changes for http method (#1234)
* enum changes for http method
2021-11-18 19:20:21 +05:30
GitHub Action 25189c3ae7 Auto Generate Syntax Docs + JSONSchema [Thu Nov 18 13:50:07 UTC 2021] 🤖 2021-11-18 13:50:07 +00:00
LuitelSamikshya 64a93a4570
enum changes for network type (#1233)
* enum changes for network type
2021-11-18 19:18:47 +05:30
LuitelSamikshya 4ff90c1373
struct to enum changes for Dns Type (#1245)
* struct to enum changes for Dns Type
2021-11-18 19:17:34 +05:30
mzack 38ff8f75b1 adding signature syntax validation 2021-11-17 01:28:35 +01:00
mzack 0379afc748 Merge branch 'dev' into research-aws-signing 2021-11-17 00:03:00 +01:00
Ice3man eaa0d37065
feat #1092: Validate binary values + precompile them as well (#1213)
* Added validation for binary values + precompile them

* Changed name of the binary matcher field

Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2021-11-17 02:04:27 +05:30
sandeep f73b20e415 Merge branch 'dev' of https://github.com/projectdiscovery/nuclei into research-aws-signing 2021-11-17 02:02:07 +05:30
Ice3man 50a816fce9
Fixed a crash with uninitialized interactsh client (#1251)
* Fixed a crash with uninitialized interactsh client
2021-11-16 20:02:39 +05:30
Ice3man543 cc33366acb fixed a conditon with workflow type switch 2021-11-14 15:30:28 +05:30
mzack eb61c519c3 converting to post-processor prototype 2021-11-13 03:17:05 +01:00
mzack e517797cfa moving aws signing logic to helper library 2021-11-13 02:13:48 +01:00
mzack 34889d50f8 correcting variable name 2021-11-12 19:58:12 +01:00
mzack 882a156b63 Merge branch 'dev' into research-aws-signing 2021-11-12 19:55:35 +01:00
mzack 041361c45e Adding aws sign prototype 2021-11-12 19:29:45 +01:00
GitHub Action dc0c568cb8 Auto Generate Syntax Docs + JSONSchema [Thu Nov 11 23:16:47 UTC 2021] 🤖 2021-11-11 23:16:47 +00:00
Ice3man543 cdb08e0879 misc fixes to websocket 2021-11-12 04:44:02 +05:30
Ice3man543 90a0502b60 Misc fixes to default part 2021-11-11 17:30:25 +05:30
Ice3man543 c1a35b3ff9 Merge branch 'dev' of https://github.com/projectdiscovery/nuclei into more-protocols 2021-11-11 17:21:25 +05:30
sullo 1d74f6ada2
Typo (#1242) 2021-11-10 23:25:22 +05:30
Mzack9999 ac75d9aa9b
Improving error handling in client certificate library (#1237) 2021-11-10 22:42:49 +05:30
Mzack9999 09b5fb11e8
Better error handling for return value of helper http library (#1239) 2021-11-10 22:41:42 +05:30
mzack 56b7d78fed Fixing http test using local http mock server 2021-11-10 18:04:53 +01:00
LuitelSamikshya 0e46d3e041
feat: Checking socks5 proxy before launching a scan #1001 (#1225)
* Proxy validation and list input support

Co-authored-by: Sajad Parra <parrasajad@gmail.com>
Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2021-11-10 21:30:03 +05:30
Sandeep Singh 66074a1842
Merge pull request #1232 from projectdiscovery/fix-redirect-response-bug
fix #1173: perform matching on all redirect responses instead of final
2021-11-10 17:38:35 +05:30
sandeep 4b169fcae1 mod update 2021-11-10 15:09:40 +05:30
Sandeep Singh f78ff42dbe
Merge branch 'dev' into more-protocols 2021-11-09 18:27:13 +05:30
Ice3man543 9b364080ea Fixed some edge cases with status codes in redirect chains 2021-11-09 17:55:42 +05:30
mzack 93060ec0e3 adding tests 2021-11-09 08:50:18 +01:00
Ice3man543 a9f586369a Misc fixes to request normalization 2021-11-09 06:20:10 +05:30
Ice3man543 3e2875267c linter fixes 2021-11-09 06:12:36 +05:30
Ice3man543 8396413f9d Added integration test for the redirect chain http functionality 2021-11-09 06:10:07 +05:30
Ice3man543 155b8cfed9 fix #1173: perform matching on all redirect responses instead of final 2021-11-09 06:00:30 +05:30
mzack 10e1b09bf3 tidying go modules 2021-11-08 19:45:01 +01:00
mzack 9675efa680 Adding support for custom headers via CLI in raw http requests 2021-11-08 19:33:54 +01:00
Sandeep Singh 952a821c6c
Merge pull request #1208 from projectdiscovery/colored_hexdump
Enhance hexdump content highlighting
2021-11-08 18:30:00 +05:30
Ice3man543 5e6b6c6b14 Show errors on invalid URL typo 2021-11-08 17:56:14 +05:30
Ice3man543 7d0529aaf7 Fixed gzip encoding bug + added test case 2021-11-08 17:39:08 +05:30
Ice3man543 88a296c9a7 Adding gzip encoding helpers 2021-11-08 16:24:47 +05:30
Ice3man543 d442c51c1a Changed input to target in core 2021-11-08 16:14:47 +05:30
Ice3man543 ce7534112a Fixed linter issues 2021-11-08 16:10:04 +05:30
Ice3man543 d772dedef1 Make default part for new protocols to response 2021-11-08 16:01:45 +05:30
Ice3man543 213853c45d Merge from dev 2021-11-08 15:40:18 +05:30
Sandeep Singh 3c53e262e3
Merge pull request #1219 from projectdiscovery/uniq-interact
Unique Interactsh URL
2021-11-06 03:33:09 +05:30
sandeep 89c6e76772 Revert "feat: Checking socks5 proxy before launching a scan #1001 (#1169)"
This reverts commit c125df4ef6.
2021-11-05 20:09:00 +05:30
Sajad Parra 6d0d3e1c35 add unique check to test case 2021-11-05 20:00:46 +05:30
LuitelSamikshya c125df4ef6
feat: Checking socks5 proxy before launching a scan #1001 (#1169)
* "#issue1001"

* changes for #issue1001

* minor changes

* minor

* flag consolidation and proxy file #issue1001

* readme changes

* review changes

* enviroment variable changes

* review comment changes

* review changes

* removed commented out code
2021-11-05 09:21:52 -05:00
Ice3man543 e8197f127f Fixed rmeote url loader test cases 2021-11-05 17:24:23 +05:30
Ice3man543 1c360e0344 Fixed DSL test 2021-11-05 17:04:42 +05:30
Ice3man543 0a09b9e451 Added test + misc 2021-11-05 16:59:24 +05:30
Sajad Parra 4d8eaad0a3 add unit test for unique interactsh url #1068 2021-11-05 15:27:49 +05:30
Ice3man543 8ad3ebcd05 Made code changes as per review comments 2021-11-05 03:01:41 +05:30
Sajad Parra 41393fc09d unique payload per interactsh placeholder #1068 2021-11-04 17:13:47 +05:30
Ice3man543 f3675d547a URL parsing addition for websocket URLs 2021-11-04 03:02:29 +05:30
Ice3man543 12321c23af Splitting big function into small 2021-11-04 02:56:59 +05:30
Ice3man543 53164c3f3e Misc linter related changes 2021-11-04 02:44:47 +05:30
Ice3man543 a60b10afca Added an enum for attackType 2021-11-04 02:41:56 +05:30
Ice3man543 a7c8d0473c Removed duplicate attackType logic + move attackType to generators 2021-11-04 02:28:48 +05:30
Ice3man543 91a7b4df6a Validate opcode before proceeding with websocket 2021-11-03 20:08:11 +05:30
Ice3man543 645ae30a47 Moved to an enum for TemplateType in protocols 2021-11-03 19:53:45 +05:30
Ice3man543 390ca8b3c6 Merge from dev 2021-11-03 18:58:00 +05:30
Sandeep Singh 0f897a3977
Merge pull request #1186 from projectdiscovery/protocol-types
Added new type and exclude-type flag
2021-11-03 18:47:26 +05:30
Ice3man543 4a0229c13d Websocket protocol rename 2021-11-03 18:36:54 +05:30
Ice3man543 956fb9296c fix merge conflict 2021-11-03 17:20:03 +05:30
Ice3man543 47949c0b52 Use separate type enum for protocol types 2021-11-03 17:18:35 +05:30
Ice3man543 cf7628c450 Misc changes according to review 2021-11-03 02:34:48 +05:30
Ice3man543 b3162decff Merge branch 'engine-execution' of https://github.com/projectdiscovery/nuclei into more-protocols 2021-11-03 02:24:00 +05:30
Ice3man543 bdb415b0c7 Misc changes as per review 2021-11-03 02:23:48 +05:30
sandeep 2224880d89 misc flag update 2021-11-02 22:57:00 +05:30
Ice3man c2df13ea22
Merge pull request #1185 from projectdiscovery/dns-variables
Added more variables for DNS requests
2021-11-02 17:54:45 +05:30
Ice3man 09cad2557c
Merge pull request #1123 from EndPositive/remote-template-workflow-lists
Remote template workflow lists
2021-11-02 16:12:29 +05:30
Ice3man543 87c3071ba7 Misc 2021-11-02 14:59:05 +05:30
Ice3man 191797380e
bug: Bug in URL parsing for unsafe templates #830
Fixed raw request path not correct with unsafe
2021-11-02 10:42:59 +02:00
forgedhallpass 8f6280dc9d refactor: In case of binary data, show a hexadecimal view as well #1080
* small enhancements with regards to dumping responses
2021-11-01 20:45:54 +02:00
forgedhallpass b477508521 feat: In case of binary data, show a hexadecimal view as well #1080
* the ASCII column in the hex dump represents non-printable ASCII characters with a "." character, so in order to enable proper highlighting, those characters has to be replaced in the generated regex as well
2021-11-01 20:44:55 +02:00
Ice3man543 f8c6f0ba64 Added debug for SSL 2021-11-01 18:02:45 +05:30
Ice3man543 a274cc5722 Misc integration test 2021-11-01 15:51:56 +05:30
Ice3man543 bb05be7b95 Added integration tests for websocket + misc fixes 2021-11-01 15:47:20 +05:30
forgedhallpass b91166a034 Merge remote-tracking branch 'origin/dev' into colored_hexdump 2021-11-01 11:57:45 +02:00
GitHub Action e1c39f255c Auto Generate Syntax Docs + JSONSchema [Mon Nov 1 09:46:34 UTC 2021] 🤖 2021-11-01 09:46:34 +00:00
Sandeep Singh 1863e8f76a
Merge pull request #1130 from zerodivisi0n/feature/case-insensitive-match
Add case-insensitive option to template
2021-11-01 15:15:22 +05:30
Ice3man 331ae0f03b
Merge pull request #1171 from kchason/client-cert-auth
Add Support for Client Certificate Authentication
2021-10-31 02:08:18 +05:30
forgedhallpass 38f2cf245e feat: In case of binary data, show a hexadecimal view as well #1080
* added Compact hex view to the output if the -vv flag is provided
2021-10-30 16:41:10 +03:00
Alexey Zhuchkov bccc8e921b Add test for output 2021-10-30 15:04:16 +03:00
Alexey Zhuchkov b8ebbc27f5 Use io.WriteCloser in output writer 2021-10-30 14:28:30 +03:00
Alexey Zhuchkov cd2db280bf Move output mutex to fileWriter 2021-10-30 14:28:30 +03:00
Alexey Zhuchkov 1eb0378952 Unwrap errors in json log output 2021-10-30 14:28:30 +03:00
Alexey Zhuchkov 463c1c0142 Use template path in output request 2021-10-30 14:28:30 +03:00
Alexey Zhuchkov 933ed2429d Update json log request format 2021-10-30 14:28:30 +03:00
Alexey Zhuchkov 3f1186da2b Add error log support 2021-10-30 14:12:21 +03:00
forgedhallpass 04e3c0165a feat: In case of binary data, show a hexadecimal view as well #1080 2021-10-30 13:17:47 +03:00
Alexey Zhuchkov 392ea23f1d Add integration tests for case-insensitive flag 2021-10-29 19:11:57 +03:00
Alexey Zhuchkov 897f11213c Add unit tests for case-insensitive flag in protocols 2021-10-29 19:11:09 +03:00
Alexey Zhuchkov bfb69b2ff2 Extract getMatchPart method in protocols 2021-10-29 19:10:17 +03:00
Alexey Zhuchkov 3a47413cd4 Add case-insensitive flag to matchers and extractors 2021-10-29 19:08:23 +03:00
Ice3man543 75f18f169c Adding response highlighting to websocket 2021-10-29 18:30:24 +05:30
Ice3man543 a10b79d7a8 merge from engine-refactor and dev 2021-10-29 18:26:06 +05:30
Ice3man543 15d467f9ff Merge branch 'dev' of https://github.com/projectdiscovery/nuclei into more-protocols 2021-10-29 17:54:02 +05:30
Ice3man543 5393cc4cd5 Adjusting packages for more API-type design 2021-10-29 03:19:43 +05:30
sandeep 8ce192c62a Merge branch 'dev' of https://github.com/projectdiscovery/nuclei into protocol-types 2021-10-29 00:58:21 +05:30
Ice3man543 1ca2cf3bea Misc 2021-10-28 23:17:05 +05:30
sandeep 533fb3f108 misc flag update 2021-10-28 22:02:22 +05:30
Ice3man543 0abc7202b1 Misc fixes with goflags 2021-10-28 17:45:38 +05:30
Ice3man543 d124dbacc7 Moved all important execution stuff to engine 2021-10-28 17:20:07 +05:30
kchason c3503922c9 Merge remote-tracking branch 'origin/client-cert-auth' into client-cert-auth
# Conflicts:
#	v2/pkg/protocols/headless/engine/http_client.go
2021-10-27 12:15:12 -04:00
kchason 4a1440a17b Merge dev branch 2021-10-27 12:13:23 -04:00
kchason a539184ffd Switch logic to a shared package 2021-10-27 12:11:42 -04:00
Ice3man543 df78ea72c5 misc 2021-10-27 18:41:39 +05:30
Ice3man543 c16c93fe7c refactor the modules to core 2021-10-27 16:50:36 +05:30
Ice3man543 97645dde52 Added new workpool package + Misc refactor 2021-10-27 15:53:04 +05:30