Commit Graph

937 Commits (6534deedc6cb29ce7910c21f8bd982cd3f0832c4)

Author SHA1 Message Date
Sandeep Singh 2df8c23c20
Merge pull request #1870 from projectdiscovery/issue-1791-automatic-scan-with-custom-templates
automatic-scan with custom dir
2022-04-21 01:56:12 +05:30
Sandeep Singh be53225da5
Merge pull request #1864 from projectdiscovery/1863-nil-pointer
nil value check
2022-04-21 00:27:33 +05:30
Mzack9999 777b75d305 fixing internal bug for unsafe oob 2022-04-20 17:11:14 +02:00
Sandeep Singh bb1a0cb9cb
Merge pull request #1874 from projectdiscovery/rdap-add-verbose
Add verbose to rdap for debugging purposes
2022-04-20 20:10:16 +05:30
Mzack9999 aafa7806d8 adding missing space 2022-04-20 12:59:25 +02:00
Ice3man 7338752cbd Merge branch 'variables-introduction' of https://github.com/projectdiscovery/nuclei into variables-introduction 2022-04-20 15:41:21 +05:30
Mzack9999 72c5c399ec adding support for dsl extractors 2022-04-20 11:32:13 +02:00
LuitelSamikshya efefd06f60 automatic-scan with custom dir 2022-04-19 17:45:35 -05:00
sandeep 1b953655d1 misc updates 2022-04-19 16:14:49 +05:30
Sandeep Singh b26ebcfa60
Merge pull request #1805 from projectdiscovery/issue-1289-multiple-host
HTTP Requests Annotation Prototype
2022-04-16 17:23:31 +05:30
Sandeep Singh 5b9f7cdaa4
Merge pull request #1811 from projectdiscovery/issue-847-digest-auth
adding support for digest authentication
2022-04-15 18:59:15 +05:30
mzack 2104df63f7 adding support for original input port 2022-04-14 12:59:21 +02:00
mzack b5432b2565 Merge branch 'dev' into issue-1289-multiple-host 2022-04-13 17:42:38 +02:00
mzack 47b808b81a improving regex + adding more cases 2022-04-13 17:41:02 +02:00
Sandeep Singh 51bca65236
Merge pull request #1839 from projectdiscovery/issue-1833-scan-bug
Improving body dump logic for HTTP requests
2022-04-13 16:44:12 +05:30
Ice3man 2f0600878d Misc changes to variables 2022-04-13 12:20:45 +05:30
LuitelSamikshya 3c4250cc81 truncated http response check 2022-04-12 13:15:01 -05:00
mzack 73a8f9bf5f Improving body dump logic 2022-04-12 19:54:59 +02:00
mzack 3bd34553c0 Merge branch 'dev' into issue-847-digest-auth 2022-04-07 14:25:15 +02:00
Ice3man 5ddc37e8d7
Allow custom technology mapping for wappalyzer data (#1796)
* Allow custom technology mapping for wappalyzer data

* Added verbose logging for mapping data

* file ext update

* package name update

Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
2022-04-07 17:55:08 +05:30
Sajad Parra b14edf833a add verbose to rdap for debugging purposes 2022-04-07 16:54:04 +05:30
Sajad 7c84590de7
add interact-url variable support for multiple placeholders #1698 (#1760)
* add interact-url variable support for multiple placeholders #1698

* add cache clearing for interactshURLs

* change interactsh-url regex

* fix interactshURLMarker regex

* use underscore(_) instead of dash(-) in interactshURLMarker

Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
2022-04-07 12:53:38 +05:30
mzack a15ec3d362 using current date in test 2022-04-07 07:53:01 +02:00
Mzack9999 67887a210d Merge branch 'dev' into issue-1289-multiple-host 2022-04-06 23:25:21 +02:00
Ice3man f156928581 Misc 2022-04-06 19:17:32 +05:30
Ice3man aea79638c6 Merge branch 'dev' of https://github.com/projectdiscovery/nuclei into variables-introduction 2022-04-06 19:04:27 +05:30
Mzack9999 775f2962d6 adding yaml parameters docs 2022-04-05 12:02:23 +02:00
Mzack9999 2f9af8cc71 adding support for digest authentication 2022-04-05 11:43:56 +02:00
Mzack9999 7b032b1733 annotation prototype 2022-04-04 09:32:41 +02:00
Ice3man d0d65f8d6b Added integration tests for variables + misc changes 2022-04-02 02:14:00 +05:30
Sami 301307bb77
Issue 1705 save responses on disk (#1727)
* save response on disk

* lint error check

* store raw request/response

* lint error fix

* file path

* mock test fix

* readme update

* .txt extension

Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2022-04-02 00:59:02 +05:30
Ice3man 17fa23e737 Added variable introduction to headless 2022-04-01 23:12:02 +05:30
Ice3man d0ef630d0b Added evaluation of variables at start for fixed strings 2022-03-31 20:54:08 +05:30
mzack 09be857df1 Adding support to skip unused payloads 2022-03-31 07:24:03 +02:00
Ice3man 9c46024727 Fixed a bug with dns variables 2022-03-31 00:58:50 +05:30
Ice3man a0ece302d1 Moved variables to template level + misc 2022-03-31 00:54:35 +05:30
Ice3man d09e71accf Added variables to http and network 2022-03-30 20:35:46 +05:30
Sandeep Singh f8fa9b5b78
Merge pull request #1780 from projectdiscovery/payloads-helper-fix
Evaluate payload helpers before matching
2022-03-30 12:58:57 +05:30
Sandeep Singh 6ede70116d
Merge pull request #1762 from projectdiscovery/clustering-improvements
Added comments to clustering + misc improvements
2022-03-30 12:54:33 +05:30
Ice3man bc4903e332 Added variables + modified insertion ordered map 2022-03-30 01:46:21 +05:30
Ice3man eaa9db19c0 Misc changes to meta and dynamic http values 2022-03-29 20:36:26 +05:30
Sandeep Singh e8690f378d
Merge pull request #1746 from projectdiscovery/issue-1703-minor-changes
Stats counter + Mime type filter
2022-03-29 17:49:44 +05:30
Sandeep Singh c0724bacc8
Merge pull request #1658 from projectdiscovery/skip-unresolved-expressions
Skip unresolved expressions using a regex
2022-03-29 17:30:41 +05:30
Ice3man bea8955dd6 Evaluate payload helpers before matching 2022-03-29 17:28:29 +05:30
Sandeep Singh bcf705c162
Merge pull request #1696 from projectdiscovery/proxy-internal-requests
Adding proxy support for internal standard HTTP requests
2022-03-24 16:28:44 +05:30
Sandeep Singh 8ee4f9f797
Merge branch 'dev' into proxy-internal-requests 2022-03-23 23:12:51 +05:30
Xavier Stevens 4a65097194 Squashed commit of the following:
commit b590de2de14923e4cb35dd19845e12833a4ccbfa
Author: Xavier Stevens <xstevens@users.noreply.github.com>
Date:   Wed Mar 23 08:29:37 2022 -0700

    Updated rand_ip to use variadic args

commit ea883be8c0aa56174a1301252129289334659f3f
Author: Xavier Stevens <xstevens@users.noreply.github.com>
Date:   Tue Mar 22 16:59:19 2022 -0700

    Updated rand_ip function to handle multiple CIDRs
2022-03-23 08:37:05 -07:00
mzack 6213454cb3 small code refactor 2022-03-22 15:16:22 +01:00
mzack 5cd25bd069 more checks + test cases fix 2022-03-22 14:18:01 +01:00
mzack 3288c77692 fixing headless test cases 2022-03-22 13:47:13 +01:00
mzack 838ddb63e7 adding mime type file support 2022-03-22 12:35:11 +01:00
mzack e7d260ea4d Fixing stats counter 2022-03-22 10:52:57 +01:00
skhalsa-sigsci 63eccc85ba random ip helper function 2022-03-21 17:39:10 -07:00
Ice3man d1f6fd9115 Fixed template doc example 2022-03-21 15:50:28 +05:30
sandeep 49c5cca78b Merge branch 'dev' of https://github.com/projectdiscovery/nuclei into proxy-internal-requests 2022-03-21 13:03:17 +05:30
mzack 428841d946 Merge branch 'dev' into automatic-workflows 2022-03-17 12:27:50 +01:00
Ice3man 8ab2dc5e48 Added global http redirects follow support 2022-03-15 18:10:05 +05:30
Ice3man 660a81c1ab Fixed crash + added unique tags for execution 2022-03-14 16:25:27 +05:30
sandeep 882bd5c77d misc change 2022-03-14 13:23:31 +05:30
Ice3man 59a1986fc4 Misc 2022-03-14 13:02:15 +05:30
Ice3man 9efa1f70dc Split tech names on comma + auto scan docs 2022-03-14 13:01:28 +05:30
Ice3man 32bc6c1718 Misc changes, moving things around as per review 2022-03-14 12:32:05 +05:30
Ice3man 14dab085ac Merge branch 'dev' of https://github.com/projectdiscovery/nuclei into automatic-workflows 2022-03-14 12:17:39 +05:30
Ice3man 9da8c0593b Added comments to clustering + misc improvements 2022-03-11 22:08:30 +05:30
sandeep 6ff801211d Merge branch 'dev' of https://github.com/projectdiscovery/nuclei into skip-unresolved-expressions 2022-03-10 11:20:07 +05:30
Akkuman c6723148b3 Add proxy to rawhttp client 2022-03-10 13:49:17 +08:00
mzack d2b5579303 Adding proxy support for internal standard HTTP requests 2022-03-09 12:31:12 +01:00
Sandeep Singh 0f38f2c80e
Merge pull request #1685 from projectdiscovery/ssl-tests
Added more tests and ciphersuits for SSL protocol
2022-03-09 13:07:45 +05:30
Sandeep Singh 80e969f917
Merge pull request #1688 from projectdiscovery/issue-1214-truncated-resp
Adding truncation info on debug
2022-03-09 00:36:50 +05:30
Ice3man 2a054290c6 Added ciphersuite to tls data + misc 2022-03-08 19:41:52 +05:30
Ice3man ffe4fea237 Performance improvements + wappalyzer as default + misc 2022-03-08 12:43:24 +05:30
mzack b55dac6ae2 Adding truncation info on debug 2022-03-07 13:32:17 +01:00
Ice3man 90b4c09f80 Added more tests and ciphersuits for SSL protocol 2022-03-07 14:07:30 +05:30
Ice3man d9a121344c Merge branch 'dev' of https://github.com/projectdiscovery/nuclei into automatic-workflows 2022-03-07 13:19:37 +05:30
mzack cf9c844c62 adding line number for extracted results 2022-03-04 09:28:58 +01:00
mzack 4bcc84df9d using int argument 2022-03-03 10:26:43 +01:00
mzack ea9f9c9c9a fixing logic condition + removing redundant code 2022-03-03 07:18:35 +01:00
mzack 64bea4da8c Merge branch 'dev' into issue-1594-regexp 2022-03-02 17:28:04 +01:00
sandeep 2955b94455 Merge branch 'dev' of https://github.com/projectdiscovery/nuclei into network-fix 2022-03-02 02:12:23 +05:30
mzack e9d4b4bc52 adding archive analysis support 2022-03-01 18:59:33 +01:00
Sandeep Singh a7849ce5e8
Merge pull request #1638 from projectdiscovery/custom-user-agent
add options to specify User-Agent in headless template
2022-03-01 22:49:44 +05:30
Ice3man 4a9000d22e Fixed network response error + timeout handling 2022-03-01 16:24:02 +05:30
mzack c89b9ef820 method renaming 2022-03-01 06:37:59 +01:00
Ice3man 409d0fce31 Skip unresolved expressions using a regex 2022-02-28 22:19:51 +05:30
mzack 6cb522c9b2 Merge branch 'dev' into issue-1594-regexp 2022-02-28 11:42:46 +01:00
Sandeep Singh 1a417a8f8d
Merge pull request #1646 from projectdiscovery/interact-color-debug
Added interaction event highlighting support in debug mode
2022-02-28 12:33:07 +05:30
mzack 06ab0dfa99 making code more uniform with chosen architecture 2022-02-26 09:06:43 +01:00
mzack a51d307967 . 2022-02-26 08:02:16 +01:00
mzack 73d1247b71 fixing typo 2022-02-26 00:54:11 +01:00
Ice3man fb6ab39d65 Added interaction event highlighting support in debug mode 2022-02-25 23:11:56 +05:30
Ice3man 2ae66ff530 Fixed unncessary hostname addition in payloads and output in network 2022-02-25 22:53:51 +05:30
Ice3man a7d6d5ce9d Added read-all flag to http unsafe request 2022-02-25 19:26:10 +05:30
mzack a4b24ea802 adding outputunique logic handling 2022-02-25 12:51:28 +01:00
mzack 1a42780370 improving dump logic 2022-02-25 08:59:10 +01:00
mzack b3e2456c80 removing unused stuff 2022-02-25 02:13:57 +01:00
mzack baabe412dd using custom implementation to avoid multiple file read 2022-02-25 02:12:54 +01:00
mzack 763ec611ab . 2022-02-25 01:49:14 +01:00
mzack 748617a9f3 first part 2022-02-25 00:55:05 +01:00
mzack 30a5a11e23 patching tests 2022-02-24 23:57:47 +01:00
mzack cf1526b7ed adding result dedupe 2022-02-24 23:54:45 +01:00
mzack 6af462c215 . 2022-02-24 23:35:51 +01:00
mzack 91ad446212 . 2022-02-24 23:18:37 +01:00
mzack 11286210e5 using helper dedupeint 2022-02-24 22:50:41 +01:00
mzack 2409d7a713 dropping multiple scan 2022-02-24 22:41:33 +01:00
Sajad Parra dc46bd263b add options to specify User-Agent in headless template 2022-02-24 12:31:08 +05:30
mzack 1551feda5a temporary line calculation with multiple file read
todo: replace with one pass scan via io.reader
2022-02-23 23:32:25 +01:00
mzack 6746071979 Refactoring file templates to handle large files in chunks + removing deprecated io methods 2022-02-23 13:54:46 +01:00
Ice3man 7d83d3f8c9
Added line number for file results + stats fixes (#1495)
* Added line number for file results + stats fixes

* Misc

* Improved file result line calculation as per review

* Added new match-all attribute for file template matcher line count
2022-02-10 15:59:05 +05:30
forgedhallpass 72af50155d Typo fixes 2022-02-07 16:41:55 +02:00
sandeep 26de1c0995 update: increased limit for file protocol
Increased default file size to read for file templates from 5 MB to 1GB to avoid false negative results.
2022-02-05 22:39:34 +05:30
Sandeep Singh 145faeef8d
Merge pull request #1574 from projectdiscovery/issue-582-headless-payloads
Adding support for payloads in headless protocol
2022-02-05 20:28:46 +05:30
Sandeep Singh a48e2adb69
Merge pull request #1529 from projectdiscovery/issue-1231-zcrypto 2022-02-05 12:24:47 +05:30
mzack fa6b21e9be fixing wrong bool condition 2022-02-05 00:37:03 +01:00
mzack 76fe8b682c correcting comment 2022-02-04 11:46:11 +01:00
mzack 54d8f9fdb5 Adding support for payloads in headless protocol 2022-02-04 11:43:42 +01:00
mzack acfe35eda9 fixing cipher suites selection 2022-02-04 07:22:10 +01:00
Sandeep Singh 249937ca72
Merge pull request #1561 from projectdiscovery/issue-1543-rand-seed
Implementing incremental expression replacement
2022-02-03 23:19:35 +05:30
Sandeep Singh d20f557ec4
Merge pull request #1555 from projectdiscovery/issue-1394-headless-templating
Adding support for CLI/ENV vars to headless
2022-02-03 23:10:04 +05:30
mzack 62fc7a8110 Merge branch 'dev' into issue-1231-zcrypto 2022-02-03 09:02:09 +01:00
Sandeep Singh 04f8f84c9d
Merge pull request #1564 from projectdiscovery/issue-1542-caa-query
Adding support for DNS CAA query
2022-02-03 11:23:03 +05:30
Sandeep Singh e502d61550
Merge pull request #1559 from projectdiscovery/issue-1546-stop-at-first-with-extractors
Fixing exit at first match with extractors
2022-02-02 23:16:48 +05:30
mzack 4d6a8a71a7 Adding support for DNS CAA query 2022-02-02 07:54:15 +01:00
mzack 766a3eefb6 Implementing incremental expression replacement 2022-02-01 14:12:16 +01:00
mzack 4370abf89b improving markers detection 2022-02-01 12:34:12 +01:00
mzack b3c61ee157 Differentiate between interact matchers and markers 2022-02-01 12:10:18 +01:00
mzack 3807e648c7 Fixing exit at first match with extractors 2022-02-01 11:25:29 +01:00
mzack c701e2ad4a adding support for interactsh 2022-01-31 08:52:36 +01:00
mzack 2ba8e10050 Adding support for CLI/ENV vars to headless 2022-01-31 02:25:14 +01:00
Sandeep Singh 8566bc0374
Merge pull request #1472 from projectdiscovery/remote-templates
Add support to run remote template
2022-01-27 18:02:52 +05:30
Ice3man 8dfa9cee39
Added debug-req/resp support for interactsh interactions (#1491)
* Added debug-req/resp support for interactsh interactions

* Added format function for interact debug logs + misc fixes

* Added function for interact debug header

* Typo fix

* Enable debug logging for req/resp debug flag
2022-01-27 12:14:32 +05:30
Sandeep Singh 7cfa39f34e
Merge pull request #1516 from projectdiscovery/issue-1497-lexer
Implementing lexer with runtime expression validation
2022-01-26 23:34:35 +05:30
mzack 695404477e Headless limited code refactor for better readability 2022-01-26 14:20:23 +01:00
mzack e7655f1df0 fixing tls config generation 2022-01-25 20:57:54 +01:00
mzack a6798f37ad making ztls global and optional 2022-01-25 20:48:21 +01:00
mzack 449e4fa431 using standard library for tls13 2022-01-25 13:26:22 +01:00
mzack a57d25fab8 adding support for configurable TLS version/cipher suites 2022-01-24 18:20:29 +01:00
mzack 6107559c8d Add support for ztls for ssl/crypto templates 2022-01-24 16:15:02 +01:00
Sandeep Singh 3091e7075f
Merge pull request #1506 from projectdiscovery/default-port-fix
fix: strip default http/https ports from Host header
2022-01-20 17:50:56 +05:30
Sandeep Singh 956442ff06
Merge pull request #1494 from projectdiscovery/fix-progress-calculation-http
Fixed stats calculation for payloads in http base request
2022-01-20 15:34:00 +05:30
mzack 8559cfabca removing unused code 2022-01-19 15:16:47 +01:00
mzack adf4721833 making markers parametric + simple match/replace for basic variables 2022-01-19 14:57:25 +01:00
mzack 369255a4fe Implementing lexer with runtime expression validation 2022-01-19 14:10:11 +01:00
Sandeep Singh 93616a9e80
Merge pull request #1511 from projectdiscovery/issue-1464-dns-ptr-query
Adding auto-PTR IP to FQDN
2022-01-19 17:30:12 +05:30
Sandeep Singh 59762ae266
Merge pull request #1503 from projectdiscovery/dsl_concat
DSL concat function
2022-01-18 21:34:21 +05:30
Sandeep Singh 3afc2f4202
Merge pull request #1500 from projectdiscovery/issue-1471-race-conditions
Fixing race-requests block on curl generation command
2022-01-18 21:32:46 +05:30
Ice3man edf111916a Misc fixes 2022-01-18 21:08:05 +05:30
Ice3man be75480256 Added initial smart workflow implementation 2022-01-18 20:59:37 +05:30
mzack aea7825f30 Merge branch 'dev' into issue-1464-dns-ptr-query 2022-01-18 13:38:39 +01:00
mzack bc84fb1109 Adding auto-PTR IP to FQDN 2022-01-18 13:35:41 +01:00
Ice3man 693796789b fix: strip default http/https ports from Host header 2022-01-18 04:13:59 +05:30