Commit Graph

334 Commits (4c79a53c3ba51faaf7156576617e16bcdc8f03f8)

Author SHA1 Message Date
Sandeep Singh 816ad073b9
Merge pull request #1672 from projectdiscovery/fix-update-check-tests
Run template update once during functional and integration test
2022-03-03 23:27:33 +05:30
Ice3man 632174e8e9 Fixed an issue with nuclei binary name in functional test 2022-03-03 19:51:16 +05:30
Ice3man f6dc6264dd Added pprof-server support with ena
ble-pprof flag
2022-03-03 19:44:29 +05:30
Ice3man 4d6071c1e0 Run template update once during functional and integration test 2022-03-03 19:10:03 +05:30
Ice3man a1dbbc5e88 Renamed variables to be more appropriate + changed return message 2022-03-03 19:01:46 +05:30
Sajad Parra bdc1b337e0 fix setting custom nuclei-templates directory #1611 2022-03-02 16:50:20 +05:30
mzack e8780b7db1 Merge branch 'dev' into issue-1594-regexp 2022-02-25 13:04:46 +01:00
Ice3man 42b3a5d3e2 Allow random resume file generation on conflict + made resume string flag 2022-02-24 14:32:41 +05:30
Sandeep Singh bf7a9aa708
Merge branch 'dev' into proxy-to-stringslice 2022-02-24 01:43:53 +05:30
mzack 6746071979 Refactoring file templates to handle large files in chunks + removing deprecated io methods 2022-02-23 13:54:46 +01:00
Ice3man 793db8a614 Use normalized original helpers to skip lowercasing for flags 2022-02-23 18:00:43 +05:30
sandeep cedb1f45f7 readme update 2022-02-22 15:23:47 +05:30
Ice3man 981e777b58 Use stringslice for proxy configuration instead of normalized 2022-02-20 17:41:10 +05:30
Mzack9999 0732406a68
Uniform behavior for input CLI flags (#1569)
* Adding file normalized string slice support

* updating goflags
2022-02-09 10:16:17 +05:30
Sandeep Singh 145faeef8d
Merge pull request #1574 from projectdiscovery/issue-582-headless-payloads
Adding support for payloads in headless protocol
2022-02-05 20:28:46 +05:30
mzack 8694af971e fixing test 2022-02-04 11:51:29 +01:00
mzack 54d8f9fdb5 Adding support for payloads in headless protocol 2022-02-04 11:43:42 +01:00
mzack 62fc7a8110 Merge branch 'dev' into issue-1231-zcrypto 2022-02-03 09:02:09 +01:00
Sandeep Singh 04f8f84c9d
Merge pull request #1564 from projectdiscovery/issue-1542-caa-query
Adding support for DNS CAA query
2022-02-03 11:23:03 +05:30
mzack 4d6a8a71a7 Adding support for DNS CAA query 2022-02-02 07:54:15 +01:00
mzack 3807e648c7 Fixing exit at first match with extractors 2022-02-01 11:25:29 +01:00
mzack 19d2b80a1c adding ssl test cases + tcpserver refactor 2022-01-27 21:29:28 +01:00
Sandeep Singh 8566bc0374
Merge pull request #1472 from projectdiscovery/remote-templates
Add support to run remote template
2022-01-27 18:02:52 +05:30
Sajad Parra 30850ced50 fix remote template integration test cases 2022-01-27 17:19:23 +05:30
mzack a6798f37ad making ztls global and optional 2022-01-25 20:48:21 +01:00
Sandeep Singh 3091e7075f
Merge pull request #1506 from projectdiscovery/default-port-fix
fix: strip default http/https ports from Host header
2022-01-20 17:50:56 +05:30
Ice3man 4f7148248b misc changes 2022-01-20 17:27:53 +05:30
Sandeep Singh 93616a9e80
Merge pull request #1511 from projectdiscovery/issue-1464-dns-ptr-query
Adding auto-PTR IP to FQDN
2022-01-19 17:30:12 +05:30
Sandeep Singh 59762ae266
Merge pull request #1503 from projectdiscovery/dsl_concat
DSL concat function
2022-01-18 21:34:21 +05:30
Ice3man be75480256 Added initial smart workflow implementation 2022-01-18 20:59:37 +05:30
mzack aec007e1b4 adding integration tests for single/multiple race conditions requests 2022-01-18 14:15:15 +01:00
mzack f552b07a5f fixing test case 2022-01-18 13:49:23 +01:00
mzack 994bc9e789 adding PTR integration test 2022-01-18 13:47:15 +01:00
Ice3man 693796789b fix: strip default http/https ports from Host header 2022-01-18 04:13:59 +05:30
forgedhallpass 286e27510d test: introduce 'concat' DSL function
* correct order and number of expected results
2022-01-17 13:50:42 +02:00
Ice3man 24326389a4
Added interactsh additional variables support (#1468)
* Added interactsh additional variables support

* Added support for interact server rotation

* Misc fixes to interact related modules

* Fixed a crash with interactsh

* Perform deduplication of output extract data before printing
2022-01-13 13:22:43 +05:30
Sajad Parra d1303797c0 * Add support to run remote template
* Add remote-template-domain config only flag to specify allowed domain list to load remote templates from
2022-01-12 18:33:17 +05:30
Mzack9999 0635b9e54f
Adding support for ignore file path override if custom config file is used (#1441)
* Adding support for ignore file path override if custom config file is used
2022-01-10 14:46:48 +05:30
Mzack9999 39519c01a6
Adding support for template id based execution (#1448) 2022-01-07 17:30:20 +05:30
Sandeep Singh 88bb6cb046
Merge pull request #1308 from projectdiscovery/issue-614-scan-resume
Adding stop-resume support
2022-01-03 15:07:30 +05:30
mzack 1f878192ec Merge branch 'dev' into issue-614-scan-resume 2021-12-23 13:15:47 +01:00
Sajad Parra c0f9c1da70 interactsh stopAtFirstMatch intergration test 2021-12-21 15:24:16 +05:30
mzack d27239e953 Fixing CVE annotate crash 2021-12-20 12:17:04 +01:00
sandeep 8e62abe6e7 fix: example reporting config update 2021-12-20 01:14:23 +05:30
Mzack9999 e9034a459d
Fixing wrong function/variable name in whois integration test (#1389)
* Fixing wrong function/variable name

* remove explicit result length check for whois integration test

Co-authored-by: Sajad Parra <parrasajad@gmail.com>
2021-12-17 11:55:46 +05:30
mzack 63b194c10a refactoring stop-resume logic with better tracking 2021-12-16 22:32:03 +01:00
Sajad 5200bcd94f
Whois Protocol Support (using rdap) (#1354)
* init rdap

* add an integration test, option to supply RDAP server to execute the request on

* add rdap protocolMappings

* add debug info, add IP, ASN query type support

* rename rdap to whois, Host to Query in template

* rename pending rdap to whois

* remove port from whois varaiables

* set Host variable even if input is not a parsable url
2021-12-16 17:08:02 +05:30
LuitelSamikshya 3f86bc7d62
Support major os (#1347)
* workflow check

* changes in run.sh file for windows support
2021-12-16 13:47:29 +05:30
forgedhallpass 85e0b96d51
bug: fixed couple of bugs in the DSL functions (#1372)
* feat: Improve DSL function UX #1295

Sort the output signatures

* feat: Improve DSL function UX #1295

Sort the output signatures.
Lint: simplified the sorting.

* bug: fixed couple of bugs in the DSL functions

Input number parameters are stored as float64 types, hence the type conversion should happen accordingly. Affected functions:
* rand_int
* wait_for
* unix_time
* rand_text_numeric

Added tests for all functions.
Related: #1261

* bug: fixed couple of bugs in the DSL functions

Handle cases when the optional input character set is an empty string. Affected methods:
* rand_char
* rand_base

* bug: fixed couple of bugs in the DSL functions

Change rand_char to return a one character string, instead of the character code

* refactor: Minor integration test changes to show the actual and expected result numbers

* test: Added integration test for all existing DSL functions

* test: Added integration test for all existing DSL functions

Fixing linter issues.

* feat: Add "repeat" DSL function

* test: Add "repeat" DSL function
2021-12-15 19:33:57 +05:30
forgedhallpass 974cbfb35e
feat: Re-run failed integration tests in debug mode (#1367)
* If the tests are executed through GitHub actions and there are failed integration tests, they will be re-executed with verbose output to help figuring out the underlying issues.
* Added some grouping to make reading the logs easier

Ticket: #1365
2021-12-14 18:13:53 +02:00
sandeep aae06e61bd fix: updating default interactsh server to use 2021-12-13 18:42:01 +05:30
mzack e279e0437d moving resume file to config folder 2021-12-10 12:45:29 +01:00
Sandeep Singh df55f7a2eb
Disabling no-sandbox in headless engine (#1135)
* Disabling no-sandbox in headless engine

* limiting disabling sandbox to bare minimum

* adding warnings related to linux os and root user requirement

Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
2021-12-05 20:14:16 +05:30
Mzack9999 8336421179
Improving headless test cases (#1313)
* Adding headless test cases
2021-12-04 23:10:11 +05:30
Sajad Parra 5b99921d75 add unit and integration tests for dsl variable #555 2021-11-30 20:20:43 +05:30
mzack 2140ffa382 Adding stop-resume support 2021-11-29 14:38:45 +01:00
forgedhallpass cd651ddf6f fix: Escaped the dot in a regex matching a domain 2021-11-26 17:12:27 +02:00
forgedhallpass 7e22d70ded refactor/documentation: typos and grammatical errors 2021-11-25 18:54:16 +02:00
forgedhallpass ec6889931d refactor: linter driven fixes
* x = x + ""  => x += ""
* pre-allocating slice with known size
* added t.Helper() methods in test helpers
* complex if-else conditions replaced by switches
* errors should be checked using error.Is() instead of ==
* function parameter should start with lower case letter
* removed unnecessary type definition
* variable/label naming convention: camelCase instead of snake_case
2021-11-25 17:57:22 +02:00
forgedhallpass fdaa8e4539 refactor: removed redundant type conversion 2021-11-25 17:18:54 +02:00
forgedhallpass 47340f06b0 refactor: uniformly sorted imports 2021-11-25 17:09:20 +02:00
forgedhallpass 3fd1f57b96 refactor: godoc and comment uniformization
Adding space after // and before the godoc/comment
2021-11-25 17:03:56 +02:00
forgedhallpass bebe5cbcfd refactor: Remove redundant character escapes from regexes 2021-11-25 16:24:37 +02:00
forgedhallpass 4bccb6cf8a fix: File and directory creation permission changes
Directories: 0755 (5 - group and other can read cd into the directory and read it's content)
Files: 0644 (4 - group and other can only read the created files)
Tests files: 0777
2021-11-25 14:37:57 +02:00
Ice3man 1581c96e4e
Added matched-status flag + template-path and url to output (#1272)
* Added matched-status flag + template-path and url to output
2021-11-22 17:53:25 +05:30
Ice3man543 c1a35b3ff9 Merge branch 'dev' of https://github.com/projectdiscovery/nuclei into more-protocols 2021-11-11 17:21:25 +05:30
LuitelSamikshya 0e46d3e041
feat: Checking socks5 proxy before launching a scan #1001 (#1225)
* Proxy validation and list input support

Co-authored-by: Sajad Parra <parrasajad@gmail.com>
Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2021-11-10 21:30:03 +05:30
Ice3man543 9b364080ea Fixed some edge cases with status codes in redirect chains 2021-11-09 17:55:42 +05:30
Ice3man543 3e2875267c linter fixes 2021-11-09 06:12:36 +05:30
Ice3man543 8396413f9d Added integration test for the redirect chain http functionality 2021-11-09 06:10:07 +05:30
Ice3man543 213853c45d Merge from dev 2021-11-08 15:40:18 +05:30
Sandeep Singh 3c53e262e3
Merge pull request #1219 from projectdiscovery/uniq-interact
Unique Interactsh URL
2021-11-06 03:33:09 +05:30
Sajad Parra 4d8eaad0a3 add unit test for unique interactsh url #1068 2021-11-05 15:27:49 +05:30
Ice3man543 8ad3ebcd05 Made code changes as per review comments 2021-11-05 03:01:41 +05:30
Ice3man543 390ca8b3c6 Merge from dev 2021-11-03 18:58:00 +05:30
Sandeep Singh 0f897a3977
Merge pull request #1186 from projectdiscovery/protocol-types
Added new type and exclude-type flag
2021-11-03 18:47:26 +05:30
Ice3man543 956fb9296c fix merge conflict 2021-11-03 17:20:03 +05:30
Ice3man543 47949c0b52 Use separate type enum for protocol types 2021-11-03 17:18:35 +05:30
Ice3man543 b3162decff Merge branch 'engine-execution' of https://github.com/projectdiscovery/nuclei into more-protocols 2021-11-03 02:24:00 +05:30
Ice3man543 bdb415b0c7 Misc changes as per review 2021-11-03 02:23:48 +05:30
sandeep 2224880d89 misc flag update 2021-11-02 22:57:00 +05:30
Ice3man 09cad2557c
Merge pull request #1123 from EndPositive/remote-template-workflow-lists
Remote template workflow lists
2021-11-02 16:12:29 +05:30
Ice3man543 a274cc5722 Misc integration test 2021-11-01 15:51:56 +05:30
Ice3man543 bb05be7b95 Added integration tests for websocket + misc fixes 2021-11-01 15:47:20 +05:30
forgedhallpass b91166a034 Merge remote-tracking branch 'origin/dev' into colored_hexdump 2021-11-01 11:57:45 +02:00
Sandeep Singh 1863e8f76a
Merge pull request #1130 from zerodivisi0n/feature/case-insensitive-match
Add case-insensitive option to template
2021-11-01 15:15:22 +05:30
Ice3man 331ae0f03b
Merge pull request #1171 from kchason/client-cert-auth
Add Support for Client Certificate Authentication
2021-10-31 02:08:18 +05:30
Alexey Zhuchkov 3f1186da2b Add error log support 2021-10-30 14:12:21 +03:00
forgedhallpass 04e3c0165a feat: In case of binary data, show a hexadecimal view as well #1080 2021-10-30 13:17:47 +03:00
Alexey Zhuchkov 392ea23f1d Add integration tests for case-insensitive flag 2021-10-29 19:11:57 +03:00
sandeep 8ce192c62a Merge branch 'dev' of https://github.com/projectdiscovery/nuclei into protocol-types 2021-10-29 00:58:21 +05:30
sandeep 533fb3f108 misc flag update 2021-10-28 22:02:22 +05:30
Ice3man543 97645dde52 Added new workpool package + Misc refactor 2021-10-27 15:53:04 +05:30
Jop Zitman 1dce8af045 Linting issues 2021-10-26 15:34:33 +02:00
Jop Zitman 86cf09fa3f Merge branch 'dev' into remote-template-workflow-lists
# Conflicts:
#	v2/cmd/nuclei/main.go
2021-10-26 15:33:39 +02:00
Ice3man 808ed4edd2
Merge branch 'dev' into client-cert-auth 2021-10-26 16:42:02 +05:30
Ice3man543 f058029841 Misc 2021-10-26 16:29:00 +05:30
Ice3man543 6541b04f4c Added new type and exclude-type flag 2021-10-25 23:24:42 +05:30
Ice3man 29e764961e
Merge branch 'dev' into interactsh-integration-test 2021-10-25 17:29:33 +05:30
kchason a911245d26 Re-add short command for env-vars lost during merge conflict resolution 2021-10-24 22:53:28 -04:00