Commit Graph

937 Commits (6534deedc6cb29ce7910c21f8bd982cd3f0832c4)

Author SHA1 Message Date
Mzack9999 cf1039f49c
Adding prototype of request flow override annotations (#2161)
* Adding prototype of request flow override annotations

* reworking iteration engine

* adding directory to .gitignore
2022-07-18 14:16:03 +05:30
dependabot[bot] 85ca247d26
chore(deps): bump github.com/go-rod/rod from 0.107.3 to 0.108.1 in /v2 (#2272)
* chore(deps): bump github.com/go-rod/rod from 0.107.3 to 0.108.1 in /v2

Bumps [github.com/go-rod/rod](https://github.com/go-rod/rod) from 0.107.3 to 0.108.1.
- [Release notes](https://github.com/go-rod/rod/releases)
- [Commits](https://github.com/go-rod/rod/compare/v0.107.3...v0.108.1)

---
updated-dependencies:
- dependency-name: github.com/go-rod/rod
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* increasing page timeout

* further increasing timeout

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
2022-07-14 03:14:13 +05:30
Sami 6c2fdd3387
Issue 2227 ntv flag run new templates added in specific version (#2275)
* ntv flag to run templates added in specified version

* added missing arguments

* misc update

* added functional test and err check

* updated the min version

Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2022-07-13 16:49:06 +05:30
Mzack9999 1c332bb85b
Improving RFC request/response passive parsing (#2192)
* Improving RFC request/response passive parsing

* adding test
2022-07-11 22:43:10 +05:30
Ice3man 5b3c2861c2
Added interact-url placeholder support to variables in http requests (#2237)
* Added interact-url placeholder support to variables in http requests

* Fixed variable errors

* Fixed issue with interactsh in req
2022-07-11 22:18:13 +05:30
anykno 73a0043f2d
fix: socks5 proxy not working on https target (#2228)
* fix: socks5 proxy not working on https target

* small name refactor

Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
2022-07-01 15:31:00 +05:30
Ice3man f3de611b49
Added enhancements for http variables support (#2223) 2022-06-28 20:20:18 +05:30
Ice3man 8040b66370
Added http request timeout support with annotations (#2233)
* Added http request timeout support with annotations

* Added nolint statements for lostcontext

* misc

* misc
2022-06-27 18:36:46 +05:30
Ice3man 7875b06fc8
Added exclude-matchers support for template & matchers (#2218)
* Added exclude-matchers support for template & matchers

* Fixed panics due to typo

* Added support for only template ID + misc cleanup
2022-06-24 23:09:27 +05:30
dependabot[bot] 1047047790
chore(deps): bump github.com/go-rod/rod from 0.106.8 to 0.107.1 in /v2 (#2114)
* chore(deps): bump github.com/go-rod/rod from 0.106.8 to 0.107.1 in /v2

Bumps [github.com/go-rod/rod](https://github.com/go-rod/rod) from 0.106.8 to 0.107.1.
- [Release notes](https://github.com/go-rod/rod/releases)
- [Commits](https://github.com/go-rod/rod/compare/v0.106.8...v0.107.1)

---
updated-dependencies:
- dependency-name: github.com/go-rod/rod
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* fixing function call

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
2022-06-22 00:31:08 +05:30
Mzack9999 112762f024
Adding http request validation at compile time (#2193)
* Adding http request validation at compile time

* misc update

Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2022-06-22 00:26:06 +05:30
Sajad 644c951449
use formedURL instead reqURL in http request dump message (#2174) 2022-06-16 17:24:21 +05:30
Mzack9999 a4cdba0691
Improving literals detection in expression engine (#2148)
* Improving literals detection in expression engine

* fixing lint errors

* re-add accidentally deleted test
2022-06-13 13:55:06 +05:30
Sajad e7591ec8b3
use request numbering as per template definition in req-condition (#2135)
* use original request number instead of current iteration in request-condition

* add previousEvent tracking back for request condition

Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2022-06-11 14:29:05 +05:30
Sandeep Singh 5281d342c0
Merge pull request #2138 from mikerott/dev
protect against multiple unnecessary Init calls
2022-06-10 18:12:31 +05:30
Mike Rheinheimer 22a8d72c65 protect against multiple unnecessary Init calls 2022-06-09 17:18:49 -05:00
forgedhallpass 04e7e053de refactor: replace date, time, time_format, time_to_string DSL functions to date_time 2022-06-08 20:41:32 +03:00
Mzack9999 cc37382519
Adding Client TLS1.0 (#2091)
* Adding Client TLS1.0

* bumping fastdialer version
2022-06-04 17:45:16 +05:30
Sami fa369b728e
ssl protocol with ms flag crash (#2101)
* crash with ssl protocol when used with ms flag fix

* added missing template info in case of failure
2022-06-03 13:32:45 +05:30
Ice3man 2b631e8e95
Add optional line number for file templates by default (#1966)
* Add optional line number for file templates by default

* updating docs

* misc flag update

Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2022-06-02 17:06:50 +05:30
Mzack9999 4bcb94e4df
Increasing timeout and fixed error msg (#2092)
* Increasing timeout and fixed error msg

* increasing timeout
2022-06-02 00:00:18 +05:30
Ice3man be5f1a7623
Added redirected matched URL + stop-at-first-match for redirect chains (#2050)
* Added redirected matched URL + stop-at-first-match for redirect chains

* Pleasing go-linter
2022-05-30 15:19:09 +05:30
Ice3man 8723a1fd70
Added header as DSL part value (#2052)
* Added header as DSL part value

* Fixed failing DSL part test cases
2022-05-30 15:16:27 +05:30
Mzack9999 dd3b0a3cfc
Increasing buffer size on AND condition (#2030)
* Increasing buffer size on AND condition

* adding integration tests

* fixing tests data path
2022-05-30 13:45:28 +05:30
Ice3man f53f360c74
Fixed websocket status-101 response reading for http (#2081) 2022-05-27 22:36:42 +05:30
Mzack9999 16a05d0aa2
Adding CLI SNI support to unsafe http (#2077)
* Adding CLI SNI support to unsafe http

* adding http unsafe sni test
2022-05-27 21:53:07 +05:30
Mzack9999 02eaf91e6a
Adding variables support for headless templates (#2064) 2022-05-27 21:31:56 +05:30
Ice3man 80f3cec293
Disable printing variables in http protocol output (#2037) 2022-05-23 20:50:51 +05:30
Sajad 4f834f1f33
store vars in values instead of payloads to fix #1882 for self contained http templates (#1924)
Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2022-05-23 15:12:58 +05:30
Mzack9999 d5e4516829
Iterating payloads over HTTP path/raw sequence (#1981)
* Iterating payloads over path/raw sequence

* fixing logic check
2022-05-17 15:22:00 +05:30
Ice3man 062fe6d01e
Added urldns gadget from ysoserial (#1985) 2022-05-17 14:33:17 +05:30
Mzack9999 39c7317ec3
Adding SNI override via request annotations (#1970)
* Adding SNI override via request annotations

* adding cli flag priority
2022-05-12 16:43:56 +05:30
Sami 6ca4374f91
sonar category: String literals should not be duplicated (#1944)
* sonar category: String literals should not be duplicated

* lint error fix

* better naming conventions for constants

* improved naming conventions and methods
2022-05-12 15:40:14 +05:30
Mzack9999 2f1330345f
Adding global SNI support for HTTP protocol via CLI (#1964)
* Adding global SNI support via CLI

* adding integration test

* adding cli option to docs

* reverting deleted test
2022-05-11 16:00:39 +05:30
Ice3man d5578200f0
Fixed query parameter addition to http raw requests (#1975) 2022-05-10 17:33:27 +05:30
Ice3man 25d6cbd95b
Use nuclei-templates instead of custom autoscan directory list (#1968)
* Use nuclei-templates instead of custom autoscan directory list

* Use templates directory from config file
2022-05-10 17:26:46 +05:30
Ice3man d7d80e3447 Added normalized wappalyzer versioned appName 2022-05-09 11:02:21 +05:30
Mzack9999 a534b9f06c
Fixing directory walk error check on windows (#1951)
* Fixing directory walk error check on windows

* moving check to helper package

* replacing godirwalk with standard library
2022-05-08 12:22:21 +05:30
mzack 3c5aea85e7 Merge branch 'dev' into issue-1849-iserver-registration 2022-05-06 13:13:50 +02:00
mzack 6a52f4f709 updating go mods + logic 2022-05-06 12:59:16 +02:00
Sandeep Singh 2e8a5fa0c7
Merge pull request #1934 from projectdiscovery/pipeline-fix
replace rawhttp dev with fix branch, don't drain resp body if pipeline is on
2022-05-05 18:14:51 +05:30
Sajad Parra df6c4eea34 fix #1929 2022-05-04 22:09:47 +05:30
Sajad Parra 14f11d24c2 replace rawhttp dev with fix branch, don't drain resp body if pipeline is on 2022-05-04 19:52:35 +05:30
Sandeep Singh b4c6efd083
Merge pull request #1903 from projectdiscovery/issue-1834-alpine
Automatic fallback to system chrome on alpine via musl detection
2022-04-29 23:34:16 +05:30
mzack d197b8df7b adding musl detection 2022-04-28 01:50:22 +02:00
LuitelSamikshya 3ccbfe4626 disable redirects flag 2022-04-27 11:19:44 -05:00
Ice3man 51d8f80713 Fixed bug with docgen 2022-04-25 14:08:23 +05:30
LuitelSamikshya b0508ab194 alternative server if a server failed 2022-04-22 16:31:42 -05:00
Sandeep Singh d3b4a86d2a
Merge pull request #1785 from projectdiscovery/variables-introduction
Added variables for nuclei + refactor variable handling
2022-04-21 17:59:01 +05:30
Sandeep Singh 4573c4e1a4
Merge pull request #1873 from projectdiscovery/issue-1565-dsl-extractors
adding support for dsl extractors
2022-04-21 16:47:58 +05:30
Sandeep Singh 2df8c23c20
Merge pull request #1870 from projectdiscovery/issue-1791-automatic-scan-with-custom-templates
automatic-scan with custom dir
2022-04-21 01:56:12 +05:30
Sandeep Singh be53225da5
Merge pull request #1864 from projectdiscovery/1863-nil-pointer
nil value check
2022-04-21 00:27:33 +05:30
Mzack9999 777b75d305 fixing internal bug for unsafe oob 2022-04-20 17:11:14 +02:00
Sandeep Singh bb1a0cb9cb
Merge pull request #1874 from projectdiscovery/rdap-add-verbose
Add verbose to rdap for debugging purposes
2022-04-20 20:10:16 +05:30
Mzack9999 aafa7806d8 adding missing space 2022-04-20 12:59:25 +02:00
Ice3man 7338752cbd Merge branch 'variables-introduction' of https://github.com/projectdiscovery/nuclei into variables-introduction 2022-04-20 15:41:21 +05:30
Mzack9999 72c5c399ec adding support for dsl extractors 2022-04-20 11:32:13 +02:00
LuitelSamikshya efefd06f60 automatic-scan with custom dir 2022-04-19 17:45:35 -05:00
sandeep 1b953655d1 misc updates 2022-04-19 16:14:49 +05:30
Sandeep Singh b26ebcfa60
Merge pull request #1805 from projectdiscovery/issue-1289-multiple-host
HTTP Requests Annotation Prototype
2022-04-16 17:23:31 +05:30
Sandeep Singh 5b9f7cdaa4
Merge pull request #1811 from projectdiscovery/issue-847-digest-auth
adding support for digest authentication
2022-04-15 18:59:15 +05:30
mzack 2104df63f7 adding support for original input port 2022-04-14 12:59:21 +02:00
mzack b5432b2565 Merge branch 'dev' into issue-1289-multiple-host 2022-04-13 17:42:38 +02:00
mzack 47b808b81a improving regex + adding more cases 2022-04-13 17:41:02 +02:00
Sandeep Singh 51bca65236
Merge pull request #1839 from projectdiscovery/issue-1833-scan-bug
Improving body dump logic for HTTP requests
2022-04-13 16:44:12 +05:30
Ice3man 2f0600878d Misc changes to variables 2022-04-13 12:20:45 +05:30
LuitelSamikshya 3c4250cc81 truncated http response check 2022-04-12 13:15:01 -05:00
mzack 73a8f9bf5f Improving body dump logic 2022-04-12 19:54:59 +02:00
mzack 3bd34553c0 Merge branch 'dev' into issue-847-digest-auth 2022-04-07 14:25:15 +02:00
Ice3man 5ddc37e8d7
Allow custom technology mapping for wappalyzer data (#1796)
* Allow custom technology mapping for wappalyzer data

* Added verbose logging for mapping data

* file ext update

* package name update

Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
2022-04-07 17:55:08 +05:30
Sajad Parra b14edf833a add verbose to rdap for debugging purposes 2022-04-07 16:54:04 +05:30
Sajad 7c84590de7
add interact-url variable support for multiple placeholders #1698 (#1760)
* add interact-url variable support for multiple placeholders #1698

* add cache clearing for interactshURLs

* change interactsh-url regex

* fix interactshURLMarker regex

* use underscore(_) instead of dash(-) in interactshURLMarker

Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
2022-04-07 12:53:38 +05:30
mzack a15ec3d362 using current date in test 2022-04-07 07:53:01 +02:00
Mzack9999 67887a210d Merge branch 'dev' into issue-1289-multiple-host 2022-04-06 23:25:21 +02:00
Ice3man f156928581 Misc 2022-04-06 19:17:32 +05:30
Ice3man aea79638c6 Merge branch 'dev' of https://github.com/projectdiscovery/nuclei into variables-introduction 2022-04-06 19:04:27 +05:30
Mzack9999 775f2962d6 adding yaml parameters docs 2022-04-05 12:02:23 +02:00
Mzack9999 2f9af8cc71 adding support for digest authentication 2022-04-05 11:43:56 +02:00
Mzack9999 7b032b1733 annotation prototype 2022-04-04 09:32:41 +02:00
Ice3man d0d65f8d6b Added integration tests for variables + misc changes 2022-04-02 02:14:00 +05:30
Sami 301307bb77
Issue 1705 save responses on disk (#1727)
* save response on disk

* lint error check

* store raw request/response

* lint error fix

* file path

* mock test fix

* readme update

* .txt extension

Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2022-04-02 00:59:02 +05:30
Ice3man 17fa23e737 Added variable introduction to headless 2022-04-01 23:12:02 +05:30
Ice3man d0ef630d0b Added evaluation of variables at start for fixed strings 2022-03-31 20:54:08 +05:30
mzack 09be857df1 Adding support to skip unused payloads 2022-03-31 07:24:03 +02:00
Ice3man 9c46024727 Fixed a bug with dns variables 2022-03-31 00:58:50 +05:30
Ice3man a0ece302d1 Moved variables to template level + misc 2022-03-31 00:54:35 +05:30
Ice3man d09e71accf Added variables to http and network 2022-03-30 20:35:46 +05:30
Sandeep Singh f8fa9b5b78
Merge pull request #1780 from projectdiscovery/payloads-helper-fix
Evaluate payload helpers before matching
2022-03-30 12:58:57 +05:30
Sandeep Singh 6ede70116d
Merge pull request #1762 from projectdiscovery/clustering-improvements
Added comments to clustering + misc improvements
2022-03-30 12:54:33 +05:30
Ice3man bc4903e332 Added variables + modified insertion ordered map 2022-03-30 01:46:21 +05:30
Ice3man eaa9db19c0 Misc changes to meta and dynamic http values 2022-03-29 20:36:26 +05:30
Sandeep Singh e8690f378d
Merge pull request #1746 from projectdiscovery/issue-1703-minor-changes
Stats counter + Mime type filter
2022-03-29 17:49:44 +05:30
Sandeep Singh c0724bacc8
Merge pull request #1658 from projectdiscovery/skip-unresolved-expressions
Skip unresolved expressions using a regex
2022-03-29 17:30:41 +05:30
Ice3man bea8955dd6 Evaluate payload helpers before matching 2022-03-29 17:28:29 +05:30
Sandeep Singh bcf705c162
Merge pull request #1696 from projectdiscovery/proxy-internal-requests
Adding proxy support for internal standard HTTP requests
2022-03-24 16:28:44 +05:30
Sandeep Singh 8ee4f9f797
Merge branch 'dev' into proxy-internal-requests 2022-03-23 23:12:51 +05:30
Xavier Stevens 4a65097194 Squashed commit of the following:
commit b590de2de14923e4cb35dd19845e12833a4ccbfa
Author: Xavier Stevens <xstevens@users.noreply.github.com>
Date:   Wed Mar 23 08:29:37 2022 -0700

    Updated rand_ip to use variadic args

commit ea883be8c0aa56174a1301252129289334659f3f
Author: Xavier Stevens <xstevens@users.noreply.github.com>
Date:   Tue Mar 22 16:59:19 2022 -0700

    Updated rand_ip function to handle multiple CIDRs
2022-03-23 08:37:05 -07:00
mzack 6213454cb3 small code refactor 2022-03-22 15:16:22 +01:00
mzack 5cd25bd069 more checks + test cases fix 2022-03-22 14:18:01 +01:00
mzack 3288c77692 fixing headless test cases 2022-03-22 13:47:13 +01:00