Commit Graph

144 Commits (76e6677e686cc87aa83c9c0de75e41f6073ef41d)

Author SHA1 Message Date
Dogan Can Bakir 7c2db9c394
introduce `template-encoded` field (#4315)
* introduce `template-encoded` field

* remove IsCustomTemplate func

* refactor and move encoding to `MakeResultEventItem` func

* encode template in case of no results were found

* commit to last commit

* don't encode templates when`-ms` is used
2023-11-11 04:42:27 +05:30
Mzack9999 3d37e4603d
Bugfix bin pack (#4298)
* misc update

* chore(deps): bump github.com/gin-gonic/gin from 1.9.0 to 1.9.1 (#4252)

Bumps [github.com/gin-gonic/gin](https://github.com/gin-gonic/gin) from 1.9.0 to 1.9.1.
- [Release notes](https://github.com/gin-gonic/gin/releases)
- [Changelog](https://github.com/gin-gonic/gin/blob/master/CHANGELOG.md)
- [Commits](https://github.com/gin-gonic/gin/compare/v1.9.0...v1.9.1)

---
updated-dependencies:
- dependency-name: github.com/gin-gonic/gin
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* fixing binary encoding

* pointing gostruct to dev branch

* dep update

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-11-04 21:12:15 +05:30
sandeep 4db5756fd0 go mod tidy 2023-11-02 20:01:13 +05:30
Dogan Can Bakir 83abe0969e
introduce `self-contained` to headless (#4322)
* introduce `self-contained` to headless

* fix matched url print
2023-11-02 19:08:20 +05:30
Tarun Koyalwar 595ba8e3a5
bug fixes in js , network protocol and flow (#4313)
* fix net read

* only return N bytes if extra available

* use ConnReadN from readerutil

* add integration test

* print unsigned warning in stderr

* fix js protocol in flow #4318

* fix integration test: url encoding issue

* fix network protocol issue + integration tests

* multiple improvements to integration test

* replace all conn.Read() from tests

* disable network-basic.yaml in windows

* disable code protocol in win CI

* fix bitwise login  ps1-snippet.yaml

* hide previous matcher events in flow

* remove dead code+ update integration tests

---------

Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
2023-11-02 13:33:40 +05:30
Dogan Can Bakir c79d2f05c4
fix trailing dot (#4295)
* fix trailing dot

* remove trailing dot from `domain`

* remove trailing dots from answer

* remove dots

* fix integration test
2023-11-01 16:51:22 +05:30
Dogan Can Bakir 1d0fbc0b62
restructure repo dir (#4293)
* restructure repo dir

* fix path in test
2023-10-30 21:00:51 +05:30
Tarun Koyalwar 83681fb308
misc sdk enhancements (#4301)
* add template sign/parse  methods

* export installer package

* add readme

* consistent implementation of writefailure

* fix lint error
2023-10-30 19:02:06 +05:30
sandeep 7aab84eae7 version update 2023-10-26 21:27:51 +05:30
Tarun Koyalwar 5c9af62037
fix relative path issue + remove residual code (#4284)
* fix relative path issue + remove residual code

* use template dir in templateFS

* fix dir relative path issue

* print metrics server address in verbose mode

* add timeout for downloading binary & templates

* update stats & metrics docs

* add template-id loader integration test
2023-10-26 19:07:04 +05:30
sandeep 7522895ca8 version update 2023-10-20 17:55:23 +05:30
Tarun Koyalwar e9ab5f498a
template preprocessor + multi request variables indexing bug fix (#4262)
* add randstr preprocessor to defaults

* fix indexing in http + preprocessor integration test

* add multi-request integration test

* skip test if asnmap is down
2023-10-20 17:54:10 +05:30
sandeep 990cec0de1 version update 2023-10-19 19:10:29 +05:30
Tarun Koyalwar dc44105baf
nuclei v3 : misc updates (#4247)
* use parsed options while signing

* update project layout to v3

* fix .gitignore

* remove example template

* misc updates

* bump tlsx version

* hide template sig warning with env

* js: retain value while using log

* fix nil pointer derefernce

* misc doc update

---------

Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2023-10-17 17:44:13 +05:30
Mzack9999 12c9ca7b12 fixing go mod 2020-09-23 22:38:59 +02:00
Víctor Zamanillo 5955ee0caf Merge branch 'master' into tpl-http-port-path-preference 2020-09-19 22:40:41 +02:00
Víctor Zamanillo dc03f284f6 Improved doc for Position method 2020-09-19 22:26:59 +02:00
Víctor Zamanillo 5ff4fdb75a Added severity to match output message
Implements a new NewNucleiColorizer to colorize all nuclei messages (included severity).
Fixes severity color is always colorized even with nocolor flag.
2020-09-19 14:43:35 +02:00
Ice3man543 9324996961 Added group capturing in backward compatible way 2020-09-17 12:01:51 +05:30
Ice3man 497136463b
Merge pull request #294 from CasperGN/master
Same-name-headers are chunked into 1 line when matching
2020-09-15 02:24:30 -07:00
Ice3man543 011c88ade7 Fixed inconsistent output hopefully 2020-09-10 16:32:01 +05:30
Casper Guldbech Nielsen 59ee0ad80e Ensure that same-name-headers doesnt get chunked into one line for more accurate matching
Signed-off-by: Casper Guldbech Nielsen <whopsec@protonmail.com>
2020-09-09 16:24:59 +02:00
Víctor Zamanillo 557bae93da gofmt 2020-09-05 18:27:02 +02:00
Víctor Zamanillo 5f7e6eadae Do not wrap errors
It makes the warning message unreadable e.j: "Could not execute step: could not handle http request: Could not do request: ERR"
2020-09-05 14:46:24 +02:00
Víctor Zamanillo 406f35b67e Keep port and path preference from template def over input URL 2020-09-05 14:44:47 +02:00
Víctor Zamanillo 4ebd6ad58d Fix for #280
split header string once with SplitN 2
2020-09-02 10:01:45 +02:00
Víctor Zamanillo 6a4629e47a Enriched verbose request mesages
The message "Sent Type request to" is redundant and noisy and does not provide any useful information, we enriched it adding the template id.
2020-08-31 11:58:12 +02:00
bauthard d7451a6c90
Merge pull request #266 from vzamanillo/json-output-template-name
Add template name to JSON output
2020-08-31 01:18:01 +05:30
Víctor Zamanillo 0c616af51c Removed dup code 2020-08-29 16:07:13 +02:00
Víctor Zamanillo e774104f41 Add template name to JSON output
Fixes  #258
2020-08-27 22:13:42 +02:00
Víctor Zamanillo 113ccb1e0e Preload workflow templates once
Fixes memory leak reported on #242
2020-08-26 20:05:31 +02:00
Víctor Zamanillo 60005290b1 Initial adoption of golangci-lint for CI 2020-08-25 23:33:20 +02:00
Ice3man543 458dbc1b38 v2 update 2020-07-01 16:17:24 +05:30
Mzack9999 dd1961f1e2
Merge pull request #111 from projectdiscovery/feature-workflow
Workflow Support
2020-06-29 17:18:52 +02:00
Ice3man543 9d27eb8365 Fixed raw request newline & blank path 2020-06-29 19:50:11 +05:30
Ice3man543 b3c52d941f Added directory support 2020-06-29 17:43:08 +05:30
Mzack9999 2b109b5a82 rebased on master 2020-06-27 22:01:01 +02:00
Ice3man543 d8d3622a5e Added json output support 2020-06-27 20:19:43 +05:30
Mzack9999 429369c971 added dns support in workflow 2020-06-26 15:10:42 +02:00
Mzack9999 d3ceb76585 uniformed template loading 2020-06-26 14:37:55 +02:00
Mzack9999 226cb23c97 workflow prototype 2020-06-26 10:23:54 +02:00
Ice3man543 6acf0d4cf6 Inform user and no output file in case of 0 results 2020-06-22 19:57:32 +05:30
Ice3man543 be3157eac3 Added better debug and verbose modes 2020-06-22 19:30:01 +05:30
bauthard 7adda0b748
updating user-agent to include project details 2020-05-26 13:55:39 +05:30
Mzack9999 91cd7cab10 custom header via cli 2020-05-22 00:23:38 +02:00
Mzack9999 6aff9b88ad automatic body decompression for user defined encoding 2020-05-18 21:36:00 +02:00
Mzack9999 375c3163f7 added payload info to output 2020-05-14 18:09:36 +02:00
Mzack9999 6cce1ea1bf solved many issues - yet to improve the output verbosity 2020-05-05 21:42:28 +02:00
Mzack9999 44821e6b77 begin of work on fuzzing - only working for raw requests with payload (TODO code cleanup) 2020-05-04 23:26:22 +02:00
Mzack9999 ea25489322
Merge pull request #61 from projectdiscovery/feature-raw-requests
HTTP + DNS Raw requests
2020-04-30 21:28:27 +02:00
Mzack9999 920a561819 removed fasttemplate 2020-04-30 17:39:33 +02:00
Mzack9999 5865cda707 small fix 2020-04-29 23:07:19 +02:00
Mzack9999 ec7cd50e22 added support for multiple raw requests 2020-04-29 21:19:35 +02:00
Mzack9999 f5b6474a11 almost working implementation 2020-04-29 02:57:18 +02:00
Mzack9999 c6a9c09ec4 adding raw field also to dns request 2020-04-28 23:03:08 +02:00
Mzack9999 7ce93ed549 begin of work on raw requests support 2020-04-28 23:02:07 +02:00
Mzack9999 9b9bb05cfe added socks5 credentials support 2020-04-28 22:15:26 +02:00
Mzack9999 8b5a2ff828
Merge branch 'master' into feature-dsl-query 2020-04-28 18:44:13 +02:00
Mzack9999 a05faa868d adding proxy socks support - untested 2020-04-28 04:01:25 +02:00
Mzack9999 1b60c87312 http header to lowercase 2020-04-28 03:23:51 +02:00
Ice3man 8947d46780
Merge pull request #54 from projectdiscovery/proxy-bug-fix
Fixed a bug with proxyURL
2020-04-27 12:00:35 -07:00
Ice3man543 e05fa0d9bf Fixed a bug with proxyURL 2020-04-28 00:29:57 +05:30
Ice3man543 405c6c0a0e Added case-sensitive matchers 2020-04-28 00:01:36 +05:30
Ice3man543 42489f6d97 Added proxy URL support 2020-04-27 23:49:53 +05:30
Ice3man543 f2852faa2c Added header templating support 2020-04-27 23:40:21 +05:30
Ice3man543 ca884947e5 Added unique regex values support 2020-04-27 23:34:08 +05:30
Mzack9999 ecd598da9b added some helper function 2020-04-27 01:28:32 +02:00
Mzack9999 2c3c269e75 poc dsl language support in matchers 2020-04-26 23:32:58 +02:00
Ice3man543 d7a1a31dcd Fixed panic with dns output file usage 2020-04-26 23:11:49 +05:30
Ice3man543 3cfedd87e0 Fixed an infinite loop issue 2020-04-26 07:02:38 +05:30
Ice3man543 5af4c9b2cf Finished executer for per-request execution 2020-04-26 06:33:59 +05:30
Ice3man543 4be566192f Added executor + refactor 2020-04-26 05:50:33 +05:30
bauthard b886a0c4f0
Merge pull request #33 from projectdiscovery/feature-dns-request
implementation of DNS templating
2020-04-24 21:08:29 +05:30
Mzack9999 cdcdb44b29 adding dns label to matched dns queries 2020-04-24 15:59:40 +02:00
Ice3man 0290c9ac8d
Update matchers.go 2020-04-24 06:54:46 +05:30
Mzack9999 fd217887b9 removed unused file 2020-04-23 18:46:46 +02:00
Mzack9999 a6b2a44080 rebase 2020-04-23 18:44:34 +02:00
Mzack9999 cb938b379c poc implementation of dns templating 2020-04-23 18:41:27 +02:00
Ice3man543 2c58a33913 Added configurable redirects per request 2020-04-23 03:56:41 +05:30
Ice3man 9c6d5fbb9c
Merge pull request #32 from NkxxkN/NkxxkN/multiple-fingerprints
Support for multiple fingerprints in single template #25
2020-04-22 14:33:28 -07:00
Mzack9999 603456ddbb poc implementation of dns templating 2020-04-22 22:45:02 +02:00
Kevin Antoine a303cd5723 Support for multiple fingerprints in single template #25 2020-04-22 14:32:13 +02:00
toufik-airane 53ac2db540
[feature] add binary rules capability
add binary characters to the rules engine capability.
In fact, the issue is that I want to bypass the utf-8 issue with
Golang and have a dedicated capability to create binary rules.
2020-04-21 20:50:35 +02:00
Ice3man543 12f986ff7b Added extractors to the workflow + misc 2020-04-06 00:44:45 +05:30
Ice3man543 d25c189bed Added extractors for text extraction 2020-04-06 00:05:01 +05:30
Ice3man543 9d905e1f8e Fixed a bug with all field on matching 2020-04-06 00:03:55 +05:30
Ice3man543 042f77c9a0 Fixed #5 leading to default headers not being set 2020-04-05 23:58:22 +05:30
Ice3man543 2db1ad6ce9 Added retryablehttp 2020-04-04 17:12:29 +05:30
Ice3man543 4cb8324b68 Added working runners + misc + logics etc 2020-04-04 15:59:05 +05:30
Ice3man543 0cfb512447 Added dynamic templating 2020-04-04 03:26:11 +05:30
Ice3man543 b78907ad46 Added requests + compile 2020-04-04 02:50:32 +05:30
Ice3man543 3024b488a5 Tests + fixed a condition logic bug 2020-04-04 00:32:03 +05:30
Ice3man543 dd8485a6e0 Added readme + templates/requests start 2020-04-04 00:17:57 +05:30
Ice3man543 69983ae4a2 Added matchers package 2020-04-04 00:16:27 +05:30