Commit Graph

2774 Commits (af2aaacbc93e0e9cf0b775af0eff2942c5e3a382)

Author SHA1 Message Date
Tarun Koyalwar af2aaacbc9
fix url panic (#3092) 2022-12-27 22:41:33 +05:30
Shubham Rasal 91f6fdfb36
Merge pull request #3031 from projectdiscovery/parse_from_reader
Add ParseTemplateFromReader function
2022-12-27 20:47:49 +05:30
shubhamrasal 1df878fdd2 add template path in json output 2022-12-27 20:02:48 +05:30
dependabot[bot] def88ba119
chore(deps): bump go.uber.org/multierr from 1.8.0 to 1.9.0 in /v2 (#3087)
Bumps [go.uber.org/multierr](https://github.com/uber-go/multierr) from 1.8.0 to 1.9.0.
- [Release notes](https://github.com/uber-go/multierr/releases)
- [Changelog](https://github.com/uber-go/multierr/blob/master/CHANGELOG.md)
- [Commits](https://github.com/uber-go/multierr/compare/v1.8.0...v1.9.0)

---
updated-dependencies:
- dependency-name: go.uber.org/multierr
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-12-26 21:01:54 +05:30
dependabot[bot] 56e7b23a89
chore(deps): bump github.com/projectdiscovery/wappalyzergo in /v2 (#3084)
Bumps [github.com/projectdiscovery/wappalyzergo](https://github.com/projectdiscovery/wappalyzergo) from 0.0.74 to 0.0.75.
- [Release notes](https://github.com/projectdiscovery/wappalyzergo/releases)
- [Commits](https://github.com/projectdiscovery/wappalyzergo/compare/v0.0.74...v0.0.75)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/wappalyzergo
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-12-26 21:01:19 +05:30
dependabot[bot] 77176493aa
chore(deps): bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in /v2 (#3083)
Bumps [github.com/aws/aws-sdk-go-v2/feature/s3/manager](https://github.com/aws/aws-sdk-go-v2) from 1.11.43 to 1.11.46.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases)
- [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/CHANGELOG.md)
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/feature/s3/manager/v1.11.43...feature/s3/manager/v1.11.46)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/feature/s3/manager
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-12-26 21:01:05 +05:30
Mzack9999 34976029d3
removing most go routine leaks (#3073)
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2022-12-24 19:22:14 +05:30
Tarun Koyalwar aee0870617
scanallip handle edge cases (#3080)
* bug fix:remove port during dns resolution

* scanallip fix edge cases

* add scanallips testcases

* workflow fix

* removing pull cmd

* Auto Generate Syntax Docs + JSONSchema [Sat Dec 24 13:29:21 UTC 2022] 🤖

Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
Co-authored-by: GitHub Action <action@github.com>
2022-12-24 19:03:23 +05:30
shubhamrasal 406d0c1873 Rename function from ParseFromReader to ParseTemplateFromReader 2022-12-22 11:04:16 +05:30
Sandeep Singh 96646c8f53
cloud templates targets sync (#2959)
* Add s3 bucket template provider

- Refactor the custom github template code
- add interface for template provider

* Validate if aws creds are passed if bucket flag

- refactor s3 provider struct to take client
- add function which returns the aws s3 client
- update error messages

* Add aws s3 bucket flags documentation in README.md

- Rename the github_test.go to customTemplate_test.go

* go mod update

* Move template provider code to pkg/external/customtemplates dir

* Added initial data_source sync to cloud

* Misc

* Add pagination to scan output and scan list (#2858)

* Add pagination to scan output and scan list

* Use time based parameters instead of page numbers

* Fix linting errors

* Do not check limits at client, check at server

* Remove unused constant

* Misc update

* Removed unnecessary flags

* Misc

* Misc

* Misc endpoint additions

* Added more routes

* Typo fix

* Misc fixes

* Misc

* Misc fixes to cloud target logic + use int for IDs

* Misc

* Misc fixes

* Misc

* Misc fixes

* readme update

* Add JSON output support for list-scan option (#2876)

* Add JSON output support for list-scan option

* Fix typo in cloud JSON output description

* Following changes

- Update status(finished, running) to be lower-case by default
- Convert status to upper-case in DisplayScanList()

* Update status to be lower-case by default

* Remove additional json flag, instead use existing

* Merge conflict

* Accomodate comment changes and restructure code

Co-authored-by: Jaideep K <jaideep@one2n.in>

* Use integer IDs for scan tasks

* Added get-templates-targets endpoint + JSON + validation

* Added target count list

* misc option / description updates

* Added changes as per code review

* duplicate options + typo updates

* Added tablewriter for tabular data writing by default

* Fixed list scan endpoint

* Review changes

* workflow fix

* Added cloud tags etc based filtering (#3070)

* Added omitempty for filtering request

* go mod tidy

* misc format update

Co-authored-by: shubhamrasal <shubhamdharmarasal@gmail.com>
Co-authored-by: Ice3man <nizamulrana@gmail.com>
Co-authored-by: Jaideep Khandelwal <jdk2588@gmail.com>
Co-authored-by: Siddharth Shashikar <60960197+shashikarsiddharth@users.noreply.github.com>
Co-authored-by: Jaideep K <jaideep@one2n.in>
2022-12-21 22:48:43 +05:30
Mzack9999 093d691c16
Issue 3033 deny list (#3037)
* fixing file deny list + refactoring

* err variable renaming

* removing redundant function

* removing unused code

* adding check on empty operator

* updating tests
2022-12-21 02:29:28 +05:30
xm1k3 bbb561b097
CLI variables are not accessible in SSL Protocol (#3069)
* added vars payload also in ssl

* fix on ssl.go, moved function on payloadValues creation

* added integration test

* rebase + minor changes

Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
2022-12-21 02:02:18 +05:30
xm1k3 aaae68ee50
The debug flags do not work correctly with headless templates (#3030)
* added check on BaseURL

* added debug flag instead on info

* added also debug response flag

* code refactoring
2022-12-20 17:30:34 +05:30
dependabot[bot] 71cdb1c335
chore(deps): bump github.com/projectdiscovery/goflags in /v2 (#3057)
Bumps [github.com/projectdiscovery/goflags](https://github.com/projectdiscovery/goflags) from 0.1.5 to 0.1.6.
- [Release notes](https://github.com/projectdiscovery/goflags/releases)
- [Commits](https://github.com/projectdiscovery/goflags/compare/v0.1.5...v0.1.6)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/goflags
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-12-20 16:54:35 +05:30
Mzack9999 2445662fb1
Fix memory leak on hmap with LRU (#3052)
* fix memory leak on hmap with LRU

* fixing lint issues
2022-12-20 15:37:48 +05:30
Tarun Koyalwar 63150a8ee4
add stop-at-first-match for headless protocol (#3034)
* headless: adds stop-at-first-match

* GH workflow fix

* misc fix

* headless use spm option

Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2022-12-19 19:52:17 +05:30
shubhamrasal b51aac290e Add tests folder 2022-12-19 19:15:04 +05:30
shubhamrasal cff0d88742 Add tests for parse function
- update the ioutils to io.ReadAll
- remove extra line
2022-12-19 18:51:20 +05:30
Mzack9999 4c2d120e3d
Merge pull request #3059 from projectdiscovery/dependabot/go_modules/v2/dev/github.com/aws/aws-sdk-go-v2-1.17.3
chore(deps): bump github.com/aws/aws-sdk-go-v2 from 1.17.2 to 1.17.3 in /v2
2022-12-19 12:47:00 +01:00
Mzack9999 4df98b26c2
Merge pull request #3060 from projectdiscovery/dependabot/go_modules/v2/dev/github.com/projectdiscovery/wappalyzergo-0.0.74
chore(deps): bump github.com/projectdiscovery/wappalyzergo from 0.0.73 to 0.0.74 in /v2
2022-12-19 12:46:49 +01:00
Mzack9999 c86abc8480
Merge pull request #3061 from projectdiscovery/dependabot/go_modules/v2/dev/github.com/xanzy/go-gitlab-0.77.0
chore(deps): bump github.com/xanzy/go-gitlab from 0.76.0 to 0.77.0 in /v2
2022-12-19 12:46:38 +01:00
Mzack9999 424393fd1b
Merge pull request #3058 from projectdiscovery/dependabot/go_modules/v2/dev/github.com/projectdiscovery/ratelimit-0.0.3
chore(deps): bump github.com/projectdiscovery/ratelimit from 0.0.2 to 0.0.3 in /v2
2022-12-19 12:46:15 +01:00
Owen Rumney b3d6155f57
fix: Check workflow templates when creating inputhttp helper (#3049)
* go mod update

* fix: Take workflow templates into account when building input helper

- when input helper is created, workflow templates aren't taken into account when deciding if http/https should be added to the inputsHTTP
- include the store.Workflows into the slice of templates that is checked for HTTP Protocol

Resolves #3048

Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2022-12-19 17:04:09 +05:30
dependabot[bot] 69b1b543e8
chore(deps): bump github.com/xanzy/go-gitlab in /v2
Bumps [github.com/xanzy/go-gitlab](https://github.com/xanzy/go-gitlab) from 0.76.0 to 0.77.0.
- [Release notes](https://github.com/xanzy/go-gitlab/releases)
- [Changelog](https://github.com/xanzy/go-gitlab/blob/master/releases_test.go)
- [Commits](https://github.com/xanzy/go-gitlab/compare/v0.76.0...v0.77.0)

---
updated-dependencies:
- dependency-name: github.com/xanzy/go-gitlab
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-12-19 05:03:32 +00:00
dependabot[bot] 6dd1ee4f53
chore(deps): bump github.com/projectdiscovery/wappalyzergo in /v2
Bumps [github.com/projectdiscovery/wappalyzergo](https://github.com/projectdiscovery/wappalyzergo) from 0.0.73 to 0.0.74.
- [Release notes](https://github.com/projectdiscovery/wappalyzergo/releases)
- [Commits](https://github.com/projectdiscovery/wappalyzergo/compare/v0.0.73...v0.0.74)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/wappalyzergo
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-12-19 05:03:28 +00:00
dependabot[bot] 9eb2c75b4c
chore(deps): bump github.com/aws/aws-sdk-go-v2 in /v2
Bumps [github.com/aws/aws-sdk-go-v2](https://github.com/aws/aws-sdk-go-v2) from 1.17.2 to 1.17.3.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases)
- [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/CHANGELOG.md)
- [Commits](https://github.com/aws/aws-sdk-go-v2/compare/v1.17.2...v1.17.3)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-12-19 05:03:24 +00:00
dependabot[bot] f0b8d3a370
chore(deps): bump github.com/projectdiscovery/ratelimit in /v2
Bumps [github.com/projectdiscovery/ratelimit](https://github.com/projectdiscovery/ratelimit) from 0.0.2 to 0.0.3.
- [Release notes](https://github.com/projectdiscovery/ratelimit/releases)
- [Commits](https://github.com/projectdiscovery/ratelimit/compare/v0.0.2...v0.0.3)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/ratelimit
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-12-19 05:03:02 +00:00
Sandeep Singh b7337a9626
bug fix tlsx ocsp panic(#3036) (#3041)
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2022-12-15 23:34:09 +05:30
xm1k3 0e3be82c72
Resuming rewriting the output file contents, so previous data removed (#2890)
* used OpenFile instead of Create()

* reverted to original mode

* fixes and resume flag added

* fix on noTimestapt var

* fix on flag

* better code refactoring

* fix on debug error

* code refactoring on file management
2022-12-15 21:11:23 +05:30
Víctor fd59841372
Replace break line characters with HTML notation when exporting to markdown (#3014)
* Fixes #2997, replace break line characters with HTML notation to avoid render the field text in a new line.

* using short helper

Co-authored-by: Víctor Zamanillo <victor.zamanillo@cifraeducacion.com>
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
2022-12-15 18:30:40 +05:30
shubhamrasal de3dda0030 Update the Parse function to use ParseFromReader 2022-12-15 17:41:07 +05:30
Mzack9999 a19385376c
Extending YAML to support include preprocessing (#1767)
* Add support for include directive

* adding yamlc support

* mod tidy

* removing yamlc

* moving code around
2022-12-14 01:05:14 +05:30
Mzack9999 221cd7b6a2
Merge pull request #3007 from vzamanillo/input-transform-refactor
Significant refactor around the input to type conversion
2022-12-13 14:12:21 +01:00
Mzack9999 aed709bd06 using helpers 2022-12-13 13:43:54 +01:00
Víctor Zamanillo bbee2ee8db Removed else branch
typeHostWithOptionalPort return the host raw input value if has not port
2022-12-13 09:07:52 +01:00
shubhamrasal 198d84ec25 Add ParseFromReader function 2022-12-13 12:57:47 +05:30
Tarun Koyalwar a5b39dcaa5
automerge url parameters from input and templates (#3010)
* fix automerge url parameters

* fix url encoding & refactor raw request

* handle trailing slash edgecases

* minor code refactoring
2022-12-13 12:09:31 +05:30
Chris Mandich aeddddc31f
Add exporter for splunk hec reporting (#3008)
* Update LICENSE.md

* removing per project COC in favor of global one (#2983)

* removing per project COC in favor of global one

* using global security info

* go mod update

* Add Splunk HEC Exporter support to Nuclei

* small refactor

Co-authored-by: Jane <5116641+JaneX8@users.noreply.github.com>
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
2022-12-12 21:26:32 +05:30
Jaideep Khandelwal 19b56570b5
retry with 504 status code (timeouts) (#2852)
* Incase of 504/timeouts, do retry

* Update the version and pass the custom policy from outside
2022-12-12 16:43:21 +05:30
Sandeep Singh 8a75cb2574
Merge pull request #3025 from projectdiscovery/dependabot/go_modules/v2/dev/github.com/projectdiscovery/wappalyzergo-0.0.73
chore(deps): bump github.com/projectdiscovery/wappalyzergo from 0.0.71 to 0.0.73 in /v2
2022-12-12 13:51:58 +05:30
Sandeep Singh 756639e0cb
Merge pull request #3026 from projectdiscovery/dependabot/go_modules/v2/dev/github.com/go-git/go-git/v5-5.5.1
chore(deps): bump github.com/go-git/go-git/v5 from 5.5.0 to 5.5.1 in /v2
2022-12-12 13:51:35 +05:30
Sandeep Singh 48e3bb778e
Merge pull request #3027 from projectdiscovery/dependabot/go_modules/v2/dev/golang.org/x/net-0.4.0
chore(deps): bump golang.org/x/net from 0.2.0 to 0.4.0 in /v2
2022-12-12 13:51:19 +05:30
dependabot[bot] ac88ffb8c9
chore(deps): bump github.com/klauspost/compress in /v2
Bumps [github.com/klauspost/compress](https://github.com/klauspost/compress) from 1.15.12 to 1.15.13.
- [Release notes](https://github.com/klauspost/compress/releases)
- [Changelog](https://github.com/klauspost/compress/blob/master/.goreleaser.yml)
- [Commits](https://github.com/klauspost/compress/compare/v1.15.12...v1.15.13)

---
updated-dependencies:
- dependency-name: github.com/klauspost/compress
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-12-12 05:05:07 +00:00
dependabot[bot] c83c53dc39
chore(deps): bump golang.org/x/net from 0.2.0 to 0.4.0 in /v2
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.2.0 to 0.4.0.
- [Release notes](https://github.com/golang/net/releases)
- [Commits](https://github.com/golang/net/compare/v0.2.0...v0.4.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-12-12 05:04:56 +00:00
dependabot[bot] b5ee903f9c
chore(deps): bump github.com/go-git/go-git/v5 from 5.5.0 to 5.5.1 in /v2
Bumps [github.com/go-git/go-git/v5](https://github.com/go-git/go-git) from 5.5.0 to 5.5.1.
- [Release notes](https://github.com/go-git/go-git/releases)
- [Commits](https://github.com/go-git/go-git/compare/v5.5.0...v5.5.1)

---
updated-dependencies:
- dependency-name: github.com/go-git/go-git/v5
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-12-12 05:04:48 +00:00
dependabot[bot] c6dc0f3831
chore(deps): bump github.com/projectdiscovery/wappalyzergo in /v2
Bumps [github.com/projectdiscovery/wappalyzergo](https://github.com/projectdiscovery/wappalyzergo) from 0.0.71 to 0.0.73.
- [Release notes](https://github.com/projectdiscovery/wappalyzergo/releases)
- [Commits](https://github.com/projectdiscovery/wappalyzergo/compare/v0.0.71...v0.0.73)

---
updated-dependencies:
- dependency-name: github.com/projectdiscovery/wappalyzergo
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-12-12 05:04:40 +00:00
sandeep 7c2cad7845 dev version update 2022-12-11 18:36:21 +05:30
sandeep f167ad774b bug fix release 2022-12-11 18:13:35 +05:30
sandeep 7274771163 Merge branch 'dev' of https://github.com/projectdiscovery/nuclei into dev 2022-12-11 18:07:30 +05:30
sandeep 9364890d9f go mod update 2022-12-11 18:07:23 +05:30