bf08913cd0
update logic + config management refactor ( #3567 )
...
* adds template manager
* refactor: checkpoint
* centrailized config & template download logic
* refactor removed unused code
* use global template directory
* update related bug fixes
* bug fix create cfg dir if missing
* fix lint error
* bug fix skip writing template dir in callback
* misc update
* remove unused code
* use strings.equalfold for comparison
---------
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2023-04-19 21:58:48 +05:30
6f4b1ae48a
Replacing ccache with generic gcache ( #3523 )
...
* Replacing ccache with generic gcache
* fixing lint issues
* removing unecessary hashing + using errorutils
* making test more tolerant
* removing dead code + refactor
* removing redundant code
* removing race
* maint
* moving code
* adding more iterations
* note + typo
* temporary fixing stop-at-first-match with interact
* wrapping internal map with mux
* sort before running integration test
* fix deadlock in requestShouldStopAtFirstMatch
* add timeout to integration_test workflow
* attempting to remove outer lock
* adds interactsh protocol tests in integration_test
---------
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2023-04-16 23:19:35 +05:30
45cc676f96
Evaluate payload variables ( #3503 )
...
* Evaluate payload variables
* Add variables evaluation
* Extend variables test
- to check evaluation of global variables in variables
- to check evaluation of golbal variables in payload
* Add default and cli variables to websocket, whois and dns proto
- use url.Parse with urlutil.Parse
2023-04-12 01:50:58 +05:30
a185348194
fix integration test ( #3506 )
...
* fix integration test
* fix interactsh fatal error
2023-04-04 10:09:52 +08:00
1b7585476e
simplify execution logic
2023-03-17 17:31:28 +01:00
6a0db1c234
restoring tests
2023-03-17 16:56:14 +01:00
c115768b8e
investigating tests
2023-03-17 15:39:12 +01:00
c9634fae72
Issue 3350 matcher condition or not work ( #3397 )
...
* fix or condition match even interactsh includes as matcher-part (#3350 )
* add integration test
* add new template to integration test
* matcher-condtion: test case for both conditions
* fix lint errors
* upgrade dependencies
---------
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2023-03-15 20:45:44 +05:30
0bf8fc027d
Fixing nil pointer reference + use map helper ( #3421 )
...
* Fixing nil pointer reference + use map helper
* bump tlsx version to v1.0.6
* increase interactsh polling in integration_test
* fix nil pointer dereference in integration_test
* fix lint error
---------
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2023-03-14 21:27:48 +05:30
0d90a555f6
adds `-track-error` option to add custom errors to max-host-error watchlist ( #3399 )
...
* Allow user to specify for "context deadline exceeded" errors to count toward the max host error count
* Convert flag to a string slice `--track-error`
* Minimize diff
* Add documentation for `-track-error`
* adds unit test & minor improvements
* update flag description
---------
Co-authored-by: Austin Traver <austin_traver@intuit.com>
Co-authored-by: Tarun Koyalwar <tarun@projectdiscovery.io>
2023-03-14 13:59:42 +05:30
572c8eb780
Issue 2987 fuzz options ( #3355 )
...
* Add override fuzzing type and mode flags
* Update english readme
* Fix failing tests
* Add the integration tests
- validate the command line overriding type and mode for fuzzing
2023-03-06 16:56:38 +05:30
d9e953acfa
fix file input in custom vars for self contained http template ( #3385 )
...
* fix file input in variables(-V)
* fix lint error
* fix nuclei-ignore file failures
2023-03-04 04:57:27 +05:30
bab15e122b
http.DefaultClient replaced with retryablehttp
2023-03-02 21:21:04 +01:00
d80cbef51d
Merge pull request #3333 from CodFrm/main
...
fix some json deserialization issues
2023-02-28 09:02:04 +01:00
21b03a2e8a
bug fix in url path and adds integration tests ( #3331 )
...
* fix unsafe edgecases+ adds integration test
* bug fixes and more url testcases
* upgrade cfssl
* fix template id in integration test
2023-02-20 22:26:04 +05:30
10693efa05
add integration tests
2023-02-17 14:23:28 +08:00
cc2f796d2f
Helper function for IP Formats ( #3286 )
...
* implemented ip_format helper function
* added tests on ip_format() helper
* fixes on logic
* fixes related to mapcidr docs
* better error value
* fixes + unit test to check index 11
* added call for integration tests
* fixes on dsl-functions number
---------
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
2023-02-17 01:47:40 +05:30
d608ffaeb2
clear after stop ( #3312 )
...
* clear after stop
* fixing data races
* adding atomic cache
* fixing lint errors
* fixing imports
2023-02-13 16:46:41 +05:30
628628893c
fix make http request inconsistencies ( #3243 )
...
* fix make http request inconsistencies
* remove parameters from http vars
* fix trailingslash unit test
* naming conventions: best practices
* fix publish docs action
* remove branch ref from push
2023-02-01 17:23:28 +05:30
0b2a3e296a
fix url encoding issues and inconsistencies ( #3211 )
...
* fix url encoding issues
* complete requested changes and improvements
* fix missing issue-tracker-config.yaml
* fuzz: deepcopy and use urlutil.Params
2023-01-24 22:04:52 +05:30
d956275e98
Adding content length edge cases ( #3147 )
...
* adding content length edge cases
* fixing CL behavior
* suppressing -1 error
* fixing path
2023-01-07 18:06:44 +05:30
a96f764959
extending request/response hijacking with native calls ( #3091 )
...
* extending request/response hijacking with native calls
* fixing tests
2023-01-05 17:26:18 +05:30
c273cbc8cb
Merge pull request #3134 from projectdiscovery/issue-3131-unused-code
...
Removing unused code in integration tests
2023-01-04 11:59:12 +05:30
e66ed30cec
fix missing trailing slash ( #3127 )
...
* raw: fix missing trailing slash
* adds rawpath integration test
* rename trailing slash test
2023-01-03 23:45:34 +05:30
463f4dd8c8
removing unused code in integration tests
2023-01-03 08:24:33 +01:00
7093180b6d
Add support to query DNS TLSA record ( #3054 )
...
* Add support to query DNS TLSA record
* fix build test
* fix ci-lint
* set expected to 0
* test domain update
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2022-12-28 21:12:02 +05:30
34976029d3
removing most go routine leaks ( #3073 )
...
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2022-12-24 19:22:14 +05:30
bbb561b097
CLI variables are not accessible in SSL Protocol ( #3069 )
...
* added vars payload also in ssl
* fix on ssl.go, moved function on payloadValues creation
* added integration test
* rebase + minor changes
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
2022-12-21 02:02:18 +05:30
3904d541be
Added http probing to clustering + add disable-clustering flag ( #3019 )
...
* Added http probing to clustering + add disable-clustering flag
* misc update
* Commented out failing test
* Fixed lint error
Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2022-12-11 18:06:21 +05:30
0295ca19bc
Add `split` DSL function ( #2838 )
...
* Add support for showing overloaded DSL method signatures
* Add `split` DSL function #2837
* fixing lint warnings
* replacing faulty regex with strings methods
Co-authored-by: Mzack9999 <mzack9999@protonmail.com>
Co-authored-by: mzack <marco.rivoli.nvh@gmail.com>
2022-11-14 06:08:12 +05:30
1fbbca66f9
Adding support to scan all v4/v6 IPs ( #2709 )
...
* Adding support to scan all v4/v6 IPs
* adding tests
* metainput prototype
* using new signature
* fixing nil pointer
* adding request context with metadata
* removing log instruction
* fixing merge conflicts
* adding clone helpers
* attempting to fix ipv6 square parenthesis wrap
* fixing dialed ip info
* fixing syntax
* fixing output ip selection
* adding integration tests
* disabling test due to gh ipv6 issue
* using ipv4 only due to GH limited networking
* extending metainput marshaling
* fixing hmap key
* adding test for httpx integration
* fixing lint error
* reworking marshaling/id-calculation
* adding ip version validation
* improving handling non url targets
* fixing condition check
2022-11-09 18:48:56 +05:30
b9472cf7e1
Added fuzzing support for query params + var dump feature ( #2679 )
...
* Added fuzzing support for query params + var dump feature
* Added query-fuzz integration test
* Fixed payloads + added keys-regex fuzz parameter
* Fixed interactsh not working + misc
* Fixed evaluation + added global variables/dsl support to payloads
* Misc fixes related to variables evaluations
* Added http variables support to fuzz
* misc
* Misc
* Added testing playground + misc renaming
* Added support for path and raw request to fuzzing
* Fixed fuzz integration test
* Fixed variable unresolved issue
* Add multiple parameter support with same name
* Added parameter value as 'value' dsl variable for parts
Co-authored-by: Sandeep Singh <sandeep@projectdiscovery.io>
2022-11-01 20:28:50 +05:30
d956f08cb9
Added attack-type option to override template attack-type ( #2724 )
...
* Added attack-type option to override template attack-type
* Added docs + integration tests
2022-10-19 03:51:45 +05:30
a9f5d2defd
reordering unsafe test in the map ( #2721 )
2022-10-15 01:38:32 +05:30
a71f5d5460
Merge pull request #2717 from projectdiscovery/issue-2657
...
updates to execute func in integration-test.go
2022-10-14 15:35:37 +02:00
909aa4cd79
updates to execute func in integration-test.go
2022-10-13 11:05:10 -05:00
cb0da81a14
ratelimit library
2022-10-12 22:04:37 -05:00
781e4e6105
Shared Execution Context Prototype ( #2576 )
...
* renaming var
* Introducing shared execution context prototype
* fixing field name
* adding shared values propagation
* adding shared context lock
* add slice values normalization
* adding integration tests
* adding metadata support for dns
* adding multi-protocol context sharing test
* removing debug test files
* moving contextargs around
* adding comments
* refactoring code
- getter/setter for complex types
- using pointers to avoid heap allocations
2022-10-03 15:42:20 +05:30
18f14b631c
Adding same host redirect support ( #2655 )
...
* simplifying test syntax
* adding same host redirect + refactoring redirect handling
* adding missing file
* adding support for template syntax
* adding integration test
* updating options
* fixing issue on same host redirect
2022-09-29 04:11:28 +05:30
9eea441b0e
Add `sort(list)`, `sort(string)`, `uniq(list)`, `uniq(string)` helper functions ( #2372 )
...
* Add feature in join() to sort a single string slice
Signed-off-by: Myung-jong Kim <mjkim610@gmail.com>
* Add sort helper function and related tests
Signed-off-by: Myung-jong Kim <mjkim610@gmail.com>
* Add uniq helper function and related tests
Signed-off-by: mjkim610 <mjkim610@gmail.com>
Signed-off-by: Myung-jong Kim <mjkim610@gmail.com>
Signed-off-by: mjkim610 <mjkim610@gmail.com>
2022-09-27 02:59:13 +05:30
fc27fc94a5
Added default config generation for reporting options ( #2605 )
2022-09-27 02:40:34 +05:30
99c14f4c9c
implementation of rate limiter with bucket refill and unrestricted token burst ( #2536 )
...
* implementation of rate limiter with interval burst
* fixing import path
* fixing syntax
* adding tests
* fixing lint errors
* adding support for context
* moving rate limiter earlier to avoid hitting timeout
2022-09-19 17:09:28 +05:30
f3eb0daa39
additional dsl functions ( #2550 )
...
* additional dsl functions
* avoid conversion at each iteration
2022-09-08 14:25:34 +05:30
42a0732d68
Add sha512 support ( #2517 )
2022-08-31 12:36:02 +05:30
043189472f
Misc fixes to integration tests
2022-08-27 19:50:25 +05:30
30054d1fb6
Adding advanced template filtering ( #2374 )
...
* Adding advanced template filtering
* fixing bug in slice
* refactoring tests
* adding test cases
* increasing error verbosity
* fixing quoted fields with spaces
* adding more test cases
* fixing merge error
* fixing lint errors
* switching to []string
* updating tag filter tests
* updating functional tests
* fixing functional test cases
* updating syntax
2022-08-25 16:52:08 +05:30
0aac36a44b
added custom config flag ( #2399 )
...
* added custom config flag
* config.yaml file in custom directory
* lint error fix
* few updates and error checks
* fix lint error
* copy config.yaml file if the dest folder does not exist
* lint error check
* added integration test
* improved test cases
* lint error fix
2022-08-25 16:10:07 +05:30
ecb3f21076
http: prevent HTTP 'connection' header from being added twice ( #2480 )
...
* http: prevent HTTP 'connection' header from being added twice
* misc fix
Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2022-08-25 00:25:02 +05:30
e7cffad312
Fixed request annotation based timeout bugs + tests + misc ( #2476 )
2022-08-23 12:45:55 +05:30
67d5769cd9
Added initial catalog interface implementation ( #2318 )
...
* Added initial catalog interface implementation
* Added OpenFile to Catalog + disk catalog implementation
* Fixed merge issues
Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2022-08-10 11:05:58 -07:00
Tarun Koyalwar
Mzack9999
Shubham Rasal
Ramana Reddy
Austin Traver
xm1k3
王一之
Sandeep Singh
Taufik Mulyana
Ice3man
forgedhallpass
LuitelSamikshya
Myung-jong Kim
Sami
James Turner
M. Ángel Jimeno