daffainfo
/
nuclei-templates
mirror of https://github.com/daffainfo/nuclei-templates.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
nuclei-templates/http/miscellaneous/robots-txt-endpoint.yaml

30 lines
515 B
YAML
Raw Normal View History

Iterate endpoints from robots.txt (#471) * Workflow to extract endpoints from robots.txt - requires projectdiscovery/nuclei/issues/304 fixed to work Signed-off-by: Casper Guldbech Nielsen <whopsec@protonmail.com> * Correcting path after conducted testing Signed-off-by: Casper Guldbech Nielsen <whopsec@protonmail.com> * Linting fixes Signed-off-by: Casper Guldbech Nielsen <whopsec@protonmail.com> * Update of regex after changes to nuclei regex params in extractor Signed-off-by: Casper Guldbech Nielsen <whopsec@protonmail.com> * Add detection of SEEEMS CMS Signed-off-by: Casper Guldbech Nielsen <whopsec@protonmail.com> * Updated template to support "iterate-all: true" Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2022-05-20 09:43:00 +00:00
id: robots-txt-endpoint
info:
name: robots.txt endpoint prober
author: CasperGN,pdteam
severity: info
Adds 'tags' attribute to robots-txt-endpoint.yaml
2023-05-22 19:10:19 +00:00
tags: misc,generic
Added max request counter of each template
2023-04-28 08:11:21 +00:00
metadata:
max-request: 2
Iterate endpoints from robots.txt (#471) * Workflow to extract endpoints from robots.txt - requires projectdiscovery/nuclei/issues/304 fixed to work Signed-off-by: Casper Guldbech Nielsen <whopsec@protonmail.com> * Correcting path after conducted testing Signed-off-by: Casper Guldbech Nielsen <whopsec@protonmail.com> * Linting fixes Signed-off-by: Casper Guldbech Nielsen <whopsec@protonmail.com> * Update of regex after changes to nuclei regex params in extractor Signed-off-by: Casper Guldbech Nielsen <whopsec@protonmail.com> * Add detection of SEEEMS CMS Signed-off-by: Casper Guldbech Nielsen <whopsec@protonmail.com> * Updated template to support "iterate-all: true" Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2022-05-20 09:43:00 +00:00
Refactoring the directory structure based on protocols (#7137) * moving http templates * updated cves.json * moved network CVEs * updated scripts * updated workflows * updated requests to http * replaced network to tcp --------- Co-authored-by: sandeep <8293321+ehsandeep@users.noreply.github.com>
2023-04-27 04:28:59 +00:00
http:
Iterate endpoints from robots.txt (#471) * Workflow to extract endpoints from robots.txt - requires projectdiscovery/nuclei/issues/304 fixed to work Signed-off-by: Casper Guldbech Nielsen <whopsec@protonmail.com> * Correcting path after conducted testing Signed-off-by: Casper Guldbech Nielsen <whopsec@protonmail.com> * Linting fixes Signed-off-by: Casper Guldbech Nielsen <whopsec@protonmail.com> * Update of regex after changes to nuclei regex params in extractor Signed-off-by: Casper Guldbech Nielsen <whopsec@protonmail.com> * Add detection of SEEEMS CMS Signed-off-by: Casper Guldbech Nielsen <whopsec@protonmail.com> * Updated template to support "iterate-all: true" Co-authored-by: sandeep <sandeep@projectdiscovery.io>
2022-05-20 09:43:00 +00:00
- method: GET
path:
- "{{RootURL}}/robots.txt"
- "{{RootURL}}{{endpoint}}"
extractors:
- type: regex
name: endpoint
group: 1
regex:
- '(?m:\s(/[[:alpha:]]+[[:graph:]]+))'
internal: true
iterate-all: true
matchers:
- type: status
status:
Adds 'tags' attribute to robots-txt-endpoint.yaml
2023-05-22 19:10:19 +00:00
- 200