Commit Graph

783 Commits (d677065f37d03c4c6056576fa7e75744188ba635)

Author SHA1 Message Date
Víctor Zamanillo c8ae7a5bd3 Better regular expression to matching subdomains
Avoid results starting with "." for wildcard subdomains in content
2020-07-15 22:13:44 +02:00
Víctor Zamanillo f0ccebbd8d Find subdomains in TextMatches too, normalize content before matching 2020-07-15 22:07:45 +02:00
Víctor Zamanillo 06b7137439 Simplified regular expression 2020-07-15 20:38:38 +02:00
Víctor Zamanillo d2cf41d939 FindAllString to get all matches ignoring submatches
We do not need submatches because we are not using it.
2020-07-15 20:27:09 +02:00
Víctor Zamanillo eadd2e571a Fixed request rate limit exceeded message 2020-07-15 15:07:25 +02:00
Víctor Zamanillo eda27f6934 Handle GitHub Search request rate limit
- Support multiple tokens to randomly pick one to avoid exceeding request rate limit
- Retry after "Retry-After" seconds header value if rate limit abuse is detected.
2020-07-15 13:19:31 +02:00
bauthard 5e9dec7de8 added github key example 2020-07-14 22:42:47 +05:30
bauthard bf664d4fd0 readme update 2020-07-14 17:38:12 +05:30
bauthard 41442e721b
Update banners.go 2020-07-14 12:24:06 +05:30
Mzack9999 b943041a4d
Merge pull request #261 from projectdiscovery/bugfix-release
using ld compiler
2020-07-13 19:33:01 +02:00
Mzack9999 b9ce80415a using ld compiler 2020-07-13 19:32:33 +02:00
bauthard fd8e57dc12 Update config.yaml 2020-07-12 17:16:01 +05:30
bauthard 5de674fb3a Update README.md 2020-07-12 17:13:48 +05:30
bauthard 46d1a0693c readme update 2020-07-12 17:05:25 +05:30
Mzack9999 c1c8723734
Merge pull request #255 from vzamanillo/github-search
Added GitHub search source
2020-07-07 22:32:55 +02:00
bauthard f09392260d
Merge pull request #254 from himanshudas/patch-1
Update commoncrawl.go
2020-07-07 13:37:53 +05:30
bauthard 5a01a53da9 Removing old year
I've removed one year from last, to have latest results and removed last one to make sure we don't get timedout on most runs.
2020-07-07 13:17:56 +05:30
Víctor Zamanillo 44c58f4d53 Verbose info for next GitHub search results URL 2020-07-05 20:50:45 +02:00
Víctor Zamanillo 032ee977dd Added GitHub search source
Search for subdomains in GitHub code providing a Personal access token
2020-07-05 20:04:20 +02:00
Himanshu Kumar Das 4d1bc4a9d6
Update commoncrawl.go
Updating commoncrawl to include results from year - 2020
2020-07-01 21:05:30 +05:30
bauthard 064e7a3fe7
updated docker endpoint 2020-06-08 16:24:42 +05:30
bauthard 02852e3b1c
Update README.md 2020-06-08 15:53:59 +05:30
bauthard a64318d9cb
version update 2020-06-08 15:41:48 +05:30
bauthard e0f0e91bb3
Update config.yaml 2020-06-08 15:40:05 +05:30
Mzack9999 b0e2f5e6b1 small changes 2020-06-08 02:54:50 +02:00
Mzack9999 0135c35bc4 Merge branch 'akhil-reni-master' 2020-06-08 02:46:43 +02:00
Akhil Reni f3028455ee added check to catch error for un-authorised request 2020-06-08 05:42:04 +05:30
Akhil Reni fb8a7cf979 added status check for no results available 2020-06-07 15:24:38 +05:30
Akhil Reni fdb25a971c added intelx source which also supports https://phonebook.cz/ 2020-06-07 06:18:15 +05:30
bauthard 2c6ff84a83
updated example config file 2020-06-06 17:43:48 +05:30
bauthard dc1558d705
Merge pull request #243 from projectdiscovery/feature-automation
go modules
2020-06-05 10:51:54 +05:30
Mzack9999 552da55ed6 updated docker endpoint 2020-06-04 11:15:56 +02:00
Mzack9999 d754b1d5b3 introduced goreleaser 2020-06-04 02:51:05 +02:00
Mzack9999 2e9df5cac1 updated actions and dockerfile 2020-06-04 02:50:19 +02:00
Mzack9999 5c31747170 adding build action 2020-06-04 02:47:48 +02:00
Mzack9999 9c2c7b2381 go modules 2020-06-04 02:46:48 +02:00
bauthard 309cb9c42e
updating readme 2020-05-23 03:12:11 +05:30
Mzack9999 73f4ced5a9
Merge pull request #242 from projectdiscovery/version-bump
Version bump
2020-05-22 19:27:53 +02:00
Mzack9999 6f7a4f82b3
Version bump 2020-05-22 19:27:35 +02:00
bauthard 9932d12fbb
updating unexpected newline 2020-05-22 08:05:33 +05:30
bauthard 5c6b2cd0b4
Merge pull request #240 from akhil-reni/master
Added spyse source
2020-05-22 07:59:00 +05:30
Akhil Reni 6e6ecf756c
Fixed typo 2020-05-22 07:45:57 +05:30
akhil-reni 247de2dab0 fixed source name to spyse 2020-05-19 08:59:26 +05:30
Mzack9999 a84782aec1 Merge branch 'lc-lc/add-chaos-upload' 2020-05-18 20:20:48 +02:00
Mzack9999 66df39eee6 Merge branch 'lc/add-chaos-upload' of github.com:lc/subfinder into lc-lc/add-chaos-upload 2020-05-18 20:08:16 +02:00
Mzack9999 ed940f14f5 small refactor 2020-05-18 20:03:12 +02:00
Mzack9999 14ecb3d269 Merge branch 'vzamanillo-simplified-rapiddns' 2020-05-18 20:01:42 +02:00
Akhil Reni 8a85769abf Added spyse source 2020-05-18 22:29:18 +05:30
lc 9e1d2abde1 Remove newline 2020-05-17 16:38:28 -05:00
lc 092e40d61b Fix error handling, clear buffer after use 2020-05-17 16:29:15 -05:00