threat-intelligence auto-update

This commit is contained in:
Zelo72 2021-10-21 12:05:40 +02:00
parent 7bce104dde
commit d89158e088
2 changed files with 3005 additions and 3229 deletions

File diff suppressed because it is too large Load Diff

View File

@ -28,57 +28,57 @@ Initialize ...
# Download and convert Sourcelists ...
Nr | Count | Format | Source | Status | File | URL/File
1 | 6706 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/phishing-filter-hosts.txt
2 | 404 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/pup-filter-hosts.txt
3 | 8465 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/urlhaus-filter-hosts.txt
1 | 6706 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/phishing-filter-hosts.txt
2 | 404 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/pup-filter-hosts.txt
3 | 8465 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/urlhaus-filter-hosts.txt
4 | 3496 | hosts | http | online | unchanged | https://gitlab.com/ZeroDot1/CoinBlockerLists/raw/master/hosts_browser
5 | 33410 | hosts | http | online | unchanged | https://hole.cert.pl/domains/domains_hosts.txt
5 | 33436 | hosts | http | online | changed | https://hole.cert.pl/domains/domains_hosts.txt
6 | 550 | hosts | http | online | unchanged | https://paulgb.github.io/BarbBlock/blacklists/hosts-file.txt
7 | 5983 | hosts | http | online | unchanged | https://raw.githubusercontent.com/DandelionSprout/adfilt/master/Alternate%20versions%20Anti-Malware%20List/AntiMalwareHosts.txt
8 | 2204 | hosts | http | online | unchanged | https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.Risk/hosts
9 | 59 | hosts | http | online | unchanged | https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.Spam/hosts
10 | 52 | hosts | http | online | unchanged | https://raw.githubusercontent.com/davidonzo/Threat-Intel/master/lists/latestdomains.piHole.txt
11 | 1049 | hosts | http | online | unchanged | https://raw.githubusercontent.com/durablenapkin/scamblocklist/master/hosts.txt
10 | 53 | hosts | http | online | unchanged | https://raw.githubusercontent.com/davidonzo/Threat-Intel/master/lists/latestdomains.piHole.txt
11 | 1060 | hosts | http | online | unchanged | https://raw.githubusercontent.com/durablenapkin/scamblocklist/master/hosts.txt
12 | 8624 | hosts | http | online | unchanged | https://raw.githubusercontent.com/guardicore/labs_campaigns/master/Autodiscover/autodiscover-tlds.txt
13 | 695 | hosts | http | online | unchanged | https://raw.githubusercontent.com/hoshsadiq/adblock-nocoin-list/master/hosts.txt
14 | 3622 | hosts | http | online | changed | https://raw.githubusercontent.com/infinitytec/blocklists/master/scams-and-phishing.txt
14 | 3622 | hosts | http | online | unchanged | https://raw.githubusercontent.com/infinitytec/blocklists/master/scams-and-phishing.txt
15 | 1072 | hosts | http | online | unchanged | https://raw.githubusercontent.com/metamask/eth-phishing-detect/master/src/hosts.txt
16 | 1386 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Badd-Boyz-Hosts/master/hosts
17 | 13465 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/The-Big-List-of-Hacked-Malware-Web-Sites/master/hosts
18 | 1578 | hosts | http | online | changed | https://urlhaus.abuse.ch/downloads/hostfile/
18 | 1559 | hosts | http | online | changed | https://urlhaus.abuse.ch/downloads/hostfile/
19 | 883 | adblock | http | online | unchanged | https://raw.githubusercontent.com/piperun/iploggerfilter/master/filterlist
20 | 914 | domains | http | online | changed | https://azorult-tracker.net/api/list/domain?format=plain
21 | 122584 | domains | http | online | unchanged | https://blocklist.cyberthreatcoalition.org/vetted/domain.txt
22 | 549 | domains | http | online | unchanged | https://feeds.alphasoc.net/ryuk.txt
23 | 9233 | domains | http | online | unchanged | https://gitlab.com/KevinThomas0/cryptoscamdb-lists/-/raw/master/cryptoscamdb-blocklist.txt
24 | 365 | domains | http | online | unchanged | https://gitlab.com/quidsup/notrack-blocklists/raw/master/notrack-malware.txt
25 | 33410 | domains | http | online | unchanged | https://hole.cert.pl/domains/domains.txt
26 | 73486 | domains | http | online | unchanged | https://joewein.net/dl/bl/dom-bl-base.txt
27 | 849 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl.txt
28 | 2000 | domains | http | online | changed | https://kriskintel.com/feeds/ktip_covid_domains.txt
29 | 1999 | domains | http | online | changed | https://kriskintel.com/feeds/ktip_malicious_domains.txt
25 | 33436 | domains | http | online | changed | https://hole.cert.pl/domains/domains.txt
26 | 73481 | domains | http | online | unchanged | https://joewein.net/dl/bl/dom-bl-base.txt
27 | 853 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl.txt
28 | 1999 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_covid_domains.txt
29 | 2000 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_malicious_domains.txt
30 | 397 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_ransomware_feeds.txt
31 | 2245 | domains | http | online | unchanged | https://orca.pet/notonmyshift/domains.txt
32 | 52 | domains | http | online | unchanged | https://osint.digitalside.it/Threat-Intel/lists/latestdomains.txt
33 | 44913 | domains | http | online | changed | https://phishing.army/download/phishing_army_blocklist.txt
34 | 54600 | domains | http | online | changed | https://phishing.army/download/phishing_army_blocklist_extended.txt
32 | 53 | domains | http | online | unchanged | https://osint.digitalside.it/Threat-Intel/lists/latestdomains.txt
33 | 44653 | domains | http | online | unchanged | https://phishing.army/download/phishing_army_blocklist.txt
34 | 54310 | domains | http | online | unchanged | https://phishing.army/download/phishing_army_blocklist_extended.txt
35 | 1406 | domains | http | online | unchanged | https://raw.githubusercontent.com/AmnestyTech/investigations/master/2021-07-18_nso/domains.txt
36 | 27 | domains | http | online | unchanged | https://raw.githubusercontent.com/DRSDavidSoft/additional-hosts/master/domains/blacklist/fake-domains.txt
37 | 35560 | domains | http | online | unchanged | https://raw.githubusercontent.com/PolishFiltersTeam/KADhosts/master/KADomains.txt
38 | 675 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Cryptocurrency
39 | 22725 | domains | http | online | changed | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Malware
39 | 22727 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Malware
40 | 179 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Risk
41 | 3960 | domains | http | online | unchanged | https://raw.githubusercontent.com/bongochong/CombinedPrivacyBlockLists/master/NoFormatting/MD-ID-Fork.txt
42 | 18454 | domains | http | online | unchanged | https://raw.githubusercontent.com/cbuijs/shallalist/master/spyware/domains
43 | 13908 | domains | http | online | unchanged | https://raw.githubusercontent.com/cbuijs/ut1/master/cryptojacking/domains
44 | 168923 | domains | http | online | changed | https://raw.githubusercontent.com/cbuijs/ut1/master/malware/domains
44 | 168923 | domains | http | online | unchanged | https://raw.githubusercontent.com/cbuijs/ut1/master/malware/domains
45 | 434 | domains | http | online | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/CryptBot/domains.txt
46 | 137 | domains | http | online | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/IcedID/domains.txt
47 | 644 | domains | http | online | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/TA551/domains.txt
48 | 3043 | domains | http | online | changed | https://raw.githubusercontent.com/iam-py-test/my_filters_001/main/Alternative%20list%20formats/antimalware_domains.txt
48 | 3043 | domains | http | online | unchanged | https://raw.githubusercontent.com/iam-py-test/my_filters_001/main/Alternative%20list%20formats/antimalware_domains.txt
49 | 2079 | domains | http | online | unchanged | https://raw.githubusercontent.com/matomo-org/referrer-spam-blacklist/master/spammers.txt
50 | 71289 | domains | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-ACTIVE.txt
51 | 406 | domains | http | online | changed | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-NEW-today.txt
51 | 431 | domains | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-NEW-today.txt
52 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_5000_domain.txt
53 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_germany.txt
54 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.8_domains.txt
@ -97,30 +97,30 @@ Initialize ...
67 | 147 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-sentinelone.txt
68 | 512 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-unit42-playbook.txt
69 | 23232 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-unit42-silverterrier.txt
70 | 3792 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-zscaler.txt
71 | 150425 | domains | http | online | changed | https://raw.githubusercontent.com/stamparm/aux/master/maltrail-malware-domains.txt
70 | 3791 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-zscaler.txt
71 | 150425 | domains | http | online | unchanged | https://raw.githubusercontent.com/stamparm/aux/master/maltrail-malware-domains.txt
72 | 16896 | domains | http | online | unchanged | https://raw.githubusercontent.com/stamparm/blackbook/master/blackbook.txt
73 | 500 | domains | http | online | changed | https://rescure.me/covid.txt
74 | 500 | domains | http | online | changed | https://rescure.me/rescure_domain_blacklist.txt
73 | 500 | domains | http | online | unchanged | https://rescure.me/covid.txt
74 | 500 | domains | http | online | unchanged | https://rescure.me/rescure_domain_blacklist.txt
75 | 77 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.domain.raw
76 | 29 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.hostname.raw
77 | 35064 | domains | http | online | changed | https://www.stopforumspam.com/downloads/toxic_domains_whole.txt
78 | 101260 | domains | http | online | changed | https://www.usom.gov.tr/url-list.txt
77 | 35064 | domains | http | online | unchanged | https://www.stopforumspam.com/downloads/toxic_domains_whole.txt
78 | 101273 | domains | http | online | changed | https://www.usom.gov.tr/url-list.txt
79 | 24 | domains | local | online | unchanged | black.list.threat-intelligence
# Build threat-intelligence Domainlist ...
Stats threat-intelligence:
** Source (raw): 1186928
== Source (unique): 859475 (-327453)
-- White: 858707 (-768)
-- White(*): 857221 (-1486)
-- Unblock: 857221 (-0)
-- Dead: 366775 (-490446)
** Source (raw): 1186462
== Source (unique): 859072 (-327390)
-- White: 858302 (-770)
-- White(*): 856843 (-1459)
-- Unblock: 856843 (-0)
-- Dead: 366408 (-490435)
366775 unique Domains - Version 2021.1021.060152
MD5 Domains RAW: fc1681429db77a4c4a07089f89d2db7b
366408 unique Domains - Version 2021.1021.120118
MD5 Domains RAW: bc34d5d495c826b684f3971cebab09e2
# Convert threat-intelligence to Hostlist ...
@ -143,10 +143,10 @@ Prepare domain list for compiling ... done.
]
}
Start compiling threat-intelligence.adblock.raw
Original length is 346794
Length after applying transformations is 346794
The list was compressed from 346797 to 318617
Final length of the list is 318623
Original length is 346447
Length after applying transformations is 346447
The list was compressed from 346450 to 318393
Final length of the list is 318399
Writing output to /media/nas/git/rpi/pihole/blocklists/build/threat-intelligence/out/threat-intelligence.adblock
Finished compiling