threat-intelligence auto-update

This commit is contained in:
Zelo72 2021-11-23 14:37:34 +01:00
parent 77cab0203f
commit be85cfe021
2 changed files with 3441 additions and 3278 deletions

File diff suppressed because it is too large Load Diff

View File

@ -34,58 +34,58 @@ Initialize ...
# Download and convert Sourcelists ... # Download and convert Sourcelists ...
Nr | Count | Format | Source | Status | File | URL/File Nr | Count | Format | Source | Status | File | URL/File
1 | 7113 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/phishing-filter-hosts.txt 1 | 7264 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/phishing-filter-hosts.txt
2 | 359 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/pup-filter-hosts.txt 2 | 365 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/pup-filter-hosts.txt
3 | 9808 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/urlhaus-filter-hosts.txt 3 | 9726 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/urlhaus-filter-hosts.txt
4 | 3496 | hosts | http | online | unchanged | https://gitlab.com/ZeroDot1/CoinBlockerLists/raw/master/hosts_browser 4 | 3496 | hosts | http | online | unchanged | https://gitlab.com/ZeroDot1/CoinBlockerLists/raw/master/hosts_browser
5 | 36592 | hosts | http | online | changed | https://hole.cert.pl/domains/domains_hosts.txt 5 | 36679 | hosts | http | online | changed | https://hole.cert.pl/domains/domains_hosts.txt
6 | 550 | hosts | http | online | unchanged | https://paulgb.github.io/BarbBlock/blacklists/hosts-file.txt 6 | 550 | hosts | http | online | unchanged | https://paulgb.github.io/BarbBlock/blacklists/hosts-file.txt
7 | 6040 | hosts | http | online | unchanged | https://raw.githubusercontent.com/DandelionSprout/adfilt/master/Alternate%20versions%20Anti-Malware%20List/AntiMalwareHosts.txt 7 | 6054 | hosts | http | online | changed | https://raw.githubusercontent.com/DandelionSprout/adfilt/master/Alternate%20versions%20Anti-Malware%20List/AntiMalwareHosts.txt
8 | 2202 | hosts | http | online | changed | https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.Risk/hosts 8 | 2202 | hosts | http | online | unchanged | https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.Risk/hosts
9 | 59 | hosts | http | online | unchanged | https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.Spam/hosts 9 | 59 | hosts | http | online | unchanged | https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.Spam/hosts
10 | 2146 | hosts | http | online | unchanged | https://raw.githubusercontent.com/davidonzo/Threat-Intel/master/lists/latestdomains.piHole.txt 10 | 2198 | hosts | http | online | changed | https://raw.githubusercontent.com/davidonzo/Threat-Intel/master/lists/latestdomains.piHole.txt
11 | 1019 | hosts | http | online | unchanged | https://raw.githubusercontent.com/durablenapkin/scamblocklist/master/hosts.txt 11 | 1016 | hosts | http | online | changed | https://raw.githubusercontent.com/durablenapkin/scamblocklist/master/hosts.txt
12 | 8624 | hosts | http | online | unchanged | https://raw.githubusercontent.com/guardicore/labs_campaigns/master/Autodiscover/autodiscover-tlds.txt 12 | 8624 | hosts | http | online | unchanged | https://raw.githubusercontent.com/guardicore/labs_campaigns/master/Autodiscover/autodiscover-tlds.txt
13 | 695 | hosts | http | online | unchanged | https://raw.githubusercontent.com/hoshsadiq/adblock-nocoin-list/master/hosts.txt 13 | 695 | hosts | http | online | unchanged | https://raw.githubusercontent.com/hoshsadiq/adblock-nocoin-list/master/hosts.txt
14 | 3795 | hosts | http | online | unchanged | https://raw.githubusercontent.com/infinitytec/blocklists/master/scams-and-phishing.txt 14 | 3795 | hosts | http | online | unchanged | https://raw.githubusercontent.com/infinitytec/blocklists/master/scams-and-phishing.txt
15 | 1072 | hosts | http | online | unchanged | https://raw.githubusercontent.com/metamask/eth-phishing-detect/master/src/hosts.txt 15 | 1072 | hosts | http | online | unchanged | https://raw.githubusercontent.com/metamask/eth-phishing-detect/master/src/hosts.txt
16 | 1386 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Badd-Boyz-Hosts/master/hosts 16 | 1386 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Badd-Boyz-Hosts/master/hosts
17 | 13464 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/The-Big-List-of-Hacked-Malware-Web-Sites/master/hosts 17 | 13464 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/The-Big-List-of-Hacked-Malware-Web-Sites/master/hosts
18 | 1064 | hosts | http | online | changed | https://urlhaus.abuse.ch/downloads/hostfile/ 18 | 1063 | hosts | http | online | changed | https://urlhaus.abuse.ch/downloads/hostfile/
19 | 3153 | hosts | http | online | changed | https://threatfox.abuse.ch/downloads/hostfile 19 | 3139 | hosts | http | online | changed | https://threatfox.abuse.ch/downloads/hostfile
20 | 883 | adblock | http | online | unchanged | https://raw.githubusercontent.com/piperun/iploggerfilter/master/filterlist 20 | 883 | adblock | http | online | unchanged | https://raw.githubusercontent.com/piperun/iploggerfilter/master/filterlist
21 | 921 | domains | http | online | changed | https://azorult-tracker.net/api/list/domain?format=plain 21 | 921 | domains | http | online | changed | https://azorult-tracker.net/api/list/domain?format=plain
22 | 122584 | domains | http | OFFLINE | unchanged | USE LOCAL COPY: blocklist.cyberthreatcoalition.org_vetted_domain.txt 22 | 122584 | domains | http | OFFLINE | unchanged | USE LOCAL COPY: blocklist.cyberthreatcoalition.org_vetted_domain.txt
23 | 549 | domains | http | online | unchanged | https://feeds.alphasoc.net/ryuk.txt 23 | 549 | domains | http | online | unchanged | https://feeds.alphasoc.net/ryuk.txt
24 | 9233 | domains | http | online | unchanged | https://gitlab.com/KevinThomas0/cryptoscamdb-lists/-/raw/master/cryptoscamdb-blocklist.txt 24 | 9233 | domains | http | online | unchanged | https://gitlab.com/KevinThomas0/cryptoscamdb-lists/-/raw/master/cryptoscamdb-blocklist.txt
25 | 344 | domains | http | online | unchanged | https://gitlab.com/quidsup/notrack-blocklists/raw/master/notrack-malware.txt 25 | 344 | domains | http | online | unchanged | https://gitlab.com/quidsup/notrack-blocklists/raw/master/notrack-malware.txt
26 | 36592 | domains | http | online | changed | https://hole.cert.pl/domains/domains.txt 26 | 36679 | domains | http | online | changed | https://hole.cert.pl/domains/domains.txt
27 | 74066 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl-base.txt 27 | 74061 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl-base.txt
28 | 874 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl.txt 28 | 882 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl.txt
29 | 2000 | domains | http | online | changed | https://kriskintel.com/feeds/ktip_covid_domains.txt 29 | 1999 | domains | http | online | changed | https://kriskintel.com/feeds/ktip_covid_domains.txt
30 | 1997 | domains | http | online | changed | https://kriskintel.com/feeds/ktip_malicious_domains.txt 30 | 1997 | domains | http | online | changed | https://kriskintel.com/feeds/ktip_malicious_domains.txt
31 | 397 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_ransomware_feeds.txt 31 | 397 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_ransomware_feeds.txt
32 | 2255 | domains | http | online | unchanged | https://orca.pet/notonmyshift/domains.txt 32 | 2255 | domains | http | online | unchanged | https://orca.pet/notonmyshift/domains.txt
33 | 2146 | domains | http | online | unchanged | https://osint.digitalside.it/Threat-Intel/lists/latestdomains.txt 33 | 2198 | domains | http | online | changed | https://osint.digitalside.it/Threat-Intel/lists/latestdomains.txt
34 | 48651 | domains | http | online | changed | https://phishing.army/download/phishing_army_blocklist.txt 34 | 48660 | domains | http | online | changed | https://phishing.army/download/phishing_army_blocklist.txt
35 | 58913 | domains | http | online | changed | https://phishing.army/download/phishing_army_blocklist_extended.txt 35 | 58943 | domains | http | online | changed | https://phishing.army/download/phishing_army_blocklist_extended.txt
36 | 1406 | domains | http | online | unchanged | https://raw.githubusercontent.com/AmnestyTech/investigations/master/2021-07-18_nso/domains.txt 36 | 1406 | domains | http | online | unchanged | https://raw.githubusercontent.com/AmnestyTech/investigations/master/2021-07-18_nso/domains.txt
37 | 27 | domains | http | online | unchanged | https://raw.githubusercontent.com/DRSDavidSoft/additional-hosts/master/domains/blacklist/fake-domains.txt 37 | 27 | domains | http | online | unchanged | https://raw.githubusercontent.com/DRSDavidSoft/additional-hosts/master/domains/blacklist/fake-domains.txt
38 | 35258 | domains | http | online | changed | https://raw.githubusercontent.com/PolishFiltersTeam/KADhosts/master/KADomains.txt 38 | 35314 | domains | http | online | changed | https://raw.githubusercontent.com/PolishFiltersTeam/KADhosts/master/KADomains.txt
39 | 678 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Cryptocurrency 39 | 678 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Cryptocurrency
40 | 26388 | domains | http | online | changed | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Malware 40 | 26402 | domains | http | online | changed | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Malware
41 | 143 | domains | http | online | changed | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Risk 41 | 143 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Risk
42 | 3960 | domains | http | online | unchanged | https://raw.githubusercontent.com/bongochong/CombinedPrivacyBlockLists/master/NoFormatting/MD-ID-Fork.txt 42 | 3960 | domains | http | online | unchanged | https://raw.githubusercontent.com/bongochong/CombinedPrivacyBlockLists/master/NoFormatting/MD-ID-Fork.txt
43 | 18459 | domains | http | online | unchanged | https://raw.githubusercontent.com/cbuijs/shallalist/master/spyware/domains 43 | 18459 | domains | http | online | unchanged | https://raw.githubusercontent.com/cbuijs/shallalist/master/spyware/domains
44 | 13908 | domains | http | online | unchanged | https://raw.githubusercontent.com/cbuijs/ut1/master/cryptojacking/domains 44 | 13908 | domains | http | online | unchanged | https://raw.githubusercontent.com/cbuijs/ut1/master/cryptojacking/domains
45 | 167870 | domains | http | online | changed | https://raw.githubusercontent.com/cbuijs/ut1/master/malware/domains 45 | 167870 | domains | http | online | unchanged | https://raw.githubusercontent.com/cbuijs/ut1/master/malware/domains
46 | 451 | domains | http | online | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/CryptBot/domains.txt 46 | 451 | domains | http | online | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/CryptBot/domains.txt
47 | 137 | domains | http | online | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/IcedID/domains.txt 47 | 137 | domains | http | online | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/IcedID/domains.txt
48 | 692 | domains | http | online | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/TA551/domains.txt 48 | 692 | domains | http | online | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/TA551/domains.txt
49 | 6186 | domains | http | online | changed | https://raw.githubusercontent.com/iam-py-test/my_filters_001/main/Alternative%20list%20formats/antimalware_domains.txt 49 | 6186 | domains | http | online | unchanged | https://raw.githubusercontent.com/iam-py-test/my_filters_001/main/Alternative%20list%20formats/antimalware_domains.txt
50 | 2079 | domains | http | online | unchanged | https://raw.githubusercontent.com/matomo-org/referrer-spam-blacklist/master/spammers.txt 50 | 2079 | domains | http | online | unchanged | https://raw.githubusercontent.com/matomo-org/referrer-spam-blacklist/master/spammers.txt
51 | 71287 | domains | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-ACTIVE.txt 51 | 71286 | domains | http | online | changed | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-ACTIVE.txt
52 | 289 | domains | http | online | changed | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-NEW-today.txt 52 | 679 | domains | http | online | changed | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-NEW-today.txt
53 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_5000_domain.txt 53 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_5000_domain.txt
54 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_germany.txt 54 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_germany.txt
55 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.8_domains.txt 55 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.8_domains.txt
@ -100,7 +100,7 @@ Initialize ...
64 | 3 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-kaspersky.txt 64 | 3 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-kaspersky.txt
65 | 9940 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-main.txt 65 | 9940 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-main.txt
66 | 1892 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-malware-traffic.txt 66 | 1892 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-malware-traffic.txt
67 | 3204 | domains | http | online | changed | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-personal.txt 67 | 3210 | domains | http | online | changed | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-personal.txt
68 | 147 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-sentinelone.txt 68 | 147 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-sentinelone.txt
69 | 86 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-tag.txt 69 | 86 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-tag.txt
70 | 512 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-unit42-playbook.txt 70 | 512 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-unit42-playbook.txt
@ -109,11 +109,11 @@ Initialize ...
73 | 152810 | domains | http | online | unchanged | https://raw.githubusercontent.com/stamparm/aux/master/maltrail-malware-domains.txt 73 | 152810 | domains | http | online | unchanged | https://raw.githubusercontent.com/stamparm/aux/master/maltrail-malware-domains.txt
74 | 17031 | domains | http | online | unchanged | https://raw.githubusercontent.com/stamparm/blackbook/master/blackbook.txt 74 | 17031 | domains | http | online | unchanged | https://raw.githubusercontent.com/stamparm/blackbook/master/blackbook.txt
75 | 500 | domains | http | OFFLINE | unchanged | USE LOCAL COPY: rescure.me_covid.txt 75 | 500 | domains | http | OFFLINE | unchanged | USE LOCAL COPY: rescure.me_covid.txt
76 | 500 | domains | http | online | changed | https://rescure.me/rescure_domain_blacklist.txt 76 | 500 | domains | http | online | unchanged | https://rescure.me/rescure_domain_blacklist.txt
77 | 508 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.domain.raw 77 | 508 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.domain.raw
78 | 90 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.hostname.raw 78 | 90 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.hostname.raw
79 | 35257 | domains | http | online | changed | https://www.stopforumspam.com/downloads/toxic_domains_whole.txt 79 | 35268 | domains | http | online | changed | https://www.stopforumspam.com/downloads/toxic_domains_whole.txt
80 | 104512 | domains | http | online | changed | https://www.usom.gov.tr/url-list.txt 80 | 104568 | domains | http | online | changed | https://www.usom.gov.tr/url-list.txt
81 | 56177 | domains | http | online | unchanged | https://airvpn.org/api/dns_lists/?code=air_malware&block=0.0.0.0&style=domains 81 | 56177 | domains | http | online | unchanged | https://airvpn.org/api/dns_lists/?code=air_malware&block=0.0.0.0&style=domains
82 | 11527 | domains | http | online | unchanged | https://airvpn.org/api/dns_lists/?code=air_cryptojacking&block=0.0.0.0&style=domains 82 | 11527 | domains | http | online | unchanged | https://airvpn.org/api/dns_lists/?code=air_cryptojacking&block=0.0.0.0&style=domains
83 | 139 | domains | local | online | unchanged | black.list.threat-intelligence 83 | 139 | domains | local | online | unchanged | black.list.threat-intelligence
@ -122,15 +122,15 @@ Initialize ...
Stats threat-intelligence: Stats threat-intelligence:
** Source (raw): 1290412 ** Source (raw): 1291334
== Source (unique): 881826 (-408586) == Source (unique): 882114 (-409220)
-- Exclude: 881821 (-5) -- Exclude: 882109 (-5)
-- White: 881044 (-777) -- White: 881331 (-778)
-- White(*): 874784 (-6260) -- White(*): 875076 (-6255)
-- Dead: 374102 (-500682) -- Dead: 374321 (-500755)
374102 unique Domains - Version 2021.1123.043201 374321 unique Domains - Version 2021.1123.143039
MD5 Domains RAW: ad06a88538936beda06ad2939847433f MD5 Domains RAW: dbee646a351d59606deedcb6c3d20447
# Convert threat-intelligence to Hostlist ... # Convert threat-intelligence to Hostlist ...
@ -153,10 +153,10 @@ Prepare domain list for compiling ... done.
] ]
} }
Start compiling threat-intelligence.adblock.raw Start compiling threat-intelligence.adblock.raw
Original length is 354159 Original length is 354329
Length after applying transformations is 354159 Length after applying transformations is 354329
The list was compressed from 354162 to 324358 The list was compressed from 354332 to 324521
Final length of the list is 324364 Final length of the list is 324527
Writing output to /media/nas/git/rpi/pihole/blocklists/build/threat-intelligence/out/threat-intelligence.adblock Writing output to /media/nas/git/rpi/pihole/blocklists/build/threat-intelligence/out/threat-intelligence.adblock
Finished compiling Finished compiling