threat-intelligence auto-update

This commit is contained in:
Zelo72 2022-01-28 10:46:42 +01:00
parent 6fbf4b7249
commit 2f93d271f6
2 changed files with 1897 additions and 18232 deletions

View File

@ -22,58 +22,58 @@ Config:
../../data/white.list.hl2guide ../../data/white.list.hl2guide
../../data/white.list.apple ../../data/white.list.apple
../../data/white.list.microsoft ../../data/white.list.microsoft
../../data/networks/google.list
../../data/white.list.tiktok ../../data/white.list.tiktok
../../data/white.list.ctech ../../data/white.list.ctech
../../doh-vpn-proxy-bypass.txt ../../doh-vpn-proxy-bypass.txt
../../data/networks/google.list
Initialize ... Initialize ...
# Download and convert Sourcelists ... # Download and convert Sourcelists ...
Nr | Count | Format | Source | Status | File | URL/File Nr | Count | Format | Source | Status | File | URL/File
1 | 5426 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/phishing-filter-hosts.txt 1 | 5426 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/phishing-filter-hosts.txt
2 | 398 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/pup-filter-hosts.txt 2 | 398 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/pup-filter-hosts.txt
3 | 8504 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/urlhaus-filter-hosts.txt 3 | 8504 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/urlhaus-filter-hosts.txt
4 | 3496 | hosts | http | online | unchanged | https://gitlab.com/ZeroDot1/CoinBlockerLists/raw/master/hosts_browser 4 | 3496 | hosts | http | online | unchanged | https://gitlab.com/ZeroDot1/CoinBlockerLists/raw/master/hosts_browser
5 | 44940 | hosts | http | online | changed | https://hole.cert.pl/domains/domains_hosts.txt 5 | 44962 | hosts | http | online | changed | https://hole.cert.pl/domains/domains_hosts.txt
6 | 550 | hosts | http | online | unchanged | https://paulgb.github.io/BarbBlock/blacklists/hosts-file.txt 6 | 550 | hosts | http | online | unchanged | https://paulgb.github.io/BarbBlock/blacklists/hosts-file.txt
7 | 6387 | hosts | http | online | unchanged | https://raw.githubusercontent.com/DandelionSprout/adfilt/master/Alternate%20versions%20Anti-Malware%20List/AntiMalwareHosts.txt 7 | 6387 | hosts | http | online | unchanged | https://raw.githubusercontent.com/DandelionSprout/adfilt/master/Alternate%20versions%20Anti-Malware%20List/AntiMalwareHosts.txt
8 | 2202 | hosts | http | online | unchanged | https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.Risk/hosts 8 | 2202 | hosts | http | online | unchanged | https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.Risk/hosts
9 | 57 | hosts | http | online | unchanged | https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.Spam/hosts 9 | 57 | hosts | http | online | unchanged | https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.Spam/hosts
10 | 1059 | hosts | http | online | changed | https://raw.githubusercontent.com/davidonzo/Threat-Intel/master/lists/latestdomains.piHole.txt 10 | 994 | hosts | http | online | changed | https://raw.githubusercontent.com/davidonzo/Threat-Intel/master/lists/latestdomains.piHole.txt
11 | 953 | hosts | http | online | changed | https://raw.githubusercontent.com/durablenapkin/scamblocklist/master/hosts.txt 11 | 952 | hosts | http | online | changed | https://raw.githubusercontent.com/durablenapkin/scamblocklist/master/hosts.txt
12 | 8624 | hosts | http | online | unchanged | https://raw.githubusercontent.com/guardicore/labs_campaigns/master/Autodiscover/autodiscover-tlds.txt 12 | 8624 | hosts | http | online | unchanged | https://raw.githubusercontent.com/guardicore/labs_campaigns/master/Autodiscover/autodiscover-tlds.txt
13 | 696 | hosts | http | online | unchanged | https://raw.githubusercontent.com/hoshsadiq/adblock-nocoin-list/master/hosts.txt 13 | 696 | hosts | http | online | unchanged | https://raw.githubusercontent.com/hoshsadiq/adblock-nocoin-list/master/hosts.txt
14 | 4015 | hosts | http | online | unchanged | https://raw.githubusercontent.com/infinitytec/blocklists/master/scams-and-phishing.txt 14 | 4015 | hosts | http | online | unchanged | https://raw.githubusercontent.com/infinitytec/blocklists/master/scams-and-phishing.txt
15 | 1071 | hosts | http | online | unchanged | https://raw.githubusercontent.com/metamask/eth-phishing-detect/master/src/hosts.txt 15 | 1071 | hosts | http | online | unchanged | https://raw.githubusercontent.com/metamask/eth-phishing-detect/master/src/hosts.txt
16 | 1386 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Badd-Boyz-Hosts/master/hosts 16 | 1386 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Badd-Boyz-Hosts/master/hosts
17 | 13464 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/The-Big-List-of-Hacked-Malware-Web-Sites/master/hosts 17 | 13464 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/The-Big-List-of-Hacked-Malware-Web-Sites/master/hosts
18 | 3217 | hosts | http | online | changed | https://threatfox.abuse.ch/downloads/hostfile 18 | 3209 | hosts | http | online | changed | https://threatfox.abuse.ch/downloads/hostfile
19 | 1313 | hosts | http | online | changed | https://urlhaus.abuse.ch/downloads/hostfile/ 19 | 1309 | hosts | http | online | changed | https://urlhaus.abuse.ch/downloads/hostfile/
20 | 883 | adblock | http | online | unchanged | https://raw.githubusercontent.com/piperun/iploggerfilter/master/filterlist 20 | 883 | adblock | http | online | unchanged | https://raw.githubusercontent.com/piperun/iploggerfilter/master/filterlist
21 | 11769 | domains | http | online | unchanged | https://airvpn.org/api/dns_lists/?code=air_cryptojacking&block=0.0.0.0&style=domains 21 | 11769 | domains | http | online | unchanged | https://airvpn.org/api/dns_lists/?code=air_cryptojacking&block=0.0.0.0&style=domains
22 | 55254 | domains | http | online | changed | https://airvpn.org/api/dns_lists/?code=air_malware&block=0.0.0.0&style=domains 22 | 55254 | domains | http | online | unchanged | https://airvpn.org/api/dns_lists/?code=air_malware&block=0.0.0.0&style=domains
23 | 932 | domains | http | online | changed | https://azorult-tracker.net/api/list/domain?format=plain 23 | 932 | domains | http | online | changed | https://azorult-tracker.net/api/list/domain?format=plain
24 | 898 | domains | http | online | unchanged | https://cert-agid.gov.it/download/log4shell-iocs-raw-domain.txt 24 | 898 | domains | http | online | unchanged | https://cert-agid.gov.it/download/log4shell-iocs-raw-domain.txt
25 | 9313 | domains | http | online | unchanged | https://gitlab.com/KevinThomas0/cryptoscamdb-lists/-/raw/master/cryptoscamdb-blocklist.txt 25 | 9313 | domains | http | online | unchanged | https://gitlab.com/KevinThomas0/cryptoscamdb-lists/-/raw/master/cryptoscamdb-blocklist.txt
26 | 325 | domains | http | online | unchanged | https://gitlab.com/quidsup/notrack-blocklists/raw/master/notrack-malware.txt 26 | 325 | domains | http | online | unchanged | https://gitlab.com/quidsup/notrack-blocklists/raw/master/notrack-malware.txt
27 | 44940 | domains | http | online | changed | https://hole.cert.pl/domains/domains.txt 27 | 44966 | domains | http | online | changed | https://hole.cert.pl/domains/domains.txt
28 | 74265 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl-base.txt 28 | 74895 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl-base.txt
29 | 838 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl.txt 29 | 1004 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl.txt
30 | 2000 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_covid_domains.txt 30 | 2000 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_covid_domains.txt
31 | 1999 | domains | http | online | changed | https://kriskintel.com/feeds/ktip_malicious_domains.txt 31 | 1998 | domains | http | online | changed | https://kriskintel.com/feeds/ktip_malicious_domains.txt
32 | 397 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_ransomware_feeds.txt 32 | 397 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_ransomware_feeds.txt
33 | 2262 | domains | http | online | changed | https://orca.pet/notonmyshift/domains.txt 33 | 2262 | domains | http | online | unchanged | https://orca.pet/notonmyshift/domains.txt
34 | 1059 | domains | http | online | changed | https://osint.digitalside.it/Threat-Intel/lists/latestdomains.txt 34 | 994 | domains | http | online | changed | https://osint.digitalside.it/Threat-Intel/lists/latestdomains.txt
35 | 53364 | domains | http | online | changed | https://phishing.army/download/phishing_army_blocklist.txt 35 | 53157 | domains | http | online | changed | https://phishing.army/download/phishing_army_blocklist.txt
36 | 55660 | domains | http | online | changed | https://phishing.army/download/phishing_army_blocklist_extended.txt 36 | 55463 | domains | http | online | changed | https://phishing.army/download/phishing_army_blocklist_extended.txt
37 | 1406 | domains | http | online | unchanged | https://raw.githubusercontent.com/AmnestyTech/investigations/master/2021-07-18_nso/domains.txt 37 | 1406 | domains | http | online | unchanged | https://raw.githubusercontent.com/AmnestyTech/investigations/master/2021-07-18_nso/domains.txt
38 | 323 | domains | http | online | unchanged | https://raw.githubusercontent.com/AmnestyTech/investigations/master/2021-12-16_cytrox/domains.txt 38 | 323 | domains | http | online | unchanged | https://raw.githubusercontent.com/AmnestyTech/investigations/master/2021-12-16_cytrox/domains.txt
39 | 28 | domains | http | online | unchanged | https://raw.githubusercontent.com/DRSDavidSoft/additional-hosts/master/domains/blacklist/fake-domains.txt 39 | 28 | domains | http | online | unchanged | https://raw.githubusercontent.com/DRSDavidSoft/additional-hosts/master/domains/blacklist/fake-domains.txt
40 | 44654 | domains | http | online | changed | https://raw.githubusercontent.com/PolishFiltersTeam/KADhosts/master/KADomains.txt 40 | 44654 | domains | http | online | unchanged | https://raw.githubusercontent.com/PolishFiltersTeam/KADhosts/master/KADomains.txt
41 | 697 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Cryptocurrency 41 | 697 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Cryptocurrency
42 | 28832 | domains | http | online | changed | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Malware 42 | 28840 | domains | http | online | changed | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Malware
43 | 147 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Risk 43 | 147 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Risk
44 | 3960 | domains | http | online | unchanged | https://raw.githubusercontent.com/bongochong/CombinedPrivacyBlockLists/master/NoFormatting/MD-ID-Fork.txt 44 | 3960 | domains | http | online | unchanged | https://raw.githubusercontent.com/bongochong/CombinedPrivacyBlockLists/master/NoFormatting/MD-ID-Fork.txt
45 | 18459 | domains | http | online | unchanged | https://raw.githubusercontent.com/cbuijs/shallalist/master/spyware/domains 45 | 18459 | domains | http | online | unchanged | https://raw.githubusercontent.com/cbuijs/shallalist/master/spyware/domains
@ -83,10 +83,10 @@ Initialize ...
49 | 514 | domains | http | online | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/CryptBot/domains.txt 49 | 514 | domains | http | online | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/CryptBot/domains.txt
50 | 137 | domains | http | online | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/IcedID/domains.txt 50 | 137 | domains | http | online | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/IcedID/domains.txt
51 | 753 | domains | http | online | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/TA551/domains.txt 51 | 753 | domains | http | online | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/TA551/domains.txt
52 | 6985 | domains | http | online | changed | https://raw.githubusercontent.com/iam-py-test/my_filters_001/main/Alternative%20list%20formats/antimalware_domains.txt 52 | 6985 | domains | http | online | unchanged | https://raw.githubusercontent.com/iam-py-test/my_filters_001/main/Alternative%20list%20formats/antimalware_domains.txt
53 | 2100 | domains | http | online | unchanged | https://raw.githubusercontent.com/matomo-org/referrer-spam-blacklist/master/spammers.txt 53 | 2100 | domains | http | online | unchanged | https://raw.githubusercontent.com/matomo-org/referrer-spam-blacklist/master/spammers.txt
54 | 71282 | domains | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-ACTIVE.txt 54 | 71282 | domains | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-ACTIVE.txt
55 | 263 | domains | http | online | changed | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-NEW-today.txt 55 | 263 | domains | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-NEW-today.txt
56 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_5000_domain.txt 56 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_5000_domain.txt
57 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_germany.txt 57 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_germany.txt
58 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.8_domains.txt 58 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.8_domains.txt
@ -103,18 +103,18 @@ Initialize ...
69 | 30 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-kaspersky.txt 69 | 30 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-kaspersky.txt
70 | 9940 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-main.txt 70 | 9940 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-main.txt
71 | 2045 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-malware-traffic.txt 71 | 2045 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-malware-traffic.txt
72 | 3710 | domains | http | online | changed | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-personal.txt 72 | 3710 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-personal.txt
73 | 147 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-sentinelone.txt 73 | 147 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-sentinelone.txt
74 | 95 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-tag.txt 74 | 95 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-tag.txt
75 | 512 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-unit42-playbook.txt 75 | 512 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-unit42-playbook.txt
76 | 23232 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-unit42-silverterrier.txt 76 | 23232 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-unit42-silverterrier.txt
77 | 3831 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-zscaler.txt 77 | 3831 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-zscaler.txt
78 | 164657 | domains | http | online | changed | https://raw.githubusercontent.com/stamparm/aux/master/maltrail-malware-domains.txt 78 | 164657 | domains | http | online | unchanged | https://raw.githubusercontent.com/stamparm/aux/master/maltrail-malware-domains.txt
79 | 17222 | domains | http | online | changed | https://raw.githubusercontent.com/stamparm/blackbook/master/blackbook.txt 79 | 17222 | domains | http | online | unchanged | https://raw.githubusercontent.com/stamparm/blackbook/master/blackbook.txt
80 | 500 | domains | http | online | unchanged | https://rescure.me/rescure_domain_blacklist.txt 80 | 500 | domains | http | online | unchanged | https://rescure.me/rescure_domain_blacklist.txt
81 | 549 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.domain.raw 81 | 549 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.domain.raw
82 | 173 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.hostname.raw 82 | 173 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.hostname.raw
83 | 36875 | domains | http | online | changed | https://www.stopforumspam.com/downloads/toxic_domains_whole.txt 83 | 36877 | domains | http | online | changed | https://www.stopforumspam.com/downloads/toxic_domains_whole.txt
84 | 112724 | domains | http | OFFLINE | unchanged | USE LOCAL COPY: usom.gov.tr_url-list.txt 84 | 112724 | domains | http | OFFLINE | unchanged | USE LOCAL COPY: usom.gov.tr_url-list.txt
85 | 635 | domains | local | online | unchanged | black.list.threat-intelligence 85 | 635 | domains | local | online | unchanged | black.list.threat-intelligence
@ -122,14 +122,14 @@ Initialize ...
Stats threat-intelligence: Stats threat-intelligence:
** Source (raw): 1221151 ** Source (raw): 1221457
== Source (unique): 893671 (-327480) == Source (unique): 893820 (-327637)
-- White: 891605 (-2066) -- White: 891762 (-2058)
-- White(*): 885279 (-6326) -- White(*): 868993 (-22769)
-- Dead: 380314 (-504965) -- Dead: 363979 (-505014)
380314 unique Domains - Version 2022.0128.040321 363979 unique Domains - Version 2022.0128.103901
MD5 Domains RAW: 6802309dae03504a8dfeae2d28324c58 MD5 Domains RAW: 39c2a0bb4d4c956344280c678020e5ec
# Convert threat-intelligence to Hostlist ... # Convert threat-intelligence to Hostlist ...
@ -152,10 +152,10 @@ Prepare domain list for compiling ... done.
] ]
} }
Start compiling threat-intelligence.adblock.raw Start compiling threat-intelligence.adblock.raw
Original length is 358284 Original length is 342205
Length after applying transformations is 358284 Length after applying transformations is 342205
The list was compressed from 358287 to 338990 The list was compressed from 342208 to 322900
Final length of the list is 338996 Final length of the list is 322906
Writing output to /media/nas/git/rpi/pihole/blocklists/build/threat-intelligence/out/threat-intelligence.adblock Writing output to /media/nas/git/rpi/pihole/blocklists/build/threat-intelligence/out/threat-intelligence.adblock
Finished compiling Finished compiling

File diff suppressed because it is too large Load Diff