threat-intelligence auto-update

This commit is contained in:
Zelo72 2021-10-21 22:27:44 +02:00
parent b80bcc1a25
commit d14f2fb34a
2 changed files with 2977 additions and 3385 deletions

File diff suppressed because it is too large Load Diff

View File

@ -28,11 +28,11 @@ Initialize ...
# Download and convert Sourcelists ... # Download and convert Sourcelists ...
Nr | Count | Format | Source | Status | File | URL/File Nr | Count | Format | Source | Status | File | URL/File
1 | 6641 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/phishing-filter-hosts.txt 1 | 6641 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/phishing-filter-hosts.txt
2 | 404 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/pup-filter-hosts.txt 2 | 404 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/pup-filter-hosts.txt
3 | 8554 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/urlhaus-filter-hosts.txt 3 | 8554 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/urlhaus-filter-hosts.txt
4 | 3496 | hosts | http | online | unchanged | https://gitlab.com/ZeroDot1/CoinBlockerLists/raw/master/hosts_browser 4 | 3496 | hosts | http | online | unchanged | https://gitlab.com/ZeroDot1/CoinBlockerLists/raw/master/hosts_browser
5 | 33491 | hosts | http | online | changed | https://hole.cert.pl/domains/domains_hosts.txt 5 | 33514 | hosts | http | online | unchanged | https://hole.cert.pl/domains/domains_hosts.txt
6 | 550 | hosts | http | online | unchanged | https://paulgb.github.io/BarbBlock/blacklists/hosts-file.txt 6 | 550 | hosts | http | online | unchanged | https://paulgb.github.io/BarbBlock/blacklists/hosts-file.txt
7 | 5983 | hosts | http | online | unchanged | https://raw.githubusercontent.com/DandelionSprout/adfilt/master/Alternate%20versions%20Anti-Malware%20List/AntiMalwareHosts.txt 7 | 5983 | hosts | http | online | unchanged | https://raw.githubusercontent.com/DandelionSprout/adfilt/master/Alternate%20versions%20Anti-Malware%20List/AntiMalwareHosts.txt
8 | 2204 | hosts | http | online | unchanged | https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.Risk/hosts 8 | 2204 | hosts | http | online | unchanged | https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.Risk/hosts
@ -45,28 +45,28 @@ Initialize ...
15 | 1072 | hosts | http | online | unchanged | https://raw.githubusercontent.com/metamask/eth-phishing-detect/master/src/hosts.txt 15 | 1072 | hosts | http | online | unchanged | https://raw.githubusercontent.com/metamask/eth-phishing-detect/master/src/hosts.txt
16 | 1386 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Badd-Boyz-Hosts/master/hosts 16 | 1386 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Badd-Boyz-Hosts/master/hosts
17 | 13465 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/The-Big-List-of-Hacked-Malware-Web-Sites/master/hosts 17 | 13465 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/The-Big-List-of-Hacked-Malware-Web-Sites/master/hosts
18 | 1533 | hosts | http | online | changed | https://urlhaus.abuse.ch/downloads/hostfile/ 18 | 1566 | hosts | http | online | unchanged | https://urlhaus.abuse.ch/downloads/hostfile/
19 | 883 | adblock | http | online | unchanged | https://raw.githubusercontent.com/piperun/iploggerfilter/master/filterlist 19 | 883 | adblock | http | online | unchanged | https://raw.githubusercontent.com/piperun/iploggerfilter/master/filterlist
20 | 914 | domains | http | online | changed | https://azorult-tracker.net/api/list/domain?format=plain 20 | 914 | domains | http | online | unchanged | https://azorult-tracker.net/api/list/domain?format=plain
21 | 122584 | domains | http | online | unchanged | https://blocklist.cyberthreatcoalition.org/vetted/domain.txt 21 | 122584 | domains | http | online | unchanged | https://blocklist.cyberthreatcoalition.org/vetted/domain.txt
22 | 549 | domains | http | online | unchanged | https://feeds.alphasoc.net/ryuk.txt 22 | 549 | domains | http | online | unchanged | https://feeds.alphasoc.net/ryuk.txt
23 | 9233 | domains | http | online | unchanged | https://gitlab.com/KevinThomas0/cryptoscamdb-lists/-/raw/master/cryptoscamdb-blocklist.txt 23 | 9233 | domains | http | online | unchanged | https://gitlab.com/KevinThomas0/cryptoscamdb-lists/-/raw/master/cryptoscamdb-blocklist.txt
24 | 365 | domains | http | online | unchanged | https://gitlab.com/quidsup/notrack-blocklists/raw/master/notrack-malware.txt 24 | 365 | domains | http | online | unchanged | https://gitlab.com/quidsup/notrack-blocklists/raw/master/notrack-malware.txt
25 | 33491 | domains | http | online | changed | https://hole.cert.pl/domains/domains.txt 25 | 33514 | domains | http | online | unchanged | https://hole.cert.pl/domains/domains.txt
26 | 73362 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl-base.txt 26 | 73362 | domains | http | online | unchanged | https://joewein.net/dl/bl/dom-bl-base.txt
27 | 745 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl.txt 27 | 745 | domains | http | online | unchanged | https://joewein.net/dl/bl/dom-bl.txt
28 | 2000 | domains | http | online | changed | https://kriskintel.com/feeds/ktip_covid_domains.txt 28 | 1999 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_covid_domains.txt
29 | 1997 | domains | http | online | changed | https://kriskintel.com/feeds/ktip_malicious_domains.txt 29 | 1999 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_malicious_domains.txt
30 | 397 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_ransomware_feeds.txt 30 | 397 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_ransomware_feeds.txt
31 | 2245 | domains | http | online | unchanged | https://orca.pet/notonmyshift/domains.txt 31 | 2245 | domains | http | online | unchanged | https://orca.pet/notonmyshift/domains.txt
32 | 53 | domains | http | online | unchanged | https://osint.digitalside.it/Threat-Intel/lists/latestdomains.txt 32 | 53 | domains | http | online | unchanged | https://osint.digitalside.it/Threat-Intel/lists/latestdomains.txt
33 | 45242 | domains | http | online | changed | https://phishing.army/download/phishing_army_blocklist.txt 33 | 44929 | domains | http | online | unchanged | https://phishing.army/download/phishing_army_blocklist.txt
34 | 55142 | domains | http | online | changed | https://phishing.army/download/phishing_army_blocklist_extended.txt 34 | 54621 | domains | http | online | changed | https://phishing.army/download/phishing_army_blocklist_extended.txt
35 | 1406 | domains | http | online | unchanged | https://raw.githubusercontent.com/AmnestyTech/investigations/master/2021-07-18_nso/domains.txt 35 | 1406 | domains | http | online | unchanged | https://raw.githubusercontent.com/AmnestyTech/investigations/master/2021-07-18_nso/domains.txt
36 | 27 | domains | http | online | unchanged | https://raw.githubusercontent.com/DRSDavidSoft/additional-hosts/master/domains/blacklist/fake-domains.txt 36 | 27 | domains | http | online | unchanged | https://raw.githubusercontent.com/DRSDavidSoft/additional-hosts/master/domains/blacklist/fake-domains.txt
37 | 35664 | domains | http | online | changed | https://raw.githubusercontent.com/PolishFiltersTeam/KADhosts/master/KADomains.txt 37 | 35258 | domains | http | online | changed | https://raw.githubusercontent.com/PolishFiltersTeam/KADhosts/master/KADomains.txt
38 | 675 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Cryptocurrency 38 | 675 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Cryptocurrency
39 | 22742 | domains | http | online | changed | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Malware 39 | 22745 | domains | http | online | changed | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Malware
40 | 179 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Risk 40 | 179 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Risk
41 | 3960 | domains | http | online | unchanged | https://raw.githubusercontent.com/bongochong/CombinedPrivacyBlockLists/master/NoFormatting/MD-ID-Fork.txt 41 | 3960 | domains | http | online | unchanged | https://raw.githubusercontent.com/bongochong/CombinedPrivacyBlockLists/master/NoFormatting/MD-ID-Fork.txt
42 | 18454 | domains | http | online | unchanged | https://raw.githubusercontent.com/cbuijs/shallalist/master/spyware/domains 42 | 18454 | domains | http | online | unchanged | https://raw.githubusercontent.com/cbuijs/shallalist/master/spyware/domains
@ -78,7 +78,7 @@ Initialize ...
48 | 3043 | domains | http | online | unchanged | https://raw.githubusercontent.com/iam-py-test/my_filters_001/main/Alternative%20list%20formats/antimalware_domains.txt 48 | 3043 | domains | http | online | unchanged | https://raw.githubusercontent.com/iam-py-test/my_filters_001/main/Alternative%20list%20formats/antimalware_domains.txt
49 | 2079 | domains | http | online | unchanged | https://raw.githubusercontent.com/matomo-org/referrer-spam-blacklist/master/spammers.txt 49 | 2079 | domains | http | online | unchanged | https://raw.githubusercontent.com/matomo-org/referrer-spam-blacklist/master/spammers.txt
50 | 71289 | domains | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-ACTIVE.txt 50 | 71289 | domains | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-ACTIVE.txt
51 | 713 | domains | http | online | changed | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-NEW-today.txt 51 | 822 | domains | http | online | changed | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-NEW-today.txt
52 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_5000_domain.txt 52 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_5000_domain.txt
53 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_germany.txt 53 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_germany.txt
54 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.8_domains.txt 54 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.8_domains.txt
@ -104,23 +104,23 @@ Initialize ...
74 | 500 | domains | http | online | unchanged | https://rescure.me/rescure_domain_blacklist.txt 74 | 500 | domains | http | online | unchanged | https://rescure.me/rescure_domain_blacklist.txt
75 | 77 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.domain.raw 75 | 77 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.domain.raw
76 | 29 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.hostname.raw 76 | 29 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.hostname.raw
77 | 35064 | domains | http | online | unchanged | https://www.stopforumspam.com/downloads/toxic_domains_whole.txt 77 | 35065 | domains | http | online | changed | https://www.stopforumspam.com/downloads/toxic_domains_whole.txt
78 | 101331 | domains | http | online | changed | https://www.usom.gov.tr/url-list.txt 78 | 101353 | domains | http | online | changed | https://www.usom.gov.tr/url-list.txt
79 | 24 | domains | local | online | unchanged | black.list.threat-intelligence 79 | 24 | domains | local | online | unchanged | black.list.threat-intelligence
# Build threat-intelligence Domainlist ... # Build threat-intelligence Domainlist ...
Stats threat-intelligence: Stats threat-intelligence:
** Source (raw): 1188221 ** Source (raw): 1187196
== Source (unique): 860353 (-327868) == Source (unique): 859652 (-327544)
-- White: 859582 (-771) -- White: 858886 (-766)
-- White(*): 858101 (-1481) -- White(*): 857395 (-1491)
-- Unblock: 858101 (-0) -- Dead: 367050 (-490345)
-- Dead: 367661 (-490440) -- Unblock: 367050 (-0)
367661 unique Domains - Version 2021.1021.180117 367050 unique Domains - Version 2021.1021.222321
MD5 Domains RAW: 6832ab02aa085e3ad603881907b47ea6 MD5 Domains RAW: 57641f6c08b2c1f909636b3836a22db9
# Convert threat-intelligence to Hostlist ... # Convert threat-intelligence to Hostlist ...
@ -143,10 +143,10 @@ Prepare domain list for compiling ... done.
] ]
} }
Start compiling threat-intelligence.adblock.raw Start compiling threat-intelligence.adblock.raw
Original length is 347548 Original length is 346979
Length after applying transformations is 347548 Length after applying transformations is 346979
The list was compressed from 347551 to 319189 The list was compressed from 346982 to 318781
Final length of the list is 319195 Final length of the list is 318787
Writing output to /media/nas/git/rpi/pihole/blocklists/build/threat-intelligence/out/threat-intelligence.adblock Writing output to /media/nas/git/rpi/pihole/blocklists/build/threat-intelligence/out/threat-intelligence.adblock
Finished compiling Finished compiling