threat-intelligence auto-update

This commit is contained in:
Zelo72 2021-11-19 04:39:07 +01:00
parent 3089522e32
commit edbd54833a
2 changed files with 3809 additions and 4739 deletions

File diff suppressed because it is too large Load Diff

View File

@ -34,11 +34,11 @@ Initialize ...
# Download and convert Sourcelists ...
Nr | Count | Format | Source | Status | File | URL/File
1 | 7073 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/phishing-filter-hosts.txt
2 | 373 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/pup-filter-hosts.txt
3 | 10314 | hosts | http | online | unchanged | https://curben.gitlab.io/malware-filter/urlhaus-filter-hosts.txt
1 | 7004 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/phishing-filter-hosts.txt
2 | 371 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/pup-filter-hosts.txt
3 | 10264 | hosts | http | online | changed | https://curben.gitlab.io/malware-filter/urlhaus-filter-hosts.txt
4 | 3496 | hosts | http | online | unchanged | https://gitlab.com/ZeroDot1/CoinBlockerLists/raw/master/hosts_browser
5 | 36265 | hosts | http | online | changed | https://hole.cert.pl/domains/domains_hosts.txt
5 | 36380 | hosts | http | online | changed | https://hole.cert.pl/domains/domains_hosts.txt
6 | 550 | hosts | http | online | unchanged | https://paulgb.github.io/BarbBlock/blacklists/hosts-file.txt
7 | 6040 | hosts | http | online | unchanged | https://raw.githubusercontent.com/DandelionSprout/adfilt/master/Alternate%20versions%20Anti-Malware%20List/AntiMalwareHosts.txt
8 | 2204 | hosts | http | online | unchanged | https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.Risk/hosts
@ -51,41 +51,41 @@ Initialize ...
15 | 1072 | hosts | http | online | unchanged | https://raw.githubusercontent.com/metamask/eth-phishing-detect/master/src/hosts.txt
16 | 1386 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Badd-Boyz-Hosts/master/hosts
17 | 13465 | hosts | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/The-Big-List-of-Hacked-Malware-Web-Sites/master/hosts
18 | 994 | hosts | http | online | changed | https://urlhaus.abuse.ch/downloads/hostfile/
19 | 4592 | hosts | http | online | unchanged | https://threatfox.abuse.ch/downloads/hostfile
18 | 982 | hosts | http | online | changed | https://urlhaus.abuse.ch/downloads/hostfile/
19 | 3152 | hosts | http | online | changed | https://threatfox.abuse.ch/downloads/hostfile
20 | 883 | adblock | http | online | unchanged | https://raw.githubusercontent.com/piperun/iploggerfilter/master/filterlist
21 | 919 | domains | http | online | changed | https://azorult-tracker.net/api/list/domain?format=plain
22 | 122584 | domains | http | OFFLINE | unchanged | USE LOCAL COPY: blocklist.cyberthreatcoalition.org_vetted_domain.txt
23 | 549 | domains | http | online | unchanged | https://feeds.alphasoc.net/ryuk.txt
24 | 9233 | domains | http | online | unchanged | https://gitlab.com/KevinThomas0/cryptoscamdb-lists/-/raw/master/cryptoscamdb-blocklist.txt
25 | 355 | domains | http | online | unchanged | https://gitlab.com/quidsup/notrack-blocklists/raw/master/notrack-malware.txt
26 | 36265 | domains | http | online | changed | https://hole.cert.pl/domains/domains.txt
27 | 74308 | domains | http | online | unchanged | https://joewein.net/dl/bl/dom-bl-base.txt
28 | 882 | domains | http | online | unchanged | https://joewein.net/dl/bl/dom-bl.txt
29 | 2000 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_covid_domains.txt
30 | 2000 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_malicious_domains.txt
26 | 36380 | domains | http | online | changed | https://hole.cert.pl/domains/domains.txt
27 | 74263 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl-base.txt
28 | 888 | domains | http | online | changed | https://joewein.net/dl/bl/dom-bl.txt
29 | 1999 | domains | http | online | changed | https://kriskintel.com/feeds/ktip_covid_domains.txt
30 | 1996 | domains | http | online | changed | https://kriskintel.com/feeds/ktip_malicious_domains.txt
31 | 397 | domains | http | online | unchanged | https://kriskintel.com/feeds/ktip_ransomware_feeds.txt
32 | 2249 | domains | http | online | unchanged | https://orca.pet/notonmyshift/domains.txt
33 | 143 | domains | http | online | unchanged | https://osint.digitalside.it/Threat-Intel/lists/latestdomains.txt
34 | 48184 | domains | http | online | unchanged | https://phishing.army/download/phishing_army_blocklist.txt
35 | 58452 | domains | http | online | unchanged | https://phishing.army/download/phishing_army_blocklist_extended.txt
34 | 48457 | domains | http | online | changed | https://phishing.army/download/phishing_army_blocklist.txt
35 | 58748 | domains | http | online | changed | https://phishing.army/download/phishing_army_blocklist_extended.txt
36 | 1406 | domains | http | online | unchanged | https://raw.githubusercontent.com/AmnestyTech/investigations/master/2021-07-18_nso/domains.txt
37 | 27 | domains | http | online | unchanged | https://raw.githubusercontent.com/DRSDavidSoft/additional-hosts/master/domains/blacklist/fake-domains.txt
38 | 35322 | domains | http | online | unchanged | https://raw.githubusercontent.com/PolishFiltersTeam/KADhosts/master/KADomains.txt
38 | 35603 | domains | http | online | changed | https://raw.githubusercontent.com/PolishFiltersTeam/KADhosts/master/KADomains.txt
39 | 678 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Cryptocurrency
40 | 25892 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Malware
41 | 208 | domains | http | online | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Risk
40 | 26042 | domains | http | online | changed | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Malware
41 | 240 | domains | http | online | changed | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Risk
42 | 3960 | domains | http | online | unchanged | https://raw.githubusercontent.com/bongochong/CombinedPrivacyBlockLists/master/NoFormatting/MD-ID-Fork.txt
43 | 18459 | domains | http | online | unchanged | https://raw.githubusercontent.com/cbuijs/shallalist/master/spyware/domains
44 | 13908 | domains | http | online | unchanged | https://raw.githubusercontent.com/cbuijs/ut1/master/cryptojacking/domains
45 | 167714 | domains | http | online | unchanged | https://raw.githubusercontent.com/cbuijs/ut1/master/malware/domains
45 | 167735 | domains | http | online | changed | https://raw.githubusercontent.com/cbuijs/ut1/master/malware/domains
46 | 451 | domains | http | online | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/CryptBot/domains.txt
47 | 137 | domains | http | online | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/IcedID/domains.txt
48 | 692 | domains | http | online | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/TA551/domains.txt
49 | 3942 | domains | http | online | unchanged | https://raw.githubusercontent.com/iam-py-test/my_filters_001/main/Alternative%20list%20formats/antimalware_domains.txt
49 | 3945 | domains | http | online | changed | https://raw.githubusercontent.com/iam-py-test/my_filters_001/main/Alternative%20list%20formats/antimalware_domains.txt
50 | 2079 | domains | http | online | unchanged | https://raw.githubusercontent.com/matomo-org/referrer-spam-blacklist/master/spammers.txt
51 | 71287 | domains | http | online | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-ACTIVE.txt
52 | 290 | domains | http | online | changed | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-NEW-today.txt
52 | 244 | domains | http | online | changed | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-NEW-today.txt
53 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_5000_domain.txt
54 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_germany.txt
55 | 10000 | domains | http | online | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.8_domains.txt
@ -100,36 +100,37 @@ Initialize ...
64 | 3 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-kaspersky.txt
65 | 10592 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-main.txt
66 | 1892 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-malware-traffic.txt
67 | 3189 | domains | http | online | changed | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-personal.txt
67 | 3189 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-personal.txt
68 | 147 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-sentinelone.txt
69 | 512 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-unit42-playbook.txt
70 | 23232 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-unit42-silverterrier.txt
71 | 3800 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-zscaler.txt
72 | 152554 | domains | http | online | unchanged | https://raw.githubusercontent.com/stamparm/aux/master/maltrail-malware-domains.txt
73 | 17019 | domains | http | online | unchanged | https://raw.githubusercontent.com/stamparm/blackbook/master/blackbook.txt
74 | 500 | domains | http | OFFLINE | unchanged | USE LOCAL COPY: rescure.me_covid.txt
75 | 500 | domains | http | online | unchanged | https://rescure.me/rescure_domain_blacklist.txt
76 | 508 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.domain.raw
77 | 90 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.hostname.raw
78 | 35220 | domains | http | online | changed | https://www.stopforumspam.com/downloads/toxic_domains_whole.txt
79 | 104133 | domains | http | online | changed | https://www.usom.gov.tr/url-list.txt
80 | 56177 | domains | http | online | unchanged | https://airvpn.org/api/dns_lists/?code=air_malware&block=0.0.0.0&style=domains
81 | 11527 | domains | http | online | unchanged | https://airvpn.org/api/dns_lists/?code=air_cryptojacking&block=0.0.0.0&style=domains
82 | 139 | domains | local | online | unchanged | black.list.threat-intelligence
69 | 86 | domains | http | online | changed | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-tag.txt
70 | 512 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-unit42-playbook.txt
71 | 23232 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-unit42-silverterrier.txt
72 | 3800 | domains | http | online | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-zscaler.txt
73 | 152592 | domains | http | online | changed | https://raw.githubusercontent.com/stamparm/aux/master/maltrail-malware-domains.txt
74 | 17026 | domains | http | online | changed | https://raw.githubusercontent.com/stamparm/blackbook/master/blackbook.txt
75 | 500 | domains | http | OFFLINE | unchanged | USE LOCAL COPY: rescure.me_covid.txt
76 | 500 | domains | http | online | changed | https://rescure.me/rescure_domain_blacklist.txt
77 | 508 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.domain.raw
78 | 90 | domains | http | online | unchanged | https://www.botvrij.eu/data/ioclist.hostname.raw
79 | 35223 | domains | http | online | changed | https://www.stopforumspam.com/downloads/toxic_domains_whole.txt
80 | 104211 | domains | http | online | changed | https://www.usom.gov.tr/url-list.txt
81 | 56177 | domains | http | online | unchanged | https://airvpn.org/api/dns_lists/?code=air_malware&block=0.0.0.0&style=domains
82 | 11527 | domains | http | online | unchanged | https://airvpn.org/api/dns_lists/?code=air_cryptojacking&block=0.0.0.0&style=domains
83 | 139 | domains | local | online | unchanged | black.list.threat-intelligence
# Build threat-intelligence Domainlist ...
Stats threat-intelligence:
** Source (raw): 1284037
== Source (unique): 878787 (-405250)
-- Exclude: 878782 (-5)
-- White: 878005 (-777)
-- White(*): 871777 (-6228)
-- Dead: 370719 (-501058)
** Source (raw): 1283872
== Source (unique): 877876 (-405996)
-- Exclude: 877871 (-5)
-- White: 877097 (-774)
-- White(*): 870846 (-6251)
-- Dead: 370013 (-500833)
370719 unique Domains - Version 2021.1118.105833
MD5 Domains RAW: ef90c2ca964f2b36ad57f8bee7daa2d7
370013 unique Domains - Version 2021.1119.043158
MD5 Domains RAW: 2f214f869a3fd84e6a91329945be5fc6
# Convert threat-intelligence to Hostlist ...
@ -152,10 +153,10 @@ Prepare domain list for compiling ... done.
]
}
Start compiling threat-intelligence.adblock.raw
Original length is 351155
Length after applying transformations is 351155
The list was compressed from 351158 to 321527
Final length of the list is 321533
Original length is 350404
Length after applying transformations is 350404
The list was compressed from 350407 to 320595
Final length of the list is 320601
Writing output to /media/nas/git/rpi/pihole/blocklists/build/threat-intelligence/out/threat-intelligence.adblock
Finished compiling