threat-intelligence auto-update

2021-10-30 09:09:08 +02:00 · 2021-10-30 09:09:08 +02:00 · 8b0651191a
parent 40aec7d611
commit 8b0651191a
2 changed files with 3436 additions and 3804 deletions
--- a/threat-intelligence.adblock
+++ b/threat-intelligence.adblock
--- a/threat-intelligence.stats
+++ b/threat-intelligence.stats
@ -8,45 +8,50 @@ Config:
   adblock
   localpush

+-- Excludelists - 2:
+
+   ../../fake.txt
+   ../../doh-vpn-proxy-bypass.txt
+
 -- Deadlists - 1:

   ../../data/dead.list

- - White - 1:
+ - White - 94:

   threat-intelligence.white

 -- Whitelists - 5:

   ../../data/exclude.list
-   ../../data/white.list.important
   ../../data/white.list.apple
   ../../data/white.list.microsoft
   ../../data/white.list.hl2guide
+   ../../data/networks/google.list

 Initialize ...

 # Download and convert Sourcelists ...

  Nr |   Count | Format  | Source | Status  | File      | URL/File
-   1 |    6805 | hosts   | http   | online  | unchanged | https://curben.gitlab.io/malware-filter/phishing-filter-hosts.txt
-   2 |     422 | hosts   | http   | online  | unchanged | https://curben.gitlab.io/malware-filter/pup-filter-hosts.txt
-   3 |   10212 | hosts   | http   | online  | unchanged | https://curben.gitlab.io/malware-filter/urlhaus-filter-hosts.txt
+   1 |    6780 | hosts   | http   | online  | changed   | https://curben.gitlab.io/malware-filter/phishing-filter-hosts.txt
+   2 |     419 | hosts   | http   | online  | changed   | https://curben.gitlab.io/malware-filter/pup-filter-hosts.txt
+   3 |   10295 | hosts   | http   | online  | changed   | https://curben.gitlab.io/malware-filter/urlhaus-filter-hosts.txt
   4 |    3496 | hosts   | http   | online  | unchanged | https://gitlab.com/ZeroDot1/CoinBlockerLists/raw/master/hosts_browser
-   5 |   34375 | hosts   | http   | online  | changed   | https://hole.cert.pl/domains/domains_hosts.txt
+   5 |   34375 | hosts   | http   | online  | unchanged | https://hole.cert.pl/domains/domains_hosts.txt
   6 |     550 | hosts   | http   | online  | unchanged | https://paulgb.github.io/BarbBlock/blacklists/hosts-file.txt
   7 |    5987 | hosts   | http   | online  | unchanged | https://raw.githubusercontent.com/DandelionSprout/adfilt/master/Alternate%20versions%20Anti-Malware%20List/AntiMalwareHosts.txt
   8 |    2204 | hosts   | http   | online  | unchanged | https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.Risk/hosts
   9 |      59 | hosts   | http   | online  | unchanged | https://raw.githubusercontent.com/FadeMind/hosts.extras/master/add.Spam/hosts
-  10 |     142 | hosts   | http   | online  | unchanged | https://raw.githubusercontent.com/davidonzo/Threat-Intel/master/lists/latestdomains.piHole.txt
-  11 |    1058 | hosts   | http   | online  | unchanged | https://raw.githubusercontent.com/durablenapkin/scamblocklist/master/hosts.txt
+  10 |     145 | hosts   | http   | online  | changed   | https://raw.githubusercontent.com/davidonzo/Threat-Intel/master/lists/latestdomains.piHole.txt
+  11 |    1056 | hosts   | http   | online  | changed   | https://raw.githubusercontent.com/durablenapkin/scamblocklist/master/hosts.txt
  12 |    8624 | hosts   | http   | online  | unchanged | https://raw.githubusercontent.com/guardicore/labs_campaigns/master/Autodiscover/autodiscover-tlds.txt
  13 |     695 | hosts   | http   | online  | unchanged | https://raw.githubusercontent.com/hoshsadiq/adblock-nocoin-list/master/hosts.txt
  14 |    3686 | hosts   | http   | online  | unchanged | https://raw.githubusercontent.com/infinitytec/blocklists/master/scams-and-phishing.txt
  15 |    1072 | hosts   | http   | online  | unchanged | https://raw.githubusercontent.com/metamask/eth-phishing-detect/master/src/hosts.txt
  16 |    1386 | hosts   | http   | online  | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Badd-Boyz-Hosts/master/hosts
  17 |   13465 | hosts   | http   | online  | unchanged | https://raw.githubusercontent.com/mitchellkrogza/The-Big-List-of-Hacked-Malware-Web-Sites/master/hosts
-  18 |    1882 | hosts   | http   | online  | changed   | https://urlhaus.abuse.ch/downloads/hostfile/
+  18 |    1753 | hosts   | http   | online  | changed   | https://urlhaus.abuse.ch/downloads/hostfile/
  19 |    4467 | hosts   | http   | online  | unchanged | https://threatfox.abuse.ch/downloads/hostfile
  20 |     883 | adblock | http   | online  | unchanged | https://raw.githubusercontent.com/piperun/iploggerfilter/master/filterlist
  21 |     915 | domains | http   | online  | changed   | https://azorult-tracker.net/api/list/domain?format=plain
@ -54,33 +59,33 @@ Initialize ...
  23 |     549 | domains | http   | online  | unchanged | https://feeds.alphasoc.net/ryuk.txt
  24 |    9233 | domains | http   | online  | unchanged | https://gitlab.com/KevinThomas0/cryptoscamdb-lists/-/raw/master/cryptoscamdb-blocklist.txt
  25 |     357 | domains | http   | online  | unchanged | https://gitlab.com/quidsup/notrack-blocklists/raw/master/notrack-malware.txt
-  26 |   34375 | domains | http   | online  | changed   | https://hole.cert.pl/domains/domains.txt
+  26 |   34375 | domains | http   | online  | unchanged | https://hole.cert.pl/domains/domains.txt
  27 |   73595 | domains | http   | online  | unchanged | https://joewein.net/dl/bl/dom-bl-base.txt
  28 |     858 | domains | http   | online  | unchanged | https://joewein.net/dl/bl/dom-bl.txt
-  29 |    2000 | domains | http   | online  | changed   | https://kriskintel.com/feeds/ktip_covid_domains.txt
-  30 |    1994 | domains | http   | online  | changed   | https://kriskintel.com/feeds/ktip_malicious_domains.txt
+  29 |    1999 | domains | http   | online  | changed   | https://kriskintel.com/feeds/ktip_covid_domains.txt
+  30 |    1996 | domains | http   | online  | changed   | https://kriskintel.com/feeds/ktip_malicious_domains.txt
  31 |     397 | domains | http   | online  | unchanged | https://kriskintel.com/feeds/ktip_ransomware_feeds.txt
  32 |    2245 | domains | http   | online  | unchanged | https://orca.pet/notonmyshift/domains.txt
-  33 |     142 | domains | http   | online  | unchanged | https://osint.digitalside.it/Threat-Intel/lists/latestdomains.txt
-  34 |   46263 | domains | http   | online  | unchanged | https://phishing.army/download/phishing_army_blocklist.txt
-  35 |   56228 | domains | http   | online  | changed   | https://phishing.army/download/phishing_army_blocklist_extended.txt
+  33 |     145 | domains | http   | online  | changed   | https://osint.digitalside.it/Threat-Intel/lists/latestdomains.txt
+  34 |   46194 | domains | http   | online  | changed   | https://phishing.army/download/phishing_army_blocklist.txt
+  35 |   56141 | domains | http   | online  | changed   | https://phishing.army/download/phishing_army_blocklist_extended.txt
  36 |    1406 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/AmnestyTech/investigations/master/2021-07-18_nso/domains.txt
  37 |      27 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/DRSDavidSoft/additional-hosts/master/domains/blacklist/fake-domains.txt
-  38 |   34689 | domains | http   | online  | changed   | https://raw.githubusercontent.com/PolishFiltersTeam/KADhosts/master/KADomains.txt
+  38 |   34689 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/PolishFiltersTeam/KADhosts/master/KADomains.txt
  39 |     675 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Cryptocurrency
-  40 |   23135 | domains | http   | online  | changed   | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Malware
+  40 |   23135 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Malware
  41 |     179 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/ShadowWhisperer/BlockLists/master/Lists/Risk
  42 |    3960 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/bongochong/CombinedPrivacyBlockLists/master/NoFormatting/MD-ID-Fork.txt
  43 |   18454 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/cbuijs/shallalist/master/spyware/domains
  44 |   13908 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/cbuijs/ut1/master/cryptojacking/domains
-  45 |  169576 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/cbuijs/ut1/master/malware/domains
+  45 |  169592 | domains | http   | online  | changed   | https://raw.githubusercontent.com/cbuijs/ut1/master/malware/domains
  46 |     434 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/CryptBot/domains.txt
  47 |     137 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/IcedID/domains.txt
  48 |     657 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/hpthreatresearch/iocs/main/TA551/domains.txt
-  49 |    3729 | domains | http   | online  | changed   | https://raw.githubusercontent.com/iam-py-test/my_filters_001/main/Alternative%20list%20formats/antimalware_domains.txt
+  49 |    3729 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/iam-py-test/my_filters_001/main/Alternative%20list%20formats/antimalware_domains.txt
  50 |    2079 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/matomo-org/referrer-spam-blacklist/master/spammers.txt
  51 |   71289 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-ACTIVE.txt
-  52 |     704 | domains | http   | online  | changed   | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-NEW-today.txt
+  52 |     350 | domains | http   | online  | changed   | https://raw.githubusercontent.com/mitchellkrogza/Phishing.Database/master/phishing-domains-NEW-today.txt
  53 |   10000 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_5000_domain.txt
  54 |   10000 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.7_germany.txt
  55 |   10000 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/prodaft/malware-ioc/master/FluBot/v3.8_domains.txt
@ -100,28 +105,29 @@ Initialize ...
  69 |     512 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-unit42-playbook.txt
  70 |   23232 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-unit42-silverterrier.txt
  71 |    3791 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/scafroglia93/blocklists/master/blocklists-zscaler.txt
-  72 |  150461 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/stamparm/aux/master/maltrail-malware-domains.txt
+  72 |  150480 | domains | http   | online  | changed   | https://raw.githubusercontent.com/stamparm/aux/master/maltrail-malware-domains.txt
  73 |   16941 | domains | http   | online  | unchanged | https://raw.githubusercontent.com/stamparm/blackbook/master/blackbook.txt
-  74 |     500 | domains | http   | online  | unchanged | https://rescure.me/covid.txt
-  75 |     500 | domains | http   | online  | unchanged | https://rescure.me/rescure_domain_blacklist.txt
+  74 |     500 | domains | http   | online  | changed   | https://rescure.me/covid.txt
+  75 |     500 | domains | http   | online  | changed   | https://rescure.me/rescure_domain_blacklist.txt
  76 |     508 | domains | http   | online  | unchanged | https://www.botvrij.eu/data/ioclist.domain.raw
  77 |      90 | domains | http   | online  | unchanged | https://www.botvrij.eu/data/ioclist.hostname.raw
-  78 |   35108 | domains | http   | online  | changed   | https://www.stopforumspam.com/downloads/toxic_domains_whole.txt
-  79 |  102256 | domains | http   | online  | changed   | https://www.usom.gov.tr/url-list.txt
+  78 |   35108 | domains | http   | online  | unchanged | https://www.stopforumspam.com/downloads/toxic_domains_whole.txt
+  79 |  102278 | domains | http   | online  | changed   | https://www.usom.gov.tr/url-list.txt
  80 |     135 | domains | local  | online  | unchanged | black.list.threat-intelligence

 # Build threat-intelligence Domainlist ...

 Stats threat-intelligence:

-** Source (raw):    1202051
-== Source (unique): 867463 (-334588)
-- White:           866683 (-780)
-- White(*):        861378 (-5305)
-- Dead:            371965 (-489413)
+** Source (raw):    1201529
+== Source (unique): 867324 (-334205)
+-- Exclude:         866739 (-585)
+-- White:           865965 (-774)
+-- White(*):        860718 (-5247)
+-- Dead:            371247 (-489471)

-371965 unique Domains - Version 2021.1030.000200
-MD5 Domains RAW: e20c92359cba5a20d9ad0b97789518db
+371247 unique Domains - Version 2021.1030.090201
+MD5 Domains RAW: 3549b2aaa72f282d5fd91266d952fc2f

 # Convert threat-intelligence to Hostlist ... 

@ -144,10 +150,10 @@ Prepare domain list for compiling ... done.
    ]
 }
 ℹ Start compiling threat-intelligence.adblock.raw
-ℹ Original length is 352427
-ℹ Length after applying transformations is 352427
-ℹ The list was compressed from 352430 to 323732
-ℹ Final length of the list is 323738
+ℹ Original length is 351897
+ℹ Length after applying transformations is 351897
+ℹ The list was compressed from 351900 to 323358
+ℹ Final length of the list is 323364
 ℹ Writing output to /media/nas/git/rpi/pihole/blocklists/build/threat-intelligence/out/threat-intelligence.adblock
 ℹ Finished compiling