rpi/pihole/blocklists/big.stats

193 lines
5.9 KiB
Plaintext
Raw Normal View History

2021-10-19 21:54:26 +02:00
### Compile big Blocklist ###
Config:
2021-10-24 09:48:17 +02:00
** Build - 6:
2021-10-19 21:54:26 +02:00
2021-10-22 13:21:35 +02:00
extendWWWFLD
2021-10-19 21:54:26 +02:00
hosts
adblock
2021-10-22 13:21:35 +02:00
adblockwhite
2021-10-19 21:54:26 +02:00
no_adblock_convert
localpush
2021-10-23 17:33:26 +02:00
++ Prioritized Blocklists - 1:
2021-10-22 13:21:35 +02:00
../../data/rules.list.block
2021-10-25 11:31:31 +02:00
- White - 18:
2021-10-22 13:21:35 +02:00
big.white
2021-10-23 12:20:02 +02:00
-- Whitelists - 2:
2021-10-22 13:21:35 +02:00
2021-10-23 17:33:26 +02:00
../../data/white.list
2021-10-22 13:21:35 +02:00
../../data/white.list.adguard
2021-10-23 17:33:26 +02:00
-- Unblocklists - 2:
../../data/white.list.important
2021-10-23 12:20:02 +02:00
../../data/white.list.referral
2021-10-22 13:21:35 +02:00
2021-10-19 21:54:26 +02:00
Initialize ...
# Download and convert Sourcelists ...
Nr | Count | Format | Source | Status | File | URL/File
2021-10-26 00:25:34 +02:00
1 | 478855 | domains | local | online | changed | multi.txt
2 | 46579 | domains | local | online | changed | fake.txt
3 | 1060333 | domains | http | online | changed | https://dbl.oisd.nl
4 | 40653 | adblock | http | online | unchanged | https://adguardteam.github.io/AdGuardSDNSFilter/Filters/filter.txt
2021-10-19 21:54:26 +02:00
# Build big Domainlist ...
Stats big:
2021-10-26 00:25:34 +02:00
** Source (raw): 1626420
== Source (unique): 1337386 (-289034)
-- White: 1337121 (-265)
-- White(*): 1334138 (-2983)
++ Block: 1334157 (+19)
-- Unblock: 1334105 (-52)
-- Unblock(*): 1334024 (-81)
++ FLD: 1334238 (+214)
++ WWW: 1346129 (+11891)
2021-10-20 08:32:30 +02:00
2021-10-26 00:25:34 +02:00
1346129 unique Domains - Version 2021.1026.001604
MD5 Domains RAW: 42d2c795ad0eac444ba34945bdb2a618
2021-10-19 21:54:26 +02:00
# Convert big to Hostlist ...
# Convert big to AdBlocklist ...
2021-10-20 08:04:32 +02:00
Starting @adguard/hostlist-compiler v1.0.12
Starting the compiler
Configuration: {
"name": "Big",
"sources": [
{
"source": "/media/nas/git/adguard/multi.adblock",
"type": "adblock",
"transformations": [
"Validate"
]
},
{
"source": "/media/nas/git/adguard/fake.adblock",
"type": "adblock",
"transformations": [
"Validate"
]
},
{
"source": "https://abp.oisd.nl/",
"type": "adblock",
2021-10-22 13:21:35 +02:00
"exclusions_sources": [
"../exclusions.txt",
2021-10-23 17:33:26 +02:00
"../../../data/adblock.exclusions.referral",
"../../../data/adblock.exclusions.list",
"../../../data/adblock.exclusions.important",
2021-10-22 13:21:35 +02:00
"https://raw.githubusercontent.com/AdguardTeam/AdGuardSDNSFilter/master/Filters/exclusions.txt"
],
"transformations": [
"Validate"
]
},
{
"source": "https://adguardteam.github.io/AdGuardSDNSFilter/Filters/filter.txt",
"type": "adblock",
"exclusions_sources": [
2021-10-23 12:20:02 +02:00
"../exclusions.txt",
2021-10-23 17:33:26 +02:00
"../../../data/adblock.exclusions.referral",
"../../../data/adblock.exclusions.list",
"../../../data/adblock.exclusions.important"
2021-10-22 13:21:35 +02:00
],
2021-10-20 08:04:32 +02:00
"transformations": [
"Validate"
]
2021-10-22 13:21:35 +02:00
},
{
"source": "https://raw.githubusercontent.com/AdguardTeam/AdGuardSDNSFilter/master/Filters/rules.txt",
2021-10-23 17:33:26 +02:00
"exclusions_sources": [
"../exclusions.txt",
"../../../data/adblock.exclusions.referral",
"../../../data/adblock.exclusions.important"
],
2021-10-22 13:21:35 +02:00
"transformations": [
"Validate"
],
"type": "adblock"
},
{
"source": "../rules.txt",
2021-10-23 17:33:26 +02:00
"exclusions_sources": [
"../exclusions.txt",
"../../../data/adblock.exclusions.referral",
"../../../data/adblock.exclusions.important"
],
2021-10-22 13:21:35 +02:00
"transformations": [
"Validate"
],
"type": "adblock"
},
{
"source": "https://raw.githubusercontent.com/AdguardTeam/AdGuardSDNSFilter/master/Filters/exceptions.txt",
"transformations": [
"Validate"
],
"type": "adblock"
},
{
"source": "../exceptions.txt",
"transformations": [
"Validate"
],
"type": "adblock"
2021-10-20 08:04:32 +02:00
}
],
"transformations": [
"Compress"
]
}
Start compiling /media/nas/git/adguard/multi.adblock
2021-10-26 00:25:34 +02:00
Original length is 258974
Length after applying transformations is 258974
2021-10-20 08:04:32 +02:00
Start compiling /media/nas/git/adguard/fake.adblock
2021-10-26 00:25:34 +02:00
Original length is 23690
Length after applying transformations is 23690
2021-10-20 08:04:32 +02:00
Start compiling https://abp.oisd.nl/
2021-10-26 00:25:34 +02:00
Original length is 371984
2021-10-25 18:38:44 +02:00
Filtering the list of rules using 2119 exclusion rules
2021-10-26 00:25:34 +02:00
Excluded 526 rules. 371458 rules left.
Length after applying transformations is 371457
2021-10-22 13:21:35 +02:00
Start compiling https://adguardteam.github.io/AdGuardSDNSFilter/Filters/filter.txt
2021-10-26 00:25:34 +02:00
Original length is 41724
2021-10-25 18:38:44 +02:00
Filtering the list of rules using 1793 exclusion rules
2021-10-26 00:25:34 +02:00
Excluded 105 rules. 41619 rules left.
Length after applying transformations is 41619
2021-10-22 13:21:35 +02:00
Start compiling https://raw.githubusercontent.com/AdguardTeam/AdGuardSDNSFilter/master/Filters/rules.txt
Original length is 576
2021-10-25 18:38:44 +02:00
Filtering the list of rules using 907 exclusion rules
2021-10-23 21:49:01 +02:00
Excluded 0 rules. 576 rules left.
Length after applying transformations is 570
2021-10-22 13:21:35 +02:00
Start compiling ../rules.txt
Original length is 2
2021-10-25 18:38:44 +02:00
Filtering the list of rules using 907 exclusion rules
2021-10-23 17:33:26 +02:00
Excluded 0 rules. 2 rules left.
2021-10-22 13:21:35 +02:00
Length after applying transformations is 2
Start compiling https://raw.githubusercontent.com/AdguardTeam/AdGuardSDNSFilter/master/Filters/exceptions.txt
Original length is 179
Length after applying transformations is 179
Start compiling ../exceptions.txt
2021-10-25 11:31:31 +02:00
Original length is 19
Length after applying transformations is 19
2021-10-26 00:25:34 +02:00
The list was compressed from 696534 to 496916
Final length of the list is 496922
2021-10-20 08:04:32 +02:00
Writing output to /media/nas/git/rpi/pihole/blocklists/build/big/out/big.adblock
Finished compiling
2021-10-19 21:54:26 +02:00
# Attach header to big Domainlist ...
# Push big to local Repositories ...