Commit Graph

19 Commits

Author SHA1 Message Date
xr_rider 76b2657715 ecolife.com seems to use tarpitting with lynx and 504 error with firefox. It may be a siteground site.. not sure. 2019-11-03 15:59:44 -05:00
xr_rider 6945e48e4b new file to catalog the myths about CloudFlare; 403 sites added 2019-10-22 23:57:47 -04:00
libBletchley 88e27934aa mastercard's info sharing opt-out page (https://www.mastercard.us/en-us/about-mastercard/what-we-do/privacy/data-analytic-opt-out.html) blocks Tor, thus forcing consumers who want to protect their data to share their IP address with mastercard:
HTTP/1.1 301 Moved Permanently
Date: Mon, 19 Aug 2019 13:19:17 GMT
Location: http://www.mastercard.us/
Content-Type: text/html; charset=iso-8859-1
Set-Cookie: LB1=502633994.20480.0000; expires=Mon, 19-Aug-2019 13:49:17 GMT; path=/; Httponly
Set-Cookie: TS0161f197=01b18b28bee840e42b1c7a1da76f29533d7696366890c7df4c54f8c8e9d5bd7c61e2fce87bcfbde5579e2e4b13a6dcc8eff35cc8a5f967404eaf038bb25d2f8f700ee45dfd; Path=/; HTTPOnly
Transfer-Encoding: chunked

HTTP/1.1 403 Forbidden
Server: AkamaiGHost
Mime-Version: 1.0
Content-Type: text/html
Content-Length: 267
Expires: Mon, 19 Aug 2019 13:19:18 GMT
Date: Mon, 19 Aug 2019 13:19:18 GMT
Connection: close

(effective URL => "http://www.mastercard.us/")
2019-08-19 09:19:16 -04:00
libBletchley 4ced63b4ed HTTP/1.1 301 Moved Permanently
Content-Length: 0
Location: http://www.lycamobile.us/
Server: Microsoft-IIS/7.5
X-Powered-By: ASP.NET
Date: Sat, 17 Aug 2019 21:07:47 GMT

HTTP/1.1 403 Forbidden
Server: awselb/2.0
Date: Sat, 17 Aug 2019 20:49:24 GMT
Content-Type: text/html
Content-Length: 134
Connection: keep-alive

(effective URL => "http://www.lycamobile.us/")
2019-08-17 16:49:22 -04:00
libBletchley ee0e3fca8b HTTP/1.1 403 Forbidden
Server: o2switch PowerBoost
Date: Thu, 15 Aug 2019 20:48:41 GMT
Content-Type: text/html
Content-Length: 153
Connection: keep-alive
Vary: Accept-Encoding

(effective URL => "http://parisversailles.com/")
2019-08-15 16:48:40 -04:00
libBletchley ac114fe3ea HTTP/1.1 301 Moved Permanently
Date: Tue, 13 Aug 2019 14:35:21 GMT
Content-Type: text/html
Content-Length: 182
Connection: keep-alive
Location: https://cheapair.com/
X-Zen-Fury: a3d63271a99e1ed9cf5c93e22eefe244ec6300ac
Server: ZENEDGE

HTTP/2 301
date: Tue, 13 Aug 2019 14:35:24 GMT
content-type: text/html
content-length: 182
location: https://www.cheapair.com/
x-zen-fury: a3d63271a99e1ed9cf5c93e22eefe244ec6300ac
server: ZENEDGE

HTTP/2 403
date: Tue, 13 Aug 2019 14:35:25 GMT
content-type: text/html
cache-control: no-store
cache-control: no-cache, no-store, must-revalidate
cache-control: max-age=0
x-zen-fury: e1163b6d7d46e71a5eca535035bd1ca126553f76
server: ZENEDGE

(effective URL => "https://www.cheapair.com/")
2019-08-13 10:35:21 -04:00
libBletchley e40588d79f HTTP/1.1 301 Moved Permanently
Content-length: 0
Location: https://www.cheaptickets.com/

HTTP/2 403
server: AkamaiGHost
mime-version: 1.0
content-type: text/html
content-length: 269
expires: Tue, 13 Aug 2019 01:27:00 GMT
date: Tue, 13 Aug 2019 01:27:00 GMT
x-edgeconnect-cache-status: 0

(effective URL => "https://www.cheaptickets.com/")
2019-08-12 21:26:58 -04:00
libBletchley f1823355b4 HTTP/1.1 301 Moved Permanently
Content-length: 0
Location: https://www.travelocity.com/

HTTP/2 403
server: AkamaiGHost
mime-version: 1.0
content-type: text/html
content-length: 269
expires: Mon, 12 Aug 2019 20:10:07 GMT
date: Mon, 12 Aug 2019 20:10:07 GMT
x-edgeconnect-cache-status: 0

(effective URL => "https://www.travelocity.com/")
2019-08-12 16:10:05 -04:00
libBletchley 4869cccb9b HTTP/1.1 301 Moved Permanently
Content-length: 0
Location: https://www.orbitz.com/

HTTP/2 403
server: AkamaiGHost
mime-version: 1.0
content-type: text/html
content-length: 264
expires: Mon, 12 Aug 2019 19:30:59 GMT
date: Mon, 12 Aug 2019 19:30:59 GMT
x-edgeconnect-cache-status: 0

(effective URL => "https://www.orbitz.com/")
2019-08-12 15:30:56 -04:00
libBletchley 79dacbdd68 HTTP/1.0 301 Moved Permanently
Location: https://www.priceline.com/
Server: BigIP
Connection: Keep-Alive
Content-Length: 0

HTTP/2 403
server: Varnish
retry-after: 0
content-type: text/html
accept-ranges: bytes
date: Mon, 12 Aug 2019 19:11:15 GMT
via: 1.1 varnish
x-served-by: cache-hhn4063-HHN
x-cache: MISS
x-cache-hits: 0
x-timer: S1565637075.051590,VS0,VE21
wsheader: (null) cdn=HHN
content-length: 10824

(effective URL => "https://www.priceline.com/")
2019-08-12 15:11:12 -04:00
libBletchley f11407771d HTTP/1.1 301 Moved Permanently
Server: AkamaiGHost
Content-Length: 0
Location: https://www.hotwire.com/
Date: Mon, 12 Aug 2019 19:09:27 GMT
Connection: keep-alive
Set-Cookie: AKA_TRAFFIC_ROUTE=UW1-AZ1; expires=Mon, 12-Aug-2019 20:09:27 GMT; path=/
AK_DEBUG_ORIGIN_HEADER:

HTTP/2 403
server: AkamaiGHost
mime-version: 1.0
content-type: text/html
content-length: 264
expires: Mon, 12 Aug 2019 19:09:28 GMT
date: Mon, 12 Aug 2019 19:09:28 GMT
set-cookie: AKA_TRAFFIC_ROUTE=UW1-AZ1; expires=Mon, 12-Aug-2019 20:09:28 GMT; path=/
set-cookie: hwesgl=AMSTERDAM||NL|52.35|4.92|77.247.181.162; secure
set-cookie: ak_hfe=gcs; expires=Tue, 13-Aug-2019 19:09:28 GMT; path=/; domain=.hotwire.com
set-cookie: akavpau_hotwire_hwcl_missing=1565637568~id=f339453ac221d039865d88c9a66173ed; Path=/
set-cookie: akacd_gcs_prod_phased_release=3743089767~rv=29~id=df7b441d4bb8b4175c780a2359164bb8; path=/;
ak_debug_origin_header:

(effective URL => "https://www.hotwire.com/")
2019-08-12 15:09:27 -04:00
libBletchley ddbc1db5ed HTTP/1.1 301 Moved Permanently
Server: nginx/1.15.10
Date: Mon, 12 Aug 2019 17:41:40 GMT
Content-Type: text/html
Content-Length: 170
Location: https://www.homedepot.com/
Via: 1.1 google

HTTP/2 403
server: AkamaiGHost
mime-version: 1.0
content-type: text/html
content-length: 266
expires: Mon, 12 Aug 2019 17:41:44 GMT
cache-control: max-age=0, no-cache, no-store
pragma: no-cache
date: Mon, 12 Aug 2019 17:41:44 GMT
set-cookie: akaau=1565632004~id=d083363392743fe165bed72d8cb8e408; path=/
x-proto: secure

(effective URL => "https://www.homedepot.com/")
2019-08-12 13:41:38 -04:00
libBletchley ed12f982db HTTP/1.1 302 Moved Temporarily
Server: AkamaiGHost
Content-Length: 0
Location: https://www.lowes.com/
Date: Mon, 12 Aug 2019 17:39:59 GMT
Connection: keep-alive

HTTP/2 403
server: AkamaiGHost
mime-version: 1.0
content-type: text/html
content-length: 261
expires: Mon, 12 Aug 2019 17:40:00 GMT
date: Mon, 12 Aug 2019 17:40:00 GMT
set-cookie: akavpau_default=1565631900~id=fbf8317b73f629337e744dbe0bb4d3d8; Path=/
content-security-policy: frame-ancestors 'self'; upgrade-insecure-requests
strict-transport-security: max-age=31536000

(effective URL => "https://www.lowes.com/")
2019-08-12 13:39:58 -04:00
libBletchley 645d5250a7 HTTP/1.1 302 Found : Moved Temporarily
Location: https://www.spirit.com/
Connection: close
Cache-Control: no-cache
Pragma: no-cache

HTTP/2 403
server: AkamaiGHost
mime-version: 1.0
content-type: text/html
content-length: 263
expires: Mon, 12 Aug 2019 15:34:37 GMT
cache-control: max-age=0, no-cache, no-store
pragma: no-cache
date: Mon, 12 Aug 2019 15:34:37 GMT
set-cookie: akacd_1=3743076876~rv=54~id=439702062eaa355297ba28e7c257a284; path=/;

(effective URL => "https://www.spirit.com/")
2019-08-12 11:34:35 -04:00
libBletchley 5d7b8a36d2 HTTP/2 462
server: Varnish
retry-after: 0
content-type: text/html; charset=utf-8
accept-ranges: bytes
date: Sun, 11 Aug 2019 20:02:06 GMT
via: 1.1 varnish
x-served-by: cache-pao17440-PAO
x-cache: MISS
x-cache-hits: 0
nel: {"report_to":"network-errors","max_age":2592000,"success_fraction":0,"failure_fraction":1.0, "include_subdomains": true}
report-to: {"group":"network-errors","max_age":2592000,"endpoints":[{"url":"https://r.3gl.net/hawklogserver/559/re.p"}]}
content-length: 431

(effective URL => "https://www.thespruceeats.com/")
2019-08-11 16:02:03 -04:00
libBletchley 782eb4ede8 HTTP/1.1 301 Moved Permanently
Date: Sun, 11 Aug 2019 19:20:22 GMT
Server: Apache/2.2.15 (CentOS)
Location: http://www.lufthansa.com/
Connection: close
Content-Type: text/html; charset=iso-8859-1

HTTP/1.1 403 Forbidden
Server: AkamaiGHost
Mime-Version: 1.0
Content-Type: text/html
Content-Length: 267
Expires: Sun, 11 Aug 2019 19:20:22 GMT
Date: Sun, 11 Aug 2019 19:20:22 GMT
Connection: close

(effective URL => "http://www.lufthansa.com/")
2019-08-11 15:20:21 -04:00
libBletchley 7e28db4c84 HTTP/1.1 403 Forbidden
Server: AkamaiGHost
Mime-Version: 1.0
Content-Type: text/html
Content-Length: 267
Expires: Sun, 11 Aug 2019 00:15:38 GMT
Date: Sun, 11 Aug 2019 00:15:38 GMT
Connection: close
Strict-Transport-Security: max-age=31536000
X-Req: 95.101.79.54:2c14ae05
Set-Cookie: akavpau_www_aircanada_com_general=1565482718~id=9426b259019839692a7f476fe9cd1a8f; Domain=www.aircanada.com; Path=/; Secure
X-FRAME-OPTIONS: SAMEORIGIN

(effective URL => "https://www.aircanada.com/")HTTP/2 403
server: AkamaiGHost
mime-version: 1.0
content-type: text/html
content-length: 262
expires: Sun, 11 Aug 2019 00:15:39 GMT
date: Sun, 11 Aug 2019 00:15:39 GMT
set-cookie: dlsite=a; path=/; domain=.delta.com
set-cookie: akaalb_www_alb=~op=www_delta_prda_prdb:prda|~rv=12~m=prda:0|~os=48d273ae4858bbc3223560588306b0ba~id=5ad97577f2f1d74b4aefd614e486b027; path=/;; HttpOnly

(effective URL => "https://www.delta.com/")
2019-08-10 20:15:37 -04:00
libBletchley 2e5b3b4651 HTTP/1.1 403 Forbidden
Server: AkamaiGHost
Mime-Version: 1.0
Content-Type: text/html
Content-Length: 266
Expires: Sat, 10 Aug 2019 22:01:05 GMT
Date: Sat, 10 Aug 2019 22:01:05 GMT
Connection: close
Set-Cookie: akacd_TrueClarity_SC=1566079265~rv=85~id=29f49290fde7c2cd62c74ba9e9c686eb; path=/; Expires=Sat, 17 Aug 2019 22:01:05 GMT

(effective URL => "https://www.easyjet.com/en")
2019-08-10 18:01:04 -04:00
libBletchley acbad1f809 cat <(sed 's/$/ 403/' list_error403.txt) <(sed 's/$/ 462/' list_error462.txt) <(printf %s\n 'manta.com 403') | sort > list_http_error.txt 2019-08-09 11:01:04 -04:00