BASH Website

From Indie IT Wiki
Jump to: navigation, search

HOWTO: Dump HTTP Header Using WGET

wget --server-response --spider

HOWTO: Download Web Page And All Files Linked

$ wget -r -np -k

Download An Entire Web Site

wget --quiet --recursive --no-clobber --page-requisites --html-extension --convert-links --domains --no-parent

HOWTO: Show Web Page Headers


curl -I

Sample output...

HTTP/1.1 200 OK
Server: Apache
Content-Type: text/html
Content-Language: en-GB
Etag: "4c572592f520bedc9a1e2c0238accaa6"
Transfer-Encoding: chunked
Date: Fri, 06 Mar 2015 11:30:51 GMT
Connection: keep-alive
Set-Cookie: BBC-UID=15d4ff99887f5eab78a60516b12f651317b26b71e7f4e4a61ad0970254e467200curl/7.35.0; expires=Tue, 05-Mar-19 11:30:51 GMT; path=/;
X-Cache-Action: HIT
X-Cache-Hits: 1149
X-Cache-Age: 64
Cache-Control: private, max-age=0, must-revalidate
Vary: X-CDN

Thanks to CyberCiti.