If you want to disable wget to download your site pages you need to declare wget as bad_bot. For that you need to add the following code in the .htaccess file located under website’s public_html directory.
after you inserted this code, if anybody tries to download your site pages using wget will receive a 403 error.

#Declare Wget a bad_bot
SetEnvIfNoCase User-Agent "^Wget" bad_bot
Order Allow,Deny
Allow from all
Deny from env=bad_bot

[email protected]:~# wget http://www.debian-tutorials.com/
--2013-02-14 xx:xx:xx--  http://www.debian-tutorials.com/
Resolving dev.slayergame.com... xxx.yyy.zzz.aaa
Connecting to www.debian-tutorials.com|xxx.yyy.zzz.aaa|:80... connected.
HTTP request sent, awaiting response... 403 Forbidden
2013-02-14 xx:xx:xx ERROR 403: Forbidden.

Wget is a free utility for non-interactive download of files from the Web.  It supports HTTP, HTTPS, and FTP protocols, as well as retrieval through HTTP proxies.

Using Wget to download entire website:

Step 1. Create directory where you are planing to store the website content:

mkdir /home/user/offline_site

Continue Reading…

Page 1 of 11