[wplug] wget with frames

[Poyner, Brandon]

What you have is a stubborn battle of the wills.  Wget considers ~ to be
an unsafe character and converts it to the hex %7e.  The server at
www.pitt.edu doesn't merely take that and convert it internally to ~ and
return the content (Apache normally does this), but rather it issues an
HTTP redirect to the URL with ~.  So wget attempts to follow the
provided link and converts ~ back to %7e.

Do you have something like curl handy?  I would consider using that
instead.

Brandon Poyner
Network Engineer III
CCAC - College Office
412-237-3086
 
 

> -----Original Message-----
> From: wplug-bounces+bpoyner=ccac.edu at wplug.org 
> [mailto:wplug-bounces+bpoyner=ccac.edu at wplug.org] On Behalf 
> Of John Harrold
> Sent: Tuesday, September 20, 2005 2:18 PM
> To: western PA LUG
> Subject: [wplug] wget with frames
> 
> Howdy,
> 
> I'm trying to mirror a website using wget and it's failing.  
> This is the
> command I'm using:
> 
> 
> wget -m --user-agent="Mozilla/4.0" http://www.pitt.edu/~biohome/ 
> 
> This is the output I get:
> 
> -14:05:52--  http://www.pitt.edu/%7Ebiohome/
>            => `www.pitt.edu/~biohome/index.html'
> Resolving www.pitt.edu... 136.142.42.14
> Connecting to www.pitt.edu[136.142.42.14]:80... connected.
> HTTP request sent, awaiting response... 302 Object Moved
> Location: http://www.pitt.edu/~biohome/ [following]
> 
> I might be wrong, but I think the frames are causing the 
> havoc. Can anyone
> offer any insight into this?
> 
> 
> -- 
> ---------------------------------------------------------- 
>                             | /"\                         
>  john harrold               | \ / ASCII ribbon campaign   
>  john.m.harrold _at_ gmail  |  X  against HTML mail       
>  the most useful idiot      | / \                         
> ----------------------------------------------------------
>  What difference does it make to the dead, the orphans, 
>  and the homeless, whether the mad destruction is brought 
>  under the name of totalitarianism or the holy name of 
>  liberty and democracy?
>  --Gandhi
> ----------------------------------------------------------
>   gpg --keyserver pgp.mit.edu --recv-key B23241CB
> ----------------------------------------------------------
>