site-ripper

[Lokrado]

anyone recommend a good site-ripper? - one that will show me all directories/contents of a server?

 

[maflynn]

I could be wrong but most if not all site-rippers are not able to pull server side scripts, so any php or scripting that occurs to render the page is inaccessible to site rippers

 

[Tonsko]

wget? curl?

 

[mulo]

wget? curl?

how would wget help displaying website directories?

 

[Tonsko]

I use it on linux.

You dump the website to your hard disk (using wget with a switch), then sed, awk or homegrown script your way to provide a nice clean text file with a detailed directory map of the website. If that's what you're after. But you've essentially cloned the website to your machine, and as such can extract whatever data you want...