Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

SrWebDeveloper

macrumors 68000
Original poster
Dec 7, 2007
1,871
4
Alexandria, VA, USA
My client is changing the name of their web site and needs a list of all areas that references the site name, an impact study -- not SEO. For example, I'll need to find all instances of "R & D" as well as "R and D" site wide and list all the URL's where either of these keywords exist and the LOE to change.

I'm thinking a crawler is in order --- What kind of spider software or web sites are out there which you recommend for this specific kind of task?

Notes:

* The site does not have a search engine built in
* I will scan the code, templates and CSS on the back end separately
* Obviously images will be scanned manually by eye and noted in the report
* I can run a local copy of prod in my sandbox and install a spider/crawler such as Sphider which is a popular LAMP solution (my platform)
* This is NOT about SEO or ranking pages or keyword rankings or metrics ;-)

Please bear those notes in mind as you respond - I don't expect a "do it all" single solution and recognize numerous tools/methods/passes might be required. Anyone with direct experience - any help appreciated.

-jim
 
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.