Downloading a collection of images from a website, what language?

[hdawg87]

Hi everybody,

I'm trying to write an application that will go to a URL of an image and download it into a folder on my hard drive with a specific filename. This will be done over 1000 times with different URL's. My problem is that I will need the url's to be stored in some kind of array and called from that. What language would I be able to do this the easiest? I'm not worried about developing a GUI or anything for this right now. Would applescript be able to accomplish this adequately?

P.S I'm running on a G5 dual 2.0ghz 3gb ram, tiger

Thanks in advance

[lee1210]

shell, 100%. I do this every time i find a new web comic and want to grab the whole archive. There's generally a need to generate dates, and out of laziness i tend to do this with C or something.

Otherwise, it's all curl/wget, to grab the page itself, then some awk/grep to parse out the image URL, then another wget to grab the image.

I'm sure it's possible to do this in any number of ways, but I think it would be much more complex.

-Lee

[savar]

Hi everybody,

I'm trying to write an application that will go to a URL of an image and download it into a folder on my hard drive with a specific filename. This will be done over 1000 times with different URL's. My problem is that I will need the url's to be stored in some kind of array and called from that. What language would I be able to do this the easiest? I'm not worried about developing a GUI or anything for this right now. Would applescript be able to accomplish this adequately?

P.S I'm running on a G5 dual 2.0ghz 3gb ram, tiger

Thanks in advance

sounds like a job for perl

[ChrisA]

Hi everybody,

I'm trying to write an application that will go to a URL of an image and download it into a folder on my hard drive...

Write it in anything that is able to call "wget". Pick the script language that you know best.

[yeroen]

CPAN almost surely has some canned web scraping utility for this sort of thing.