Sidebar Sidebar
Become a MacRumors Supporter for $50/year with no ads, ability to filter front page stories, and private forums.

macOS Can you download a list of URLs using automator?

W

whitedragon101

macrumors 65816
Original poster
Sep 11, 2008
1,337
334
I use a website that runs a service I will shortly loose. It lists all my cricket clubs member details just changing member number for each URL. They don't want to make it easy for you to download a csv of all the members so you keep using them. I have made a webpage (on my own server) that lists every member id as a link.

http://www.sportsclub-manager.com/member13424.asp
http://www.sportsclub-manager.com/member45447.asp
etc
(1500 links)

I want to download each page as a full webarchive.

I have tried downloadthemall and scrapbook firefox add ons but there is a table that appears 1second after the page loads that doesn't get downloaded. If I save manually as a webarchive it does.

Can automator do something this i.e

load list of URLs from webpage
start loop
load link x to safari
wait 3 seconds
save content to file
end loop
 
The Doctor11

The Doctor11

macrumors 603
Dec 15, 2013
5,976
1,408
New York
You made two threads :eek:
 

Attachments

  • Capture.JPG
    Capture.JPG
    55.5 KB · Views: 781
W

whitedragon101

macrumors 65816
Original poster
Sep 11, 2008
1,337
334
kryten2 said:
Info : AppleScript: Safari - Save As Web Archive - How to tell Safari to open and save a web page
Click to expand...

Thank you very much. I nearly have it. I'd really appreciate it if you could have a look at this and edit it so the the variable theURL is entered as the filename to save (by default it uses the page title which is the same for every page).

Code: 
tell application "Safari"
	activate
	repeat with theURL in theList
		set the URL of front document to theURL
		tell application "System Events"
			tell process "Safari"
				tell menu 1 of menu bar item "File" of menu bar 1
					repeat while enabled of menu item "Save as…" is false
						delay 0.1
					end repeat
				end tell
				keystroke "s" using command down -- Save As…
				repeat until sheet 1 of window 1 exists
					delay 0.1
				end repeat
				keystroke "d" using command down -- save to Desktop
				tell sheet 1 of window 1
					click pop up button 1 of group 1
					keystroke return -- Web Archive
					keystroke return -- Save
					if sheet 1 exists then -- that is "sheet 1 of sheet 1"
						click button "Replace" of sheet 1
					end if
				end tell
			end tell
		end tell
	end repeat
end tell
 
K

kryten2

macrumors 65816
Mar 17, 2012
1,114
99
Belgium
whitedragon101 said:
Thank you very much. I nearly have it. I'd really appreciate it if you could have a look at this and edit it so the the variable theURL is entered as the filename to save (by default it uses the page title which is the same for every page).
Click to expand...

Try this :

Code: 
tell sheet 1 of window 1
set value of text field 1 to theURL -- theURL as the filename to save
click pop up button 1 of group 1
keystroke return -- Web Archive
keystroke return -- Save
if sheet 1 exists then -- that is "sheet 1 of sheet 1"
click button "Replace" of sheet 1
end if
end tell
 
W

whitedragon101

macrumors 65816
Original poster
Sep 11, 2008
1,337
334
kryten2 said:
Try this :

Code: 
tell sheet 1 of window 1
set value of text field 1 to theURL -- theURL as the filename to save
click pop up button 1 of group 1
keystroke return -- Web Archive
keystroke return -- Save
if sheet 1 exists then -- that is "sheet 1 of sheet 1"
click button "Replace" of sheet 1
end if
end tell
Click to expand...

Awesome thanks. It worked perfectly :)
 
You must log in or register to reply here.
Register on MacRumors! This sidebar will go away, and you'll see fewer ads.
Top Bottom