Fetching Website Data

Discussion in 'Mac Programming' started by Blakeasd, Jul 14, 2011.

  1. Blakeasd macrumors 6502a

    Joined:
    Dec 29, 2009
    #1
    Hello,
    How do I fetch data from a website sort of like these apps:
    WikiBot
    MiniTube
    How do these apps access and search website and display them the way they do. What is this called so I can find some resources on doing it?
    Thanks!
     
  2. chown33, Jul 14, 2011
    Last edited: Jul 14, 2011

    chown33 macrumors 604

    Joined:
    Aug 9, 2009
    #2
    It might be called something like "page scraping" or "webpage scraping".

    Some of what WikiBot does is just caching and storing for later. You can do that using the DOM of a web page, getting all the anchors and links, downloading, then storing for later.

    YouTube has an API, and that would be my first guess of what minitube is using.
     

Share This Page