MacRumors' Webcast Stats during the MWSF 2007 Keynote

Discussion in 'MacRumors.com News Discussion' started by MacRumors, Jan 14, 2007.

  1. macrumors bot

    MacRumors

    Joined:
    Apr 12, 2001
    #1
    [​IMG]

    On January 9th, 2007, MacRumors delivered live updates of the Macworld San Francisco 2007 keynote speech given by Steve Jobs. Since no live Quicktime stream was made available, Apple fans had to rely on live web updates to follow the action. This year, we successfully incorporated near real-time photos into our keynote transcription.

    After analyzing our logs files (22.4GB), we've posted a detailed summary of the MacRumorsLive system and the traffic it was able to serve.

    In short, we peaked at over 213,000 simultaneous web visitors during the keynote and delivered over 408GB of data during the time surrounding the keynote event. If not for the efficiency of the MacRumorsLive webcast system, the same webcast would have generated almost 1 terabyte of data in the same short window of time.

    In order to deliver near-real time photos, we had to temporarily expand our resources and incorporated Cachefly's content delivery system, Amazon's Simple Storage Service, and Amazon's Elastic Compute Cloud Service.

    The final archive of the keynote transcript remains available.

    [ digg this ]
     
  2. macrumors 6502a

    javabear90

    Joined:
    Dec 7, 2003
    Location:
    Houston, TX
    #2
    keep up the good work
     
  3. macrumors 68020

    Joined:
    Dec 27, 2006
    #3
    Could you perhaps list the cost of a project like this? It might motivate people to donate to the site.

    And yes, this is the next best thing from seeing it in person.
     
  4. macrumors member

    Joined:
    Jun 27, 2006
    #4
    dang. but yes, keep up the good work!
     
  5. macrumors 68000

    dllavaneras

    Joined:
    Feb 12, 2005
    Location:
    Caracas, Venezuela
    #5
    Excellent work! keep it up
     
  6. Administrator

    Doctor Q

    Staff Member

    Joined:
    Sep 19, 2002
    Location:
    Kepler-452b
    #6
    I'm surprised that the non-AJAX data transfer wouldn't come out to even more than a terabyte. AJAX, and the auto-refresh system used, made MacRumorsLive very bandwidth efficient.
     
  7. macrumors 6502

    Joined:
    Apr 29, 2005
    Location:
    Hobart, Australia
    #7
    Wow, those are some impressive numbers!

    Keep up the great work so I can get up at an ungodly hour next year! :D
     
  8. macrumors member

    Joined:
    Apr 15, 2003
    #8
    I loved it!

    MacRumors was my one source for info from the MWSF Keynote and I found the coverage to be thrilling!!! I was on the edge of my seat awaiting each new update - which was always just a few seconds away.

    Later, watcing the QT video of the event I felt as though I hadn't missed a thing. And the photos made me feel as though I was there!

    Thanks so much for all your hard work in making an exciting day what it was.
     
  9. macrumors G5

    nagromme

    Joined:
    May 2, 2002
    #9
    Thanks to MR, and to whoever was there typing away!

    I made a point of clicking a few ads, just in case that supplies a few cents of support.
     
  10. Administrator

    Doctor Q

    Staff Member

    Joined:
    Sep 19, 2002
    Location:
    Kepler-452b
    #10
    Sometimes it seems almost silly that so many people want to hear the keynote news the split second it happens, and not wait 5 or 10 minutes while somebody prepares a nice written summary for them.

    But the numbers speak for themselves; the play-by-play instant updates are hugely popular.
     
  11. macrumors 68000

    Joined:
    Oct 8, 2003
    Location:
    Sacramento, CA, USA
    #11
    And Macrumors continues to impress. Thank you for the live web updates!
     
  12. macrumors regular

    Joined:
    Oct 4, 2005
    Location:
    DC
    #12
    IMO, the keynote reporting from Macrumors was much, much, much more up to date, faster, and better than last year.

    The system worked very well. Congrats to you guys for very good and up to the minute keynote reporting!

    Thanks!
     
  13. macrumors Core

    MacNut

    Joined:
    Jan 4, 2002
    Location:
    CT
    #13
    How close did we come to breaking the all time forum record.
     
  14. macrumors 65816

    mdntcallr

    Joined:
    Aug 1, 2000
    Location:
    Los Angeles, CA
    #14
    Great job Macrumors!!!

    i know i was one of those streams and i am appreciative of the coverage.

    thanks guys
     
  15. macrumors 68000

    savar

    Joined:
    Jun 6, 2003
    Location:
    District of Columbia
    #15
    How did Macrumors get into ECC? I thought there were like 10 spots in the world.

    Awesome throughput though. When your *logs* are 22GB, you know you moved a lot of content.
     
  16. macrumors P6

    twoodcc

    Joined:
    Feb 3, 2005
    Location:
    Right side of wrong
    #16
    i agree. excellent job!
     
  17. macrumors 68020

    Joined:
    Jul 8, 2006
    Location:
    California
    #17
    Congratulations MacRumors!
     
  18. macrumors regular

    doogle

    Joined:
    Dec 29, 2003
    Location:
    Australia
    #18
    a minor moan

    ...um I found the live images to be a good addition but so small that they did not provide much detail. I jumped over to engadget to see their massive pictures - they seemed to have a better location in the hall too? They seemed to have heaps more text coming up on the site - maybe they have more resources/people? Whatever, I somehow trust MR more and congratulate you on another excellent event coverage.
     
  19. arn
    macrumors god

    arn

    Staff Member

    Joined:
    Apr 9, 2001
    #19
    A few issues... I think next time we will offer both.... fast/transcription text and longer summary paragraphs. We probably will try to increase photo size... but the original thought was that smaller/more photos would give more of a realtime feel to it.

    They probably do have a better location in the hall... as Engadget gets media passes for the keynote, unlike MacRumors.

    arn
     
  20. Administrator

    Knox

    Staff Member

    Joined:
    Jul 1, 2002
    Location:
    UK
    #20
    The 1TB figure assumes perfect caching of images & other static content, which of course wouldn't be the case in reality. It would probably have been much more but it's difficult to calculate exactly how much so I stayed on the safe side.

    They emailed a "select group of developers" about it originally (whether that means 100 or 10,000 I have no idea) but I think you had to be pretty quick to get in - I signed up 20 minutes after I got the email.

    The size of the logs amused me for a bit, until I came to having to process the things! I didn't dare try and use awstats to process the whole thing, instead I only used it to process the HTML/XML logs, but even then they were almost 7GB and awstats took about 9 hours to run.
     
  21. macrumors 6502a

    eluk

    Joined:
    Dec 14, 2006
    Location:
    East London, UK
    #21
    A really impressive set of stats. The pictures add a lot to the overall service.
    Great job.
     
  22. macrumors 6502a

    fixyourthinking

    Joined:
    Oct 24, 2002
    Location:
    Greenville SC
    #22
    Macrumors had (BY FAR) the quickest updates ... while Engadget was slightly more detailed ... it was about 5 to 10 minutes behind during most of the keynote and I really really liked Macrumors auto update feature. Good job Arn.

    Did you apply for a media pass and get turned down? I would take issue with that with IDG ... I didn't see any Engadget staff on TV TWICE discussing MacWorld Expo and I certainly consider this site news/news reporting. I'll bet Bill Palmer got media passes ... for iProng ... if so that's a severe injustice (vs you NOT getting one).
     
  23. macrumors regular

    Joined:
    Feb 9, 2003
    Location:
    tokyo
    #23
    Great Job!!

    i had streams going from 3 sites. all considered themselves more or less live/quick refresh.
    MacRumors site was BY FAR the best.
    -accurate
    -refreshed without fail with new info
    those are the only important things.
    other sites by comparison: sometimes didnt refresh, or refreshed with no new info and also had extraneous comments and sometimes wrong/mis-heard info.
    WELL DONE!!
     
  24. macrumors newbie

    Joined:
    Jan 7, 2007
    Location:
    California
    #24
    Enjoyed the Ride

    Thank you.
     
  25. macrumors 6502

    Joined:
    Feb 16, 2005
    #25
    Nice stuff.

    Interesting to see a peak at 12p,, :) All those lunchers.
     

Share This Page