Testing: do you test on ALL iphone/itouch models in-house?

Discussion in 'iOS Programming' started by speedracer3000, Nov 16, 2009.

  1. macrumors 6502

    Joined:
    Sep 29, 2008
    #1
    I am new to iphone/itouch development and I am wondering if everyone keeps an inventory of all the hardware models (iphone 2G, 3G, 3GS, iTouch 1st Gen,2nd Gen etc.) in-house for testing purposes? Or is it reasonable to just test on whatever you have and solicit beta testers from the public? Ideally it makes sense to test on all the models, but since the iphone/itouch is a fairly closed system (unlike Android for example), there really isn't a big difference between say for example iphone 2G and 3G to require keeping both (or is there?)
     
  2. Guest

    Joined:
    Mar 13, 2009
    #2
    Obviously, it's better to test on every device that you can. However, with all the devices running the same OS, and being extremely similar to one another, the odds of an app not working across the board are very, very slim. Unless of course it's a more hardware-intensive game, in which case the first generation devices may run it poorly. A prime example of that is Dungeon Hunter on the 1st Gen iPhone and iPod Touch.
     
  3. macrumors 6502

    Joined:
    Apr 24, 2003
    #3
    I test with what I have: an iPhone 3G and a 2nd Gen iPod Touch. I probably don't even need to have the touch, but I think it's good to have a device from each family, but I think having one of each device ever made is going to get pretty expensive...
     
  4. macrumors regular

    xsmasher

    Joined:
    Jul 18, 2008
    #4
    I've seen more differences between OS versions than I have between devices - more aggressive memory reclamation on 3.0, plus changes in audio handling.

    I use a 1st gen iPod touch with 2.2.1 and two 3G iPhones with 3.0 and 3.x.latestVersion; plus I send a build to friends with 3Gs'es.
     
  5. macrumors 68030

    PhoneyDeveloper

    Joined:
    Sep 2, 2008
    #5
    It depends a little on the needs of your app. In my case it's the difference between OS versions that's important, more so than the hardware. I do the majority of my development on the Sim. I do move around between OS versions while developing, 3.0 one day 3.1 the next, etc. For testing I have one iPod touch 2 gen and I change the OS from 2.2.1 to whatever's latest.

    There are of course major differences between 2.2.1 and 3.x but only minor differences between 3.0 and 3.1, mainly just bug fixes. I can't remove the workarounds for the bugs in many cases because I'm still supporting older versions.

    I've never received a bug report from a user that was related to their hardware, although I have received some related to the OS version.
     
  6. macrumors 68000

    Joined:
    Feb 12, 2008
    Location:
    Illinois
    #6
    If you could only choose a single device, the iPhone 3G would probably be the best as I don't think the iPod touch offers anything that is of concern whilst the iPhone 3G has interruption by calls, SMS, etc. And it's not fast enough so that you miss the optimization.
     
  7. macrumors 603

    Joined:
    Jul 29, 2003
    Location:
    Silicon Valley
    #7
    I would try to at least test on the slowest device with the oldest OS revision that your app supports, as well as the fastest device with the newest OS.

    I keep an old 1st gen iPod Touch running 2.2.1 for the first.
     
  8. macrumors regular

    Joined:
    Nov 20, 2008
    Location:
    Banglore
    #8
    if we need to test the sdk app on the downgraded os(say for 2.2.1) , now , where can we find the OS. As the latest OS is available on the apple sites, I would like to know two quests...

    1) Where can we find the downgraded OS , mean OS with lesser version than the latest one.
    2) Any link on the web that show the process of the installing (either upgrading or downgrading) the OS version on the iPhone.
     
  9. macrumors 603

    Joined:
    Jul 29, 2003
    Location:
    Silicon Valley
    #9
    You can't always downgrade an iPhone (especially the baseband). If you want to up/downgrade for testing, an old early model iPod Touch is better.
     
  10. macrumors 68030

    PhoneyDeveloper

    Joined:
    Sep 2, 2008
    #10
  11. macrumors newbie

    Joined:
    Nov 19, 2009
    #11
    I do the majority of my development on the Sim. I do move around between OS versions while developing, 3.0 one day 3.1 the next, etc.
     
  12. macrumors 603

    Joined:
    Jul 29, 2003
    Location:
    Silicon Valley
    #12
    Doing development on the Simulator is fine if you are not stressing any of the performance limits or require any device specific features.

    Testing on the Simulator is not fine, since it won't catch any of the differences in behavior or performance between it and actual devices. The Simulator doesn't even run the same code, so even subtle compiler differences could potentially kill an app.

    And the performance differences are obvious. An app can run super smooth on the Simulator, and be a big jerky unresponsive mess on an older device.
     
  13. macrumors newbie

    Joined:
    Jun 30, 2008
    #13
    testing

    I tested thoroughly on my iphone 3Gs and on my gf's iphone 3g. The 3G is a lot slower as my app uses 3g.

    I didn't test on ipod touch but should have. cuase if something goes wrong when the apple tester is using it... it wastes two weeks minimum these days.

    And it does say that Apple test on both iPhone and iPod... (depending on ur app of course).

    Cheers
     
  14. macrumors newbie

    tutukun

    Joined:
    Nov 19, 2009
    #14
    right now im just testing it on my 3gs. i will probably get a 2nd gen ipod touch to test whenever my game goes into the main testing stage.
     
  15. macrumors 603

    Joined:
    Jul 29, 2003
    Location:
    Silicon Valley
    #15
    Note that a 2nd gen Touch is about 25% faster than a 1st gen iPhone, iPhone 3G, and 1st gen Touch.
     

Share This Page