Non-dev testers...

Discussion in 'iOS 7' started by Silvereel, Aug 13, 2013.

  1. Silvereel macrumors 6502

    Joined:
    Jan 19, 2010
    #1
    This is just a question I'm asking out of curiosity. I'm not endorsing or advising anything, but from a purely technical standpoint, does Apple gain anything from having lots of non-dev testers? Obviously there are quite a few out there, and I just wonder if any good data comes in, since these people aren't going to be sending in any actual bug reports. For instance, do you think the automatic diagnostic reports do much good, as far as testing the OS and identifying problems goes?
     
  2. charlituna macrumors G3

    charlituna

    Joined:
    Jun 11, 2008
    Location:
    Los Angeles, CA
    #2
    They don't really gain much at all since those folks don't have access to filing actual bug reports.

    All they really do is make a muck in the retail stores trying to get phones fixed over dying batteries etc. And annoy developers posting reviews that apps are crap cause they haven't been updated for iOS 7
     
  3. illyb2000 macrumors 6502

    Joined:
    Jun 25, 2012
    #3
    I'm not a dev but have managed to file bug reports to which I've had replies to asking for more details. I just signed into bug reports with my Apple ID and filed them.
     
  4. Daveoc64 macrumors 601

    Joined:
    Jan 16, 2008
    Location:
    Bristol, UK
    #4
    On the contrary, what do you think is going to be the downside for Apple?
     
  5. Tander macrumors 6502a

    Tander

    Joined:
    Oct 21, 2011
    Location:
    Johannesburg, South Africa
    #5
    Personally, I doubt Apple gains anything from this. However on the downside - we have idiots posting app reviews that apps don't work in iOS7. Really now...?
     
  6. naasrd macrumors 6502

    naasrd

    Joined:
    Apr 30, 2008
    Location:
    Dublin, Ireland
    #6
    Utter nonsense. Based on a biased, narrow minded opinion. Or show us proof of your "dying batteries" theory. Go on, I dare you...
     
  7. syd430, Aug 14, 2013
    Last edited by a moderator: Aug 14, 2013

    syd430 Guest

    #7
    They can gauge their reaction on public forums, giving them something broader to work with than just developers and bug reports. It definitely helps to get get an overall perception from a user base that resembles the general public a lot closer than developers that are usually more focused on technical nuisances.
     
  8. KeanosMagicHat macrumors 65816

    KeanosMagicHat

    Joined:
    May 18, 2012
    #8
    When this topic comes up, people always focus upon the minority of users who really don't appreciate what a Beta is all about. Those that complain everywhere including iTunes Store reviews when their favourite app is not working.

    There is a big difference between complaining and highlighting a problem and most, I believe, do the latter.

    Apple could lock out non-developers if they wanted to very easily.

    The fact that they have always allowed users with access to a little technical know how to install the Betas is not an accident.

    Although the most in depth and valuable info will come from employees and developers, the later Betas are tested by the nominated close family of Apple Employees as a way of judging usability etc with fresh eyes.

    Apple employees can be too close to the process to see everything and as you would expect, most of a developer's main focus is providing the best experience of their apps on iOS 7.

    The invited Apple employee family members and non-developers with access have no motivation other than to ensure the OS works better and introduces new, useful features that enhance the overall ownership of an iDevice.

    Although not their main source of info, Apple will have a small number of people tasked with monitoring popular Apple specific forums like this and an element of the feedback from here will definitely prove valuable.
     
  9. Brian Y macrumors 68040

    Joined:
    Oct 21, 2012
    #9
    Actually he's not far wrong.

    Why do you think Apple has instigated a new policy with iOS 7 - if you have a fault, and you cannot restore to iOS 6, you wait until iOS 7 has launched before getting service.

    Bug reports that are submitted by non-developers will 99% of the time be irrelevant. Apple doesn't want to know that spotify crashes, or that an icon isn't lined up properly - they want to know that NSString.encodeWithCoder returns null when you supply a non-UTF8 string, or that NSSearchPathForDirectoriesInDomains returns the wrong value. The beta is released to devs for API testing only - nothing more.
     
  10. KeanosMagicHat macrumors 65816

    KeanosMagicHat

    Joined:
    May 18, 2012
    #10
    This illustrates my point perfectly.

    Of course specific technical feedback like this is vital to Apple, but so is information on the wider "user experience" of iOS 7.

    "This new feature change means I now have to do two steps instead of one to access the same info" etc

    That's where some non-developers can prove useful.
     
  11. Tander macrumors 6502a

    Tander

    Joined:
    Oct 21, 2011
    Location:
    Johannesburg, South Africa
    #11
    But those sort of things are not bugs. They are design flaws in the users opinion.
     
  12. KeanosMagicHat macrumors 65816

    KeanosMagicHat

    Joined:
    May 18, 2012
    #12
    This is true, but a Beta test is not just about finding bugs. It's also about functionality/usability.

    Look at the calendar app, for example. When first introduced on iOS 7 Beta there was no "at a glance" dots to quickly see which days were busy. This has now been changed, presumably from feedback from all parties, including the non-developers.

    It hasn't gone far enough yet, in my opinion, as there is still no pane showing only the appointments booked in day view - but that's another story.
     
  13. Tander macrumors 6502a

    Tander

    Joined:
    Oct 21, 2011
    Location:
    Johannesburg, South Africa
    #13
    I see good point. I notice that Apple use the bug report for feature requests / enhancements too - so it's not a far stretch to think that they listen to user experience through it, too.
     
  14. Menel macrumors 603

    Menel

    Joined:
    Aug 4, 2011
    Location:
    ATL
    #14
    All handsets submit diagnostic and usage data. Dev or not.
     
  15. abshole765 macrumors 6502a

    Joined:
    Jun 10, 2013
    #15
    People go to stores because their battery died?
     
  16. Donka macrumors 68020

    Donka

    Joined:
    May 3, 2011
    Location:
    Scotland
    #16
    As has been said before - if Apple wanted to lock out non devs they could. Installing IOS 7 on a non registered IOS device is a well known simple process that Apple could easily block. Look at a lot of the aesthetic changes that have been made through the various betas. If Apple were only interested in Dev feedback on broken APIs at the moment, why would they be making these visual changes that just happen to mirror what is being posted in these forums by many people? Apple clearly are monitoring feedback from the community and making suitable changes off the back of that. Free feedback - they would be mad to ignore it!
     
  17. Tander, Aug 14, 2013
    Last edited by a moderator: Aug 14, 2013

    Tander macrumors 6502a

    Tander

    Joined:
    Oct 21, 2011
    Location:
    Johannesburg, South Africa
    #17
    I think it's more of a case of batteries not lasting, rather than being flat.
     
  18. Brian Y macrumors 68040

    Joined:
    Oct 21, 2012
    #18
    This isn't a beta test. It's a developer preview.

    Apple has their own internal usability testing.
     
  19. HarryAinslie macrumors regular

    HarryAinslie

    Joined:
    Feb 2, 2011
    Location:
    Doncaster, England, UK
    #19
    Maybe from a marketing point of view they have x amount of people boasting how good iOS 7 is!

    However i do agree with some of the above comments, i'm not a dev, but using iOS7, i understand that it's in Beta and my phone may crash, apps may not work etc. Hence why i don't complain about it!

    Those that don't understand this really shouldn't have an iPhone never mind a Dev account!
     
  20. kdhoe macrumors member

    Joined:
    Aug 12, 2011
    #20
    It's just too easy to install an iOS beta. I'm sure they diagnostic data they receive from ALL users will be examined.
     
  21. bushido Suspended

    bushido

    Joined:
    Mar 26, 2008
    Location:
    Germany
    #21
    well, i am not a paid dev but i got iOS7 and i file bug reports all the time and apple is actually thanking me via email so BITE ME

    plus imo the "regular ppl" are the real testers as devs may overlook some simple things easily. its like asking some math genius for a simple 3rd grade answer which he may not even be able to answer cuz its just too easy for him by now. u know what im mean
     
  22. johnnyboy360 macrumors regular

    Joined:
    Aug 28, 2010
    #22
    I am a non-dev and while I haven't reported any bugs or anything, I still think Apple get my diagnostic reports. And I'm sure they will help out in some way. I mean, they can't complain at getting more data!
     
  23. famoussasjohn macrumors 6502a

    famoussasjohn

    Joined:
    Jul 7, 2010
    #23
    I don't have a developer account, but I'm running the beta. I have no intentions on going into the store for any issues, as I have yet to have a major issue so far, surprisingly just one crash in beta 4 that rebooted just fine. I don't post reviews on applications, nor would I ever post a review on an app that wasn't built for iOS7. Some people are idiots, but I'm doing no harm in running the beta.
     
  24. Silvereel thread starter macrumors 6502

    Joined:
    Jan 19, 2010
    #24
    Obviously though, internal testing isn't always enough, otherwise Apple wouldn't be making usability changes throughout the beta (or even after general release).

    On an unrelated note, how are all of you non-devs submitting bug reports? How does that work for you, and how technical are your reports?
     
  25. Cayennr macrumors member

    Joined:
    Feb 7, 2013
    Location:
    Skopje, Macedonia
    #25
    Heh… good analogy. Just wondering, how do you file the bug reports if you’re not a registered developer?
     

Share This Page