PDA

View Full Version : Reviews in the app store should only be posted by actual users!!!




diesel
Jul 21, 2008, 12:42 PM
I've noticed that there are so many reviews posted for apps where it's obvious that the poster never purchased, downloaded, or used the app that they are supposed to be reviewing. this really creates so much noise and pisses me off. A lot of reviews and ratings are suspect and idiotic especially when coming from non-users.

In addition, it's open to abuse from developers and fanboys of a particular app who are more interested in promoting some other application then reviewing the application in which they posted their supposed "review". Especially when the system allows you to make up reviewer names on the fly so that it can seem as several people are posting similiar bogus comments.

Apple seriously needs to limit feedback to only those that have paid for and downloaded an application. And they need to force us all to register under a specific nickname so that when posting a review the poster's nickname can be displayed and not made up on the fly.



Sky Blue
Jul 21, 2008, 12:44 PM
This has been mentioned here numerous times. I agree though. When you buy an App you should get an email (maybe with your receipt?) that gives you a link to review your App.

Silver-Fox
Jul 21, 2008, 12:46 PM
This has been mentioned here numerous times. I agree though. When you buy an App you should get an email (maybe with your receipt?) that gives you a link to review your App.

Hmmmm thats a good idea actually, getting sent an email to leave feedback. You could be on to something there

razorianfly
Jul 21, 2008, 12:47 PM
When will Apple realise, we need to ability to create reviews on-the-fly in the iTunes Wifi Music Store, too - I wonder? :rolleyes:

Hopefully in 2.0.1 :cool:

I agree, reviewers should be owners of the application, otherwise,
it's giving a false perception to would-be buyers of the applications features or usefulness.

R-Fly

Luap
Jul 21, 2008, 12:51 PM
I mostly agree. HOWEVER! There are many times i've seen multiple apps made by different people, but all do essentially the same thing. Yet some are free, and some are not. For example.. There are LOTS of silly little 'Torch' applications on there. All it does it create a white screen. Yet someone expects to be paid for that. Reviews are useful as you can step in and say "Hey, wait a minute, XXX does the same thing, but that is free" This saves people money and annoyance.

rKunda
Jul 21, 2008, 12:53 PM
Would be easier than a confirmation email or something. It's something that's already in their infrastructure. Now, if you attempt to buy an app you've already bought it prompts you and lets you know you already own it, and lets you grab a new copy for free. (Music should work like this, imo.)

Simply have it track purchases like it always does and flag those accounts with permission to review apps.

ucfgrad93
Jul 21, 2008, 01:16 PM
This has been mentioned here numerous times. I agree though. When you buy an App you should get an email (maybe with your receipt?) that gives you a link to review your App.

This is a great idea.

Mindflux
Jul 21, 2008, 01:18 PM
This has been mentioned here numerous times. I agree though. When you buy an App you should get an email (maybe with your receipt?) that gives you a link to review your App.

Why not just store it with your purchase information? You make a 'purchase' (free or not) and it gives you the ability to review that App. Updates can also give you an additional review to comment on fixed functions.

A link to review would just get spread around for people to abuse.

Niiro13
Jul 21, 2008, 01:25 PM
Now since this has been posted before, I'll add something to it.

Reviews should not contain the crashes.

I think Apple should like email everyone saying how it's not the developer's fault that the applications are crashing.

I want to see the rating of an application reflect on how it is...not have to click on see all reviews, then see how many of the lower ratings are simply application crashes.

Sky Blue
Jul 21, 2008, 01:31 PM
A link to review would just get spread around for people to abuse.

It would be tied to your account, so you'd have to supply your username/password. It wouldn't just be a generic link anyone could use.

Rojo
Jul 21, 2008, 01:45 PM
I mostly agree. HOWEVER! There are many times i've seen multiple apps made by different people, but all do essentially the same thing. Yet some are free, and some are not. For example.. There are LOTS of silly little 'Torch' applications on there. All it does it create a white screen. Yet someone expects to be paid for that. Reviews are useful as you can step in and say "Hey, wait a minute, XXX does the same thing, but that is free" This saves people money and annoyance.

Perhaps we can have it BOTH ways?

If you BUY an app, iTunes will automatically allow you to post a STARRED review of whatever the maximum length is allowed for reviews (IS there a limit? I assume there is).

If you do NOT buy an app, you can still post a short, non-starred comment of a limited length...150 characters max, or something like that...basically the length of this sentence.

People checking the reviews can then have a realistic starred average rating of the app from users who actually bought it, while still being able to read comments from other readers warning of other "free" versions, or whatever.

Luap
Jul 21, 2008, 03:03 PM
Rojo, not bad. Personally though, I think an easier and simpler system would be a simple icon of some description besides peoples name/review to show if they actually bought/downloaded the application or not.
That way you can better judge peoples comments/reviews.

diesel
Jul 21, 2008, 03:22 PM
Rojo, not bad. Personally though, I think an easier and simpler system would be a simple icon of some description besides peoples name/review to show if they actually bought/downloaded the application or not.
That way you can better judge peoples comments/reviews.


Problem is, when calculating the total average score, this score would still get f'ed up by those who haven't actually used the program.

SiskoKid
Jul 21, 2008, 05:49 PM
I completely and utterly disagree oon both points that non-downloaders can post reviews and on the point that people whose app crashes shouldn't post a review.

There are quite a few 'non-purchased' app reviews that I learned a lot about what's going on with the program. I tend to read the low reviews of all software first so I can get an realistic idea of what the app is about.

For instance, with Scrabble, many people are saying it crashes a lot. It's $10. I now know to wait for another version of scrabble or for an update to see if they fixed the issue. That's exactly what the user reviews are for. TO EDUCATE YOURSELF ON THE PROGRAM SO YOU CAN SEE IF YOU'D LIKE TO PURCHASE IT OR IF IT'S JUST GONNA GIVE YOU HEADACHES!

Also, as for reviews coming from people who haven't purchased the app, let's take Namco's Pacman. It's $10. The one star reviews are bashing it for its price, not its quality necessarily. Last I checked, even professional reviews take price into consideration especially video game reviews (I would know, I'm a huge gamer). Many reviews will say, "The game's OK, but it's so short it's not worth the full $50." We've all played pacman so to suggest that the reviewers don't know what they're talking about is silly. The price is steep and people looking to purchase it should know that when comparing the price to Pacman on other devices, you're being ripped off.

And, also, many games tend to play the same when they fall in a certain genre. There are multiple Sudokus for instance. Although someone may not have played the $8 version, they give it a low star grade because all other versions of Sudoku are not only cheaper, but from the free versions and cheaper versions they HAVE played, it doesn't seem worth it to purchase an $8 version that shows no new features listed hence educating you on better deals for an app you like.

These reviews should come from everyone who wants to express their opinion on the issue. Of course, there'll be those who give crap reviews just because they're bored that day. Should we condone that? No. But the whole idea is that there are MULTIPLE reviews creating ONE main score. Multitudes of people aren't going to waste their time bashing or praising something if it doesn't deserve that bashing or praise to begin with.

The reviews, from everyone, have helped me make purchases on the store, and I would be furious if Apple took those off. It would seem suspicious to me if Apple made these ridiculous rules suggested in this thread.

janey
Jul 21, 2008, 05:58 PM
I think Apple should like email everyone saying how it's not the developer's fault that the applications are crashing.
This is not necessarily true. Many times it is the developer's fault.

If you BUY an app, iTunes will automatically allow you to post a STARRED review of whatever the maximum length is allowed for reviews (IS there a limit? I assume there is).

I actually had a discussion about this over twitter with some iPhone developers, and here's my proposed idea:
Have reviews from everyone. Sometimes you need to have the ability to tell people about the app even if you yourself didn't buy it..maybe you know a better alternative, maybe you tried it on someone else's phone, maybe you tried the jailbroken version and it's functionally similar to the app store version (e.g. a lot of the flashlights).

However, have reviews from non-purchasers weighted less compared to the purchaser reviews: e.g. 5 reviews from non-purchasers = 1 review from a purchaser. Give purchasers more weight and more visibility - people will have to click to get all reviews to see reviews from non-purchasers.

On top of that, have application version # and date of review with every review, and have both those affect how the review is weighted - older versions and older reviews get pushed to the bottom. Additionally have a better system for letting the developers answer to people and have mutually-removable reviews: many of the reviews are because of crashes and issues that have been resolved.

App store is not music, and there aren't many obvious ways to contact the developers. I feel the changes that I outlined above could be more useful (and if you haven't noticed, generally how user-submitted reviews work on many of the software sites like macupdate and versiontracker.).

diesel
Jul 21, 2008, 06:14 PM
I completely and utterly disagree oon both points that non-downloaders can post reviews and on the point that people whose app crashes shouldn't post a review.

There are quite a few 'non-purchased' app reviews that I learned a lot about what's going on with the program. I tend to read the low reviews of all software first so I can get an realistic idea of what the app is about.

For instance, with Scrabble, many people are saying it crashes a lot. It's $10. I now know to wait for another version of scrabble or for an update to see if they fixed the issue. That's exactly what the user reviews are for. TO EDUCATE YOURSELF ON THE PROGRAM SO YOU CAN SEE IF YOU'D LIKE TO PURCHASE IT OR IF IT'S JUST GONNA GIVE YOU HEADACHES!

Also, as for reviews coming from people who haven't purchased the app, let's take Namco's Pacman. It's $10. The one star reviews are bashing it for its price, not its quality necessarily. Last I checked, even professional reviews take price into consideration especially video game reviews (I would know, I'm a huge gamer). Many reviews will say, "The game's OK, but it's so short it's not worth the full $50." We've all played pacman so to suggest that the reviewers don't know what they're talking about is silly. The price is steep and people looking to purchase it should know that when comparing the price to Pacman on other devices, you're being ripped off.

And, also, many games tend to play the same when they fall in a certain genre. There are multiple Sudokus for instance. Although someone may not have played the $8 version, they give it a low star grade because all other versions of Sudoku are not only cheaper, but from the free versions and cheaper versions they HAVE played, it doesn't seem worth it to purchase an $8 version that shows no new features listed hence educating you on better deals for an app you like.

These reviews should come from everyone who wants to express their opinion on the issue. Of course, there'll be those who give crap reviews just because they're bored that day. Should we condone that? No. But the whole idea is that there are MULTIPLE reviews creating ONE main score. Multitudes of people aren't going to waste their time bashing or praising something if it doesn't deserve that bashing or praise to begin with.

The reviews, from everyone, have helped me make purchases on the store, and I would be furious if Apple took those off. It would seem suspicious to me if Apple made these ridiculous rules suggested in this thread.


please explain to me how anyone can say something is not worth x dollars if they have not even tried the program?

in addition, you draw comparisons to game review sites but you seem to gloss over one major point, the fact that the game review sites ACTUALLY tried out the apps that they are reviewing whereas a large number of reviews posted in the app store are from users who never took the time to try out an app. so, how are they able to comment on the app. it's just a matter of common sense.

I do agree with you on the need for users to actually post if an app crashes constantly. my point is that users and really only users should be allowed to actually comment on an app. anything less than that is just pure speculation as to how the app handles.

janey
Jul 21, 2008, 06:16 PM
please explain to me how anyone can say something is not worth x dollars if they have not even tried the program?
Sometimes you need to have the ability to tell people about the app even if you yourself didn't buy it..maybe you know a better alternative, maybe you tried it on someone else's phone, maybe you tried the jailbroken version and it's functionally similar to the app store version (e.g. a lot of the flashlights).

Reviews from only customers is not good. Reviews from bitter competitors is not good. Just take them all with a grain of salt.

For what it's worth, I still have trouble believing reviews from customers as many are completely incompetent at writing good reviews.

SiskoKid
Jul 22, 2008, 12:50 AM
please explain to me how anyone can say something is not worth x dollars if they have not even tried the program?

in addition, you draw comparisons to game review sites but you seem to gloss over one major point, the fact that the game review sites ACTUALLY tried out the apps that they are reviewing whereas a large number of reviews posted in the app store are from users who never took the time to try out an app. so, how are they able to comment on the app. it's just a matter of common sense.

I do agree with you on the need for users to actually post if an app crashes constantly. my point is that users and really only users should be allowed to actually comment on an app. anything less than that is just pure speculation as to how the app handles.

Sorry, I should've been more clear. Not all software can be talked about if you haven't used it. But the examples I proposed (Pacman and Sudoku) I think is pretty straight forward. Unless the $8 version brings something that really sets it apart from the $3 version, I think people can make educated decisions on comparing the products without having to try them. Also this allows users to inform potential buyers of alternative options.

The 1 star review grabs peoples' attention whether you agree with the review or not. The 1 star reviews have helped me make good purchasing decisions from the iTunes app store and from online stores in general. And all the reviews, those who have purchased the product and from those who haven't, have helped me make those decisions. To censor them is a mistake.

Just like I said in my original post, the product won't draw in a lot of bad or good reviews unless it deserves it. It's ridiculous to assume that dozens or hundreds of users decided to unanimously pick one app and destroy it with 1 star reviews. The same can be said for 5 star reviews. Sometimes idiots make reviews. OH WELL. Life goes on. And who's to say people who actually do buy the app don't post horrible reviews? But the people who actually pay attention to user reviews and input are smart enough to know the difference between someone who's posting to be an idiot versus someone who's actually trying to inform others.

And if a purchaser just looks at the star score and it's low, more than likely it's probably true because, again, multitudes of people aren't on the web looking to lower the score on user reviews.

Moose408
Jul 22, 2008, 01:46 AM
Reviews should not contain the crashes.

I think Apple should like email everyone saying how it's not the developer's fault that the applications are crashing.

I want to see the rating of an application reflect on how it is...not have to click on see all reviews, then see how many of the lower ratings are simply application crashes.

A lot of the apps are very very poorly written and the crashes are absolutely the developers fault. Even if it's not, it doesn't matter why it crashes, if it crashes it is a worthless app and I don't want to buy it. I've already bought 3 apps that I will never use because of crashes/bugs. So a review telling me this would have saved me some money.

TimothyB
Jul 22, 2008, 01:56 AM
Seeing how iTunes and even the App store on the iPhone know you've downloaded the program, even a free one, reasonably you'd think they could deny your review if you never bought or downloaded an application.

I too am sick of reading through useless reviews of obviously someone that never tried it.

TimothyB
Jul 22, 2008, 02:14 AM
It's also real bad when people post about price, so it's obvious they don't have it. Not just talking about $10 game, but professional applications, that cost $100+ and are worth it to those that use it. Sometimes while seemingly expensive, cheaper than other versions similar professional software. People that have no business with the app will post a review with 1 star complaining about something they know nothing about. Sometimes just asking "Why is this app $140? and marked with one star"

diesel
Jul 22, 2008, 11:22 AM
Sorry, I should've been more clear. Not all software can be talked about if you haven't used it. But the examples I proposed (Pacman and Sudoku) I think is pretty straight forward. Unless the $8 version brings something that really sets it apart from the $3 version, I think people can make educated decisions on comparing the products without having to try them. Also this allows users to inform potential buyers of alternative options.



I will have to continue to disagree with you. Yes, pacman is pacman and sudoku is sudoku in terms of the core gameplay, however alot of details is in the actual implementation and execution of the gameplay and unless you have actually used the version that you are reviewing, quite frankly you have no basis to write a review. Anything you write would just be pure speculation. It's as plain and simple as that. Pacman from abc developer might look better than pacman from xyz developer. pacman from abc developer might have a more intuitive control mechanism than from xyz developer and so on and so on even though the core gameplay is the same. It's like watching a remake of an old movie, the core plot is the same however the original might be far more entertaining than the remake or vice versa. once again, the details is in the implementation and execution of that core plot.

To further my point, check out the reviews of all the different mahjong applications available on the iphone that ilounge.com has posted:

http://www.ilounge.com/index.php/articles/comments/iphone-gems-the-best-of-all-7-mahjong-games/

the core gameplay of mahjong is identical between these 7 reviewed versions, however you will find that the implementation of the game differs widely between the different developers. Different graphics, different soundtracks, different control/ui mechanisms, which all add or detract from the playability and enjoyability of the game. This goes to the point that unless you have ACTUALLY TRIED a specific program, you really have no basis to form an opinion. And to be honest, i would like those opinions with no basis for judgement to simply be filtered out from the main reviews as well as from the aggregated ranking. By including them, the value of the ranking system is greatly diminished.

DarkNight79
Aug 2, 2008, 11:37 PM
You're absolutely right. I'm astounded by the number of "reviews" trashing an app simply because it's not free- or promoting a competing app- when they've obviously not downloaded it. You know the review system is seriously distorted when the #5 app, iBeer, has a rating of 1 1/2 stars, and virtually all the bad reviews are complaining that it should be free, like iPint. The same is true for many other apps.

Apple could very easily verify whether you've downloaded an app before you can review it. They know you've purchased it- they're doing updates automatically, and they notify you that you've already purchased an app if you try to download it again. Adding that check before allowing someone to post a review would be very simple.

Unfortunately, with everything they've got going on, the only way it's going to happen is if they get a LOT of developers requesting the change. If enough people contact the iPhone Developer Connection and make that suggestion, they might listen.

amcan12
Aug 3, 2008, 12:30 AM
This should also apply to posting suggestions, answers and/or advice here - how many idiots who post "advice" have clearly stated in their signature "waiting for my Touch" or "soon to be a proud Touch owner"?

jrbdmb
Aug 3, 2008, 08:35 AM
In looking for a chess app, I've found three in the store, and all have one-stars reviews which are basically "why isn't this free?" Which is an interesting review considering there are no free chess apps (yet) in the store. :rolleyes:

I guess like with most public review sites, star ratings can't be trusted, you actually have to dig into the individual reviews to get an idea if a program is worth buying.

dmb8021
Aug 3, 2008, 08:44 AM
the app that comes to mind is the DMB Setlist app. People were giving it one star because they don't like DMB. That's not the point of reviewing the app. The app worked perfectly, no problems at all, but now the rating is skewed because people felt a need to give it a low rating because it was for a band they didn't like.

TimothyB
Aug 3, 2008, 01:36 PM
I guess Apple should really change the review system to be called "Biased Opinion" or plainly '"Forum," and just be done with it, as so far, where the heck are the reviews?

TimothyB
Aug 3, 2008, 01:54 PM
http://phobos.apple.com/WebObjects/MZStore.woa/wa/viewSoftware?id=286778329&mt=8

OMG, this is a new one.

A user Wrote:
"Cool app but I don't live in Houston, so wats the point of getting it???"
Stars given: One

Holy freaking... I wish iTunes had a cartoon boxing glove on a spring that would've knocked the guy out for sending that. Or maybe a giant mallet. Seriously, these people need some sense knocked into them.

Anyone got a good simple explanation that we can all copy and paste into the report concern for all these bogus reviews?

The General
Aug 3, 2008, 02:01 PM
"Cool app but I don't live in Houston, so wats the point of getting it???"

:mad::mad::mad::mad::mad:

TimothyB
Aug 3, 2008, 06:05 PM
Checking again, I'm glad that last review is now 0 out of 8 found it helpful.

That got me thinking, that kind of reviewer probably does this over and over. Maybe Apple can have a flag system, where it they are reported, just their reviews have to be screened for real before showing up.

Another review for that "FREE" app puts it down because they didn't develop for the biggest city first (probably his area), giving it 2 stars. If that person really wants to give advice, why not review the app with a rating for what it is, then give an extra comment at the end. I mean if he feels it's only worth 2 stars why should he care which city it's for anyway.

How many times can we click "no" on of a review?

TimothyB
Aug 3, 2008, 06:18 PM
Another one for the stupid community:

A new Peg Jump game:
http://phobos.apple.com/WebObjects/MZStore.woa/wa/viewSoftware?id=284944942&mt=8

Now, that one is $1, but we all know, there happens to be a freen Peg Jump that looks much better:
http://phobos.apple.com/WebObjects/MZStore.woa/wa/viewSoftware?id=286027047&mt=8

So guess what's happening, everyone is giving 1 star reviews to the $1 version, claiming why buy this and it looks worse than the free one.

But even I after, playing with the free one, and just quickly looking at the screens of the $1, the pay one actually has three difficulty levels.

The free only has the easy board with 15 pegs. Why the $1 app includes medium and hard, using 21-28 peg boards. Seems to me $1 is well worth it if you like the game to have those extra levels of difficulty, yet all the reviews simply say there's a free version. Maybe there are other legitimate 1 star reasons, but most are not beyond that it's not free.

Makes me sick some developer is getting shafted for his work because of these people.

(EDIT, I noticed that while the screens showed 3 difficulty levels, the description says those were just added, so some of the reviews might have been based off a single level version like the free one. Still, should an app get 1 star just because there is a free version, can't they rate it with more judgement, like 3 stars for being a good game, but 2 knocked off for charging a $1. But nope, nearly everyone reviewing it doesn't have the app)

Though, I understand that the developer of the pay one is the guy who everyone loves for making the most useless pay apps.