GAMES: GameSpot GameFAQs MOVIES: Metacritic Movietome Comic-Con
Wednesday, Aug 19, 2009

It's bad enough that Gamespot, which lost a great deal of credibility when the likes of Jeff Gerstmann and Alex Navarro flew the coop (or in Gerstmann's case, made to fly the coop), continually and consistently delays its reviews. There is no question that this tendency has its own nefarious designs, namely to ensure that GS ratings can effectively sandbag the Metacritic average for a given title. Personally, I think Gamespot reviewers have used the practice in order to appoint themselves the "Fox News" of the game industry--delivering allegedly unbiased and unfiltered reviews that purport to give the "real" take on a particular title. It's as if Gamespot relishes the faux prestige that comes with dispensing the last opinion on a game, even if reviews elsewhere are better-written, more comprehensive, and more in touch with the general gaming public's expectations.

What exacerbates this failing, however, is Gamespot's insanely unbalanced scoring system, which was revamped a couple of years ago and has proven time and time again to be an abject disaster. Two recent, ballyhooed releases provide perfect examples of how disingenuous the Gamespot scoring system has become:

Madden NFL 10 received an overall 7.5 rating. This is effectively a C+ for a game that, per the review, had but a handful of minor annoyances. Bland commentary and AI quirks take this game down that many pegs? It should be noted that in a comparable review from another website, these same drawbacks were also cited but the game received a score in the high 8s. Apparently, Gamespot feels that minor, subjective grievances warrant significant point reductions, which is odd when you consider how these quibbles are treated elsewhere. Then again, refer to my point above about the delay factor--every other major reviewer had already published its review by the time Gamespot threw its two cents in, and no score was lower than an 8/10. So naturally Gamespot scores it a 7.5 and gives off the pompous air of being unimpressed.

Shadow Complex got an admirable 8.5 overall in a review published only hours ago. Now, having not played this game yet, I can't fairly debate the merits of whether this comparatively low score--in the context of the critical mass that had accumulated so far--is justifiable. But again, I can read the review and ascertain that while this may be the best $15 digital download to date, Gamespot thinks some occasional aiming quirks should take the game out of the Editor's Choice realm. I never really quarrel with what Gamespot reviewers identify as flaws, but I do question the gravity they assign to these alleged shortcomings. Why did Grand Theft Auto IV get a perfect 10 when it had some pop-in and clipping issues?

The scoring system that was adopted a few years ago was designed, presumably, to make Gamespot's critiques distinctive. The emblems and the good/bad snippets had the potential to be useful, but instead the removal of categorized scoring has made these overall ratings completely flaccid and untrustworthy. I don't necessarily want to know how the sausage is made but I do want to know the ingredients--Gamespot has taken the position that you don't need to know what's even in the sausage, short of assigning cutesy little icons, but that at the end of it all, it's sausage of a particular grade. And, frankly, I think that's doing the readers a disservice.

Category: Editorial
Posted by b_wilcox, 9:11am
6 Comments | Post a Comment

Comments

Page 1 
« prev  |  next »
Ditto. Though occasionally they hit the nail on the head.
Posted Aug 19, 2009 11:00 am PT
One more point I should make is that in the video review, Lark Anderson describes Shadow Complex as "an incredible genre-defining adventure that won't be forgotten in a long, long time."

That is the kind of praise reserved for 9.0s and above. Again, we're splitting hairs, but because Gamespot's review system has eschewed fractional points, you're looking at very inconsistent results. An 8.5 is, of course, still a very good score...but based on the content and tone of the video and written review, is that really what it merited?
Posted Aug 20, 2009 12:04 pm PT
I'm not sure what the character limit is on these comments, but since I'm the head of reviews here I'll attempt to address some of the points you've made here.

We definitely do not relish being the last site to post an opinion on a game, but we also don't jump through hoops with publishers to be first. We turn down trips to review games under controlled conditions, we don't do exclusive reviews, and we insist on reviewing finished games that will run on retail consoles. Also, as initially happened with Madden NFL 10 recently, if we only receive the X360 version of a game we only review the X360 version. Sure, we could probably just run the same review and get lucky when the two games end up being near-identical, but that's not always the case. If you want to base your PS3 game buying decision on an X360 review that's your call to make, not ours.

Where Madden is concerned, our rating of 7.5 means that we think it's a very good game. We rate games on a scale of 1 to 10, and we use the whole scale. Our rating system might look similar to other publications', but perhaps we use it a little differently? That's not to say that we're right and others are wrong, we just have different opinions.

To your point about "point reductions", games do not all start out as perfect 10s and then have points deducted until we arrive at a final score...
Posted Aug 24, 2009 4:29 pm PT
... It would be closer to the truth (though not entirely accurate) to say that all games start out at the bottom of the scale and must earn points towards a final score.

Where Shadow Complex is concerned, the video review was shot before the text review had been finalized, and during the course of our QA some of the language was changed to be more in keeping with the 8.5 score. That's not a "very good" score by the way, that's somewhere between "great" and "superb", so I really don't think we've sold the game short.

I wasn't involved in coming up with our current scoring system, but my understanding is that one of the reasons Greg Kasavin and Jeff Gerstmann came up with it was that, with the old system, the final score was too dependent on the five component scores (or "ingredients"). Reviewing a game with no or very little sound like the Championship Manager/Football Manager games, for example, made it almost impossible for us to give them the scores we felt they deserved. Similarly, superb games with lackluster graphics were in danger of getting shortchanged just because they didn't look great.

I'm sure I must be way over the character limit now, so we'll see how many comments I need to post this. Feel free to PM me anytime you have a question about reviews. Justin
Posted Aug 24, 2009 4:29 pm PT
You make some good points, Justin, and I can certainly respect the desire to review a game up from zero instead of down from perfection, as it were. And my grumble about the lateness of reviews, you must understand, is based more on the fact that I have always put a great deal of trust in Gamespot's opinions and that has led to much frustration recently when other sites beat Gamespot to the punch by several days, or in certain cases, when GS fails to actually publish a review until after a game is released. My biggest complaint, again, is that sometimes I don't see the scale matching the content. Yes, 8.5 overall is quite a lofty score for an excellent game like Shadow Complex, but I can't help but think that the half-point system simply isn't fine enough to make distinctions. Let me bring up another example: BioShock received a 9.0 here and that score took a lot of criticism by many GS readers (myself included) because the game was overwhelmingly innovative, aesthetically groundbreaking, and arguably one of the best FPS titles to ever grace a console. At the time, BioShock's review (Gerstmann wrote it, as I recall) arrived well after scads of 9.5s and up had been published; it wasn't that the 9.0 itself looked amiss, but the fact that there were basically only a couple of niggling criticisms that took it down several pegs.
Posted Aug 30, 2009 9:02 pm PT
Now, context matters, so then it's important to look at Halo 3, which was released weeks later and received a 9.5 despite having what many considered to be much more damning flaws than those present in BioShock. It looked suspect because Halo 3 was, of course, one of the year's most anticipated titles while BioShock arrived with a bit less fanfare. So I guess I don't look at Shadow Complex's 8.5 in a vacuum--I think other reviews have to be considered, inside and outside GameSpot.
Posted Aug 30, 2009 9:03 pm PT
Page 1 
« prev  |  next »
  • b_wilcox
  • Level: 1 (0%)
  • Rank: Mogwai
  • Forum Posts: 10
  • Messages Read: 0


advertisement

Friends

My Friends