It's bad enough that Gamespot, which lost a great deal of credibility when the likes of Jeff Gerstmann and Alex Navarro flew the coop (or in Gerstmann's case, made to fly the coop), continually and consistently delays its reviews. There is no question that this tendency has its own nefarious designs, namely to ensure that GS ratings can effectively sandbag the Metacritic average for a given title. Personally, I think Gamespot reviewers have used the practice in order to appoint themselves the "Fox News" of the game industry--delivering allegedly unbiased and unfiltered reviews that purport to give the "real" take on a particular title. It's as if Gamespot relishes the faux prestige that comes with dispensing the last opinion on a game, even if reviews elsewhere are better-written, more comprehensive, and more in touch with the general gaming public's expectations.
What exacerbates this failing, however, is Gamespot's insanely unbalanced scoring system, which was revamped a couple of years ago and has proven time and time again to be an abject disaster. Two recent, ballyhooed releases provide perfect examples of how disingenuous the Gamespot scoring system has become:
Madden NFL 10 received an overall 7.5 rating. This is effectively a C+ for a game that, per the review, had but a handful of minor annoyances. Bland commentary and AI quirks take this game down that many pegs? It should be noted that in a comparable review from another website, these same drawbacks were also cited but the game received a score in the high 8s. Apparently, Gamespot feels that minor, subjective grievances warrant significant point reductions, which is odd when you consider how these quibbles are treated elsewhere. Then again, refer to my point above about the delay factor--every other major reviewer had already published its review by the time Gamespot threw its two cents in, and no score was lower than an 8/10. So naturally Gamespot scores it a 7.5 and gives off the pompous air of being unimpressed.
Shadow Complex got an admirable 8.5 overall in a review published only hours ago. Now, having not played this game yet, I can't fairly debate the merits of whether this comparatively low score--in the context of the critical mass that had accumulated so far--is justifiable. But again, I can read the review and ascertain that while this may be the best $15 digital download to date, Gamespot thinks some occasional aiming quirks should take the game out of the Editor's Choice realm. I never really quarrel with what Gamespot reviewers identify as flaws, but I do question the gravity they assign to these alleged shortcomings. Why did Grand Theft Auto IV get a perfect 10 when it had some pop-in and clipping issues?
The scoring system that was adopted a few years ago was designed, presumably, to make Gamespot's critiques distinctive. The emblems and the good/bad snippets had the potential to be useful, but instead the removal of categorized scoring has made these overall ratings completely flaccid and untrustworthy. I don't necessarily want to know how the sausage is made but I do want to know the ingredients--Gamespot has taken the position that you don't need to know what's even in the sausage, short of assigning cutesy little icons, but that at the end of it all, it's sausage of a particular grade. And, frankly, I think that's doing the readers a disservice.
Comments
That is the kind of praise reserved for 9.0s and above. Again, we're splitting hairs, but because Gamespot's review system has eschewed fractional points, you're looking at very inconsistent results. An 8.5 is, of course, still a very good score...but based on the content and tone of the video and written review, is that really what it merited?
We definitely do not relish being the last site to post an opinion on a game, but we also don't jump through hoops with publishers to be first. We turn down trips to review games under controlled conditions, we don't do exclusive reviews, and we insist on reviewing finished games that will run on retail consoles. Also, as initially happened with Madden NFL 10 recently, if we only receive the X360 version of a game we only review the X360 version. Sure, we could probably just run the same review and get lucky when the two games end up being near-identical, but that's not always the case. If you want to base your PS3 game buying decision on an X360 review that's your call to make, not ours.
Where Madden is concerned, our rating of 7.5 means that we think it's a very good game. We rate games on a scale of 1 to 10, and we use the whole scale. Our rating system might look similar to other publications', but perhaps we use it a little differently? That's not to say that we're right and others are wrong, we just have different opinions.
To your point about "point reductions", games do not all start out as perfect 10s and then have points deducted until we arrive at a final score...
Where Shadow Complex is concerned, the video review was shot before the text review had been finalized, and during the course of our QA some of the language was changed to be more in keeping with the 8.5 score. That's not a "very good" score by the way, that's somewhere between "great" and "superb", so I really don't think we've sold the game short.
I wasn't involved in coming up with our current scoring system, but my understanding is that one of the reasons Greg Kasavin and Jeff Gerstmann came up with it was that, with the old system, the final score was too dependent on the five component scores (or "ingredients"). Reviewing a game with no or very little sound like the Championship Manager/Football Manager games, for example, made it almost impossible for us to give them the scores we felt they deserved. Similarly, superb games with lackluster graphics were in danger of getting shortchanged just because they didn't look great.
I'm sure I must be way over the character limit now, so we'll see how many comments I need to post this. Feel free to PM me anytime you have a question about reviews. Justin
DoctorBedlam