In addition to the general playability and content completeness we also note the severity of bugs we might come across. Furthermore, we try to test different versions of a game (different revisions, from different regions, different platforms, etc…) to compare them. You can find our full list of games tested here.
Main steps of our testing process
- Take the hardware platform (PC/console/handheld) fully offline and remain offline until the test is completed.
- Freshly install the game.
- Ideally, use a local profile that has not been connected to any online services like PlayStation Network, EA Origin, Bethesda.net, Battle.net, etc.
- At the very least, beat the main gameplay mode (story, campaign, career, etc.) and do as much side content as possible.
- Put the game under common stress situations, like idling for a longer time, ALT-TAB-ing multiple times or creating a lot of graphically demanding effects on screen at the same time.
- Note any bugs, missing content, mandatory downloads, glitches, mandatory log-ins or other forms of internet requirements and DRM.
- Note region (ESRB, PEGI, CERO, etc.), edition (Standard vs. GOTY vs. published by limited print micropublishers), file version, disc/cart ID, spine ID, cart revision code (Switch only) of the game.
- Note hardware platform (PC vs. PlayStation vs. Switch, etc.), platform model (Base PS4 vs. PS4 Pro vs. PS5 BC, e.g.) and in case of PC the operating system.
What do the classifications mean exactly
When we test games along the two main criteria, we categorize them in one of three/four ratings each. In the description of each test we detail the factors that lead to our judgment.
Offline play:
Yes:
- The game does not depend on any online check-ins, a permanent internet connection and/or online accounts.
Yes*:
- Game is mainly online-focused, but has some offline functionality (e.g., a small offline campaign or offline bot matches).
- Game is generally enjoyable offline, but some minor features require an online connection (e.g., unlockables, trophies, leader boards).
No:
- All game modes are online-only. There is no significant offline gameplay mode.
- The game requires a permanent internet connection for any reason.
- The game requires a login into a certain account (e.g., Bethesda.net, Battle.net, Microsoft, 2K, etc.)
- The game requires a profile that has been connected to the platform holders’ services before (e.g., PlayStation Network).
Download required:
No:
- The entire advertised content is included on the physical medium. At worst, only insignificant content (e.g., pre-order bonus skins) require a download or are only included as a voucher.
- The game has no significant bugs that hinder enjoyment or playability of the game – always relative to the scope of the game (if a 200 hour open world game has a bit of pop-in, we usually don’t classify it as “download/patch required”).
No*:
- The release is content-complete on the physical medium, but has bugs that are either too severe or too many to provide a mostly flawless experience. The game can still be beaten and can also likely be enjoyed for the most part.
- The release is missing minor content outside of the base game (e.g., small amount of bonus characters in fighting games or one or two additional tracks in racing games). Experiencing the core game is not affected by that.
Yes*:
- The game can technically be beaten, but you either need a very high tolerance of bugs or luck to progress past them.
- The release misses significant side content (e.g., story DLC, a high amount of bonus missions/levels or characters). This rating especially applies to “Complete/Ultimate/etc.” editions, that come with a playable base game, but miss major portions of the advertised content that would justify the “Complete/Ultimate/etc.” label.
Yes:
- The release either has a hard-coded prompt for a download, misses essential content or is not on the physical medium at all.
- Bugs are so severe that they either make playing the game extremely unpleasant or downright unbeatable.
Disclaimer
While we thoroughly test everything we can, there are limits to our resources. We can't 100% every 1000-hour JRPG. We can't travel to every pixel of modern open-world games. But we can beat campaigns, we can do tons of side quests and we can hoard collectibles until the last drop of coffee is gone. If we say, you can enjoy a game, you can-given that you like a certain type of game in general, of course.