New Xbox Experience: DVD vs. Hard Disk Face-Off
Is it worth installing stuff? We investigate.
For a dashboard upgrade supposedly aimed at attracting the 'casual' audience, New Xbox Experience actually has a lot of love for the core 360 enthusiast gamer. The Party mode craved by Live users has been incorporated, tweaks long asked for have been made to the VGA/HDMI video outputs, but perhaps most surprisingly of all, Microsoft has allowed gamers to optionally install their games to hard disk. This is - potentially - a very good thing.
Eurogamer has never been a massive fan of the mandatory installations required on many PlayStation 3 releases. It has a fundamental impact on the 'plug and play' nature of console gaming, especially when you can be sitting about for up to 25 minutes waiting to play your brand new release. It also forces you to manage hard disk space efficiently, especially if you have a lower-capacity drive in your PS3. There's also the fact that once you've deleted your game install, as you inevitably will in order to get more mandatory installs onto your hard disk, you'll need to wait another 25 minutes if, for example, you fancy a one-off late-night blast on Devil May Cry 4 sometime in the future.
That said, we've always been fan of the optional installs found in PS3 games like Ridge Racer 7, Virtua Fighter 5, and more recently, Disney's excellent Pure. You've still got that instant accessibility that is a fundamental part of console gaming, but if you want your games to load faster, and you're willing to deal with the hassles of deleting content to let your new games run, the option is there. With NXE, remarkably, that option is available for every single game in your library - except Crackdown or Dead or Alive Xtreme 2, which bizarrely aren't compatible with the new hard disk function.
The only other PS3 comparison worth mentioning is the question of install and deletion times. The 360 stores its files as disc images - whatever the Xbox version of an ISO may be. It's literally one file. That means that installation times are basically the same for any given amount of data, and deletion is virtually instant (as just one file is being erased from the table of contents). PS3 on the other hand uses variable installation techniques depending on the developer - the reason Devil May Cry 4 takes so long to install is that it's copying across multiple files rather than just one sustained write. It's also why it takes a long while to delete too.
But the real question for 360 owners is: just how much of an impact does the optional install make? With so many games streaming data from the DVD on the fly, do we actually see any improvements to gameplay as well as loading times? Do all games benefit with shorter loading times? We set out to find out.
The methodology for the tests was remarkably straightforward - my workhorse Xbox 360 Elite ran a carefully selected range of ten top games, first from DVD, then from hard disk. Video captures of both gameplay run-throughs allowed us to get frame-accurate loading times (rounded up to the nearest half-second) and the comparison of the selected footage could also be used to judge any differences in game performance.
As the vast majority of the userbase would be running NXE from the 20GB hard disk, that's what we did too. In truth, I've never got around to moving my content over from the launch era hard disk to the 120GB drive that came with the Elite. This aged drive has never been formatted and never had its cache cleared. It's basically had three years of everyday heavy use, and for the purposes of this test, we left just 7GB free - in short, we're filling the hard disk to capacity, just to make things even more challenging.
As the opportunity to install to HDD is obviously a compelling argument for upgrading the hard disk (and probably a key reason for adding the feature in the first place) we also did some tests on the default 120GB drive, unused and unloved since I bought the Elite, but perhaps now worth a bit more respect.
Enough small talk. Let's get to work.
Gears of War 2
Install Size: 6.7GB
Epic's Gears of War 2 is an excellent example of a game designed from the ground up to minimise disc loading. It loads its campaigns while the cinematics are running - a trick also used in PlayStation 3 titles including Uncharted: Drake's Fortune. Gears 2 is therefore multiplexing video and audio data with the maps in one file streamed off the hard disk.
That being the case, the tangible benefits of installing the game to HDD effectively amount to loading the game, restoring your save position or accessing multiplayer options, all of which are covered in our measurements. As you can see, Epic's streaming is extremely well optimised for playing from disc, to the point where the hard disk installation barely makes any positive impact whatsoever, aside from saving yourself the odd second here and there, and of course reducing the volume of your Xbox 360.
Section Tested | DVD Load Time | HDD Load Time |
---|---|---|
Initial Load | 32 seconds | 24 seconds |
Tip of the Spear (Digging In) | 18 seconds | 15 seconds |
Gathering Storm | 29 seconds | 29 seconds |
Denizens (Scattered) | 17 seconds | 11.5 seconds |
Horde Stage (Avalanche) | 16 seconds | 16 seconds |
Training Grounds (The Basics) | 10.5 seconds | 9.5 seconds |
The Orange Box
Install Size: 4.7GB
Yes, you read that correctly. Despite featuring five different games in one phenomenal package, The Orange Box in its entirety fills only 4.7GB of the theoretical 6.8GB limit imposed by an Xbox 360-formatted dual-layer DVD. It's also one of the few games where performance is hugely improved by the installation. The measurements below speak for themselves; on all of the major Half-Life 2 games, loading times are often twice as fast, while the lighter content additions to the Orange Box feature far fewer benefits.
The Orange Box goes about its business in a decidedly old-skool manner. There's nothing in the way of on-the-fly geometry or texture streaming going on - Valve opted for discrete loading of each section of gameplay as and when it is needed, and that kind of PC-styled approach clearly favours the hard disk installation. In-game performance is totally identical as a result, too.
Section Tested | DVD Load Time | HDD Load Time |
---|---|---|
Loading Half-Life 2 | 44.5 seconds | 25.5 seconds |
Half Life 2 Save Game - 'We don't go there any more' | 47 seconds | 15 seconds |
Loading Episode 1 | 38 seconds | 22 seconds |
Episode 1 Save Game - 'Direct Intervention' | 17.5 seconds | 17 seconds |
Loading Episode 2 | 40.5 seconds | 25 seconds |
Episode 2 Save Game - 'This Vortal Coil' | 16 seconds | 14 seconds |
Loading Portal | 34.5 seconds | 20.5 seconds |
Portal Save Game - 'Testchamber 15' | 7.5 seconds | 6.5 seconds |
Loading Team Fortress 2 | 57.5 seconds | 41.5 seconds |
TF2 '2Fort' Capture the Flag System Link match | 31 seconds | 31 seconds |