UT2k3 Demo Benchmark V1.001

+=============================+
 Unreal Tournament 2003 Demo
 Benchmarking Script  V1.001
+=============================+

First the needed Legal Crapola....

License and usage:

Use of this software by HardOCP.com is submitted to acceptance of all the terms of this License.  

This software is not sold, but only licensed. This software cannot be sold or included in any other program or commercial package. You may NOT alter, delete, or add any files in the distribution package. 


Disclaimer of warranty:

The software and accompanying written materials are provided "as is" without warranty of any kind, either expressed or implied. The Licensee agrees that the Author shall not be liable for any incidental, indirect, special, or consequential damages, including, but not limited to, loss of profits, business interruption, loss of information, incurred by the Licensee or any third party, even if the author has been advised of the possibility of such damages. 

Upon using the software, the user agrees with the above statements. 

KB Networks, Inc. DBA HardOCP.com Copyright © 2002.  All rights reserved. 

+++++++++++++++++++++++++++++++++

These scripts were made ONLY for the UT2003 DEMO.  These are untested and unknown to work with the full version game.  It is likely the full version game will have many differences to the DEMO version in the way it benchmarks.  Please only use these scripts on the downloadable 100MB DEMO with the Demo Patch installed.  When the full version is released to retail we will make some benchmarking script files for it as well.

---------------
Introduction:
---------------

Unreal Tournament 2003 Demo comes with some benchmarking tools already included in the package.  If you browse to the system directory of the UT2003Demo folder (default location is C:\UT2003Demo) you will find an exacutable called benchmark.exe.  If you run this file it will go through a sequence of two flyby test and two both match tests which then averages the FPS and gives you a result.  The problem with using this tool as a standard benchmark is the fact that quality settings in the game will be set different depending on what video card you have installed.  To ensure that the same quality settings apply for each video card being compared you must use the same ut2003.ini file for each card tested which is also located in the system directory of your UT2003Demo folder.  This is where this benchmarking script helps; we have created a set of .INI files pre-configured for three different quality settings to use as a standard test for comparing cards.

Next is the benchmarking folder itself located in your UT2003Demo folder.  Inside this folder are batch files that have been created to run each flyby separately as well as the bot matches.  The problem here is that these are very basic and would require manual editing to run the tests in a pre-configured sequence at different resolutions.  This is also what our script does for you; it has pre-configured batch files that run the flyby tests at three different resolutions so you don’t have to.

The last issue is about the bot match tests themselves.  The bot match tests are simply a game of bots running through a game; the end result could be different depending on your computer setup.  Because the end result could be different this would make an un-fair benchmark comparing different video cards across different platforms.  For that reason we have not utilized the bot match tests, only the flyby tests which show to be the better video card tester so far in UT2K3, ala fill-rate oriented.  

---------------
Installation:
---------------

Two requirements must be met for these to work currently.

1.)  You must have the Unreal Tournament 2003 Demo Installed in the DEFAULT install path i.e. C:\UT2003Demo   If it is not installed there these will not work.

2.)  You must have a card that supports T&L.  The results will not be fair comparing cards with and without T&L.

After that installation could not be any easier:

1.)  Extract the zip file onto your desktop.  It should extract into a folder called UT2K3 Demo Benchmarking.

2.)  Inside the folder you will find:  This readme.txt, and three folders labeled ‘High Quality’, ‘Medium Quality’, and ‘Low Quality.’  

3.)  Double click the quality setting you want to test.

4.)  Inside the following folder will be a batch file called Install.bat.  Double Click this file.  What this does is copy the UT2003.ini file in that folder into the C:\UT2003Demo\System folder overwriting the one you already have there.  (Note this DOES overwrite it, so if you wish to backup the one that is in there by default I suggest you do so before running Install.bat)

5.)  Then you simply run the flyby-benchmark.bat and let it run through the sequences.  Total time takes about 10 minutes depending on your system speed.

6.)  When it is done it will drop you back to the folder, inside that folder you will see a shortcut ‘Shortcut to Benchmark Results’.  Double click that and you will see the results of the tests it just completed in order starting from 1600x1200 resolution then 1280x1024 resolution and then 1024x768 resolution in each map as labeled.

7.)  Before you run the next quality test you need to copy and paste the info in that benchmark results TXT file somewhere else because you need to clear the results you just did from that file and save the changes.  Otherwise if you keep doing tests it will start to look like a mess and you will loose your place as to what you have benchmarked.

8.)  Repeat as necessary for each quality setting. Hit install.bat then run flyby-bechmark.bat and read results.

The results shown will be Minimum FPS/Average FPS/Maximum FPS.  And then a final total average score.  This way you get a good idea how a video card performs by looking at its Minimum, Average and Maximum FPS.

Don’t forget you may also apply video card specific quality settings such as Anisotropic Filtering and Anti-Aliasing with these quality settings to further enhance IQ and test performance.  Just be sure to keep up with what you are testing.



--------------------
Complete Breakdown
--------------------

I will break down here exactly what this script is doing for your reference.  

I first took an in-depth look into the ut2003.ini file to figure out what settings effected D3D effects in the game.  I then figured out the best settings to make a High Quality, Medium Quality and Low Quality settings for the game.  These are the results I came out with.


High Quality:
--------------

[WinDrv.WindowsClient]
WindowedViewportX=800
WindowedViewportY=600
FullscreenViewportX=1600
FullscreenViewportY=1200
MenuViewportX=800
MenuViewportY=600
Brightness=0.800000
Contrast=0.700000
Gamma=0.800000
UseJoystick=False
CaptureMouse=True
StartupFullscreen=True
ScreenFlashes=True
NoLighting=False
MinDesiredFrameRate=0.000000
Decals=True
Coronas=True
DecoLayers=True
Projectors=True
NoDynamicLights=False
ReportDynamicUploads=False
TextureDetailInterface=UltraHigh
TextureDetailTerrain=UltraHigh
TextureDetailWeaponSkin=UltraHigh
TextureDetailPlayerSkin=UltraHigh
TextureDetailWorld=UltraHigh
TextureDetailRenderMap=UltraHigh
TextureDetailLightmap=UltraHigh
TextureMaxLOD=-1.0
TextureMinLOD=-1.0
NoFractalAnim=False
ScaleHUDX=0.000000

[D3DDrv.D3DRenderDevice]
DetailTextures=True
HighDetailActors=True
SuperHighDetailActors=True
UsePrecaching=True
UseTrilinear=True
AdapterNumber=-1
ReduceMouseLag=True
UseTripleBuffering=True
UseHardwareTL=True
UseHardwareVS=True
UseCubemaps=True
DesiredRefreshRate=0
UseCompressedLightmaps=False
UseStencil=True
Use16bit=False
Use16bitTextures=False
MaxPixelShaderVersion=255
UseVSync=False
LevelOfAnisotropy=1
DetailTexMipBias=-1.0
DefaultTexMipBias=-1.0
UseNPatches=False
TesselationFactor=1.000000
CheckForOverflow=False
DecompressTextures=False
UseXBoxFSAA=False


Medium Quality:
----------------

[WinDrv.WindowsClient]
WindowedViewportX=800
WindowedViewportY=600
FullscreenViewportX=1280
FullscreenViewportY=1024
MenuViewportX=800
MenuViewportY=600
Brightness=0.800000
Contrast=0.700000
Gamma=0.800000
UseJoystick=False
CaptureMouse=True
StartupFullscreen=True
ScreenFlashes=True
NoLighting=False
MinDesiredFrameRate=0.000000
Decals=True
Coronas=True
DecoLayers=True
Projectors=True
NoDynamicLights=False
ReportDynamicUploads=False
TextureDetailInterface=Normal
TextureDetailTerrain=Normal
TextureDetailWeaponSkin=Normal
TextureDetailPlayerSkin=Normal
TextureDetailWorld=Normal
TextureDetailRenderMap=Normal
TextureDetailLightmap=Normal
TextureMaxLOD=0
TextureMinLOD=0
NoFractalAnim=False
ScaleHUDX=0.000000

[D3DDrv.D3DRenderDevice]
DetailTextures=True
HighDetailActors=True
SuperHighDetailActors=True
UsePrecaching=True
UseTrilinear=True
AdapterNumber=-1
ReduceMouseLag=True
UseTripleBuffering=True
UseHardwareTL=True
UseHardwareVS=True
UseCubemaps=True
DesiredRefreshRate=0
UseCompressedLightmaps=True
UseStencil=False
Use16bit=False
Use16bitTextures=False
MaxPixelShaderVersion=255
UseVSync=False
LevelOfAnisotropy=1
DetailTexMipBias=0.0
DefaultTexMipBias=0.0
UseNPatches=False
TesselationFactor=1.000000
CheckForOverflow=False
DecompressTextures=False
UseXBoxFSAA=False


Low Quality:
-------------

[WinDrv.WindowsClient]
WindowedViewportX=800
WindowedViewportY=600
FullscreenViewportX=1024
FullscreenViewportY=768
MenuViewportX=800
MenuViewportY=600
Brightness=0.800000
Contrast=0.700000
Gamma=0.800000
UseJoystick=False
CaptureMouse=True
StartupFullscreen=True
ScreenFlashes=False
NoLighting=True
MinDesiredFrameRate=0.000000
Decals=False
Coronas=False
DecoLayers=False
Projectors=False
NoDynamicLights=True
ReportDynamicUploads=False
TextureDetailInterface=Lower
TextureDetailTerrain=Lower
TextureDetailWeaponSkin=Lower
TextureDetailPlayerSkin=Lower
TextureDetailWorld=Lower
TextureDetailRenderMap=Lower
TextureDetailLightmap=Lower
TextureMaxLOD=1.0
TextureMinLOD=1.0
NoFractalAnim=True
ScaleHUDX=0.000000

[D3DDrv.D3DRenderDevice]
DetailTextures=False
HighDetailActors=False
SuperHighDetailActors=False
UsePrecaching=True
UseTrilinear=False
AdapterNumber=-1
ReduceMouseLag=True
UseTripleBuffering=False
UseHardwareTL=True
UseHardwareVS=True
UseCubemaps=False
DesiredRefreshRate=0
UseCompressedLightmaps=True
UseStencil=False
Use16bit=False
Use16bitTextures=False
MaxPixelShaderVersion=255
UseVSync=False
LevelOfAnisotropy=1
DetailTexMipBias=1.0
DefaultTexMipBias=1.0
UseNPatches=False
TesselationFactor=1.000000
CheckForOverflow=False
DecompressTextures=False
UseXBoxFSAA=False


I then created an Install.bat file that will copy this ut2003.ini file into the folder for everyone so you won’t have to manually go copy it yourself.  This does overwrite the one already in your C:\UT2003Demo\System folder.

For the flyby-benchmark.bat file I placed the commands that will force a flyby benchmark in each level available for these tests.  I then added the resolution switch -1600x1200 and -1280x1024 and -1024x768 to run the tests in those three resolutions automatically one after the other.  Here is the sample code for one:

C:\UT2003Demo\System\ut2003.exe dm-antalus?game=engine.gameinfo exec=C:\UT2003Demo\Benchmark\Stuff\flybyexec.txt -benchmark -seconds=77 -nosound -1600x1200 %1

I then made a shortcut to the lowframerate.log file located in the C:\UT2003Demo\Benchmarking folder.  I chose this result file because it displays the map name above the test which the benchmark.log file does not.  Both files show the same results, but the lowframerate.log file presents it better.

This should make benchmarking a little bit easier.  You simply just run Install.bat, then run the flyby-benchmark.bat file and go get yourself something to eat!  The whole process takes about 10 minutes for one quality test depending on your system speed.  You can of course add video card settings of Anisotropic and AA to test with as well.  The results are easy to understand and will be very usefull for comparing video cards.  Remember this is just for the DEMO, once the full version is out we will explore benchmarking with it.

This is simply a handy little utility which will hopefully make reviewing with UT2K3 just a little bit easier so we don’t all have to make our own scripts and end up having different quality settings making a comparison not be fair between reviewers and their hardware.


Well, I hope you have fun with it!  Now back to some Bombing Run, yeah baby!



====================================
Brent Justice aka [H]Drone
Vid Card Gawd
[H]ard|OCP : http://www.hardocp.com
Email :  [email protected]

9-23-2002

“Please don’t edit the files yourself, especially the .ini files.  This will change the quality settings and fair comparisons will no longer be possible.  Any tweaks/comments/suggestions/flames should be directed to me and I will make appropriate changes and re-distribute”

Thanks,
Brent
====================================