OGRE-Next  4.0.0unstable
Object-Oriented Graphics Rendering Engine
Ogre::HlmsDiskCache Class Reference

This class allows saving the current state of an Hlms to disk: both its compiled shaders with source and the generated PSOs. More...

#include <OgreHlmsDiskCache.h>

+ Inheritance diagram for Ogre::HlmsDiskCache:

Classes

struct  Cache
 
struct  DatablockCustomPiecesCache
 
struct  Pso
 
struct  SourceCode
 

Public Types

typedef vector< DatablockCustomPiecesCache >::type DatablockCustomPiecesCacheVec
 
typedef vector< Pso >::type PsoVec
 
typedef vector< SourceCode >::type SourceCodeVec
 

Public Member Functions

 HlmsDiskCache (HlmsManager *hlmsManager)
 
 ~HlmsDiskCache ()
 
void applyTo (Hlms *hlms, size_t numThreads)
 
void clearCache ()
 
void copyFrom (Hlms *hlms)
 
void load (DataStreamPtr &dataStream, Hlms::RenderableCache &renderableCache)
 
void load (DataStreamPtr &dataStream, HlmsPropertyVec &properties)
 
void load (DataStreamPtr &dataStream, IdString &hashedString)
 
void load (DataStreamPtr &dataStream, String &string)
 
void loadFrom (DataStreamPtr &dataStream)
 
void save (DataStreamPtr &dataStream, const Hlms::RenderableCache &renderableCache)
 
void save (DataStreamPtr &dataStream, const HlmsPropertyVec &properties)
 
void save (DataStreamPtr &dataStream, const IdString &hashedString)
 
void save (DataStreamPtr &dataStream, const String &string)
 
void saveTo (DataStreamPtr &dataStream)
 

Static Public Member Functions

static void _compileShadersThread (CompilerJobParams &threadHandle, size_t threadIdx)
 

Public Attributes

Cache mCache
 
uint16 mDebugStrSize
 
bool mFastShaderBuildHack
 
HlmsManagermHlmsManager
 
uint16 mNativeShadingLangVer
 
uint8 mPrecisionMode
 
String mShaderProfile
 
bool mTemplatesOutOfDate
 

Detailed Description

This class allows saving the current state of an Hlms to disk: both its compiled shaders with source and the generated PSOs.

This allows cutting down stalls by compiling at loading time.

This cache is not meant to be used with HLMS_COMPUTE or HLMS_LOW_LEVEL.

The cache saves several layers:

  1. The preprocessed shader
  2. The properties used to generate the shader, in case the template becomes out of date
  3. The generated PSO pairs.

The layer 1 can only be used for the same platform & RenderSystem it was built for (e.g. a cache built for Windows+D3D11 can only be used there). However the rest of the layers work on any platform on any RenderSystem.

The cache cannot be used if it was generated with a different value of OGRE_DEBUG_STR_SIZE (i.e. see IdString) unless the current value of OGRE_DEBUG_STR_SIZE is 0.

In practice this means caches generated by Debug builds can be used in Release, but caches generated by Release builds cannot be used in Debug, unless OGRE_IDSTRING_ALWAYS_READABLE was set for the Release build.

Decrease loading times further by also enabling the microcode cache. See http://wiki.ogre3d.org/Ogre+2.1+FAQ#Starting_my_app_takes_forever_particularly_Direct3D11_

Remarks
IMPORTANT: If you're using the microcode cache, it should be loaded BEFORE the disk cache. And setSaveMicrocodesToCache should be called BEFORE loading the disk cache.

What's the difference between the Microcode cache and HlmsDiskCache?

A PSO has multiple stages since it's compiled in an Hlms:

Hlms Shader Templates These are the shader templates (e.g. PixelShader_ps.glsl)
|
v
Property & Piece info These are the properties set by the Hlms to describe information
| about the mesh, the material and the pass (e.g. does it have
| normals? does it use normal mapping? Is this a shadow mapping pass?)
| This info is used to run the Hlms parser on the templates to
| produce the preprocessed shaders for the next step.
| HlmsDiskCache stores it in
| HlmsDiskCache::Cache::sourceCode::mergedCache
| This information is API & platform agnostic. In certain cases, the
| cache may still be used even if the templates have changed.
|
v
Preprocessed Shader These are the templates processed by the Hlms. There is up to 1
| for each shader stage. The produced output is valid shader code
| but specific to each RenderSystem API (OpenGL, D3D11, Metal)
| While parsing the templates is fast, it's not free; specially in
| debug builds.
| HlmsDiskCache stores this in
| HlmsDiskCache::Cache::sourceCode::sourceFile
|
v
Compiled Microcode The is a binary blob produced by the shader compiler
| (e.g fxc in D3D11). *This is cached by the Microcode cache*.
| If the microcode cache is not active, the HlmsDiskCache will
| rebuild it from scratch to move the performance hit (stalls) from
| realtime into loading time.
|
V
Pipeline State Object This is a huge amalgamation of all the information required to
(PSO) draw a triangle on screen. See HlmsPso for what's in it.
The driver will internally merge the compiled microcode and PSO info
and translate it into an ISA (Instruction Set Architecture) which is
specific to the GPU & Driver the user currently has installed;
and store the ISA into the PSO.
Under Vulkan & D3D12 this ISA can be saved to disk.
However for the rest of the APIs, HlmsDiskCache saves all the info
required to rebuild the PSO/ISA from scratch again.
Depending on the API and Driver, building the PSO can be very fast
or take significant time.
Note that due to a technical issue, this information is currently
being saved to disk but the PSO is not rebuilt (i.e. the information
is not used). Because of it, certain platforms may still experience
some stalls at runtime, due to the driver translating the Microcode
to the internal ISA.
HlmsDiskCache(HlmsManager *hlmsManager)
PsoVec pso
Definition: OgreHlmsDiskCache.h:177

Member Typedef Documentation

◆ DatablockCustomPiecesCacheVec

◆ PsoVec

typedef vector<Pso>::type Ogre::HlmsDiskCache::PsoVec

◆ SourceCodeVec

Constructor & Destructor Documentation

◆ HlmsDiskCache()

Ogre::HlmsDiskCache::HlmsDiskCache ( HlmsManager hlmsManager)

◆ ~HlmsDiskCache()

Ogre::HlmsDiskCache::~HlmsDiskCache ( )

Member Function Documentation

◆ _compileShadersThread()

static void Ogre::HlmsDiskCache::_compileShadersThread ( CompilerJobParams &  threadHandle,
size_t  threadIdx 
)
static

◆ applyTo()

void Ogre::HlmsDiskCache::applyTo ( Hlms hlms,
size_t  numThreads 
)

◆ clearCache()

void Ogre::HlmsDiskCache::clearCache ( )

◆ copyFrom()

void Ogre::HlmsDiskCache::copyFrom ( Hlms hlms)

◆ load() [1/4]

void Ogre::HlmsDiskCache::load ( DataStreamPtr dataStream,
Hlms::RenderableCache &  renderableCache 
)

◆ load() [2/4]

void Ogre::HlmsDiskCache::load ( DataStreamPtr dataStream,
HlmsPropertyVec properties 
)

◆ load() [3/4]

void Ogre::HlmsDiskCache::load ( DataStreamPtr dataStream,
IdString hashedString 
)

◆ load() [4/4]

void Ogre::HlmsDiskCache::load ( DataStreamPtr dataStream,
String string 
)

◆ loadFrom()

void Ogre::HlmsDiskCache::loadFrom ( DataStreamPtr dataStream)

◆ save() [1/4]

void Ogre::HlmsDiskCache::save ( DataStreamPtr dataStream,
const Hlms::RenderableCache &  renderableCache 
)

◆ save() [2/4]

void Ogre::HlmsDiskCache::save ( DataStreamPtr dataStream,
const HlmsPropertyVec properties 
)

◆ save() [3/4]

void Ogre::HlmsDiskCache::save ( DataStreamPtr dataStream,
const IdString hashedString 
)

◆ save() [4/4]

void Ogre::HlmsDiskCache::save ( DataStreamPtr dataStream,
const String string 
)

◆ saveTo()

void Ogre::HlmsDiskCache::saveTo ( DataStreamPtr dataStream)

Member Data Documentation

◆ mCache

Cache Ogre::HlmsDiskCache::mCache

◆ mDebugStrSize

uint16 Ogre::HlmsDiskCache::mDebugStrSize

◆ mFastShaderBuildHack

bool Ogre::HlmsDiskCache::mFastShaderBuildHack

◆ mHlmsManager

HlmsManager* Ogre::HlmsDiskCache::mHlmsManager

◆ mNativeShadingLangVer

uint16 Ogre::HlmsDiskCache::mNativeShadingLangVer

◆ mPrecisionMode

uint8 Ogre::HlmsDiskCache::mPrecisionMode

◆ mShaderProfile

String Ogre::HlmsDiskCache::mShaderProfile

◆ mTemplatesOutOfDate

bool Ogre::HlmsDiskCache::mTemplatesOutOfDate

The documentation for this class was generated from the following file: