Ogre::HlmsDiskCache Class Reference

This class allows saving the current state of an Hlms to disk: both its compiled shaders with source and the generated PSOs. More...

#include <OgreHlmsDiskCache.h>

Inheritance diagram for Ogre::HlmsDiskCache:

Classes
struct	Cache
struct	Pso
struct	SourceCode

Public Types
typedef vector< Pso >::type	PsoVec
typedef vector< SourceCode >::type	SourceCodeVec

Public Member Functions
	HlmsDiskCache (HlmsManager *hlmsManager)
	~HlmsDiskCache ()
void	applyTo (Hlms *hlms)
void	clearCache (void)
void	copyFrom (Hlms *hlms)
void	load (DataStreamPtr &dataStream, Hlms::RenderableCache &renderableCache)
void	load (DataStreamPtr &dataStream, HlmsPropertyVec &properties)
void	load (DataStreamPtr &dataStream, IdString &hashedString)
void	load (DataStreamPtr &dataStream, String &string)
void	loadFrom (DataStreamPtr &dataStream)
void	operator delete (void *ptr)
void	operator delete (void *ptr, const char *, int, const char *)
void	operator delete (void *ptr, void *)
void	operator delete[] (void *ptr)
void	operator delete[] (void *ptr, const char *, int, const char *)
void *	operator new (size_t sz)
void *	operator new (size_t sz, const char *file, int line, const char *func)
	operator new, with debug line info
void *	operator new (size_t sz, void *ptr)
	placement operator new
void *	operator new[] (size_t sz)
void *	operator new[] (size_t sz, const char *file, int line, const char *func)
	array operator new, with debug line info
void	save (DataStreamPtr &dataStream, const Hlms::RenderableCache &renderableCache)
void	save (DataStreamPtr &dataStream, const HlmsPropertyVec &properties)
void	save (DataStreamPtr &dataStream, const IdString &hashedString)
void	save (DataStreamPtr &dataStream, const String &string)
void	saveTo (DataStreamPtr &dataStream)

Public Attributes
Cache	mCache
uint16	mDebugStrSize
HlmsManager *	mHlmsManager
String	mShaderProfile
bool	mTemplatesOutOfDate

Detailed Description

This class allows saving the current state of an Hlms to disk: both its compiled shaders with source and the generated PSOs.

This allows cutting down stalls by compiling at loading time.

This cache is not meant to be used with HLMS_COMPUTE or HLMS_LOW_LEVEL.

The cache saves several layers:

1. The preprocessed shader
2. The properties used to generate the shader, in case the template becomes out of date
3. The generated PSO pairs.

The layer 1 can only be used for the same platform & RenderSystem it was built for (e.g. a cache built for Windows+D3D11 can only be used there). However the rest of the layers work on any platform on any RenderSystem.

The cache cannot be used if it was generated with a different value of OGRE_DEBUG_STR_SIZE (i.e. see IdString) unless the current value of OGRE_DEBUG_STR_SIZE is 0.

In practice this means caches generated by Debug builds can be used in Release, but caches generated by Release builds cannot be used in Debug, unless OGRE_IDSTRING_ALWAYS_READABLE was set for the Release build.

Decrease loading times further by also enabling the microcode cache. See http://wiki.ogre3d.org/Ogre+2.1+FAQ#Starting_my_app_takes_forever_particularly_Direct3D11_

Remarks

IMPORTANT: If you're using the microcode cache, it should be loaded BEFORE the disk cache. And setSaveMicrocodesToCache should be called BEFORE loading the disk cache.

What's the difference between the Microcode cache and HlmsDiskCache?

A PSO has multiple stages since it's compiled in an Hlms:

Hlms Shader Templates       These are the shader templates (e.g. PixelShader_ps.glsl)
         |
         v
Property & Piece info       These are the properties set by the Hlms to describe information
         |                  about the mesh, the material and the pass (e.g. does it have
         |                  normals? does it use normal mapping? Is this a shadow mapping pass?)
         |                  This info is used to run the Hlms parser on the templates to
         |                  produce the preprocessed shaders for the next step.
         |                  HlmsDiskCache stores it in
         |                  HlmsDiskCache::Cache::sourceCode::mergedCache
         |                  This information is API & platform agnostic. In certain cases, the
         |                  cache may still be used even if the templates have changed.
         |
         v
 Preprocessed Shader        These are the templates processed by the Hlms. There is up to 1
         |                  for each shader stage. The produced output is valid shader code
         |                  but specific to each RenderSystem API (OpenGL, D3D11, Metal)
         |                  While parsing the templates is fast, it's not free; specially in
         |                  debug builds.
         |                  HlmsDiskCache stores this in
         |                  HlmsDiskCache::Cache::sourceCode::sourceFile
         |
         v
 Compiled Microcode         The is a binary blob produced by the shader compiler
         |                  (e.g fxc in D3D11). *This is cached by the Microcode cache*.
         |                  If the microcode cache is not active, the HlmsDiskCache will
         |                  rebuild it from scratch to move the performance hit (stalls) from
         |                  realtime into loading time.
         |
         V
Pipeline State Object       This is a huge amalgamation of all the information required to
       (PSO)                draw a triangle on screen. See HlmsPso for what's in it.
                            The driver will internally merge the compiled microcode and PSO info
                            and translate it into an ISA (Instruction Set Architecture) which is
                            specific to the GPU & Driver the user currently has installed;
                            and store the ISA into the PSO.
                            Under Vulkan & D3D12 this ISA can be saved to disk.
                            However for the rest of the APIs, HlmsDiskCache saves all the info
                            required to rebuild the PSO/ISA from scratch again.
                            HlmsDiskCache stores this info in HlmsDiskCache::Cache::pso
                            Depending on the API and Driver, building the PSO can be very fast
                            or take significant time.
 
                            Note that due to a technical issue, this information is currently
                            being saved to disk but the PSO is not rebuilt (i.e. the information
                            is not used). Because of it, certain platforms may still experience
                            some stalls at runtime, due to the driver translating the Microcode
                            to the internal ISA.

Member Typedef Documentation

PsoVec

typedef vector<Pso>::type Ogre::HlmsDiskCache::PsoVec

SourceCodeVec

typedef vector<SourceCode>::type Ogre::HlmsDiskCache::SourceCodeVec

Constructor & Destructor Documentation

HlmsDiskCache()

Ogre::HlmsDiskCache::HlmsDiskCache

(

HlmsManager *

hlmsManager

)

~HlmsDiskCache()

Ogre::HlmsDiskCache::~HlmsDiskCache

(

)

Member Function Documentation

applyTo()

void Ogre::HlmsDiskCache::applyTo

(

Hlms *

hlms

)

clearCache()

void Ogre::HlmsDiskCache::clearCache

(

void

)

copyFrom()

void Ogre::HlmsDiskCache::copyFrom

(

Hlms *

hlms

)

load() [1/4]

void Ogre::HlmsDiskCache::load	(	DataStreamPtr &	dataStream,
		Hlms::RenderableCache &	renderableCache
	)

load() [2/4]

void Ogre::HlmsDiskCache::load	(	DataStreamPtr &	dataStream,
		HlmsPropertyVec &	properties
	)

load() [3/4]

void Ogre::HlmsDiskCache::load	(	DataStreamPtr &	dataStream,
		IdString &	hashedString
	)

load() [4/4]

void Ogre::HlmsDiskCache::load	(	DataStreamPtr &	dataStream,
		String &	string
	)

loadFrom()

void Ogre::HlmsDiskCache::loadFrom

(

DataStreamPtr &

dataStream

)

operator delete() [1/3]

template<class Alloc >

void Ogre::AllocatedObject< Alloc >::operator delete ( void *  ptr )

inlineinherited

operator delete() [2/3]

template<class Alloc >

void Ogre::AllocatedObject< Alloc >::operator delete ( void *  ptr, const char *  , int  , const char *    )

inlineinherited

operator delete() [3/3]

template<class Alloc >

void Ogre::AllocatedObject< Alloc >::operator delete ( void *  ptr, void *    )

inlineinherited

operator delete[]() [1/2]

template<class Alloc >

void Ogre::AllocatedObject< Alloc >::operator delete[] ( void *  ptr )

inlineinherited

operator delete[]() [2/2]

template<class Alloc >

void Ogre::AllocatedObject< Alloc >::operator delete[] ( void *  ptr, const char *  , int  , const char *    )

inlineinherited

operator new() [1/3]

template<class Alloc >

void * Ogre::AllocatedObject< Alloc >::operator new ( size_t  sz )

inlineinherited

operator new() [2/3]

template<class Alloc >

void * Ogre::AllocatedObject< Alloc >::operator new ( size_t  sz, const char *  file, int  line, const char *  func  )

inlineinherited

operator new, with debug line info

operator new() [3/3]

template<class Alloc >

void * Ogre::AllocatedObject< Alloc >::operator new ( size_t  sz, void *  ptr  )

inlineinherited

placement operator new

operator new[]() [1/2]

template<class Alloc >

void * Ogre::AllocatedObject< Alloc >::operator new[] ( size_t  sz )

inlineinherited

operator new[]() [2/2]

template<class Alloc >

void * Ogre::AllocatedObject< Alloc >::operator new[] ( size_t  sz, const char *  file, int  line, const char *  func  )

inlineinherited

array operator new, with debug line info

save() [1/4]

void Ogre::HlmsDiskCache::save	(	DataStreamPtr &	dataStream,
		const Hlms::RenderableCache &	renderableCache
	)

save() [2/4]

void Ogre::HlmsDiskCache::save	(	DataStreamPtr &	dataStream,
		const HlmsPropertyVec &	properties
	)

save() [3/4]

void Ogre::HlmsDiskCache::save	(	DataStreamPtr &	dataStream,
		const IdString &	hashedString
	)

save() [4/4]

void Ogre::HlmsDiskCache::save	(	DataStreamPtr &	dataStream,
		const String &	string
	)

saveTo()

void Ogre::HlmsDiskCache::saveTo

(

DataStreamPtr &

dataStream

)

Member Data Documentation

mCache

Cache Ogre::HlmsDiskCache::mCache

mDebugStrSize

uint16 Ogre::HlmsDiskCache::mDebugStrSize

mHlmsManager

HlmsManager* Ogre::HlmsDiskCache::mHlmsManager

mShaderProfile

String Ogre::HlmsDiskCache::mShaderProfile

mTemplatesOutOfDate

bool Ogre::HlmsDiskCache::mTemplatesOutOfDate

---

The documentation for this class was generated from the following file:

• OgreHlmsDiskCache.h