13: Internal Chroma Keyer

Composure Compositing

Internal chroma key overview

Unreal provides two methods for internal chroma keying:

• A single pass chroma key material.
• A multi pass chroma key with the plugin Composure.

The recommended method for Prime VSAR is the chroma key based on Composure.

For more information about Composure, go to https://docs.unrealengine.com

 

Setup

There is a dedicated UI in order to create all the necessary assets needed.

In the Content Browser, right-click to show the contextual menu, go to PRIME VSAR category and select Chroma Keyer Comp.

You can optionally select assets to create along and link them to the comp.

If it is the first Chroma Keyer Comp created, It is recommended to check all options in order to also create and link all necessary assets. The MediaPlayer will also automatically play the MediaSource in this case.

Assets created when all options are checked, the main asset named ChromaKeyer.

Drag and drop the asset ChromaKeyer in the level.

Parameters

Input

1. Select a Media Texture as the input (it is already set if the option to create a Media Texture was checked previously).
2. Then go under Composure > Transform/Compositing Passes > Transform Passes.

Multi-pass chroma keyer

1. Select the key colors with the color picker.
2. Multiple key colors can be added but be aware that each color picked adds an additional rendering pass.

Despill

1. Select the key colors with the color picker .
2. Multiple key colors can be added but be aware that each color picked adds an additional rendering pass and thus increasing demands on performance.

 

Image description: ‎Despill off

Image description: ‎Despill on

Erode

Erodes outline of the keyed subject, useful for removing spilled color on hair ouline.

Crop

Normalized crop from each side in range [0-1]

The alpha channel can be cropped as a garbage matte.

Output

The output resolution is adjustable, it should match the input’s resolution (FHD by default).

Billboard for Chroma Key

The result of the chroma key is rendered to a Target Texture. This texture can be used in Material to apply on geometries. For the Trackless solution, we are displaying the texture on a billboard (i.e. a plane always facing the camera).

There are multiple ways to create a billboard in PRIME VSAR.

• Unreal Engine’s native Component “Material Billboard”
• PRIME VSAR’s Billboard Actor
• Matte plane

PRIME VSAR’s Billboard Actor

From the menu “PRIME VSAR Tools”, drag and drop the Actor “BillboardPlane” in the level.

Image description: PRIME VSAR Tools menu

Select the Actor and choose a “Target”, (the Object the plane should “look at” typically the Cesium Camera and choose the Texture from the Chroma Key as the “Input Texture”)

Billboard Plane does only rotate towards camera on the Z axi (Yaw), It does not Pitch towards the camera.

Matte plane

Plane directly attached to cesium camera,

See the Setup guide for information about matte plane parameters.

Setting for Matte plane can be changed in when clicking on cesium camera in the Matte plane section or in the VSAR Config → Cameras section

Enable with the checker box “Matter Plane Enabled”

Create material from the RenderTarget

Right click on the RenderTarget for the chroma key and click “Create Material”
‎

Open the material and set the blend mode to Translucent | Masked
‎

Plug the A (alpha value) from the Texture sample to the Opacity | Opacity Mask
‎

(Optional step) set the “Shading Mode” to Unlit and plug the RGB from the Texture sample to Emissive color - this might be something that you want to make the Matter Plane not get affected by the lighting in level.
‎

Assign this new material to “Matte Plane Material”
‎

To set up shadow in the matte plane material when using translucent blend mode:

In the advanced section of the material section, enable “Cast Dynamic shadow as Masked”
‎

To set up reflection for matte plane with AR Plane:

Add Cesium camera actor itself into “Objects in Foreground” in Cesium camera details.
‎