Replacing Broken and Cracked Wall in a Live Action Footage Using 3D Tracking
February 22, 2016 - Uncategorized
1. Importing the Footage
Open After Effects.
Press Ctrl-N to open Composition Settings window. Create a
new composition as Final of 6 second duration and the frame
resolution as 720/576.
Press Ctrl-I to open the Import File window. The live action
footage is in image sequence. Select the first frame, turn on the JPEG
Sequence option and click on Open.
Drag and drop the image sequence in the timeline. You can see the image
sequence as the video in the comp/monitor view.
2. 3D Tracking
With the image sequence layer selected, go to Effect > Perspective
> 3D Camera Tracker.
As soon as you apply the 3D Camera Tracker effect,
the system starts analyzing and solving the footage. You can see the progress
in the comp view.
Once the tracking is done, you get several track points on the footage.
These track point would help to generate the dummy 3D plane/null for
linking and the camera. You need to select at least four points to generate the
helping dummy or layer.
Select four corner track points of the photo frame as
shown in the following image.
With the four corner points selected, secondary-click the mouse and select Create
Solid and Camera.
You get a 3D solid layer and 3D camera in the timeline. This solid layer is
the placeholder and sticks with the footage and follows the camera.
With the solid layer selected, go to Effect > Distort > Corner Pin.
With the upper left corner pin selected, drag and put it to upper left
corner of the photo frame.
With the upper right corner pin selected, drag and put it to
upper right corner of the photo frame.
With the lower left corner pin selected, drag and put it to
lower left corner of the photo frame.
With the lower right corner pin selected, drag and put it to
lower right corner of the photo frame.
Due to tracking and the adjustment of the corners of the
solid layer, the solid layer keeps the photo frame covered throughout the
3. Applying Track Matte
Keep the solid layer above the photo frame video layer. With the photo
frame video layer selected, go to Track Matte tab and select Alpha
This action eliminates the rest of the portion of the video but the photo
frame throughout the video. There is no need to make any mask or do rotoscopy.
4. Cracks and Broken Wall Compositing
I’ve made a crack image which I’ll composite in the scene. I’ve imported the
crack image file in the main comp.
Turn on the 3D option of the crack file. Copy the Transform
and Corner Pin properties of the solid layer and paste them in the crack
Increase the Scale of the crack layer so that it appears from the
back of the photo frame layer.
Put the photo frame video footage in the background.
Change the mode of the crack layer to Multiply. Now the crack looks
the part of the footage.
Create a new composition. Rename this composition as Broken Wall.
I have an image of brick wall. I’ll import that image in the new Broken
With the help of Pen tool, make a small mask around the wall.
Import the crack image file in the main comp. Turn on the 3D
option of the Broken Wall layer file. Copy the Transform and Corner
Pin properties of the solid layer and paste them in the Broken Wall
Put the Broken Wall layer above the Crack layer. Increase the
Scale of the wall layer so that it appears from the back of the photo
Press the Play button and you will see the crack and the broken
wall are perfectly matching with the scene.
The End Result
Track Matte is a great technique in After Effects. It saves huge amount of rotoscopy time. With the help of 3D tracking technique in After Effects, it can work wonders.
Source: Photoshop | Tuts