Screen Replace

For this project, I replaced the screen on an iPad and matched it to the user's finger movements as they browsed a website.

 

I used After Effects in tandem with Mocha, relying on Mocha for both rotoscoping the hand and creating a planar track of the screen. The track was more complex than usual since the hand passed in front of the screen.

 

On set, they originally planned to use a bright green screen on the iPad to key it in Post, but I asked for them to also shoot a version with the screen turned off. This gave me clean reflections that I reintegrated using a screen blend mode, which helped sell the realism.

 

I animated the screen to react to finger swipes, using images of the updated website that hadn't gone live yet. Since the images were the wrong aspect ratio, I had to stretch them with the "ctrl+alt+F" shortcut, pre-comp them, and apply corner pinning to the pre-comp instead.

 

I’ve done a lot of screen replacement, so this wasn’t a huge challenge, but getting those web images to behave cleanly within the perspective and motion required some extra problem-solving.