The Magic Continues: A retrospective of Cinesite’s work on the classic Harry Potter films

In just ten days an expansion of the Harry Potter universe will hit theatres globally. Set in 1920’s New York, Fantastic Beasts and Where to Find Them is the first of a trilogy, following the adventures of writer Newt Scamander in New York’s secret community of witches and wizards seventy years before Harry Potter reads his book in school.

To celebrate the release of the film co-written by J.K. Rowling, expanding on her simple creature encyclopaedia of the same name, we wanted to revisit our creative journey having worked on every Harry Potter film in the series, for a total of over 2,000 shots over the 8-film franchise.

Model Magic

Cinesite’s work on the Potter films began with the physical construction of the Hogwarts models for the franchise. The principal model team at Cinesite for Harry Potter & The Prisoner of Azkaban had previously worked on Harry Potter & The Chamber of Secrets. Most of the same team had also completed the first major model build for Harry Potter & The Philosopher’s Stone.

This 1:24 scale model, with details taken from the original sets at Alnwick Castle and Durham Cathedral took 86 artists and crew members to construct the first version which was then rebuilt and altered many times for the next seven films.

The huge 1:24 scale model of the Hogwarts exterior was expanded by around 40% for Harry Potter & The Prisoner of Azkaban. Under the Production Design of Stuart Craig and Model Unit Art Direction of Gary Tomkins Hogwarts evolved, with new features including a clock tower, clock tower courtyard, the “Rickety Wooden Bridge”, hospital wing and new spires for the Durham section of the main Hogwarts building.   Minute detail on the existing models was also improved, including retexturing the roof of the main building. The newly landscaped version of Hogwarts was filmed in some sequences while it was wet, which particularly enhanced colour saturation and gave more definition and contrast.

The new courtyard and clock tower were also built in more detail in 1:10 scale; this would be particularly utilised in some major composites, which Cinesite would later undertake back at the Soho offices.

Former Cinesite model supervisor, Jose Granell, unveils a model of Hogwarts castle at the Warner Bros Studio Tour, in Watford, London, on March 1st, 2012

The model as it appears in the film Harry Potter and the Philosopher’s Stone

The clock tower model as it appears in the film Harry Potter and The Prisoner of Azkaban

Potter Portraits

For the magic, moving portrait effects, Cinesite honed techniques developed in the previous two Harry Potter films, working with shots, which required more elements and greater complexity. Original live action was filmed with blue screens covering the portrait canvass areas; contents of the pictures were filmed in separate live action plates. Cinesite’s team developed in-house motion analysis software, which would track the live action actors to the canvas and warp and wrap the movement of the picture’s surface to match its inhabitants.

Style references were supplied by the production for the “look” of the pictures, of works by Alma Tadema, Leonardo deVinci and Thomas deKeyser. These were used to affect the appearance of the subjects of the portraits, applying blocks of colour to give a painterly effect. Finally, an aged dirty varnish effect was added.

Cinesite developed in-house motion analysis software which would track the live action actors to the canvass and wharp and wrap the movement of the picture’s surface to match its inhabitants

7_fat_lady

Time Travel

One of Cinesite’s biggest achievements was the time travel sequence featured in the hospital wing during The Prisoner of Azkaban. Director Alfonso Cuaron stylistically favours long shots in his films and this was certainly the case in the Harry Potter film. Indeed, this time travel shot was over a minute long in its entirety.

Original live action of the children was filmed on a steadycam against bluescreen. Four minutes of separate background footage was also shot, including the children arriving in the hospital, and other patients being treated around them. This footage was sped up and composited behind the children. As the children turn, two other plates of background footage were tiled together to make up the hospital environment and match-moved to the foreground action. Once Hermione has turned back time, the children run out of the hospital door and down a corridor; the camera continues straight on through the workings of the clock in the clock tower, while the children run down the stairs and meet up with the camera again in the courtyard. The whole shot was treated as one continuous camera move.

The workings of the clock were all entirely computer generated by Cinesite’s modellers and animators. They were created using detailed previsualisation, which clearly demonstrated how the camera would move through the clock workings and reference textures, both supplied by the production. The production had also constructed a forced perspective set, which was used as an additional visual reference in the creation of the clock parts.

As the children run across the courtyard, you are actually looking at a composite with the 1:24 scale model. The landscape around the courtyard was created as a digital matte painting, mapped onto a 3D model.

In the reverse of the previous shot, the children run back up through the tower to the hospital wing, to meet themselves as they turn back time. Inversely to the previous shot, we begin in the courtyard, rising up the outside of the clock tower building, through the clock face, through the workings of the clock and meeting up with the children again as they run down the corridor towards the hospital wing.

Cinesite’s time travel sequence was featured in the hospital wing during The Prisoner of Azkaban.

harry-time-travel

Magical Environment 

Some of the most beautiful and memorable shots in the Harry Potter films are the external sweeping panoramas of the Hogwarts environment. In The Goblet of Fire, Cinesite composited motion control footage of its 30-foot model of Hogwarts with tiled photographs of Scottish Lochs and mountains, which were stitched together to create a spectacular digital matte painting.

Hogwarts School of Witchcraft and Wizardry

Many memorable internal Hogwarts scenes were also created, including the highly recognisable multitude of candles hovering in the Great Hall. Using techniques established early on in the Harry Potter films, five candle models were created and replicated. Automated systems were written to position the candles in spirals at varying heights above the tables, maintain appropriate scale, and loop the flame flicker animation, all with a convincing sense of randomness. Depth passes and light directional passes were created to get the right depth of focus.

The iconic staircases were also a regular feature within Cinesite’s work. The great marble staircase where a large portion of the action in The Deathly Hallows Part 2 takes place, was built as a very large CG asset that could appear in many scenes throughout the film at different times of day, and also be destroyed. The staircases were featured in the earlier films; sometimes with rotating steps, but in the last instalment it became much larger, extending into the distance within a very large environment.

staircase-1

Percy Weasley leading Hogwart’s first-years to Gryffindor Tower in Harry Potter and the Philosopher’s Stone

staircase-2

Away from the school of witchcraft and wizardry Cinesite rebuilt the set for Godric’s Hallow (The Deathly Hallows Part 1) in CG; as well as 2D and CG set extensions, full CG environments and CG snow were also created for this scene. The team additionally created the environments for the Windswept Hill sequence (in The Deathly Hallows Part 1), which involved shooting terrain and using photographs of Malham Cove in Yorkshire and compositing them into the digital scene.

Cinesite created the scenes of Harry and Hermione’s camp on the limestone pavement at Malham Cove by shooting terrain and using photographs to compositing them together for the digital scene

The Patronus Doe

The Patronus doe appears in Harry Potter and The Deathly Hallows Part 1 in the form of a light expanding into a semi-formed character. To achieve the effect, Cinesite generated a fully rigged photo-real animated cg doe.

Cinesite’s Patronus doe appears in the film in the form of a light expanding into a semi-formed character

24_cinesite_deathlyhallows_pt1

Ghosts

As any avid reader of the Harry Potter books will know, many ghosts inhabit Hogwarts. Cinesite created effects for many of these ghosts, including the two knight’s, who dramatically charge through a large window outside the Great Hall, and perhaps most famously Dumbledore’s ghost. To create this effect, Cinesite used a clean plate of the corridor in which Dumbeldores’s ghost appears and a green screen plate of Sir Michael Gambon. The team generated a digi-double from texture stills and a cyberscan of the actor, and match-moved and projected Gambon’s green screen performance onto the model. The digi-double was also used to drive particle simulations and colourise the particles so that they could be blended seamlessly back onto the digi-double. Cinesite generated around 150 million individual particles as well as a model of the corridor, in which the ghost appears to use for particle collisions.

12_cinesite_deathlyhallows_pt1

Cinesite created Albus Dumbledore in a ghost-form providing security for 12 Grimnauld Place

Voldermort’s Snout

As one of the film’s lead characters, Voldemort’s looks and performance were critical to the story. Cinesite was responsible for replacing actor Ralph Fiennes’ nose area with Lord Voldemort’s snake-like snout in ‘The Deathly Hallows Part 1’, and carried on with the task in ‘The Deathly Hallows Part 1’. Artists completed about 130 such shots in part 2, contrasting with only about 50 in part 1. The same nose asset was used, but with a much larger team to track and light the shots.

Voldemort’s head was built from a cyberscan of the actor’s head. Cinesite’s artists cleaned up the geometry and generated a very detailed displacement to achieve enough detail to represent small wrinkles and pores. As they were replacing part of a main actor’s face, they had to make sure the matchmove was completely accurate to keep the integrity of the actor’s performance. To achieve such a precise matchmove, the team built the rig with three layers of animation controls. This allowed them to make full use of the tracking markers that were attached to his head, while still having enough flexibility to animate as needed.

To generate the snake nose, a proprietary skin shader tool was developed to allow the team to render out with Renderman. They generated textures by using a set of photographs shot using cross-polarised and non-polarised lights and lenses, which allowed them to extract highly detailed pore maps, to be used for bump and specular passes. The team also used a multi-level subsurface scattering algorithm to enhance the photorealistic look.

Cinesite replaced Ralph Fiennes’ nose area with Lord Voldemort’s cg snout throughout part 1 & 2 of The Deathly Hallows

The Magic Continues 

Cinesite is very proud to have worked on every film in the Harry Potter series, and cannot wait for audiences to see a little more of our VFX magic when Fantastic Beasts and Where to Find Them hits theatres worldwide on the 18th November. Until then, here’s the VFX-filled trailer

  • Release date: 18.11.2016
  • Studio: Warner Bros.
  • Director: David Yates
  • Cinesite VFX Supervisor: Andrew Morley

fb-poster-1

 

Categories: