Everything you ever wanted to know about HFR and The Hobbit

An editorial by Tim Dashwood

Hobbit HFR 3DThe Hobbit has finally been released in 2D and 3D at the traditional 24 frames per second (fps) as well as 3D High Frame Rate (HFR) at 48 fps. If the posts on social media are a fair indication, it seems that audiences have not reacted as positively to the 3D HFR version as the industry had hoped. Why not? Industry leaders like James Cameron, Douglas Trumbull and Peter Jackson have been been telling us why HFR is a better choice for 3D (and 2D) by overcoming one particular technical issue that may cause viewer discomfort, and they are absolutely correct in that respect. However, HFR will not solve all the potential eye-strain problems associated with a 3D presentation, and the film-going public has become accustomed to the aesthetics of 24 fps as a key contributor to the cinematic look of their favourite films. To most, the hyper-realism of 48 fps seems like a strange intruder in the context of an epic fantasy film like The Hobbit. Battle-lines are being drawn between the technical improvement of HFR and the aesthetic “feel” of the traditional 24 fps film standard.

 

Why haven’t we always used a higher frame rate than 24 fps for cinema?

Historically, 24 fps came about at the dawn of “talkies,” when previously the usual frame rate of silent films was only 14-18 fps. 24fps was the minimum speed required to successfully play back sound tracks in sync. When you consider that a 1000 foot roll of 35mm film only represents about 10 minutes of screen time, is expensive to purchase and process, it makes logical sense that the studios would want to use as little as possible and therefore made the choice to standardize the slowest frame rate necessary for sound. Scientifically speaking, humans’ threshold for fps approximating real life is about 50 or 60 fps, so the unintentioned side effect of 24 fps is the ‘other worldly’ sense that a film is a cinematic experience and not real life.

The slow frame rate had no ill-effects in the infancy of film because the camera was typically wide and stationary. However, when filmmakers like G.A. Smith, Giovanni Pastrone, Allan Dwan and D.W. Griffith started moving the camera, it became apparent that, because of the flicker and low frame rate, slow controlled “push in” or “pull out” moves were far more pleasing to the viewer than fast pans or side-to-side dolly moves.


A shot from Giovanni Pastrone’s “Cabiria” (1914), largely considered to be the first film to use controlled dolly moves, and a major inspiration for similar moves in D.W. Griffith’s epic “Intolerance.”

The bump up from 18 fps to 24 fps didn’t help very much with this issue and soon pan speed charts were published by organizations like the American Society of Cinematographers.

ASC Manual Pan Speed Chart

One of the pan speed charts found in the ASC Manual. (8th edition shown)

These charts are still published in the ASC manuals and professional cinematographers still refer to them. If I reference a typical example in the ASC chart I see that a 90 degree sweep of a static scene at 24 fps with a 35mm lens should not be performed in less than 18 seconds (whip-pans being the exception). However, the same pan with the same setup at 48 fps can be performed in half the time at 9 seconds.

There are always exceptions to these ‘rules’ but the point is that it makes logical sense to shoot and project at a higher frame because it frees the filmmaker to shoot faster pans with less “judder” and faster action with less motion blur.

Douglas Trumbull created an HFR 60 fps system a long time ago called Showscan, but it never took off for mainstream production because of the inhibitive costs associated with all of that film. Filmmakers have always had to find ways to fit their creative requirements within the technical limitations of the medium. HFR digital acquisition is supposed to remove one of those limitations, but it can only truly do that if HFR is also used in digital projection.

The technical limitations of the medium are even more restrictive when working in stereoscopic 3D (S3D), especially when it comes to frame rates. The S3D illusion requires parallax points for each object in the scene to be visible to each eye, which is almost impossible in scenes with fast movement (like sword fights) where key parallax point practically disappear due to motion blur. When panning in S3D the brain must work even harder to link the images from the two views and the judder effect is compounded further by current S3D projection technology.

If you have the chance to watch both 24 fps and 48 fps HFR versions of The Hobbit you will see feel the eye strain in the large and fast sweeping shots at 24 fps, but it will feel smooth and effortless at 48 fps.

Knowing how higher frame rates can improve this important aspect of S3D and free filmmakers constraints, it makes sense from a technical perspective that the S3D industry would push for higher frame rates, especially now that digital acquisition and digital projection remove many of the financial detractors. But will audiences accept the radically different look and feel for narrative films like The Hobbit, or is it better suited for nature documentary, concerts, theatre, theme parks and sports? Frame rate plays a big role in the psychological perception of what we are watching.

24p (left) vs simulated HFR
(48fps synthesized by Luke Letellier)
[Watch only on a computer or HDTV monitor with at least a 60Hz refresh rate]

 

The “Video Look” and why most audiences dislike it for drama.

Even though the 2012 hype around HFR makes it seem like something new, anyone who has ever watched television is already very familiar with the temporal quality and ‘feel’ of video acquired and broadcast at 50 or 60 interlaced fields per second. European HDTV viewers and American HDTV viewers of Fox or ESPN are already familiar with the look of 60 frames per second HD broadcasts. We have become accustomed to soap operas, news, sports, game shows, reality TV and low-budget drama being shot and broadcast at 50 or 60 fps. Films, sitcoms, music videos and TV drama are typically acquired at 24 fps are still broadcast at their original frame rate (via 2:3 pulldown in 60i or 25p in 50i).

At the time when television standards were being established, broadcast frame rates were chosen for practical purposes. Television systems needed some sort of timing clock and the simplest engineering solution at the time was to use the common AC power frequency. Therefore 60Hz for North America and 50Hz for Europe.

Since the early TV camera tubes had to scan the frame electronically over time (instead of exposing all parts simultaneously as with film) it was impossible to pan or capture fast movement accurately without apparent tilting or the “jello” effect, an issue modern digital filmmakers are all-too-familiar with in CMOS rolling shutters. The solution to the problem was to scan the even and odd lines in the frame at separate times, which minimized the effect. Hence 60 “interlaced” fields per second = 30 frames per second. The temporal ‘feel’ was still equivalent to 60 frames per second so there has always been a distinctive difference between 24 fps film and interlaced video.

DVX100

The Panasonic DVX100B

Our association with certain types of programming and the frame rate is something we cannot easily shake. Aspiring filmmakers want their films to look like professionally produced films. There are many things that constitute the look of a professional film like lighting, camera moves, lenses, acting, and set design, but the overwhelming factor is always the frame rate. In the 90’s popular “Filmlook” processes and best-selling software like Magic Bullet approximated the look of 24fps from interlaced video.
Low budget productions who couldn’t afford to shoot on film were desperate to give their interlaced video the film look. Therefore it was no surprise to me when Panasonic first introduced the DVX100 camera (the first DV camcorder capable of acquiring in 24 progressive frames per second) it quickly became one of the best selling camcorders of all time. The “digital revolution” then followed with pro-consumer HD camcorders like JVC’s HD100 and then Canon’s 5DMkII, as well as the professional digital offerings with Super-35 sized sensors. In fact, 24p acquisition is now so popular that it is almost impossible to purchase a professional or consumer camcorder without the feature. This suggests that we really do love the look 24fps, especially for our narrative storytelling.
However, it is interesting that as soon as 24p was available to the masses via digital video, lots of complaints about “judder” started to surface. Suddenly an issue professional cinematographers had always effectively dealt with was thrust upon the amateur videographers who likely did not have access to panning speed charts. Unfortunately the term “judder” became the primary talking point for an anti-24p movement and before long all the major TV manufacturers were adding “smooth-motion” circuits to HDTVs, which created new morphed in-between frames to overcome the supposed “problem” of 24 fps.

 

Will audiences eventually accept HFR as a cinematic medium for narrative storytelling?

Just before Siggraph 2012 I was invited by SIRT to help plan a test shoot to compare 24, 48 and 60 fps acquisition at different shutter angles for S3D. This test footage was shown by Christie at Siggraph alongside James Cameron’s tests. During the planning stage we watched James Cameron’s HFR comparison tests where he convincingly made the argument for HFR as a solution to all of S3D’s problems. I personally wasn’t impressed with the look. The HFR dinner scenes felt to me like BBC teleplays from the 80’s and the sword fight felt slow, theatrical and rehearsed. However, my most interesting observation was that even though most of us “old guys” in the room disliked the temporal feel of the HFR, the film students in the room (most born in the 1990’s) all seemed to prefer the HFR. This sort of makes sense considering that generation spent its formative years in the age of disposable media and YouTube, where the art of the photography or lighting doesn’t matter as much as the immediacy of the content. So maybe it’s simply a generational thing and after some time HFR will be easily accepted by the masses? As I mentioned before, I personally think that the hyper-realism of HFR is perfectly suited to nature documentary, theatre, concerts, theme parks and sporting events, but not necessarily to narrative storytelling.

Cirque Du Soliel Worlds Away 3D

Worlds Away 3D

With this in mind, I can’t figure out why the proponents of this technology have taken such a huge risk of public backlash by choosing to feature The Hobbit as the worldwide introduction to the format instead of the James Cameron produced S3D film “Cirque du Soleil – Worlds Away 3D” coming out next week.
It was apparently acquired in HFR and with the dynamic fast motion of the Cirque performers it would have been the perfect application and introduction to HFR technology, but I can’t find a single HFR screening of the Cirque du Soleil film at any of my local theatres. They unfortunately are all in 24 fps.  I remember Cameron demonstrating footage from the film in HFR within the last year, so I can’t figure out why they didn’t jump on the opportunity to release it now in HFR?

I certainly hope Cameron’s Mariana Trench film will be easily accessible in HFR 3D because it will be the closest any of us will ever get to experiencing “being there” from the comfort of the cinema. Another perfect application for HFR.

 

The best approach for the future.

Higher frame rates are freeing for the filmmaker only if the projection is guaranteed to also be in HFR. In the case of The Hobbit, the film is still being released in 24fps 2D and 3D formats so it was still necessary for the filmmakers to consider the lower frame rate, somewhat defeating the purpose of the HFR. Unfortunately there are many fast sweeping shots in The Hobbit that are simply too fast for 24 fps, but look great in the HFR version. 48fps was chosen instead of 60 because it is simply doubles the normal frame and makes pulling a 24 fps master very easy, but it will not be easy to adapt it to 50i/p or 60i/p broadcasts. (Current limitations in the Red Epic’s HDR mode may have also played a role in the decision.) Also, using no shutter (360 degrees) in digital 48 fps acquisition is equivalent to the exposure time of standard 180 degree shutter in 24 fps, so the acquisition frame rate of the 24 fps master will be indistinguishable and the exposure unaffected.

In an ideal world I think I would use 24p wherever possible for a narrative production and a higher frame rate on certain shots when necessary. This method would also be easy to accomplish in almost any modern non-linear editor on a 60p timeline.  In fact, Douglas Trumbull has already been developing this method by acquiring at 120 fps for a 60 fps master that can contain 24 fps with pulldown.

It seems to be a good idea on paper, but of course the exposure time per frame becomes much shorter at 120 fps, which affects the lighting plan and apparent motion blur. Motion blur can be synthesized in post, but directors of photography never want to give up exposure, especially when working with 3D rigs. Imagine how fast a slow motion shot would need to be overcranked at 60 fps!

 

What about the 3D quality of The Hobbit?

The stereoscopic 3D execution in The Hobbit is not perfect, with numerous stereo window violations and some depth map/inversion errors on dimensionalized VFX shots. These are issues that left me with strained eye muscles (specifically in my right eye), and cannot be remedied by viewing the HFR version. However, overall the film has many good S3D moments and the visual effects (in 24 fps) are spectacular, but they start to show their seams at 48 fps. The stellar score ties it in well with LOTR and it has everything a Tolkien fan would expect from a Peter Jackson film set in Middle Earth.

The proponents of HFR for The Hobbit will say things like it creates a “window in to the real world”, but I don’t want my favourite fantasy hobbits, dwarves, orcs, trolls, goblins, wizards and elves to be in my reality, I want a window into the fantastical Middle Earth, which to me is always in 24 fps.

I personally recommend to all my friends to see it in 24fps first in a Digital IMAX 3D presentation because you will get the added bonus of the exclusive preview of the first 9 minutes of the next Star Trek sequel. Save HFR 3D for your second viewing. I’m glad I did.

Tim Dashwood is the founder of Dashwood Cinema Solutions, a stereoscopic research, development & consultancy division of his Toronto-based production company Stereo3D Unlimited. Dashwood is an accomplished director/cinematographer & stereographer and a member of the Canadian Society of Cinematographers. His diverse range of credits include music videos, commercials, feature films and 3D productions for Fashion Week, CMT, Discovery Channel and the National Film Board of Canada. He also consults on and previsualizes fight/stunt action scenes for productions such as Kick-Ass, Scott Pilgrim vs the World and Pacific Rim. Dashwood is the creator of the award winning Stereo3D Toolbox plugin suite and Stereo3D CAT calibration and analysis system.

10 Comments for Everything you ever wanted to know about HFR and The Hobbit

  1. Rodney says:

    Great article… Seeing the Hobbit in IMAX 3D doesn’t necessarily get you a sneak peak at the Star Trek movie. 15/70 Film IMAX 3D theatres are playing the Hobbit at 24 fps but don’t have Star Trek. The film prints are too long and leave no extra room for Star Trek. Seeing The Hobbit in a Digital IMAX will get you the 9 minutes of Star Trek but might be showing the Hobbit at 24 fps or at 48 fps depending on the theatre. There are quite a few options.

  2. Tim Dashwood says:

    Thanks Rodney. I didn’t know they had done a 15/70 version. I’m surprised 2 hours and 50 minutes of 3D 15/70 will fit in a projection booth! I added “Digital” in front of IMAX. My understanding was that all of the IMAX presentations were at 24 fps. Only specific HFR presentations are at 48fps.

  3. Rodney says:

    The film prints go right to the edge of the larges IMAX platters. When Avatar came out they modified the platters to hold just a little bit more film. The same modified platters are being used on the Hobbit.

    http://www.hollywoodreporter.com/news/hobbit-an-unexpected-journey-imax-401724

    http://www.imax.com/corporate/media-coverage/high-frame-rate-theatres-playing-the-hobbit-an-unexpected-journey/

  4. Brad Carvey says:

    I saw the Hobbit without knowing about the higher frame rate.

    I was distracted and still don’t know if I liked or hated the movie. I wished that I had been aware of the HFR and initially saw the film in 24 fps. The movie just felt “Wrong”. It seemed like the lighting was too uniform and bright. It seemed to lack dynamic range. Some scenes felt too Crisp. Regardless, I didn’t enjoy the movie.

    I am a fan of higher frame rates, but it seem like the Hobbit had issues beyond just higher frame rates.

    Brad Carvey

  5. Denise Quesnel says:

    Hi Tim, good to see you writing this article. I had the same feeling about the Cameron Medieval scenes- it wasn’t as much the HFR as the bad costumes, over acting, staging etc. They also deliberately roughed up dolly moves (no motion control, all push) to influence the HFR effect. We didn’t see you in Toronto but we got to see the clips you worked on with SIRT, and we also presented our research and a short film in variable HFR (shot on the Red Epics). You mention the use of HFR in shots as needed for aesthetic purposes, so you might be really interested in seeing our variable HFR work : http://www.s3dcentre.ca/projects/hfr-high-frame-rate-research

    I enjoyed The Hobbit for the most part in HFR but I found the colour timing, 3D and story to be problematic at times. More so than the HFR look. Thanks for the article, looking forward to hearing more of your thoughts on the topic.

    Cheers,
    Denise Quesnel

  6. Bob says:

    My local AMC 16-plex in Burbank is advertising the Hobbit as being in “High Frame Rate – IMAX 3D.”It is a Digital IMAX theater. Haven’t seen it yet, but will report back when I do.

  7. Chuck Braverman says:

    I saw the Hobbit at my local AMC running not in Imax, but in HFR and 3D. I don’t think the HFR enhanced the fantasy. There is a subtle difference looking more like video HD. Your article was very good but does not mention persistence of vision which is what is missing at 48 fps. I saw Doug Trumbull’s 60 FPS Showscan years ago and was very excited about the super realism it displayed. But when you want to go into a film that is fiction, I believe 24 fps will and should continue.

  8. Jesse Blanchard says:

    I was surprised when I sat down to watch the Hobbit and up on the screen in the theater was a Mac Desktop with VLC player, something I had never seen in a commercial theater before. They started the previews and they were awful. The stereo was not fusing, ghosting, everything. Long story short, we had gone to the fanciest theater in town to see HFR 3D, the theater had a technician flown in, and still it was not set-up correctly. We ended up seeing a later show were the 3D was correct but the top and bottom of the screen was cut-off. My point is, correct implementation is still a big problem. I sat there thinking, “How many people are going to watch this movie incorrectly calibrated and have a terrible HFR experience?” I don’t know how to solve this problem but public opinion has to be taken with a grain of salt, who knows what their experience really was.

  9. Sareesh S says:

    Brilliant review, Tim. The best one yet. I personally enjoyed 48 fps – people have seen video on TV. Watching it on a big screen is something else! I’m sure people will find out ways to use this ‘presence’ for dramatic effect.

    Peter Jackson can’t get everything right the first time, so one shouldn’t judge its (HFR) potential by his effort. I’m all for 60 fps now!

  10. Jay Webster/WPI says:

    Great info on the evolution of film and video frame rates all in one article!
    Good job Tim!