Captioning Sound Effects in TV and Movies

June 18, 2020 BY ELISA LEWIS

Julia child

The first electric television was invented in 1927. 44 years later, captions were introduced to TV programs. 

In 1972, Gallaudet University, American Broadcasting Company (ABC), and the National Bureau of Standards presented the technology needed to make television shows accessible with captions. The first program to officially broadcast with captions was “The French Chef” with Julia Child, airing across the U.S. on PBS. 

Since then, captions have become a legal mandate for broadcast media and an integral part of the enjoyment of media and entertainment. 

Captioning Best Practices for Media and Entertainment

What are Captions?

Captions are a textual representation of the audio within a media file. They make video, like TV shows and movies, accessible to the deaf and hard of hearing communities by providing a time-to-text track as a supplement to, or as a substitute for, the audio. 

While the text in a caption file mostly contains speech, captions also include non-speech elements like speaker IDs and sound effects that are critical to understanding the plot. 

In many parts of the world, captions and subtitles are used interchangeably – like in countries in Europe or in Latin America. However, in the United States, there’s a clear distinction between captions and subtitles. 

Captions assume the viewer cannot hear and they are often dictated with a “CC” icon on video players or remotes. On the other hand, subtitles are for hearing viewers who don’t understand the language of the show or film. Unlike captions, subtitles don’t include the non-speech elements of the audio. 

In the next section, we’ll dive into how to caption sound effects, a non-speech element and an important component of captions. 

Captioning Sound Effects

TV flashing a CC icon

The Described and Captioned Media Program (DCMP) is funded by the U.S. Department of Education and administered by the National Association of the Deaf. Their mission is to “promote and provide equal access to communication and learning through described and captioned educational media.” 

The DCMP provides a set of guidelines on captioning best practices. One guideline in particular touches upon caption quality. It states that captions should be accurate, consistent, clear, readable, and equal. Under the “clear” section, it specifically states that captions need to be a complete textual representation of the audio, including non-speech information, in order to provide clarity. 

According to the DCMP, sound effects are sounds in a TV program or film other than music, narration, or dialogue. Sound effects are captioned if it’s necessary for understanding and/or enjoyment of the media. 

When it comes to sound effects, there are a number of best practices to keep in mind as to not distract or disrupt the viewing experience for viewers. Let’s jump in! 

 Captioning Best Practices for Media and Entertainment ➡️ 

➡️ When describing sound effects, it should include the source of the sound in brackets. The only time you may exclude the source sound is when it can be clearly seen on screen.

 

with source sound: soccer player scores a goal. The caption reads "audience cheering". without source sound: cloud of smoke. Caption reads "explosions"

➡️ A described sound effect can be combined with an onomatopoeia (the formation of a word from a sound associated with what is named). The described sound effect should be the first line of the caption and separate from the onomatopoeia. In addition, the described sound effect and the onomatopoeia should be lowercase.

 

A bee lands on a flower. The captions reads bee buzzes. Buzz

➡️ When a sound effect happens off screen, it should be italicized, if italics are available.

 

person holds a set of keys. Caption reads "keys jangling"

➡️ Place the description of the sound effect as close as possible to the sound source. 
➡️ For offscreen sound effects, it’s not necessary to repeat the source of the sound if it’s making the same sound a few captions later. 

 

first image is a pig in a pen. Caption reads "pig squealing". Second image is the same pig on a field. Caption reads" squealing continues".

➡️ When indicating the speed or pace of a sound effect, always use punctuation.

 

doorbell ringing. Repeated words: [doorbell ringing] ding, ding Two different words: [doorbell ringing] ding-dong

➡️ When describing a sustained sound, use the present participle form of the verb. When describing an abrupt sound, use the third person verb form.

 

Sustained sound: [dog barking] woof, woof...woof Abrupt sound: [dog barks] woof

➡️ The only time when it is necessary to caption background sound effects is when they are essential to the plot.

  • For example, it’s not necessary to caption a driving car if it has nothing to do with the plot, but if an important character drives into the driveway and it plays into the plot, it should be captioned 
➡️ Whenever possible, be sure to use specific, rather than vague or general terms, to describe sound effects.

two images of a robin. The first general captions reads "bird singing". The specific caption reads "robin singing"

➡️ When indicating the speed or pace of a sound effect, always use punctuation

 

Slow: [clock chiming] dong...dong...dong Fast: [gun firing] bang, bang, bang

➡️ Captions are synchronized with the sound, therefore, they should always be used in the present tense. Never use the past tense when describing sounds.

For more information on captioning sound effects and other non-speech elements, visit the DCMP website.

Legal Requirements for Captioning TV and Movies

Aside from enhancing the viewer experience, broadcast media companies caption their media to comply with the FCC. 

The Federal Communications Commission, otherwise known as the FCC, regulates interstate and international communications, including in the analog and digital spaces.

Closed captioning was mandated by the FCC in the early 1980s as a requirement for broadcast TV to make it accessible to all audiences, including people with hearing loss. There are about 466 million people with hearing loss worldwide according to the World Health Organization, and when media is not captioned, millions of people cannot access and enjoy media. 

Now that online video is becoming increasingly popular, the 21st Century Communications and Video Accessibility Act (CVAA) was enacted to ensure that online video content is made accessible. 

Under the CVAA, all online videos that previously aired on TV in the U.S. with captions must include captions when published on the internet. This includes clips and montages. 

In order to comply with the law, TV and movie broadcasters must ensure that they provide captions for their media and that non-speech elements, like sound effects, are captioned as well. 


Closed Captioning Best Practices for Media and Entertainment. This white paper goes into depth on closed captioning best practices, standards, and legal requirements for the digital distribution of TV and film. It focuses on the technical standards preferred for caption delivery, encoding, styling, and onscreen placement, as well as industry trends and converging universal standards. Download the ebook