Game Audio Project Management (Part 4: Sound Design)
Introduction
Sound design in video games is a crucial aspect that brings a virtual world to life and enhances the player's experience. It encompasses various elements such as environmental sounds, foley effects, and spot SFX, which provide feedback and notifications to players, as well as being a gameplay feature. The use of sound can range from providing realistic and immersive audio that players expect to hear when interacting with the game's environment, to giving insight into a character's mindset, evoking an emotional response from the player and providing useful feedback. A prime example of this is the focus mechanic in The Last of Us (2013) or the Focus Hearing Tutorial (2014) which uses sound to give players an advantage in gameplay. Furthermore, sound design can also include the use of audio middleware such as WWISE and FMOD to create adaptive audio events, allowing for dynamic changes in sound based on player actions and performance. This type of adaptive sound design is commonly used in sports games such as FIFA and NBA, as well as other games such as Black Box VR, where the crowd's reactions are linked to the player's actions and performance. A skilled sound designer can manipulate sounds in a way that evokes an emotional response from the player and adds to the overall immersion of the game.
Sound Design Approaches
Audio Middleware
Audio middleware is an essential tool for sound designers in the video game industry. It allows for the creation of game events, the manipulation and control of these events, and provides an intuitive way to mix and balance game sounds. While not necessary, audio middleware can make it much easier and less time-consuming to produce complex audio systems in game engines like Unity or Unreal. Unity, in particular, can be quite challenging for sound designers as it requires a lot of coding, whereas Unreal has some built-in audio tools like MetaSounds and Blueprints that are more accessible for those with a non-coding background.
It's worth noting that audio middleware is often free for smaller indie projects, but a licensing fee may be required for larger-scale projects. Therefore, it's important to read the terms and conditions carefully, as a license is required regardless of the project's scale.
VR Spatial Audio
When working in VR, it is important to consider the implementation of a binaural audio plugin to produce a more realistic 3D sound representation. There are several popular options such as Resonance Audio, Valve Software and Oculus, which can be integrated into the audio engine or audio middleware to extend audio functionality. One of the benefits of these plugins is the ability to play back Ambisonic files, which allows for more precise spatial placement of audio in the virtual environment.
For example, at Black Box VR, I used Google Resonance in FMOD to design crowd chants for different sized arenas from the player's perspective. In a DAW, I was able to place the crowd around the player in a way that changes depending on the size of the arena. The advantages of using Ambisonic files in this way include the ability to nest and synchronize the crowd chants with the adaptive music system, resulting in a more immersive experience for the player.
An alternative approach would be to place multiple crowd chant audio emitters around the player, but this can lead to synchronization issues between the audio and music systems. In VR, it is essential to be able to turn your head and hear the crowd's placement in the environment, which is why using Ambisonic files and binaural audio plugins can provide a more immersive and seamless experience for the player.
Licensing SFX
Licensing sound effects (SFX) can be a cost-effective and efficient way to enhance the audio experience in a game or other project. Companies like BOOM Library and Soundsnap offer a wide range of sound libraries that can be licensed for use in various projects. These libraries often include themed sound effects, such as nature sounds, city ambience, and more.
When working with a sound designer, they will often manipulate, process, and layer these licensed sound effects to create new and unique assets. This allows them to tailor the audio experience to the specific needs of the project and add their own creative touch. However, even if a sound designer is not involved in the project, using licensed sound effects can still be beneficial as it ensures that there is a level of sound quality and consistency in the project.
Additionally, these libraries often include a variety of sound formats such as WAV, AIFF, and others, making it easy to integrate them into your project. When licensing SFX, it’s important to ensure that you read and understand the terms and conditions of the license, as it will dictate how you can use the sound effects and how many projects you can use them in. For example, some libraries may require attribution or a one-time fee, while others may have a subscription-based model.
Sound Designer
A sound designer's role in game development is crucial for creating a unique and immersive audio experience for the player. In addition to the technical skills mentioned in the introduction, a sound designer can bring a creative touch to the game's soundscape by producing original sounds or manipulating existing ones.
Having a sound effect library at their disposal can greatly speed up the sound design process, as it allows the sound designer to have a wide range of sounds to work with and manipulate. Many sound designers also have their own bespoke sound effect libraries, which they have curated and organized over time.
Sound designers also typically add metadata to their files, making it easy to search and locate specific sounds in the future. It's also important to note that there are sound designers who specialize in video games and have unique skills that are specific to the medium. If a game developer is looking for dynamic and interactive soundscapes, it's best to hire a video game sound designer who is familiar with audio middleware such as FMOD or WWISE, which have tools and logic for building such systems.
Technical Sound Designer
A technical sound designer is a specialist in the implementation of sound effects and audio in video games. They work closely with the sound designer to ensure that the sound assets are integrated seamlessly into the game engine and are triggered correctly based on the game's logic. They have a deep understanding of the technical aspects of game audio, including design patterns, coding, and audio middleware such as FMOD and WWISE. They also have the ability to design and build custom tools that aid in the implementation of sound effects and audio. These tools can range from simple scripts to more complex software, and can be used by other sound designers to more efficiently implement SFX in the game.
In addition to their technical skills, a technical sound designer also has a strong understanding of game design and the game development process. They work closely with other members of the development team, such as programmers, to ensure that the sound design complements the gameplay and enhances the overall player experience. They also have an understanding of the technical constraints of the target platform, such as hardware and memory limitations, and work to optimize the audio assets accordingly.
On smaller projects, the role of technical sound designer may be combined with that of a sound designer, where the individual is responsible for both creating and implementing sound effects and audio. This requires a strong understanding of both the creative and technical aspects of game audio, and the ability to seamlessly integrate the two.
Overall, a technical sound designer is an essential member of a game development team, responsible for bringing the sound design to life and ensuring it is integrated seamlessly into the game. They have a unique set of skills that are essential for creating immersive and engaging audio experiences in video games. They are the ones that make sure that the SFX are correctly implemented, and that the audio is optimized for the target platform, and that the audio design is consistent throughout the game.
Sound Asset Management
Sound asset management is a crucial aspect of sound design, as it ensures that all audio assets are organized and easily accessible for use in the game. Naming conventions play a vital role in sound asset management, as it helps to keep the audio assets organized and easy to locate. It's important to establish a naming convention that is clear, consistent, and easy to understand. This can include information such as the game name, sound design, designer name, and project name. For larger projects, including dates in the asset names can also be useful for identifying specific projects.
Proper naming conventions should also be applied to the asset rendering and file sample conversion process, as well as the audio engine, whether it's an internal audio engine or audio middleware. This ensures consistency in the naming scheme and makes it easier to locate assets when needed.
To make sound asset management even more efficient, it's recommended to use a sound database software, such as Basehead or SoundParticle's Explorer (Fonseca, N. 2022). This allows for easy searching and retrieval of audio assets and also enables the use of meta tagging, which can be extremely valuable for future reference and time-saving.
The Benefits of Hiring a Sound Designer and Technical Sound Designer for Game Development
When it comes to sound design for games, the benefits of hiring a dedicated sound designer and technical sound designer are clear. A sound designer brings a level of expertise and creativity to the process that can elevate the overall sound of the game. They have a deep understanding of sound design principles and techniques, and can create unique and immersive sounds that enhance the player's experience.
Procedural sound design is another important aspect that can be brought to the table by a dedicated sound designer. This technique involves the design of audio systems that dynamically and procedurally combine different elements in a nonlinear fashion. This approach can create a sense of unpredictability and realism in the sound, making the game experience more engaging and immersive for the player.
When done well, an event loop will always sound different, unlike the implementation of linear stock sounds. This is a powerful tool for game developers, as it can provide a sense of dynamic and ever-changing audio that keeps the player engaged.
A technical sound designer, on the other hand, brings a level of technical expertise to the table that allows for seamless implementation of the sound into the game. They have a good understanding of game development and can work closely with the development team to ensure that the sound is perfectly integrated into the game.
While it may be tempting to try and handle sound design yourself as a developer, the truth is that it can be a time-consuming and complex process. Hiring dedicated sound designers and technical sound designers allows the development team to focus on their areas of expertise, while also ensuring that the sound design is of the highest quality. Additionally, having professionals in these roles can also save on development time and costs in the long run.
Conclusion
In conclusion, sound design is a crucial aspect of game development that greatly enhances the overall player experience. A qualified sound designer typically has a background in music production, audio engineering, or a related field, and possesses a strong understanding of sound design techniques, such as layering, EQ, compression, and spatialization, as well as knowledge of software and hardware used in sound design. They also have a keen ear for detail, are able to think creatively, and are able to work within the constraints of a project's budget and timeline. In addition to their technical skills, sound designers must also have the ability to collaborate with game developers and understand the role of sound in the overall player experience. It's important to note that depending on the size of the project, the role of a sound designer may vary. On small indie projects, the developer may be responsible for doing their own sound design and implementation, while on larger projects, a dedicated sound designer or team of sound designers may be responsible for creating and implementing the sound effects. Additionally, on big projects, a technical sound designer may also be hired to focus on the implementation of sounds into the game engine.
References
The Last Of Us. (2013). Sony Interactive Entertainment.
Focus Hearing Tutorial (2014). The Last of Us: Remastered - The Quarantine Zone: Focus Hearing Tutorial (Infected Combat Sequence). [online] Available at: https://www.youtube.com/watch?v=Tnxo7tAGCko.
BOOM Library. (2022). BOOM Library | Professional Sound Effects - Royalty-Free. [online] Available at: https://www.boomlibrary.com.
Soundsnap. (2022) Download Sound Effects | Soundsnap Sound Library. [online] Available at: https://www.soundsnap.com.
Resonance-Audio. (2022). Resonance Audio -. [online] Available at: https://resonance-audio.github.io/resonance-audio/.
Valve Software. (2022). Steam Audio. [online] Available at: https://valvesoftware.github.io/steam-audio/ [Accessed 9 Oct. 2022].
Oculus, (2022). Oculus Spatializer Plugin for Unity - Requirements and Setup: Unity | Oculus Developers. [online] Available at: https://developer.oculus.com/documentation/unity/audio-osp-unity-req-setup/?locale=en_GB [Accessed 9 Oct. 2022].
Fonseca, N. (2022.). Explorer. [online] soundparticles.com. Available at: https://soundparticles.com/products/explorer [Accessed 10 Oct. 2022].