Multimodality & Creating Our Edition

Multimodality signifies the use of multiple modes or forms of communication or expression within a single context or interaction (Siegel, 2006). As such, multimodality argues that, for example images, gestures, music, movement, and animation should be regarded as equally significant as language (Siegel, 2006).  Discourse is almost always multimodal, as we use more than just words when we talk or write. Verbal communication, for example, involves tone of voice, facial expressions, and gestures, while written communication incorporates fonts, colors, and images (Van Leeuwen, 2015). In the digital era, the idea of multimodality clarifies how gestures, speech, inscription, and other modalities combine to create meanings that transcend disciplinary boundaries (Jewitt et al., 2016). It entails not only investigating the co-occurrence and interplay of different modes but also understanding how they function uniquely. As such, by integrating diverse resourcesmultimodality challenges the conventional dichotomy between verbal and non-verbal communication (Jewitt et al., 2016).

Our 3D edition in itself is a multimodal way of telling Ken’s story. We employ multiple modalities to narrate the story of our Ken doll. Firstly, we use various images to complement the articles we wrote about Ken.  Secondly, we incorporate (YouTube) videos, either as links or embedded, to showcase for example the "I'm Just Ken" song from the Barbie Movie (2023). Thirdly, we use audio, such as for example in the audio introduction or recorded sounds in some annotations, thereby offering our audience a richer comprehension of the content (Campano et al., 2020). Lastly, camera movements used in our tours also give another dimension to the story we are telling about Ken. Overall, all these modalities influence and enhance the story we are telling our audience.