Citations in the document
With all due respect the the resources we have collected here, a careful reading of each of them is not our intention. Instead, we want you to look quickly on the left side of NowComment’s 2-pane set-up and find a few things that resonate with your own learning and your plans for students. Once identified, go to the right side and, in both comments and replies, describe how something you created in a recent workshop or seminar is an example of multimodal literacy and learning. Then begin to think with your peers about how this might be applied in your classrooms this year.
Why Should We Teach Multimodal Literacies?
What do We Teach?
How do We Teach It?
The texts children interact with today have become more visual, digital, and multimodal.
Analogue-Based Multimodal Texts
Digitally-Based Multimodal Texts
Transmedial Texts
Because of these shifts, we have to redefine what we mean by “text” & what counts as reading.
Redefining Texts
Text as Written Language
Text as Visual Object
Text as Multimodal Ensemble
Text as Cultural Artifact
What Do We Teach?:
A Multimodal Curriculum
Re-Envisioning Reader Competencies
Re-Thinking Analytical Perspectives
We have to help students develop new competencies for designing, producing, navigating, and
interpreting multimodal texts.
Developing Multimodal Competencies
Learning Processes (van Leeuwen )
Students need a variety of analytical perspectives from which to consider and interpret
multimodal texts.
Analytical Perspectives
3 Analytical Perspectives
Additional Theoretical Perspectives
Multimodal pedagogy should be an optimal blend of explicit instruction and student
exploration and experimentation.
3 Points of Entry
Art Movements
Questions to Ask
Visual Grammar
Point of View (Positioning)
How viewers of an image are positioned.
Has socially determined meaning potentials.
Provides viewer with their “window on the world.”
May suggest certain power relationships.
Questions to Ask
Viewer Interactions
Questions to Ask
Visual Design Features
Questions to Ask
Endpapers: Different Roles of Endpapers
Questions to Ask
Some Final Thoughts
Professional Resources
Reading the Visual – Serafini
Reading Contemporary Picture Books – Lewis
Looking at Pictures in Picture Books – Doonan
Postmodern Picturebooks – Sipe and Pantaleo
How Picturebooks Work – Nikolajeva and Scott
Reading Images – Kress & van Leeuwen
Picture This – Bang
Literacy in the New Media Age – Kress
Practices of Looking – Sturken and Cartwright
Handbook of Visual Analysis – van Leeuwen & Jewitt
Visual Methodologies – Rose
Thank You!
www.frankserafini.com
resources for literacy teachers
Storytelling in any format is about making meaning. While the essence of the stories we tell may remain the same, the ways in which we can now share these stories have changed dramatically with the development of digital communication technologies. Access to simple, easy to use media production tools and resources in conjunction with the potential for immediate and universal online publication has significant implications for literacy thinking and practice.
This website is an evolving compilation of resources designed to support the development of student multimodal authoring at all year levels. It features examples of different types of student multimodal compositions to demonstrate the rich variety of choices available, along with practical resources to support text production.
Creating is defined in the Australian Curriculum as ‘the development and/or production of spoken, written or multimodal texts in print or digital forms’ and is an embedded literacy expectation across all disciplines.
Multimodal is defined in the Australian Curriculum as the strategic use of ‘two or more communication modes‘ to make meaning, for example, image, gesture, music, spoken language, and written language.
While the development of multimodal literacy is strongly associated with the growth of digital communication technologies, multimodal is not synonymous with digital. The choice of media for multimodal text creation is therefore always an important consideration.
A multimodal text can be paper – such as books, comics, posters.
A multimodal text can be digital – from slide presentations, e-books, blogs, e-posters, web pages, and social media, through to animation, film and video games.
A multimodal text can be live – a performance or an event.
And, a multimodal text can be transmedia– where the story is told using ‘multiple delivery channels’ through a combination of media platforms, for example, book, comic, magazine, film, web series, and video game mediums all working as part of the same story. Transmedia is a contested term and Henry Jenkins is worth reading for more background. Jenkins argues that transmedia is more than just multiple media platforms, it is about the logical relations between these media extensions which seek to add something to the story as it moves from one medium to another, not just adaptation or retelling. Transmedia enables the further development of the story world through each new medium; for example offering a back story, a prequel, additional ‘episodes’, or further insight into characters and plot elements. (Jenkins, 2011). It also can require a more complex production process.
To enable our students to effectively design and communicate meaning through such rich and potentially complex texts, we need to extend their (and along the way, our own) multimodal literacy knowledge and skills. Skilled multimodal composition requires new literacy design skills and knowledge to enable students to make informed choices within and across the available communication modes to effectively construct meaning.
REPORT THIS AD
Creating a multimodal text, a digital animation, for example, is a complex meaning design process requiring the strategic orchestration of a combination of modes such as image, movement, sound, spatial design, gesture, and language. The process of constructing such texts is also truly a cross-disciplinary literacy process, drawing on digital information technologies and The Arts (media, music, drama, visual arts, design) to bring meaning to life.
The multimodal text examples here describe different media possibilities – both digital and on paper and provide links to examples of student work and production guides.
Print-based multimodal texts include comics, picture storybooks, graphic novels; and posters, newspapers and brochures.
Digital multimodal texts include slide presentations, animation, book trailers, digital storytelling, live-action filmmaking, music videos, ‘born digital’ storytelling, and various web texts and social media. The level of digital technology requirements range from very simple options such as slide presentations through to complex, sophisticated forms requiring a higher level of technical and digital media skills. The choice is yours depending on your skill and experience, level of confidence, and the resources and tools available to you.
These examples of different types of student multimodal composition are provided as ideas and starting points, and may also provide models for introducing new forms of ‘writing’ to your students.
The technical construction of digital multimodal texts is always a significant consideration for teachers. Practical information about communication technology resources and digital media tools is provided where possible to support the successful implementation of multimodal authoring in the literacy classroom.
Please explore these resources as a starting point to develop ideas to suit your own situation.
Production processes is an overview of the three production stages in creating a multimodal text.
Media resources provides links to a wealth of digital audio and image resources which can be used under creative commons licensing.
Copyright and Attribution provides information about how to ethically source and use digital materials responsibly.
Modes and meaning systems explores the key meaning-making systems we can use to create meaning
Pedagogy provides a brief guide to teaching creating multimodal texts.
Visual literacy provides a closer look at one of the key meaning-making modes, with the aim to develop a shared metalanguage for talking about how visual meaning is constructed.
Reading multimodal texts provides resources for deconstructing and analysing how different modal systems work to create meaning in a text.
0 General Document comments
0 Sentence and Paragraph comments
0 Image and Video comments
New Conversation
Hide Thread Detail
Procedural knowledge versus content knowledge
New Conversation
Hide Full Comment
I agree with this, Destiny. It’s sort of why whenever I have to set up furniture or fix something on my car, for example, I got to YouTube. If I simply want to explore a particular subject, I got to Wikipedia.
What I like about platforms like NowComment and YouthVoices, however, is that it can be both instructional and exploratory with different forms of media all at once.
New Conversation
Hide Full Comment Hide Thread Detail
I usually do both in order to learn about the desired topic in depth, I would read articles to become well informed but I would also watch youtube videos as I am a visual learner. Each outcome has its benefits as you mentioned you could have instructional and exploratory. Both produce knowledgeable content in their own way and everyone learns differently..
New Conversation
Hide Full Comment
New Conversation
New Conversation
Hi Destiny.
I do the same thing. if I want to learn how to do something or need basic information I check Youtube. Now if I need a deeper understanding I Just Google and search for a truth source.
New Conversation
Hide Full Comment
After watching each video and posting on the Scrapbook, I notice that each aspect of multimodal is to be used by a specific student. But as Baback demonstrated, all linguistic aspect must be included, text, visual, sound, spatial, etc. If we only view Teachernerdz, we tend to believe that we are going back to the cave age times when only sounds and visual images was the mean to tell story and to communicate. Great post Jennifer.
New Conversation
Hide Full Comment
New Conversation
Whether it’s installing a car seat (even though I have the manual) or getting a quick synopsis of a book, I go for a video format whenever it is available.
New Conversation
Hide Full Comment
Nowadays we live in a world where technology has become vital in our daily routines. I believe that learning how to use technology and the amount of time we spend using it is crucial but also I understand that in this modern times it’s ok to take advantage of what it can offer. So like you I would access internet and use technology when I need to.
New Conversation
Hide Full Comment
New Conversation
New Conversation
We have done many multimodal work. Which have been interesting. For example It is important for a teacher to use an appropiate multimodal for the lesson. In my case I will use a digital multimedia for a better communication. Since many of our students are visuals.
New Conversation
Hide Full Comment
Multimodality in writing, provides other modes of expression aside from reliance on writing. This benefits greatly Ell students because it gives them options to express their knowledge using new digital tools to support English acquisition while reinforcing their native language. In lesson planning, multicultural relevant pedagogy becomes oriented to the needs of the student’s life. As one of the speaker suggests, students engaged in meaningful work is more likely to foster the ability and power to define the world and secondly to shape the world to act in desired manner.
New Conversation
Hide Full Comment
This is cool. In any discipline it’s important to get students to view writing as an outlet for shaping their own relationship with the world.
It is also cool that this was presented in the form of a comic strip. It added a neat dimension to it.
Instead of the answer being “no!” to the question “can we…” it should more often be “yes!”
New Conversation
Hide Full Comment Hide Thread Detail
Maybe this is why late elementary and middle school kids are just over the moon about graphic novels.
New Conversation
Hide Full Comment
I agree with you Jessie that it is important to get students to view writing in a way that can help them shape and be relatable to themselves. I believe if students find a way to connect with writings in a personal way their interest in writing will grow.
New Conversation
Hide Full Comment Hide Thread Detail
Engaging students would be the ideal outcome for better writing. After reading all your posts it reminded me of why I like to write. I feel that through writing, one is able to reflect and put on paper the ideas, thoughts, or questions one has. Furthermore, even more so when it’s engaging or relatable. For some students, writing can be an outlet and find commonalities with other students if writing is also shared.
New Conversation
Hide Full Comment
New Conversation
There is just as much preparation for a video as there is for an essay, and just as much writing, with additional steps of recording, editing, and uploading the video! However, a rant video usually feels more accessible to students than an essay.
New Conversation
Hide Full Comment
Apart from the engaging visuals, I like how it touches upon different ways writing can be better to help students express themselves. It touches upon real problems of why very few students identify themselves as writers and it’s because writing becomes limited, narrowing down the capability of students exploring varieties of topics in a deeper way. It showcases various methods that could be effective for the student’s writing.
New Conversation
Hide Full Comment
New Conversation
Hide Thread Detail
I totally agree, Brittney. But with the added perk that creating an image, video, audio, etc. text with multiple modes is really writing! I think that some in education have not really considered this idea quite yet, but the way and what we (and our future students) read in today’s world is beyond printed text. =)
New Conversation
Hide Full Comment
New Conversation
Hide Full Comment
New Conversation
Hide Thread Detail
New Conversation
Hide Full Comment Hide Thread Detail
https://www.youthvoices.live/activity/p/133317/
New Conversation
Hide Full Comment
New Conversation
Hide Full Comment
New Conversation
Hide Thread Detail
New Conversation
Hide Full Comment Hide Thread Detail
Tell us more.
New Conversation
Hide Full Comment Hide Thread Detail
The blocks referred to what I would call actions. I felt like it was a good set of restrictions to keep students from becoming overwhelmed with all possible blocks. At the same time it was a nice challenge to create a whole program using only the 10 blocks.
New Conversation
Hide Full Comment Hide Thread Detail
I enjoyed using scratch, I felt like it gave me the ability to be free and express myself especially with the About Me project which I believe students would truly enjoy as they get to express who they are and then share their masterpieces created through scratch. I feel scratch gives students the ability to do endless creative things.
https://scratch.mit.edu/projects/701093895/editor
New Conversation
Hide Full Comment
New Conversation
New Conversation
New Conversation
New Conversation
New Conversation
Hide Thread Detail
New Conversation
New Conversation
https://youtu.be/b17YT-m2DGk
New Conversation
Hide Full Comment Hide Thread Detail
I love how this video shows how multimodal lessons supports all learners under a universal design framework.
New Conversation
Hide Full Comment
New Conversation
Hide Full Comment
New Conversation
https://www.youthvoices.live/irreplaceable/
New Conversation
Hide Full Comment Hide Thread Detail
via GIPHY
New Conversation
Hide Full Comment Hide Thread Detail
I believe this is the most effective way of learning although not everyone learns the same. I feel for me visuals would always be important and I shall use visuals to teach my students as well. Although having a book in a physical form makes it more personal, digitals are not too bad as well.
New Conversation
Hide Full Comment
We have already learned how to use Scratch to help students create and share their ideas, but there are many other possibilities, such as video or audio programs. Even a “basic” program like Microsoft Paint is one way that students can create and share their work.
New Conversation
Hide Full Comment Hide Thread Detail
https://scratch.mit.edu/projects/703464852/
New Conversation
Hide Full Comment
New Conversation
Hide Full Comment Hide Thread Detail
This is helpful, Marina. Thank you. I can begin to look at my own planning with respect to the various ways in which my students will respond to the material.
When I was in 9th grade I had an assignment for a biology class on taxonomy. Even my teacher expressed an explicit disinterest in taxonomy, as it is often fairly dry.
In order to make the project interesting for myself, I created a comic book, complete with characters and scenery, to take the reader on a journey through “Taxonomy Land.”
Looking back at the results, they were certainly crude, but I’m still proud of the concept to this day. I will post to this thread once I’m able to find the scan of it.
New Conversation
Hide Full Comment
I think that Serafini’s take is pretty good, that different forms of sensory input are not only independent, but that they form a complex of interactions.
Writing only has meaning because it corresponds to other sensory phenomenon. And vice versa.
New Conversation
Hide Full Comment
New Conversation
Hide Thread Detail
I think it may be worth consideration for educators, despite the obvious flaws in the experiment. I wonder if, in our classrooms, we can make some reasonable assumptions about how the majority of students learn.
New Conversation
Hide Full Comment
https://www.youthvoices.live/marinas-scratch-funhouse/
New Conversation
Hide Full Comment
I agree that text that children interact with today have become visual so we need to find ways to incorporate visual learning into what students read today.
New Conversation
Hide Full Comment Hide Thread Detail
Don’t forget the role that music can play in multimodal literacy
New Conversation
Hide Full Comment
New Conversation
New Conversation
New Conversation
I agree, text are becoming more accessible to children’s interest. There is a great variety of text to meet children at their level and to encourage progress and learning. Again, technology plays a huge role in such improvement and it has become an important for educator to meet student’s goal with a better approach
New Conversation
Hide Full Comment
The multimodal literacy is connected to the use of technology. I noticed that that each mean of communication involve requires some mean of technology usage. I used created my first multimodal artifact using “Scratch” where I had to use code blocks to create a scene where the character was able to say what was written in text. Scratch is an excellent tools for the teaching of multimodal literacy.
New Conversation
Hide Full Comment Hide Thread Detail
New Conversation
This seems to sum it up quite nicely. Learning is a dialogue!
New Conversation
Hide Full Comment Hide Thread Detail
Maybe the directions?
New Conversation
Hide Full Comment
Multimodal instruction is a method I have used in my 3K setting, but I label it “differentiation.” For example, when students use a tablet to create they own story and then retell, is a way to differentiate the process of creating and telling story. I have a concern of implementing multimodal because in my opinion, some students will rely on one method of communication and will neglect one, the written text. If we want to prepare students well, they must be able to read text for understanding instruction or information that would make them thinkers.
New Conversation
Hide Full Comment Hide Thread Detail
For example, a Spanish class can be composed of heritage language learners and second language acquisition students. I have learned that teachers must differentiate instructions to be inclusive and support all students in the classroom.
New Conversation
Hide Full Comment
New Conversation
Hide Full Comment Hide Thread Detail
These links that you are posting, Marina, remind me of sketchnoting. For those unfamiliar, check out this website: https://www.verbaltovisual.com/what-is-sketchnoting/
New Conversation
Hide Full Comment Hide Thread Detail
New Conversation
Hide Thread Detail
New Conversation
Hide Full Comment
General Document Comments 0
I am a teacher of a 3-K program students where they work on developing every skill needed to perform well in their future education or social life. After viewing the deferent ways other educators implement multimodal with their students, I decided to use “Scratch” in my class to. help students develop digital literacy using, visual, text, and sound and voice in their project. This is great tool for any student at any age because it includes option for any school subject as well as any modality required in the multimodal approach.
New Conversation
Hide Full Comment
New Conversation