Hostname: page-component-745bb68f8f-d8cs5 Total loading time: 0 Render date: 2025-02-05T22:46:19.132Z Has data issue: false hasContentIssue false

The effect of infant-directed speech on early multimodal communicative production in Spanish and Basque

Published online by Cambridge University Press:  20 August 2019

Irati DE PABLO
Affiliation:
Departamento de Didáctica de la Lengua y la Literatura, Universidad del País Vasco, Spain
Eva MURILLO*
Affiliation:
Departamento de Psicología Básica, Universidad Autónoma de Madrid, Spain
Asier ROMERO
Affiliation:
Departamento de Didáctica de la Lengua y la Literatura, Universidad del País Vasco, Spain
*
*Corresponding author: Departamento de Psicología Básica. Facultad de Psicología. Universidad Autónoma de Madrid, Campus de Cantoblanco, 28049. Madrid. Spain. E-mail: eva.murillo@uam.es
Rights & Permissions [Opens in a new window]

Abstract

We analyzed the effect of infant-directed speech (IDS) on multimodal communicative production of children at the beginning of the second year of life in two different languages: Spanish and Basque. Twelve Spanish and twelve Basque children aged between 12 and 15 months observed two versions of an audiovisual story: one version was narrated with IDS and the other with adult-directed speech (ADS). We analyzed the use of gaze and the communicative behaviors produced by children. The time spent looking at the story increases in the IDS condition regardless of the language of the narration. Children produced more multimodal communicative behaviors while watching the IDS version both in Spanish and in Basque. These results suggest that IDS increases attention and social engagement promoting joint attention episodes.

Type
Brief Research Reports
Copyright
Copyright © Cambridge University Press 2019

Introduction

When interacting with infants, adults adapt their speech in different ways. These adaptations are known as ‘motherese’, ‘baby-talk’, ‘child-directed speech’, or ‘infant-directed speech’ (IDS), and include changes in utterance length and structure, as well as in prosodic patterns. Adults’ utterances to infants are shorter, more redundant, and linguistically simpler than those produced in interactions between adults. Adults produce a large number of questions and frequently include proper names. Regarding prosody, it can be observed at a slower tempo, with longer pauses and more prosodic repetitions. Furthermore, fundamental frequency (F0) values are higher in utterances addressed to infants, with exaggerated prosodic contours and wider F0 variations (see Saint-Georges et al., Reference Saint-Georges, Chetouani, Cassel, Apicella, Mahdhaoui, Muratori and Cohen2013, for a review, and Soderstrom, Reference Soderstrom2007, for an overview on prosodic, lexical, phonological, and syntactic properties of ID speech).

It is well known that infants prefer this type of IDS from the very early stages of their development. Classic studies have shown that even neonates prefer IDS to adult-directed speech (ADS) (Cooper & Aslin, Reference Cooper and Aslin1990). Similar findings have also been reported for 7-week-olds (Pegg, Werker, & McLeod, Reference Pegg, Werker and McLeod1992), 4-month-olds (Fernald, Reference Fernald1985; Werker & McLeod, Reference Werker and McLeod1989) and 7- to 9-month-olds (Glenn & Cunningham, Reference Glenn and Cunningham1983; Werker & McLeod, Reference Werker and McLeod1989). This preference for IDS vs. ADS remains for the first months of life, and some studies suggest that it may begin to decrease by the end of the first year (Newman & Hussain, Reference Newman and Hussain2006). By contrast, other studies reported a U-shaped developmental pattern regarding IDS preference (Hayashi, Tamekawa, & Kiritani, Reference Hayashi, Tamekawa and Kiritani2001) and some data indicate that IDS preference continues during the second year of life (Segal & Newman, Reference Segal and Newman2015).

These adaptations of adult speech when interacting with infants have a key role in several aspects of early language development.

In the first months of life, IDS has arousing properties and increases infant's attention (Kaplan, Goldstein, Huckeby, Owren, & Cooper, Reference Kaplan, Goldstein, Huckeby, Owren and Cooper1995). IDS prosodic characteristics direct an infant's attention towards the linguistic stream, promoting social interaction (Cooper & Aslin, Reference Cooper and Aslin1990; Fernald, Reference Fernald1985; Pegg, Werker, & McLeod, Reference Pegg, Werker and McLeod1992). A recent meta-analysis on IDS effects on language development has shown that IDS prosody is associated with attention (global measures of attention, joint attention, and conditional attention) in infants (Spinelli, Fasolo, & Mesman, Reference Spinelli, Fasolo and Mesman2017). Recent findings suggest that IDS might be more attractive to the infants because it is less predictable than ADS regarding its prosodic features (Räsänen, Kakouros, & Soderstrom, Reference Räsänen, Kakouros and Soderstrom2018). IDS guides infant attention not only to a social partner, but also to an external referent. Senju and Csibra (Reference Senju and Csibra2008) showed that 6-month-old infants followed an adult's gaze towards an external object only when it was preceded by an ostensive cue such as direct gaze and IDS.

Infants’ preference for IDS makes them more responsive, and consequently they are perceived as more willing to maintain a positive and affective interaction with the caregiver. Therefore, IDS fosters the engagement and maintenance of social interaction.

Besides this social-engaging and attention-getting role, IDS characteristics also have a function in emotional regulation. IDS conveys an adult's affective state and influences an infant's emotional state. Mothers use specific pitch contours to modulate an infant's emotional state (Papousek, Papousek, & Bornstein, Reference Papousek, Papousek, Bornstein, Field and Fox1985), and exaggerate those prosodic cues that convey emotional information (Scherer, Reference Scherer1986).

Moreover, several characteristics of IDS facilitate speech processing in different ways. On the one hand, the exaggerated suprasegmental characteristics of IDS speech facilitate syllable discrimination and vowel categorization in the first three months of life (Karzon, Reference Karzon1985). IDS prosody also facilitates word segmentation from fluent speech: infants find IDS easier to segment than ADS (Thiessen, Hill, & Saffran, Reference Thiessen, Hill and Saffran2005). On the other hand, not only prosodic, but also linguistic properties of IDS can influence language development. For example, the tendency in IDS to put target words in the final positions of the sentence helps infants to segment the linguistic stream (Messer, Reference Messer1981). The use of diminutives can facilitate word segmentation and gender agreement learning (Kempe, Brooks, & Gillis, Reference Kempe, Brooks and Gillis2005), and vowel lengthening according to specific language characteristics (Werker, Pons, Dietrich, Kajikawa, Fais, & Amano, Reference Werker, Pons, Dietrich, Kajikawa, Fais and Amano2007) can also facilitate the language learning process (see Saint-Georges et al., Reference Saint-Georges, Chetouani, Cassel, Apicella, Mahdhaoui, Muratori and Cohen2013, for a review).

It seems, therefore, that the characteristics of the IDS can facilitate the language acquisition process. IDS exposure in the early stages of development is related to subsequent language acquisition. IDS is associated with both prelinguistic (rate of response and imitation) and linguistic (lexical, syntactic, and vocabulary productions) outcomes, but the associations with prelinguistic outcomes is stronger (Spinelli et al., Reference Spinelli, Fasolo and Mesman2017). Although the effect of IDS prosody seems to be stronger in children younger than 9 months, little is known about the influence of IDS prosody in older infants.

Ramírez-Esparza, García-Sierra, and Kuhl (Reference Ramírez-Esparza, García-Sierra and Kuhl2014) showed that the raw quantity of parental speech to infants had no effect on subsequent linguistic progress, but the quality of speech input to children was related to children's language development. Specifically, they found that IDS exposure in one-to-one social interaction contexts around the first year of life was related to vocabulary size at 24 months of age. The same influence of IDS quality on language development a year later is reported by Hirsh-Pasek et al. (Reference Hirsh-Pasek, Adamson, Bakeman, Owen, Golinkoff, Pace and Suma2015) for children aged 24 months, and by Rowe (Reference Rowe2012) for children from 18 to 42 months of age.

Cross-linguistic studies have shown that adult speech adaptation appears in very different cultures and in languages with different structures (Soderstrom, Reference Soderstrom2007). IDS can be found in the Western languages as well as in Russian (Kuhl et al., Reference Kuhl, Andruski, Chistovich, Chistovich, Kozhevnikova, Ryskina and Lacerda1997) Korean, (Lee, Davis, & MacNeilage, Reference Lee, Davis and MacNeilage2008), Hebrew (Segal, Nir-Sagiv, Kishon-Rabin, & Ravid, Reference Segal, Nir-Sagiv, Kishon-Rabin and Ravid2009), Chinese (Grieser & Kuhl, Reference Grieser and Kuhl1988), Thai (Kitamura, Thanavishuth, Burnham, & Luksaneeyanawin, Reference Kitamura, Thanavishuth, Burnham and Luksaneeyanawin2002), and Japanese (Fernald & Morikawa, Reference Fernald and Morikawa1993). IDS seems to preserve some characteristics regardless of the language, but some others change according to specific linguistic characteristics. For example, Fernald, Taeschner, Dunn, Papousek, de Boysson-Bardies, and Fukui (Reference Fernald, Taeschner, Dunn, Papousek, de Boysson-Bardies and Fukui1989) found similar prosodic modifications when talking to infants aged 10 to 14 months in French, Italian, German, Japanese, British English, and American English. Parents showed higher fundamental frequency, greater f0-variability, shorter utterances, and longer pauses when speaking to their children than when speaking with an adult. They found also language-specific variations, for example, the difference between the mean f0 of IDS and ADS was higher for American English-speaking parents than for parents in all other languages except Japanese (Fernald et al., Reference Fernald, Taeschner, Dunn, Papousek, de Boysson-Bardies and Fukui1989).

An especially interesting case of language adaptation to infants is the Basque language. Unlike Spanish, which is a Romance language, Basque has an unknown origin. Regarding phonology, Basque distinguishes three types of voiceless sibilants and their corresponding affricates. Basque has five vowels, as in Spanish, although in the dialect of Zuberoa a sixth vowel is used. At a morphosyntactic level, Basque is an agglutinating language, it has an ergative case in the declination, and in general terms it has a neutral SOV structure (Fernández, Reference Fernández2016). Basque and Spanish are very different at the grammar level, Spanish is functor-initial (also called a ‘Head–Complement language’), but Basque is functor-final (also called a ‘Complement–Head language’). Acoustic analyzes have confirmed that Basque follows a functor-final pattern regarding prosody, producing a trochaic pattern within a phrase, whereas Spanish follow an iambic prosodic pattern (Molnar, Carreiras, & Gervain, Reference Molnar, Carreiras and Gervain2016).

The Basque language, when directed to infants, has some specific adaptations not found in other languages. At the phonetic level can be observed the palatalizations of sibilants, to attract an infant's attention more easily. At the morphosyntactic level, we find the suppression of the auxiliary verb and the repetition of the syntagma at the beginning and at the end of the phrase. Regarding the lexicon, there is a general tendency to use specific infantile terms with their corresponding adult words in successive utterances (Santazilia & Zubiri, Reference Santazilia, Zubiri and Salaberri2014).

Although the literature on IDS in Basque is extremely scarce, these specific adaptations and the relevant role of IDS in the family context of linguistic transmission lead us to hypothesize a higher sensitivity to this type of speech on the part of Basque children.

The differences between Spanish and Basque, and the specific characteristics of IDS in the latter, make this comparison very interesting in terms of the differential effect of IDS on children's communicative production, and especially on children's multimodal production.

As we have seen previously, the influence of IDS on language processing has been widely studied, but little is known about how IDS contributes to children's communicative production, i.e., to the deployment of actions aimed at conveying a meaning to another person. Considering that language development as well as early social interaction are multimodal phenomena, the focus of the present study is to analyze the influence of IDS on the multimodal communicative production of children from different languages.

Multimodal communication and language development

As Golinkoff, Can, Soderstrom, and Hirsh-Pasek (Reference Golinkoff, Can, Soderstrom and Hirsh-Pasek2015) pointed out, IDS is not used in isolation but in a social context. IDS is part of a multimodal social frame that promotes interaction, communication, and hence language development. In the context of social interaction, around the first year of life children start to produce intentional multimodal communicative behaviors to convey meanings to others. Even before children start using their first words, they combine gestures and vocal elements in their social interactions. The different communicative elements are tightly integrated from the early stages of language development (Esteve-Gibert & Prieto, Reference Esteve-Gibert and Prieto2014; Romero, Etxebarria, de Pablo, & Romero, Reference Romero, Etxebarria, de Pablo and Romero2017). These multimodal communicative behaviors are related to subsequent linguistic development from the early stages of language learning (Aureli, Spinelli, Fasolo, Garito, Perucchini, & D'Odorico, Reference Aureli, Spinelli, Fasolo, Garito, Perucchini and D'Odorico2017; Cadime, Silva, Santos, Ribeiro, & Viana, Reference Cadime, Silva, Santos, Ribeiro and Viana2017; Igualada, Bosch, & Prieto, Reference Igualada, Bosch and Prieto2015; Murillo & Belinchón, Reference Murillo and Belinchón2012, Reference Murillo and Belinchón2013; Wu & Gros-Louis, Reference Wu and Gros-Louis2014). The use of communicative gestures coordinated with vocalizations and words predicts not only lexical development but also the beginning of the two-word combination stage (Butcher & Goldin-Meadow, Reference Butcher, Goldin-Meadow and McNeill2000; Capobianco, Pizzuto, & Devescovi, Reference Capobianco, Pizzuto and Devescovi2017; Goldin-Meadow & Butcher, Reference Goldin-Meadow, Butcher and Kita2003; Iverson & Goldin-Meadow, Reference Iverson and Goldin-Meadow2005).

Aims and hypothesis

The aim of this study is two-fold. On the one hand, we want to analyze the effect of IDS on children's attention and multimodal communicative production at the beginning of the second year of life. On the other hand, we want to test if this effect (or the lack of) is language-dependent, comparing languages with very different structures: Spanish and Basque.

Considering that IDS prosody facilitates attention to a social partner as well as to an external referent, and increases vocal production, IDS could be related to multimodal communicative behavior production at the beginning of the second year of life. We expect that IDS promotes not only an infant's attention to a social partner, but also directs that attention to an audiovisual target, that is, a referent that does not vary its behavior according to children's actions. At the same time, we expect that this increase in attention will promote children's communicative behavior towards a social partner.

Our hypothesis is that IDS increases infant attention to relevant events of the environment, and promotes children's communicative intention about it. Children will use multimodal communicative resources to share their interest with their social partner.

These multimodal communicative behaviors are more salient for the adult and they are perceived as more communicative than isolated behaviors such as vocalizations or gestures produced alone. Multimodal communicative behaviors will thus have a contingent response by the adult in an attention-shared frame that facilitates lexical development (Fasolo & D'Odorico, Reference Fasolo and D'Odorico2012).

To test if there are any differences in the relationship between IDS and multimodal communicative production depending on the characteristics of the language, we tested these hypotheses in two languages with very different structures: Spanish and Basque. Taking into account the special adaptation of Basque language to children, one could expect a higher effect of IDS in Basque-learning children compared to Spanish-learning children.

Specifically, our hypothesis are as follows:

  • H1: Children will spend more time looking at the screen in the IDS condition than in the ADS condition.

  • H2: Children will produce specifically more multimodal communicative behaviors in the IDS condition than in the ADS condition.

  • H3: The differences found between IDs and ADS conditions in the previous comparisons will be higher in the Basque condition than in the Spanish condition.

Method

Participants

Twenty-four children between 12 and 15 months of age participated in the study (12 girls, 12 boys). Half of them came from monolingual Spanish-speaking homes from Madrid, and half of them from Basque-speaking homes from the Basque Country. In the case of Basque-speaking children, although there are two main languages in the Basque Country – Basque and Spanish – the children chosen for this study were children with Basque as mother tongue and they were enrolled in Basque-speaking schools. Therefore, they were children with a linguistic majority exposure to Basque.

Families were contacted through several daycare facilities, and parents agreed to participate voluntarily and provided informed consent. All the participants were developing typically; they had no history of hearing loss and parents reported no developmental problems or concerns. The characteristics of the participants are shown in Table 1.

Table 1. Characteristics of the sample

Materials

We designed a video with the story of Little Red Riding Hood. The video showed a series of static images depicting several passages in the story. The audio accompanying the images of the story was different for each of the four experimental conditions. All the narrations were performed by the same woman, who was an early childhood teacher and researcher. Her mother tongue is Basque and she is bilingual Spanish–Basque. All the stories had the same duration (3 minutes and 35 seconds) and the same lexical content, but were different in two characteristics: the language (Basque and Spanish) and the prosody (infant-directed vs. adult-directed). The infant-directed version had exaggerated prosodic contours and wider F0 variations than the adult-directed version. The acoustic characteristics of the videos (F0, intensity, and pause duration) are described in Table 2.

Table 2. Acoustic characteristics of the videos

We had, therefore, a video for each of the four conditions (Spanish-IDS, Spanish-ADS, Basque-IDS, Basque-ADS) (see Supplementary materials for the videos, available at <https://doi.10.1017/S0305000919000412>).

Procedure

We conducted the observation sessions in an isolated room of a children's daycare center. The child was placed in front of a laptop, next to her teacher. A camcorder was located behind the laptop to register the children's gaze and behavior. Once the child was placed in the setting, the experimenter abandoned the room and the teacher started the story in the laptop. We asked the teachers to respond normally if the children tried to interact with them, but not to initiate or provoke the child's communicative behaviors.

Every child watched the two versions of the video (IDS and ADS) corresponding to their mother tongue. The order of presentations was counterbalanced to control for novelty and fatigue effects: half of the children of each group watched the IDS version first, and half of the children watched the ADS version first. There was at least an hour between presentations.

Coding and analysis

We coded the children's gaze and all the communicative behaviors produced by them using ELAN 5.1 software (Lausberg & Sloetjes, Reference Lausberg and Sloetjes2009). We considered as communicative behaviors all the gestures and vocalizations produced to the adult. To be able to identify the vocalizations produced by children, the coders could listen to the audio while coding.

We coded children's gaze by means of a frame-by-frame analysis of the movement of the children's eyes. This analysis allows an accuracy of 40 milliseconds. We considered a ‘social gaze’ to be when the child directed her eyes towards the face of the adult and kept the look for more than 40 milliseconds. We considered a ‘look to the screen’ to be when the child directed her eyes towards the screen and kept the look for more than 40 milliseconds. The fixation of the gaze is identified in a frame-by-frame analysis: as the child establishes eye contact or fixes her eyes on the screen, the image of the eyes of the child stops being blurred.

We considered a gesture to be any action addressed to convey a meaning to another person (Acredolo & Goodwin, Reference Acredolo and Goodwin1988). We coded the gestures as follows:

  • Point: index finger visibly extended with some extension of the arm.

  • Reach: arm is extended with hand open and finger straight.

  • Conventional: gestures produced as social routines such as saying “hello” or “bye”, clapping hands, etc.

  • Emotive: the child expresses an emotional state – joy, sadness, anger … – facially accompanying that expression with hand and arm movements.

  • Other: any gesture observed not included in the previous categories or not clearly observable.

We coded the vocalizations of the children according to the following categories (based on Majorano and D'Odorico, Reference Majorano and D'Odorico2011, and Murillo and Belinchón, Reference Murillo and Belinchón2012):

  • Babbling: the utterance is not similar to any word of the language. It has no sound–meaning regularity and no formal relationship with the referent alluded to.

  • Word: the utterance is clearly identifiable as a word and has a referential sense. We included in this category onomatopoeic sounds and proto-words, that is, utterances with a stable phonetic structure and a clear relationship with the referent but that does not constitute a word in the adult language.

  • Other: any vocal sound that was unclear or that could not be included in the previous categories.

Once the gestures and vocalizations were coded using ELAN, we considered a multimodal communicative behavior those behaviors that included some temporal overlap between gesture, vocalizations, and/or gaze towards the adult (social gaze). We considered that there was temporal overlap between two communicative elements when they were coincident in time at some point between the beginning and the end of the two of them. The minimum temporal coincidence allowed by our coding software is 10 milliseconds. We also measured the time that children spent looking at the screen and looking at the teacher. After the coding was done, the data were analyzed using the statistical program SPSS v24 (IBM Corp., 2016).

To ensure the reliability of the coding system, two independent observers coded 10% of the sample, including videos of both languages. Regarding gesture, gaze, and vocalization classification, the overall agreement between coders was 90% (N = 107; k = .77). The agreement for the gestures classification was 100% (N = 9), for gaze was 84% (N = 70), and for vocalization was 78% (N = 29).

Results

We conducted several analyses to explore the effect of IDS in different languages on specific aspects of children's behavior. Preliminary analysis showed no effect of the order of presentation on the variables studied.

Effects of the type of speech and language on children's attention

To test our first hypothesis (H1), we analyzed the effect of the type of speech (IDS vs. ADS) on child's attention, both towards the audiovisual story and towards the social partner. We expected that children found the IDS version of the story more interesting than the ADS version, and consequently would look at the screen for a longer time. We also measured the time that children spent looking at the adult to test if a larger time of looking could reflect a general tendency to look during longer periods in the IDS version, regardless of whether they were looking at the screen or at the adult. The duration of each look at the adult or at the screen was measured by means of the ELAN 5.1 software. We conducted a repeated-measures ANOVA, taking as the dependent variable the time spent looking at the screen, with the type of speech (IDS vs. ADS) and the language (Basque vs. Spanish) as factors. We found a main effect of the type of speech (F(1,22) = 4.52; p = .045; η2 = .17). Infants spent significantly more time looking at the screen in the IDS condition than in the ADS condition (108.41 vs. 93.03 s.). We did not find any effect of language (F(1,22) = 0.88; p = .35), nor of the interaction between type of speech and language (F(1,22) = 2.09; p = .16).

We conducted the same analysis, a repeated-measures ANOVA, but considering the time spent looking at the adult as the dependent variable. The type of speech (IDS vs. ADS) and the language (Basque vs. Spanish) were the factors. We did not find any effect of the type of speech (F(1,22) = 0.046; p = .83), or of the language (F(1,22) = 1.25; p = .27), or of the interaction between the two (F(1,22) = 1.14; p = .29) on the time spent looking at the adult. Table 3 shows the means and standard deviations of the time spent looking at the adult in both conditions and in both languages.

Table 3. Time spent looking at the adult (s)

Effects of the type of speech and language on multimodal communicative behavior

In order to test our second hypothesis (H2), we analyzed the impact of IDS in the general communicative behavior and in the multimodal communicative behavior of the children. We conducted three different repeated-measures ANOVAS, taking as factors the type of speech (IDS vs. ADS) and the language (Basque vs. Spanish). The dependent variables considered were: communicative behavior frequency, gesture frequency, and vocalization frequency. Results are shown in Table 4.

Table 4. Results of the repeated-measures ANOVAS conducted on the frequency of communicative behaviors, gestures, and vocalization depending on the type of speech and the language

In the first analysis regarding the impact of the type of speech on the willingness to communicate, we took as the dependent variable the total frequency of communicative behaviors produced by the children (total frequency of gestures, vocalizations, and looks at the adult). We did not find any significant effect of type of speech or language, nor of the interaction between them, on the general communicative behaviors produced by children. In the second and third analyses we took, respectively, the frequency of gestures and of vocalizations produced, regardless of whether they were produced in combination or in isolation, as the dependent variable. We found for both variables similar results to those found for the general communicative behavior: no effect of the type of speech, nor of the language or of the interaction (see Figure 1 and Table 4 for details).

Figure 1. Frequency of total communicative behaviors, gestures, and vocalizations in IDS and ADS conditions.

To analyze the effect of the type of speech and language on the multimodal communicative behavior, we took the frequency of multimodal communicative behaviors (that is, the frequency of behaviors that included at least two elements: gesture, vocalization, and/or gaze) as the dependent variable. Once again, we took the type of speech and the language as factors. Figure 2 shows the frequencies of multimodal productions in Spanish and Basque in the two conditions.

Figure 2. Frequencies of multimodal productions in Spanish and Basque in IDS and ADS conditions.

We found a main effect of the type of speech on the frequency of multimodal communicative behaviors (F(1,22) = 5.37; p =. 03; η2 = .19). Children in our sample produced more multimodal communicative behaviors in the IDS condition that in the ADS condition (3.8 vs. 2.5). There were no language (F(1,22) = 0.27; p = .60) or interaction (F(1,22) = 0.005; p = .94) effects.

Next, we studied each of the multimodal combinations separately to investigate whether IDS had any effect on the frequency of specific multimodal elements. We took the frequency of vocal behaviors produced with gaze or gesture as the dependent variable, and the same factors as in the previous analyses, and we conducted a repeated-measures ANOVA. The results showed a main effect of the type of speech on the production of vocal multimodal behaviors (F(1,22) = 6.59; p = .01; η2 = .23), with a higher frequency in the IDS condition (2.63 vs. 1.58). Then, we repeated the same analysis but taking as the dependent variable the frequency of gestures produced with vocalizations or gaze to the adult. In this case, we did not find any effect of the type of speech (F(1,22) = 0.92; p = .34) on the multimodal gesture production. Results showed no effect of language (F(1,22) = 0.51; p = .48), nor of an interaction (F(1,22) = 0.10; p = .75). Then, we analyzed specifically the multimodal behaviors composed of three elements: gestures, vocalization, and gaze (GVG). Conducting the same analysis, we found that, although the frequency of GVG behaviors is higher in the IDS condition than in the ADS condition, the differences did not reach statistical significance (F(1,22) = 2.69; p = .11). Table 5 shows the frequencies of each type of multimodal communicative behavior.

Table 5. Frequency of each type of multimodal communicative behavior

Discussion

Our results showed that IDS had an effect on children's attention and multimodal communicative production at the beginning of the second year of life. Regarding the attention-getting role of IDS, our findings are consistent with previous research. Children in our sample paid more attention to the IDS version of the story, confirming the arousing properties of IDS proposed in previous studies (e.g., Kaplan et al., Reference Kaplan, Goldstein, Huckeby, Owren and Cooper1995). Our work extends the attentional increase towards the social partner of IDS to a non-interactive stimulus, that is, to stimuli whose action is independent of children's behavior. This fact emphasizes the crucial role of IDS prosody on the language learning process, not only in the first months of life (Saint-Georges et al., Reference Saint-Georges, Chetouani, Cassel, Apicella, Mahdhaoui, Muratori and Cohen2013) but still at the beginning of the second year.

Moreover, IDS enhances multimodal social contact with the adult and thus increases the probability of an experience becoming a joint attention episode. In this way, the opportunities for communicative and linguistic exchanges increase in relation to elements that are of interest to the child, and so too do the opportunities for learning a language. In this sense, our findings contribute to establishing an indirect link between IDS processing and productive vocabulary.

Although previous studies have confirmed an increase in children's communicative response to IDS (e.g., Spinelli et al., Reference Spinelli, Fasolo and Mesman2017), our data do not show a general increase in communicative behaviors in children at the beginning of the second year of life. The results concerning the effect of IDS on general communicative behavior frequency indicate that IDS does not increase children's general tendency to communicate.

However, we did find an increase in multimodal production in the IDS condition. The developmental period that we studied is characterized by a progressive increase in multimodal communication (Murillo & Belinchón, Reference Murillo and Belinchón2012; Romero et al., Reference Romero, Etxebarria, de Pablo and Romero2017; Wu & Gros-Louis, Reference Wu and Gros-Louis2014). It seems that children are incorporating their communicative skills especially in those arousing situations which capture their attention.

From all the multimodal combinations, those that include vocal components seem to be more sensitive to an IDS effect. The tendency seen in younger children to vocalize more with IDS and to produce more mature vocalizations with social contingent responses (i.e., Goldstein & Schwade, Reference Goldstein and Schwade2008) has its parallel in multimodal production. In our sample, children do not vocalize more in the IDS condition, but they produce more multimodal behaviors with vocal components. This suggests that in the IDS condition they use their more sophisticated resources to communicate with others. In other words, in an interesting situation ‘they do their best’.

In contrast, our results did not find evidence that the influence of IDS on attention and multimodal production is modified by language. We did not find evidence that the differences between the two languages in their prosodic patterns had an effect on children's attention or multimodal communicative production.

Although our results are very promising and suggest interesting applications at an educational level, our study has some limitations to consider. First of all, the size of the sample is limited. This can affect the power of the analysis and the representativeness of the sample, so results should be interpreted with caution. In this sense, our results must be taken as a starting point for future research. In addition, we do not have direct measurements of the child's gaze, so it would be interesting to broaden the study using an eye-tracking device. The use of an eye-tracker device would allow us to analyze not only the time spent looking at the screen, but also exploratory gaze patterns (time of fixations and exploratory eye-movements) to specific elements involved in the story. This could provide information about how IDS helps to focus on the relevant elements at each point of the story, and about which specific elements elicit multimodal communicative productions. The images employed in the story are static, so it may be interesting to analyze the influence of IDS with dynamic images. Coders had no previous information about the condition, but they could deduce it from the background sound of the recordings. It must also be taken into account that the observation situation is not naturalistic and the voice of the stimulus is not the mother's voice.

It seems, therefore that IDS has an effect on attention and on multimodal communicative production at the beginning of the second year of life. In summary, our results show an effect of IDS on the attention towards an audiovisual stimulus and on specific communicative productions of children in this situation. IDS does not increase the global communicative behavior's frequency, but specifically the multimodal communicative productions. From the multimodal productions, the ones that are more sensitive to IDS are those that include vocal elements. The effect of IDS on multimodal communicative behaviors seems to be independent of the language employed, at least when comparing Basque and Spanish. These findings can be seen as an indirect link between IDS prosody processing and lexical development via multimodal production, and specifically, vocal multimodal behaviors.

Supplementary materials

For Supplementary materials for this paper, please visit <https://doi.org/10.1017/S0305000919000412>.

Acknowledgments

We would like to thank the staff and families from E. I. Caperucita, E. I. Reggio, Alonsotegiko haurreskola, Bekosolo haurreskola, Altzoan haurreskola, Deusto haurreskola, and Zelaieta haurreskola for their invaluable cooperation. We also thank Marta Casla, Jessica Rodríguez, and Celia Méndez for their help in collecting the data, and Jose Manuel Igoa for lending a hand with the manuscript. This research has been partially funded by FEDER, Ministerio de Innovación y Universidades, Agencia Estatal de Investigacion, Project PGC-2018-095275-A-100.

References

Acredolo, L., & Goodwin, S. (1988). Symbolic gesturing in normal infants. Child Development, 59(2), 450–66.CrossRefGoogle ScholarPubMed
Aureli, T., Spinelli, M., Fasolo, M., Garito, M. C., Perucchini, P., & D'Odorico, L. (2017). The pointing–vocal coupling progression in the first half of the second year of life. Infancy, 22(6), 801–18.CrossRefGoogle Scholar
Butcher, C., & Goldin-Meadow, S. (2000). Gesture and the transition from one- to two-word speech: when hand and mouth come together. In McNeill, D. (Ed.), Language and gesture (pp. 235–58). Cambridge University Press.CrossRefGoogle Scholar
Cadime, I., Silva, C., Santos, S., Ribeiro, I., & Viana, F. L. (2017). The interrelatedness between infants’ communicative gestures and lexicon size: a longitudinal study. Infant Behavior and Development, 48, 8897.CrossRefGoogle ScholarPubMed
Capobianco, M., Pizzuto, E. A., & Devescovi, A. (2017). Gesture–speech combinations and early verbal abilities. Interaction Studies, 18(1), 5576.CrossRefGoogle Scholar
Cooper, R. P., & Aslin, R. N. (1990). Preference for infant-directed speech in the first month after birth. Child Development, 61(5), 1584–95.CrossRefGoogle ScholarPubMed
Esteve-Gibert, N., & Prieto, P. (2014). Infants temporally coordinate gesture–speech combinations before they produce their first words. Speech Communication, 57, 301–16.CrossRefGoogle Scholar
Fasolo, M., & D'Odorico, L. (2012). Gesture-plus-word combinations, transitional forms, and language development. Gesture, 12, 115.CrossRefGoogle Scholar
Fernald, A. (1985). Four-month-old infants prefer to listen to motherese. Infant Behavior and Development, 8(2), 181–95.CrossRefGoogle Scholar
Fernald, A., & Morikawa, H. (1993). Common themes and cultural variations in Japanese and American mothers’ speech to infants. Child Development, 64(3), 637–56.CrossRefGoogle ScholarPubMed
Fernald, A., Taeschner, T., Dunn, J., Papousek, M., de Boysson-Bardies, B., & Fukui, I. (1989). A cross-language study of prosodic modifications in mothers’ and fathers’ speech to preverbal infants. Journal of Child Language, 16(3), 477501.CrossRefGoogle ScholarPubMed
Fernández, B. (2016). Euskera para castellano hablantes. Donostia: Erein.Google Scholar
Glenn, S. M., & Cunningham, C. C. (1983). What do babies listen to most? A developmental study of auditory preferences in nonhandicapped infants and infants with Down's syndrome. Developmental Psychology, 19(3), 332–7.CrossRefGoogle Scholar
Goldin-Meadow, S., & Butcher, C. (2003). Pointing toward two-word speech in young children. In Kita, S. (Ed.), Pointing: where language, culture, and cognition meet (pp. 85107). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
Goldstein, M. H., & Schwade, J. A. (2008). Social feedback to infants’ babbling facilitates rapid phonological learning. Psychological Science, 19(5), 515–23.CrossRefGoogle ScholarPubMed
Golinkoff, R. M., Can, D. D., Soderstrom, M., & Hirsh-Pasek, K. (2015). (Baby) talk to me: the social context of infant-directed speech and its effects on early language acquisition. Current Directions in Psychological Science, 24(5), 339–44.CrossRefGoogle Scholar
Grieser, D. L., & Kuhl, P. K. (1988). Maternal speech to infants in a tonal language: support for universal prosodic features in motherese. Developmental Psychology, 24(1), 1420.CrossRefGoogle Scholar
Hayashi, A., Tamekawa, Y., & Kiritani, S. (2001). Developmental change in auditory preferences for speech stimuli in Japanese infants. Journal of Speech, Language, and Hearing Research, 44(6), 1189–200.CrossRefGoogle ScholarPubMed
Hirsh-Pasek, K., Adamson, L. B., Bakeman, R., Owen, M. T., Golinkoff, R. M., Pace, A., … & Suma, K. (2015). The contribution of early communication quality to low-income children's language success. Psychological Science, 26(7), 1071–83.CrossRefGoogle ScholarPubMed
IBM Corp. (2016). IBM SPSS Statistics for Windows, Version 24.0. Armonk, NY: IBM Corp.Google Scholar
Igualada, A., Bosch, L., & Prieto, P. (2015). Language development at 18 months is related to multimodal communicative strategies at 12 months. Infant Behavior and Development, 39, 4252.CrossRefGoogle ScholarPubMed
Iverson, J., & Goldin-Meadow, S. (2005). Gesture paves the way for language development. Psychological Science, 16, 367–71.Google ScholarPubMed
Kaplan, P. S., Goldstein, M. H., Huckeby, E. R., Owren, M. J., & Cooper, R. P. (1995). Dishabituation of visual attention by infant- versus adult-directed speech: effects of frequency modulation and spectral composition. Infant Behavior and Development, 18(2), 209–23.CrossRefGoogle Scholar
Karzon, R. G. (1985). Discrimination of polysyllabic sequences by one- to four-month-old infants. Journal of Experimental Child Psychology, 39(2), 326–42.CrossRefGoogle ScholarPubMed
Kempe, V., Brooks, P. J., & Gillis, S. (2005). Diminutives in child-directed speech supplement metric with distributional word segmentation cues. Psychonomic Bulletin & Review, 12(1), 145–51.CrossRefGoogle ScholarPubMed
Kitamura, C., Thanavishuth, C., Burnham, D., & Luksaneeyanawin, S. (2002). Universality and specificity in infant-directed speech: pitch modifications as a function of infant age and sex in a tonal and non-tonal language. Infant behavior and Development, 24(4), 372–92.CrossRefGoogle Scholar
Kuhl, P., Andruski, J., Chistovich, I., Chistovich, L., Kozhevnikova, E., Ryskina, V., … & Lacerda, F. (1997). Cross-language analysis of phonetic units in language addressed to infants. Science, 277(5326), 684–6.CrossRefGoogle ScholarPubMed
Lausberg, H., & Sloetjes, H. (2009). Coding gestural behavior with the NEUROGES-ELAN system. Behavior Research Methods, Instruments, & Computers, 41, 841–9.CrossRefGoogle Scholar
Lee, S., Davis, B. L., & MacNeilage, P. F. (2008). Segmental properties of input to infants: a study of Korean. Journal of Child Language, 35(3), 591617.CrossRefGoogle ScholarPubMed
Majorano, M., & D'Odorico, L. (2011). The transition into ambient language: a longitudinal study of babbling and first word production of Italian children. First Language, 31(1), 4766.CrossRefGoogle Scholar
Messer, D. J. (1981). The identification of names in maternal speech to infants. Journal of Psycholinguistic Research, 10(1), 6977.CrossRefGoogle Scholar
Molnar, M., Carreiras, M., & Gervain, J. (2016). Language dominance shapes non-linguistic rhythmic grouping in bilinguals. Cognition, 152, 150–9.CrossRefGoogle ScholarPubMed
Murillo, E., & Belinchón, M. (2012). Gestural–vocal coordination: longitudinal changes and predictive value on early lexical development. Gesture, 12, 1639.CrossRefGoogle Scholar
Murillo, E., & Belinchón, M. (2013). Patrones comunicativos multimodales en la transición a las primeras palabras: cambios en la coordinación de gestos y vocalizaciones. [Multimodal communicative patterns on the transition to first words: changes in the coordination of gesture and vocalization]. Infancia y Aprendizaje, 36, 473–87.CrossRefGoogle Scholar
Newman, R. S., & Hussain, I. (2006). Changes in preference for infant-directed speech in low and moderate noise by 4.5-to 13-month-olds. Infancy, 10(1), 6176.CrossRefGoogle Scholar
Papousek, M., Papousek, H., & Bornstein, M. H. (1985). The naturalistic vocal environment of young infants: on the significance of homogeneity and variability in parental speech. In Field, T. & Fox, N. (Eds.), Social perception in infants (pp. 269–97). Norwood NJ: Ablex.Google Scholar
Pegg, J. E., Werker, J. F., & McLeod, P. J. (1992). Preference for infant-directed over adult-directed speech: evidence from 7-week-old infants. Infant Behavior and Development, 15(3), 325–45.CrossRefGoogle Scholar
Ramírez-Esparza, N., García-Sierra, A., & Kuhl, P. K. (2014). Look who's talking: speech style and social context in language input to infants are linked to concurrent and future speech development. Developmental Science, 17(6), 880–91.CrossRefGoogle ScholarPubMed
Räsänen, O., Kakouros, S., & Soderstrom, M. (2018). Is infant-directed speech interesting because it is surprising? Linking properties of IDS to statistical learning and attention at the prosodic level. Cognition, 178, 193206.CrossRefGoogle ScholarPubMed
Romero, A., Etxebarria, A., de Pablo, I., & Romero, A. (2017). Interrelación entre gestos y vocalizaciones en funciones comunicativas tempranas: Evidencias desde la lengua vasca [Interrelation between gestures and vocalizations in early communicative functions: Evidence from the Basque language]. Revista signos, 50(93), 96123.CrossRefGoogle Scholar
Rowe, M. L. (2012). A longitudinal investigation of the role of quantity and quality of child-directed speech in vocabulary development. Child Development, 83(5), 1762–74.Google ScholarPubMed
Saint-Georges, C., Chetouani, M., Cassel, R., Apicella, F., Mahdhaoui, A., Muratori, F., … & Cohen, D. (2013). Motherese in interaction: at the cross-road of emotion and cognition? (A systematic review). PloS one, 8(10), e78103.CrossRefGoogle Scholar
Santazilia, E., & Zubiri, J. J. (2014). La salvaguarda del lenguaje infantil en euskera en apoyo a la transmisión lingüística en Navarra [Fostering Basque child-directed speech to support language transmission in Navarre]. In Salaberri, P. (Ed.) El patrimonio cultural inmaterial: ámbito de la tradición oral y de las particularidades lingüísticas. Pamplona, Navarra: Cátedra Archivo del patrimonio inmaterial de Navarra.Google Scholar
Scherer, K. R. (1986). Vocal affect expression: a review and a model for future research. Psychological Bulletin, 99(2), 143–65.CrossRefGoogle Scholar
Segal, J., & Newman, R. S. (2015). Infant preferences for structural and prosodic properties of infant-directed speech in the second year of life. Infancy, 20(3), 339–51.CrossRefGoogle Scholar
Segal, O., Nir-Sagiv, B., Kishon-Rabin, L., & Ravid, D. (2009). Prosodic patterns in Hebrew child-directed speech. Journal of Child Language, 36(3), 629–56.CrossRefGoogle ScholarPubMed
Senju, A., & Csibra, G. (2008). Gaze following in human infants depends on communicative signals. Current Biology, 18(9), 668–71.CrossRefGoogle ScholarPubMed
Soderstrom, M. (2007). Beyond babytalk: re-evaluating the nature and content of speech input to preverbal infants. Developmental Review, 27(4), 501–32.CrossRefGoogle Scholar
Spinelli, M., Fasolo, M., & Mesman, J. (2017). Does prosody make the difference? A meta-analysis on relations between prosodic aspects of infant-directed speech and infant outcomes. Developmental Review, 44, 118.CrossRefGoogle Scholar
Thiessen, E. D., Hill, E. A., & Saffran, J. R. (2005). Infant-directed speech facilitates word segmentation. Infancy, 7(1), 5371.CrossRefGoogle ScholarPubMed
Werker, J. F., & McLeod, P. J. (1989). Infant preference for both male and female infant-directed talk: a developmental study of attentional and affective responsiveness. Canadian Journal of Psychology / Revue canadienne de psychologie, 43(2), 230–46.CrossRefGoogle ScholarPubMed
Werker, J. F., Pons, F., Dietrich, C., Kajikawa, S., Fais, L., & Amano, S. (2007). Infant-directed speech supports phonetic category learning in English and Japanese. Cognition, 103(1), 147–62.CrossRefGoogle ScholarPubMed
Wu, Z., & Gros-Louis, J. (2014). Infants’ prelinguistic communicative acts and maternal responses: relations to linguistic development. First Language, 34, 7290.CrossRefGoogle Scholar
Figure 0

Table 1. Characteristics of the sample

Figure 1

Table 2. Acoustic characteristics of the videos

Figure 2

Table 3. Time spent looking at the adult (s)

Figure 3

Table 4. Results of the repeated-measures ANOVAS conducted on the frequency of communicative behaviors, gestures, and vocalization depending on the type of speech and the language

Figure 4

Figure 1. Frequency of total communicative behaviors, gestures, and vocalizations in IDS and ADS conditions.

Figure 5

Figure 2. Frequencies of multimodal productions in Spanish and Basque in IDS and ADS conditions.

Figure 6

Table 5. Frequency of each type of multimodal communicative behavior

De Pablo et al. supplementary material

De Pablo et al. supplementary material 1

Download De Pablo et al. supplementary material(Video)
Video 29.7 MB

De Pablo et al. supplementary material

De Pablo et al. supplementary material 2

Download De Pablo et al. supplementary material(Video)
Video 28.5 MB

De Pablo et al. supplementary material

De Pablo et al. supplementary material 3

Download De Pablo et al. supplementary material(Video)
Video 29.3 MB

De Pablo et al. supplementary material

De Pablo et al. supplementary material 4

Download De Pablo et al. supplementary material(Video)
Video 29.2 MB