Hostname: page-component-745bb68f8f-b95js Total loading time: 0 Render date: 2025-02-11T09:49:07.707Z Has data issue: false hasContentIssue false

Language practice with multimedia supported web-based grammar revision material

Published online by Cambridge University Press:  01 September 2010

Meltem Huri Baturay*
Affiliation:
Institute of Informatics, Gazi University, Milas Sok. Teknikokullar, Beşevler, Ankara, Turkey. Phone: +90 (312) 202 38 05; Fax: +90 (312) 202 37 91 (email: baturay@gazi.edu.tr)
Aysegul Daloglu*
Affiliation:
Department of Foreign Language Education, Middle East Technical University, Faculty of Education, 06531 Ankara, Turkey. Phone: +90 (312) 210 4007; Fax: +90 (312) 210 4146 (email: daloglu@metu.edu.tr)
Soner Yildirim*
Affiliation:
Department of Computer Education & Instructional Technology, Middle East Technical University, Faculty of Education, 06531 Ankara, Turkey. Phone: +90 (312) 210 4007; Fax: +90 (312) 210 4146 (email: soner@metu.edu.tr)
Rights & Permissions [Opens in a new window]

Abstract

The aim of this study was to investigate the perceptions of elementary-level English language learners towards web-based, multimedia-annotated grammar learning. WEBGRAM, a system designed to provide supplementary web-based grammar revision material, uses audio-visual aids to enrich the contextual presentation of grammar and allows learners to revise target grammatical structures using interactive exercises such as gap-filling, combo-box and drag-and-drop exercises. This study gathered quantitative data on learner satisfaction, attention and participation and qualitative data with regard to the material’s content, visual and instructional design, usability, practicality and effectiveness. The findings indicate that learners enjoyed using the material and developed a positive attitude towards the system.

Type
Research Article
Copyright
Copyright © European Association for Computer Assisted Language Learning 2010

1 Introduction

Over the last decade, ideas that second-language learning requires a certain amount of focus on form and that form should, to some extent, be learned explicitly have been steadily gaining ground (Norris & Ortega, Reference Norris and Ortega2000). Exactly what instructional activities this implies, however, remains the subject of considerable controversy. The use of information communication technologies (ICT) has become widespread in recent years (Liou, Reference Liou2000; Warschauer, Reference Warschauer2000), and studies measuring the effects of technology-enhanced instruction on language learning have also grown in number (Al-Jarf, Reference Al-Jarf2004; Meskill & Anthony, Reference Meskill and Anthony2005; Schwienhorst, Reference Schwienhorst2004; Banados, Reference Banados2006; Scida & Saury, Reference Scida and Saury2006). Yet, despite the increased role of computer-assisted language learning (CALL) in curriculum and instruction, its effects on language development and, more specifically, grammar learning, is an area that requires further exploration.

Technology is used to perform many functions in the language classroom. One function has been to create the main characteristics of a communicative classroom by engaging learners in real and meaningful communication. Another major function has been to provide opportunities for learners to practise the language through mechanical activities that are not normally used in the classroom. As Felix (Reference Felix2001) states, new technologies offer excellent opportunities for adding value to classroom teaching in a variety of ways. Through on-line exercises, learners have the opportunity to select from a given set of options or to construct their own answers, and texts, graphics, audio and video materials can be used as media for the presentation of questions and answers (Wu, Witten, Edwards, Nichols & Aquino, Reference Wu, Witten, Edwards, Nichols and Aquino2007). However, only when on-line learning environments are properly structured can they move instruction from teacher-centered, lecture-based, passive instruction to learner-centered, self-reflective and active learning. It is worth noting that technology itself does not cause advances in learners’ cognitive abilities, nor does it guarantee the development of higher order skills, which can only be developed in a well-designed, properly structured learning environment (Quitadamo & Brown, Reference Quitadamo and Brown2001). In addition, Ma and Kelly (Reference Ma and Kelly2006) emphasize that the quality of CALL programs is determined more by their methodology than by their computer technology. It is also important that during the instructional process students are made aware of the fact that learning English through multimedia demands new learning strategies and self-directed learning (Yang & Chen, Reference Yang and Chen2007).

Clark and Mayer (Reference Clark and Mayer2003) suggest some principles regarding multimedia use in designing web courses based on cognitive learning theory. They suggest using words and graphics rather than words alone (multimedia principle), placing corresponding words and graphics near to each other (contiguity principle), presenting words as audio narration rather than on-screen text (modality principle), avoiding extraneous sounds (coherence principle), avoiding presenting words in both text and audio narration (redundancy principle), and using conversational style and virtual coaches (personalization principle). However, it is suggested that these recommendations might change according to the goal of training, the prior knowledge of the learners and the environment in which the training will be deployed.

According to Mayer’s generative theory, which is a cognitive psychological theory on processing information, multimedia learning provides the learner with information through different (e.g. visual, auditory) modes (Mayer, Reference Mayer2001). Mayer’s theory is based on Paivio’s (Reference Paivio1990) dual-coding theory, which claims that words that are coded in two modes are learned better than those coded using only one mode. Paivio’s dual-coding theory is supported by the research of Plass, Chun, Mayer and Leutner (Reference Plass, Chun, Mayer and Leutner1998), who found that learning is best when new language input is both visually and verbally annotated. Furthermore, a multimedia environment takes into account individual differences in learning preferences by offering learners a choice from among different modes of information, made attractive through enjoyable activities supported by sound, visuals, animations and video.

2 Computer-based grammar teaching

Computer-based grammar teaching has not received the same amount of attention as communicative CALL (Nutta, Reference Nutta1998). Although it offers many benefits, the use of computers to teach grammar has not increased through the years and has not been researched as much as the communicative aspects of CALL. While computers are unable to completely engage learners in authentic two-way communication, they can, in fact, provide rich input in the form of integrated multimedia programs and explicit grammar explanations that learners can review at their own pace (op. cit., 1998).

The literature, does include some research studies on computer use in second language grammar learning and materials. According to Al-Jarf (Reference Al-Jarf2005), research into the use of computer-assisted instruction in English-language teaching indicates that computer-based grammar instruction can be as effective as or more effective than traditional techniques of instruction such as workbooks and lectures. These findings should hopefully lead to a greater role for multimedia tools that develop grammatical competence within the context of English language teaching. In their study on researcher created drill and practice courseware, Liou, Wang and Hung-Yeh (Reference Liou, Wang and Hung-Yeh1992) found that a combination of traditional instruction and CALL seems to contribute to L2 learning more than traditional instruction alone. Nagata (Reference Nagata1996), in his study on intelligent computer versus workbook grammar instruction, found that computer instruction is more effective for teaching grammatical skills and intelligent feedback is important. In another study on computer assisted meta-linguistic instruction to teach grammatical structures, Nagata (Reference Nagata1997) found that students were able to understand complex grammatical concepts through computer exercises with the help of meta-linguistic feedback. Gonzalez-Bueno and Perez (Reference Gonzalez-Bueno and Perez2000) in their study on grammatical and lexical accuracy and quantity of language through e-mail found significant advantages of using e-mail over paper-and-pencil-based dialogue journals in terms of quantity of language, but no advantages in the development of lexical and grammatical accuracy.

Due to the increase in the availability and usage of web-based courses, many research studies have been conducted to examine learners’ attitudes and satisfaction regarding the implementation of a web-based course. Understanding how these factors influence the learning experiences of learners is important because it necessitates improvements in web–based courses to make them more effective (Kim & Moore, Reference Kim and Moore2005). The success of any training material is largely dependent on the learners’ motivation and attitude, which are mostly affected by the material’s usability and user-friendliness. Whenever learners complain about web-based learning material, it is mostly the interface and usability of the material, rather than the educational content of the material which concerns them. Usability has a significant role on the success of e-learning since poor usability might well obstruct learning (Ardito et al., Reference Ardito, Costabile, De Marsico, Lanzilotti, Levialdi, Roselli and Rossano2006). Therefore, educators must attempt to stimulate and sustain student motivation through the design of effective interactions in web-based learning environments (Reeves & Reeves, Reference Reeves and Reeves1997). Berzosa and Rokowski (Reference Berzosa and Rokowski2000) found the motivation of the learners to be the most outstanding characteristic of computer assisted language learning. Thus, there are questions to be answered after releasing any material for learners’ use: what do the learners really think about the use and usability of the learning material? Are they satisfied with it, and how much time do they allocate for studying with it?

The purpose of the current study was to determine how learners respond to the usability of web-based supplementary material and to investigate whether such material supports their learning in a user-friendly manner. The study is expected to contribute to the literature by providing research findings and conclusions on computer-assisted language learning with lower level learners (Campbell, Brown & Weatherford, Reference Campbell, Brown and Weatherford2008) specifically on computer-based grammar teaching (Nutta, Reference Nutta1998) and contribute to the limited literature about assessing the effectiveness of hybrid online language courses (Murday, Ushida & Chenoweth, Reference Murday, Ushida and Chenoweth2008).

3 Outline of the study

This study reports on the major characteristics of WEBGRAM, a web-based grammar revision support system, and learners’ perceptions of the material. As suggested by Clark and Mayer (Reference Clark and Mayer2003), the software that is the focus of this study was designed with cognitive learning theory principles (multimedia, contiguity, modality and personalization were employed) at its foundation and features of effective web-based materials and foreign language grammar instruction techniques as its main points of reference. Following the main principles of WEBVOCLE (Baturay, Yıldırım & Daloğlu, Reference Baturay, Yıldırım and Daloğlu2009), an earlier system developed by the researchers that focused on vocabulary retention, the contextual presentation of the grammatical structures in WEBGRAM was enriched with multimedia resources, taking account of cognitive learning theory principles in a web-supported environment. Differing from other grammar teaching materials, WEBGRAM provided learners with spaced repetition of grammatical structures based on Ebbinghaus’s rate of forgetting curve (1885, cited in Waring, Reference Waring2004), which suggests that repetitions distributed over time may support long-term memory retention. All these arrangements were hypothesized to affect positively learners’ perceptions of the material, as well as their attention and satisfaction levels.

WEBGRAM was designed as support material to present, explain and provide opportunities for the practice of grammatical structures outside the classroom. As a result, more classroom time can be dedicated to real communication that focuses on expressing meaning and using appropriate grammatical structures to express that meaning, as suggested by Nutta (Reference Nutta1998). It aims to give learners the chance to regulate their own learning through the use of effective time-management strategies, self-assessment of learning outcomes and the establishment of personalized learning targets. Through the individualized instruction provided by the material, teachers can identify areas that require further classroom focus and provide remedial instruction in these areas.

This study aimed to answer the following questions:

  1. 1 What are learners’ perceptions regarding the content, visual and overall design of the web-based material?

  2. 2 What are learners’ levels of satisfaction, attention and participation with the online material and how do they compare with those of traditional methods?

4 Method

4.1 The students

The study was conducted in the fall semester of the 2007–2008 academic year. The participants comprised 54 English language learners at Gazi University School of Foreign Languages in Ankara, Turkey (female: 19; male: 35; age range: 17–23 years). Participating learners were enrolled in one of two sections of a compulsory language course and had the same level of English-language proficiency (elementary), as determined by a universal examination required for all entering students at the School of Foreign Languages. Students in these two sections received the same instruction as students in the other sections of the course, but were also given WEBGRAM as supplementary material for the revision of pre-learned grammatical structures.

4.2 Data collection and analysis

This study is both quantitative and qualitative in nature. Quantitative data was collected through the checklists and surveys; qualitative data was collected through the comment parts in the checklists. Reeves (Reference Reeves1997) stated that the qualitative paradigm explores (a) the dynamics of interactions with the emphasis on the world as a socially constructed reality involving multiple perspectives; (b) the various possible interpretations through the perceptions and values of all the participants in a situation. Quantitative data was descriptively analyzed which simply means that frequencies and standard deviations were employed. Qualitative data included iterative cycles of examining the patterns and ideas in the participants’ comments. Then, the researchers explored similarities and differences among the learners’ views from the collected data. Later, the general themes were identified and the researchers searched for confirming and disconfirming evidences about these themes that would be incorporated into the conclusions. After counting the themes and ‘yes/no’ with ‘not sure’ responses in the checklist, all data were presented in frequencies and percentages. Data regarding demographics, previous experience with web-based learning and location of computer access of learners were collected at the beginning of the semester, whereas, satisfaction and attention scores and qualitative data were collected at the end.

4.3 The checklist

Learners’ perceptions about WEBGRAM’s visual and instructional design, usability, practicality and effectiveness were obtained through a 16-item checklist containing closed-ended items organized into three main areas (Content Design: 5 items; Visual Design: 4 items; Overall Design: 7 items). Learners were asked to respond ‘yes/no’ or ‘not sure’ to the closed-ended items and were provided with extra space where they could write down any additional comments. In designing the checklist, researchers were guided by the first of Kirkpatrick’s (Reference Kirkpatrick1994) four levels of training evaluation, which focuses on student thoughts and feelings in response to the training. The items addressing the visual design of the material were chosen from Heinich, Molenda, Russell and Smaldino (Reference Heinich, Molenda, Russell and Smaldino2002). The information on learner response to the material that was obtained through the checklists helped the researchers to make necessary modifications and improvements to the WEBGRAM design after the study.

4.4 Attention and satisfaction survey

In addition to the checklist, at the end of the semester, learners were asked to complete a survey about their attention levels and satisfaction with WEBGRAM. Specifically, learners were asked to comment on how effective they perceived on-line learning to be and how satisfied they were with the specific components of the on-line material. Using a 1–5 Likert Scale (1 = “not true”, 5 = “very true”), learners were asked to report their perceptions by responding to twelve statements about attention and six questions about satisfaction. The statements were adapted from Keller’s Instructional Materials Motivation Survey (IMMS) (1993), which was developed from two of the four components (attention, relevance, confidence and satisfaction) of his ARCS motivation model (1987). The scale was translated into Turkish and given to learners in their native language. The responses of the negative manner items in the attention subscale were reversed before the mean was calculated for the attention survey as suggested by Keller (Reference Keller1993). Reliability estimates were calculated, and Cronbach Alpha values of .89 and .92 were obtained, respectively, for the twelve questions on attention and the six questions on satisfaction.

5 The procedure

The main textbook used in the classroom was Face2Face, Elementary (Redston & Cunningham, Reference Redston and Cunningham2007), whereas the contents of the WEBGRAM web-based grammar revision support system were adapted from the textbook Focus on Grammar 1 (Schoenberg & Maurer, Reference Schoenberg and Maurer2006) with the consent of the publisher. Focus on Grammar 1 was selected because the content and grammar points were at the same language proficiency level and parallel to Face2Face, Elementary. WEBGRAM provided learners with additional exercises on two grammar issues they had studied in class.

At the beginning of the semester, learners were asked to complete a needs assessment questionnaire in order to identify their competencies and needs in using computers. According to their responses, 53 out of 54 learners (98%) had adequate computer skills and/or experience. The questionnaire also asked learners to rate their previous experience with web-based learning, based on the categories identified by Burrows (Reference Burrows2001), as follows: (1): I have attended one or more web-based learning applications that were delivered completely via Internet; (2) I have used one or more blended learning applications; (3) I have had one or more experiences with web-supported instruction by visiting educational web sites, participating in forums and using list-servers; and (4) I have not had any prior experience with web-based instruction. The results indicated that none of the participants had previous experience with web-based or blended learning and only 26 percent of participants had some experience with web-supported instruction.

Before providing learners with access to WEBGRAM, a 30-minute exploration lesson was presented by one of the researchers that explained how to register, log-in and log-out of the system. Participants were also asked where they would use WEBGRAM. The majority of participants relied on off-campus Internet access, which typically had lower speed than on-campus access. Slightly more than half (56%) of learners reported using WEBGRAM at Internet Cafés, less than half (29%) of participants used it on their own computers at home, and the remainder (15%) used it on shared computers available in their residence halls (Table 1).

Table 1 Location of computer access

Grammar structures were pre-taught in class. As a supplement, WEBGRAM focused on two grammar issues: Simple Present Tense and Definite/Indefinite articles with ‘some’ and ‘any’.

WEBGRAM was implemented in three phases, as follows:

Phase 1 (1st revision): Phase 1 includes a total of four exercises, including a combo-box and fill-in-the-blanks exercises (Figures 2 and 3).

Fig. 1 A sample informative page (includes English and Turkish translation of the instructions)

Fig. 2 A sample reading and listening activity from Module B

Fig. 3 A sample combo-box exercise from module A

  1. A. Simple present tense: Structures are introduced in context through a reading and listening activity, followed up by combo-box and fill-in-the-blanks exercises.

  2. B. Definite and indefinite articles: Structures are introduced in context through a reading and listening activity, followed up by combo-box and fill-in-the-blanks exercises.

Phase 2 (2nd revision): A1, B1. Phase 2 includes a total of four fill-in-the-blanks writing exercises (Figures 4 and 5) – two for the practice of simple present tense and two for the practice of definite and indefinite articles.

Fig. 4 A sample fill-in-the-blanks writing exercise from A1

Fig. 5 A sample fill-in-the-blanks writing exercise from B1

Phase 3 (3rd revision): A2, B2. Phase 3 includes a total of two drag-and-drop listening exercises (Figure 6) – one for the practice of simple present tense and one for the practice of definite and indefinite articles.

Fig. 6 A sample drag-and-drop listening exercise from A2

Each WEBGRAM phase has an introductory explanation in Turkish and English (Figure 1).

For listening activities, learners were provided with audio versions of dialogues (Figure 2).

Figures 36 show examples of, respectively, a listening activity, a combo-box activity (A), a fill-in-the-blank activity (A1), a fill-in-the-blank activity (B1) and a drag-and-drop activity (A2).

Learners spent approximately 20–25 minutes on each activity in modules A and B and approximately 10–15 minutes on each of the revision activities (A1, B1 and A2, B2).

The WEBGRAM system included a reporting page through which the instructor was able to access information on each student’s performance. By clicking on a student’s name, the instructor could observe the amount of time the student allocated for each exercise (Figure 7).

Fig. 7 Sample reporting page indicating learner participation

6 Findings

6.1 Learners’ Perceptions

Comments and suggestions on the content, visual appearance and overall design of the material were obtained from the checklists. Out of 54 learners, only 38 returned the checklists, and the majority of these did not provide comments (Table 2).

Table 2 Learners’ perceptions regarding the content, and visual and overall design of WEBGRAM

Learner feedback indicated that the language level of the WEBGRAM content was appropriate for the majority of learners (79%), who had no difficulties in comprehending the texts or deducing the meaning of grammatical structures from the given contexts (82%). Learners found the length of the dialogues appropriate (84%). Nearly half (47%) of the WEBGRAM learners were satisfied with the dialogue topics, with the most preferred content focusing on interpersonal relationships; however, some WEBGRAM users (37%) reported that they found the dialogues boring. The vast majority (92%) of WEBGRAM learners had no problems understanding the instructions.

With regard to the interface design, most WEBGRAM learners (87%) said they found it to be well-organized, harmonious and user-friendly, with the items well-placed on the web pages so that everything could be easily found. According to most learners (82%), the pictures helped them to comprehend the dialogues and the target grammatical structures by clarifying the details. The commonly used navigation tools, such as ‘back’, ‘next’, ‘drag’ and ‘drop’ did not create any problems and were found to be user-friendly for most learners (68%), nearly all of whom (98%) were computer literate. Moreover, most learners reported making use of WEBGRAM’s flexibility, which allowed them to skip some exercises and return to them later. Learners also emphasized the importance of using the ‘seeing the correct answer’ button, which made them aware of their mistakes and helped them refrain from making the same mistakes again. Most of the learners found the font size and type appropriate (92%).

The findings of this study indicated that more than half of the WEBGRAM learners (61%) were motivated to study the material. It should be noted that some learners stated that they were not satisfied (21%) or undecided (18%) about their satisfaction with WEBGRAM and that they thought it should contain more exercises and that the level of proficiency should be increased. Some learners (71%) found WEBGRAM suitable as supplementary material to in-class learning. These learners (16%) stated that WEBGRAM allowed them to access extra exercises to revise the pre-learned grammatical structures in a practical way, since they often had difficulties in finding other exercises appropriate for their level of grammar and vocabulary competence outside the textbook. Others (21%) stated that studying grammar and pronunciation at home was more enjoyable for them. One learner stated, “At home I was able to study and learn Simple Present Tense, which I had not understood at school.” WEBGRAM was designed so that the given contexts for target grammatical points supply learners with the clues needed for knowledge construction. This study found that most of the learners (90%) were satisfied with learning grammar in context and that this technique made it easier for them to learn the target grammatical structures. Learners (92%) also liked the fact that WEBGRAM gave them the ability to repeatedly revise these structures by themselves, without a CD and player, and recall these structures. In addition, most learners (84%) said they enjoyed listening to the dialogues because it helped them to decrease their pronunciation mistakes and improve their pronunciation of the words in the dialogues and their spoken English in general. Although learners were accustomed to a traditional classroom environment and had no prior experience with web-based learning, most learners (76%) found using WEBGRAM fast, organized and not unduly time-consuming. Although the majority of WEBGRAM learners (84%) found it trouble-free and uncomplicated from a technical point of view, some users (11%) reported problems related to slow screen loads caused by a low connection speed and screen resolution and/or browser incompatibility that caused navigation buttons to disappear from their computer screens.

6.2 Learners’ Satisfaction, Attention, and Participation Levels

Data on learner satisfaction and attention levels were collected through the questionnaires and descriptively analyzed. Student participation time, i.e. the time spent working on the material, was measured in minutes and seconds. The results indicate that learners reported above-average satisfaction with WEBGRAM (M = 3.33, SD = 1.2). Similarly, the result of the attention survey shows an above-average attention level (M = 3.52, SD = 1.1) (Table 3).

Table 3 Mean scores for participation, satisfaction and attention

* The time was measured in minutes and seconds.

When each item in the surveys was descriptively analyzed (Table 4), the results indicated that the material stimulated learners’ curiosity (M = 3.02) and the content of the material helped keep their attention on the course (M = 3.08). The arrangement of the information on the pages (M = 3.00) and the quality of the writing helped to keep their attention (M = 3.00). They did not find the course material abstract (M = 1.67), nor did they find its pages dry and unappealing (M = 1.65). However, there were items indicating moderate attention levels: the existence of something interesting at the beginning of the course (M = 2.71) and finding the learnt things surprising or unexpected (M = 2.35). The repetitions throughout the material did not cause the learners to get bored (M = 2.18).

Table 4 Mean scores for each item of the attention and satisfaction surveys

1 = Not true, 2 = Slightly true, 3 = Moderately true, 4 = Mostly true, 5 = Very true.

The satisfaction scores indicated that learners felt good when they successfully completed the exercises in the course (M = 3.67); they were pleased to work on the well-designed material (M = 3.51) and they liked the way feedback was given (M = 3.37). They enjoyed the web-based course (M = 3.20) and they stated that they would like to know more about the topic presented in the web-based material (M = 3.22).

7 Discussion

The learners were satisfied with the level of the content of the material and they found the texts comprehensible. As Jonassen (Reference Jonassen1994) has suggested, constructing learning environments that are context- and content-dependent enable knowledge construction that leads to meaningful learning. The learners found that using the WEBGRAM material for studying was not unduly time-consuming, which met their expectations in this respect. Smart and Cappel (Reference Smart and Cappel2006) have stated that assignment length and time required to complete on-line modules are key factors in on-line learning because they seriously affect learner motivation. Unless learners feel that the amount of time they spend completing modules in an on-line environment is worthwhile in terms of the knowledge gained, they will lose the motivation to study the material (ibid.). This study found learners to be satisfied with the material’s organized, convenient, quickly and easily accessible material. Learners’ comments indicate that the material enabled them to learn and revise the target grammatical structures in approximately fifteen minutes. However, some users found the dialogues boring. As Yang (Reference Yang2001) has emphasized, interest is the impetus of learning. Other studies suggest that learners’ interest in the content is among the most important factors influencing their motivation (Adler, Milne & Stablein, Reference Adler, Milne and Stablein2001). The learners felt comfortable using the material to study. They found it user-friendly and flexible enough, which allowed them to skip some exercises and return to them later. As Quitadamo and Brown (Reference Quitadamo and Brown2001) have emphasized, a well-designed and properly structured on-line learning environment leads to the development of higher-order thinking skills.

Learners’ perceptions regarding the concurrent use of pictures and dialogue are consistent with Paivio’s dual-coding theory (Reference Paivio1990). As the literature points out, broadening learners’ potential by providing pictures, audio and video is a popular method in foreign language learning (Johnson & Heffernan, Reference Johnson and Heffernan2006).

The learners seemed to be intrinsically motivated to study the material. According to Krashen (Reference Krashen1985) and Chang (Reference Chang2005), learners who possess high motivation and self-confidence are better equipped for success in second-language acquisition. Chang and Lehman (Reference Chang and Lehman2002) found that students who were intrinsically motivated performed better academically at an instructional computer-based language-learning program. Ardito et al. (Reference Ardito, Costabile, De Marsico, Lanzilotti, Levialdi, Roselli and Rossano2006) assert that the success of any training program is largely dependent on students’ motivation and attitude. The instructional design of the material incorporated context-based grammar learning and learner-centered learning approaches into an on-line learning environment so as to support learners’ development of reasoning and problem-solving skills. Learners were expected to study via web material which was constructed in light of how the mind learns and experimental evidence concerning e-learning features that promote best learning (Clark & Mayer, Reference Clark and Mayer2003). The learners were satisfied with learning grammar by studying with this supplementary material and stated that it made easier for them to learn the target grammatical structures. This finding concurs with Liou, Wang and Hung-Yeh (Reference Liou, Wang and Hung-Yeh1992), who found that the combination of classroom instruction and grammatical CALL might be helpful.

Attention, the primary aspect of Keller’s ARCS model (Reference Keller1987), which coincides with the first step in Gagne’s (Reference Gagne1965) “events of instruction”, has to do with gaining and keeping the learner’s attention. Keller’s strategies include sensory stimuli, inquiry arousal (thought-provoking questions) and variability (variance in exercises and use of media). The online material’s use of multimedia is believed to create a learning environment that stimulates learners’ attention and promotes satisfaction. Keller (Reference Keller1987) suggests that learners must obtain some type of satisfaction or reward from the learning experience. This can take the form of entertainment or a sense of achievement. External rewards such as praise from the teacher, a high mark on a test, or a self-assessment exercise acknowledging the user’s correct answers in a web-based learning environment are important; however, most important of all is learner satisfaction upon finding that studied items are useful and can help in obtaining high marks in coursework. Most of the learners were satisfied with the material. In fact, learners taking web–based courses are reported to be generally satisfied with their learning experience (Kim & Moore, Reference Kim and Moore2005; Wegner et al., Reference Wegner, Holloway and Garton1999).

To conclude, almost all of the learners had positive perceptions regarding the usability and user-friendliness of the web-based material. Most of the learners were satisfied with the material which attracted their attention and aroused interest. In a similar online French course, most of the students reported being satisfied with the course and their progress learning the language (Chenoweth & Murday, Reference Chenoweth and Murday2003). However, modifications might be made in areas where learners indicated moderate attention level scores. For example, the beginning of the material might be made more interesting and some surprising or unexpected things might be added into the modules to arouse curiosity and motivation.

8 Conclusions and further recommendations

This study suggests that blended learning of grammar – i.e. the use of supplementary web-based grammar revision material as an aid to in-class learning – can be used effectively in language courses. The findings reflect the perceptions of users which might be helpful to other practitioners or designers of online learning materials. However, the effects of web-based foreign-language instruction on students’ perceived satisfaction and attention are still open to further investigation. In view of the current trend towards the integration of ICT into the curriculum, educational institutions need to be aware that in order to effectively benefit from these new technologies, curriculum design and instructional environments must be reinforced and updated. In designing any web-based material, the designer should keep in mind the fact that on-line education should not attempt to duplicate face-to-face learning/teaching, but should take into account the many facilities available when using the Internet that are specific to on-line instruction. The design of e-learning applications deserves special attention. Designers need to follow both multimedia and pedagogical principles to develop effective and user-friendly web-based educational material.

Acknowledgement

We would like to acknowledge the contribution of İbrahim Abadanoğlu in developing the web-based material.

References

Adler, R. W., Milne, M. J.Stablein, R. (2001) Situated motivation: An empirical test in an accounting class. Canadian Journal of Administrative Sciences, 18(2): 101116.CrossRefGoogle Scholar
Al-Jarf, R. (2004) The effects of Web-based learning on struggling EFL college writers. Foreign Language Annals, 37(1): 4957.Google Scholar
Al-Jarf, R. (2005) The effects of on-line grammar instruction on low proficiency EFL college students’ achievement. The Asian EFL Journal Quarterly, 7(4): 166190.Google Scholar
Ardito, C., Costabile, M. F., De Marsico, M., Lanzilotti, R., Levialdi, S., Roselli, T.Rossano, V. (2006) An approach to usability evaluation of e-learning applications. Universal Access in the Information Society International Journal, 4(3): 270283.Google Scholar
Banados, E. (2006) A blended-learning pedagogical model for teaching and learning EFL successfully through on online interactive multimedia environment. CALICO Journal, 23(3): 533550.Google Scholar
Baturay, M., Yıldırım, S.Daloğlu, A. (2009) Effects of web-based spaced repetition on vocabulary retention of foreign language learners. Eurasian Journal of Educational Research, 34: 1736.Google Scholar
Berzosa, M. J.Rokowski, P. E. (2000) CALL for Beginners: Motivation or Rejection. Proceedings of ESP conference 2000 ESP and IT 2000. http://www.it.uom.gr/elu/director/Google Scholar
Burrows, C. P. (2001) Faculty attitudes and perceptions concerning web-based instruction. A Ph.D. Dissertation. The Faculty of the Curry School of Education. University of Virginia, US.Google Scholar
Campbell, A., Brown, I.Weatherford, Y . (2008) A CALL Project with Low-Level EFL Students. 3rd World CALL International Conference, Fukuoka, Japan.Google Scholar
Chang, M. (2005) Applying self-regulated learning strategies in a web-based instruction–an investigation of motivation perception. Computer Assisted Language Learning, 18(3): 217230.Google Scholar
Chang, M. M.Lehman, J. D. (2002) Learning foreign language through an interactive multimedia program: An experimental study on the effects of the relevance component of the ARCS model. The Computer Assisted Language Instruction Consortium Journal, 20(1): 8198.Google Scholar
Chenoweth, N. A.Murday, K. (2003) Measuring student learning in an online French course. CALICO Journal, 20(2): 285314.CrossRefGoogle Scholar
Clark, R. C.Mayer, R. E. (2003) E-Learning and the Science of Instruction: Proven Guidelines for Consumers and Designers of Multimedia Learning. San Francisco, CA: Jossey-Bass/Pfeiffer.Google Scholar
Felix, U. (2001) A multivariate analysis of students’ experience of web-based learning. Australian Journal of Educational Technology, 17(1): 2136.Google Scholar
Gagne, R. M. (1965) The conditions of learning. New York: Holt, Reinehart & Winston.Google Scholar
Gonzalez-Bueno, M.Perez, L. C. (2000) Electronic mail in foreign language writing: A study of grammatical and lexical accuracy, and quantity of language. Foreign Language Annals, 33(2): 189198.Google Scholar
Heinich, R., Molenda, M., Russell, J. D.Smaldino, S. E. (2002) Instructional media and technologies for learning (7th edition). Upper Saddle River, NJ: Pearson Education Inc.Google Scholar
Johnson, A.Heffernan, N. (2006) The short readings project: A CALL reading activity utilizing vocabulary recycling. Computer Assisted Language Learning, 19(1): 6377.CrossRefGoogle Scholar
Jonassen, D. H. (1994) Thinking Technology: Towards a construvtivist design model. Educational Technology, 34(4): 3437.Google Scholar
Keller, J. M. (1987) Development and use of the ARCS model of instructional design. Journal of Instructional Development, 10(3): 210.CrossRefGoogle Scholar
Keller, J. M. (1993) Manual for the Instructional Materials Motivational Survey (IMMS). Unpublished manuscript, Tallahassee, FL.Google Scholar
Kim, K. S.Moore, J. L. (2005) Web-based learning: Factors affecting students’ satisfaction and learning experience. First Monday, 10(11), http://firstmonday.org/htbin/cgiwrap/bin/ojs/index.php/fm/article/viewArticle/1294/1214CrossRefGoogle Scholar
Kirkpatrick, D. L. (1994) Evaluating training programs: the four levels. San Francisco, CA: Berrett-Koehler.Google Scholar
Krashen, S. D. (1985) The input hypothesis: Issue and implications. New York: Longman.Google Scholar
Liou, H. C. (2000) Conceptualization and implementation of an English learning Web site which bridges TEFL theories and practices. Paper presented at the 4th International Conference on Multimedia Language Education, Chung-Li, Yuan Ze University.Google Scholar
Liou, H.-C., Wang, S. H.Hung-Yeh, Y. (1992) Can grammatical CALL help EFL writing instruction? CALICO Journal, 10(1): 2343.CrossRefGoogle Scholar
Ma, Q.Kelly, P. (2006) Computer assisted vocabulary learning: design and evaluation. Computer Assisted Language Learning, 19(1): 1545.CrossRefGoogle Scholar
Mayer, R. E. (2001) Multimedia learning. New York: Cambridge University Press.CrossRefGoogle Scholar
Meskill, C.Anthony, N. (2005) Foreign language learning with CMC: forms of on-line instructional discourse in a hybrid Russian class. System, 33(1): 89105.CrossRefGoogle Scholar
Murday, K., Ushida, E.Chenoweth, N. A. (2008) Learners’ and teachers’ perspectives on language online. Computer Assisted Language Learning, 21(2): 125142.CrossRefGoogle Scholar
Nagata, N. (1996) Computer vs. workbook instruction in second language acquisition. CALICO Journal, 14(1): 5375.CrossRefGoogle Scholar
Nagata, N. (1997) The effectiveness of computer-assisted metalinguistic instruction: A case study in Japanese. Foreign Language Annals, 30(2): 187200.CrossRefGoogle Scholar
Norris, J.Ortega, L. (2000) Effectiveness of L2 instruction: A research synthesis and quantitative meta-analysis. Language Learning, 50: 417528.Google Scholar
Nutta, J. (1998) Is computer-based grammar instruction as effective as teacher-directed grammar instruction for teaching L2 structures? The Computer Assisted Language Instruction Consortium Journal, 16(1): 4962.Google Scholar
Paivio, A. (1990) Mental representation: A dual coding approach. Oxford: Oxford University Press.CrossRefGoogle Scholar
Plass, J. L., Chun, D. M., Mayer, R. E.Leutner, D. (1998) Supporting visual and verbal learning preferences in a second-language multimedia learning environment. Journal of Educational Psychology, 90(1): 2536.CrossRefGoogle Scholar
Quitadamo, I. J.Brown, A. (2001) Effective teaching styles and instructional design for on-line learning environments. Washington, DC: Department of Education. (ERIC Document Reproduction Service No. ED462 942).Google Scholar
Redston, C.Cunningham, G. (2007) Face2Face Elementary. Cambridge: Cambridge University Press.Google Scholar
Reeves, T. C. (1997) Established and emerging evaluation paradigms for instructional design. In: Dills, C. R. and Romiszowski, A. J. (eds.), Instructional Development Paradigms. Englewood Cliffs, New Jersey: Educational Technology Publications, 163178.Google Scholar
Reeves, T. C.Reeves, P. M. (1997) The effective dimensions of interactive learning on the WWW. In: Khan, B. H. (ed.), Web-based instruction. Englewood Cliffs, NJ: Educational Technology Publications, 5966.Google Scholar
Schoenberg, I. E.Maurer, J. (2006) Focus on grammar 1 (3rd ed.). New York: Longman.Google Scholar
Scida, E. E.Saury, R. E. (2006) Hybrid courses and their impact on student and classroom performance: A case study at the University of Virginia. CALICO Journal, 23(3): 517531.Google Scholar
Schwienhorst, K. (2004) Native-speaker/non native-speaker discourse in the MOO: topic negotiation and initiation in a synchronous text-based environment. Computer Assisted Language Learning, 17(1): 3550.CrossRefGoogle Scholar
Smart, K. L.Cappel, J. J. (2006) Students’ perceptions of on-line learning: A comparative study. Journal of Information Technology Education, 5: 201219.Google Scholar
Waring, R. (2004) How to successfully use flashcards: In defense of learning words in word pairs. The Internet TESL Journal. http://iteslj.org/links/TESL/Articles/Vocabulary/Google Scholar
Warschauer, M. (2000) On-line learning in second language classrooms: An ethnographic study. In: Warschauer, M. and Kern, R. (eds.), Network-Based Language Teaching: Concepts and Practice. New York: Cambridge University Press, 4158.CrossRefGoogle Scholar
Wegner, S. B., Holloway, K. C.Garton, E. M. (1999) The effects of Internet-based instruction on student learning. Journal of Asynchronous Learning Networks, 3(2): 98106.Google Scholar
Wu, S., Witten, I. H., Edwards, A., Nichols, D.Aquino, R. (2007) A digital library of language learning exercises. International Journal of Emerging Technologies in Learning, 2: 1.Google Scholar
Yang, S. C. (2001) Integrating computer-mediated tools into the language curriculum. Journal of Computer Assisted Learning, 17(1): 8593.Google Scholar
Yang, S. C.Chen, Y. J. (2007) Technology-enhanced language learning: A case study. Computers in Human Behavior, 23: 860879.Google Scholar
Figure 0

Table 1 Location of computer access

Figure 1

Fig. 1 A sample informative page (includes English and Turkish translation of the instructions)

Figure 2

Fig. 2 A sample reading and listening activity from Module B

Figure 3

Fig. 3 A sample combo-box exercise from module A

Figure 4

Fig. 4 A sample fill-in-the-blanks writing exercise from A1

Figure 5

Fig. 5 A sample fill-in-the-blanks writing exercise from B1

Figure 6

Fig. 6 A sample drag-and-drop listening exercise from A2

Figure 7

Fig. 7 Sample reporting page indicating learner participation

Figure 8

Table 2 Learners’ perceptions regarding the content, and visual and overall design of WEBGRAM

Figure 9

Table 3 Mean scores for participation, satisfaction and attention

Figure 10

Table 4 Mean scores for each item of the attention and satisfaction surveys