Towards a signature pedagogy for technology-enhanced task-based language teaching: Defining its design principles

Abstract

This paper reports on ongoing research aimed at characterizing a signature pedagogy (Shulman, 2005) of technology-enhanced task-based language teaching (TETBLT). To achieve this goal, we initially identified 15 pedagogical principles and practices distinctive of TETBLT. This initial set of principles and practices were motivated by second language acquisition theories (Doughty & Long, 2003), methodological approaches in foreign language teaching (Kramsch, 2014), and state-of-the-art publications on computer-assisted language learning (Chapelle & Sauro, 2017). During the first phase of the study, we consulted an initial group of 34 experts in the field, using the Delphi technique to achieve gradual consensus about the set of principles. After analyzing the first set of responses (N = 23) to the principles, which attained a degree of agreement averaging 71% and ranging from 48% to 96%, we refined the principles incorporating the feedback received and sent out a second questionnaire, which allowed us to reach a consensus about a set of eight robust pedagogical principles for TETBLT.

1. Introduction

1.1 Technology-enhanced task-based language teaching

As a subfield of applied linguistics, computer-assisted language learning (CALL) is largely influenced by interactionist perspectives of second language acquisition (SLA; Chapelle, 2009), sociocultural theory, and language learning theories grounded in socio-constructivism (Lantolf & Thorne, 2006; Levy & Stockwell, 2013). These theories consider that the language learning process is embedded in a sociocultural context that mediates interactions among learners. Experiential and situated learning are promoted during these interactions, where meaning is co-constructed through negotiation between learners and teachers, and among learners themselves. Therefore, the role and affordances of technology for language learning must be regarded, considering its capacity to facilitate the language learning process.

Earlier studies have put forward principles connecting technology and language use, language teaching, and language learning (Chun, Kern & Smith, 2016), and principles to create an optimal psycholinguistic environment for language learning (Doughty & Long, 2003). Doughty and Long (2003) propose a set of methodological principles – motivated by theory and research findings in SLA and educational psychology – and pedagogic procedures to implement a task-based syllabus. Following González-Lloret and Ortega (2014), who detail ways to integrate principles of task-based language teaching (TBLT) to existing technology-enhanced language teaching by examining empirical studies, the current paper proposes an integrated set of pedagogical principles for technology-enhanced task-based language teaching (TETBLT), comprising CALL, mobile-assisted language learning (MALL), and computer-mediated communication (CMC). The aim of the present research is to uncover a signature pedagogy for the field of TETBLT. When TBLT is carried out in a technology-enhanced (CALL or CMC) environment, it also involves interaction “within social and material environments” (Lantolf & Thorne, 2006: 201). The technologies that mediate language learning could constitute one of these environments. These technologies, such as virtual learning environments, social media platforms, and teleconferencing tools, include several means of carrying out collaborative and cooperative action-oriented tasks and projects. All these environments in which tasks and projects can be carried out potentially constitute the core of socio-constructivist complex learning environments (Korsvold & Rüschoff, 1997: 18). Most of the above-mentioned technologies allow learners to create meaning through experience, a mainly socio-constructivist idea, while engaging in meaning-making interactions as an integral part of communicative tasks (Ortega, 2007) in a shared social context. The study of this type of interaction between learners is a shared focus of interactionist SLA research and sociocognitive approaches to SLA (Atkinson, 2002).

Several authors such as Chapelle (2009, 2014) and Zuengler and Miller (2006) point out the need for creating an integrative approach to technology-mediated TBLT that includes both sociocultural and cognitive views, backed up by Ellis (2003) and Swain and Lapkin (1998). We believe the adoption of such an approach would be beneficial in the field of CALL due to the increasing interest in technology-enhanced environments for language teaching and learning. Even though cognitive, sociocultural, and socio-constructivist theories have different epistemic premises, they may complement one another when trying to conceptualize language learning and teaching. The fields of CALL and CMC focus on various aspects that cover a wide range of areas, from materials and task design to opportunities for providing comprehensible input, to connecting individuals who engage in holistic language learning practices. Chapelle (2009: 748) argues that “a perspective for combining these approaches into a metatheory … would put the theory pieces together to create a fuller picture.” Chapelle (p. 751) also points to the need to draw on contrastive language acquisition and language learning theories to develop pedagogical methodologies for CALL. Similarly, Foster and Ohta (2005: 404) also note that despite their “differences, researchers using each of these approaches share a strong interest in how learners develop facility in an L2 via social interaction. … Both are interested in how it is that interaction promotes SLA.”

CALL can take many shapes and forms, but TBLT lends itself especially well to providing a context suitable for technological designs for language learning (Chapelle, 2003). In particular, TBLT addresses issues around how learners relate to and learn together with other learners through interactions that are often mediated by digital devices (González-Lloret, 2007). There have been some attempts to bridge the fields of TBLT and CALL, but there is still a need to conduct more studies that explore “how to integrate new technologies and language tasks into an organic and mutually informative whole” (González-Lloret & Ortega, 2014: 4). Rather than adapting TBLT principles to CALL, as has already been attempted (González-Lloret & Ortega, 2014), in the present article we seek to create a unique set of pedagogical principles of TBLT and CALL and articulate an additional set of consensually agreed principles based on current developments in CALL by both examining existing literature and drawing on the expertise of renowned scholars in the field.

The term we will use throughout the paper is technology-enhanced task-based language teaching (TETBLT) given that CALL has been the term historically adopted in the field, although it has been challenged as a problematic and outdated term in some respects (Jarvis & Krashen, 2014). When referring to technology and language learning, we refer not only to computers but also to handheld devices, such as tablets and mobile phones (MALL), and any other means of creating technology-enhanced language learning experiences.

1.2 Signature pedagogies and signature epistemologies

Our endeavor rests on two fundamental claims:

• Every domain of knowledge or practice has its signature pedagogies: “the types of teaching that organize the fundamental ways in which future practitioners are educated for their new professions” (Shulman, 2005: 52).

• These signature pedagogies reflect the domain’s signature epistemology: the system of practices by which knowledge is asserted by experts in this domain.

The notion of signature pedagogies emerged from the study of professional training (Shulman, 2005) and was later expanded to other knowledge domains, such as literary studies, history, fine arts and design, computer science, and engineering (Chick, Haynie & Gurung, 2009; Lucas & Hanson, 2016; Thomson, Hall, Jones & Sefton-Green, 2012). It is instrumental for practice-oriented teacher education approaches (and hence for training second language teachers), as it highlights the complexities and nuances of educational work. It recognizes that the ways in which we teach are subtle and diverse, reflecting unique cultures of meaning-making and action.

Implicit in the articulation of signature pedagogies is the assumption that each domain of knowledge or practice has its canonical set of epistemic practices (Kelly & Licona, 2018): the methods by which knowledge is constructed, validated, and communicated. We find it fitting to refer to this set as the domain’s signature epistemology. This concept is akin to the concept of argumentative grammar (Cobb & Gravemeijer, 2008): the substrate of rules and assumptions that binds the discourse of a community and the logical system by which claims are presented and justified. A signature epistemology expands on the notion of argumentative grammar in that it includes the whole scope of actions taken to generate and disseminate knowledge, not just the linguistic and discursive ones. The practical and personal dimensions of a signature epistemology are related to the work on personal epistemology (Hofer, 2001), which identifies the processes by which individuals establish and validate truths. However, the literature in that field tends to focus on universal practices, ignoring the differences between domains.

Signature epistemologies are rooted in a combination of endemic and cultural factors. Endemic factors refer to the nature of knowledge in the domain. In mathematics, new knowledge is derived by logical deduction from previously established knowledge; in biology, it is established by observation and experimentation; and in literary hermeneutics, by verbal manipulation. Cultural factors refer to the norms and linguistic structures of the community.

The ultimate purpose of any pedagogical practice is to enculturate learners into the epistemic practices of the domain: when teaching mathematics, we ideally want to bring learners to “think as a mathematician”; when teaching a language, we aim to lead learners to internalize the rules of the target language and become proficient language users and effective intercultural and multilingual communicators. Hence, we expect a close correspondence between a signature pedagogy and the signature epistemology it aims for. Thus, articulating these structures and identifying the links and gaps between them should be a powerful method for analyzing and enhancing educational systems.

1.3 Articulating a signature pedagogy: Values, design principles, and design patterns

Shulman (2005) argues that a signature pedagogy has three levels: a surface structure – the concrete, operational, and visible acts of teaching and learning; a deep structure – the set of assumptions underlying the surface structure about how best to impart knowledge; and an implicit structure – the set of ethical and normative beliefs about professional attitudes, values, and dispositions.

Many studies use a mixture of literature reviews, classroom observations, case studies, and ad hoc surveys to identify and present signature pedagogies (cf. Lucas & Hanson, 2016; Thomson et al., 2012; and, to an extent, Chick et al., 2009). These descriptions are typically simultaneously descriptive and prescriptive, in the sense that they both claim to report on an existing phenomenon and argue for a desired one. This ambiguity appears to diverge from Shulman’s original thesis, which was aimed at uncovering the nature of knowledge in a professional domain through the observable ways in which practitioners are trained in this domain. We posit that rather than trying to eliminate this tension, it should be made explicit. We adopt a design science stance, entailing a commitment to go beyond describing the world as it is and consider how it should be and how to make it so (Mor & Winters, 2007). Furthermore, we are seeking a coherent and effective descriptive framework (or language) for signature pedagogies that is structured, flexible, and actionable. To these ends, we have chosen to represent the three levels of a signature pedagogy by mapping them to constructs familiar in the learning sciences and technology-enhanced learning literature, namely values, design principles, and design patterns (Mor et al., 2015).

Pedagogical design patterns describe a particular educational challenge, the context in which it arises, and a possible evidenced method of addressing this challenge. They are simultaneously descriptive, as a form of analyzing existing practice, and prescriptive, as a means of promoting effective practice. Design patterns provide an effective format for describing the surface structure of a signature pedagogy. These need to be supplemented with similar forms for describing the corresponding epistemic practices (Warburton & Mor, 2015).

Design principles translate theoretical and empirical findings from the study of teaching and learning into directives, providing designers with clear, evidence-based rules of action. They offer a useful representation for the deep structure and should be justified by reference to the relevant deep epistemic structures. In our framework, these structures are represented as epistemic principles.

The discussion below focuses on the implicit (values) and deep (principles) levels. The exploration of the surface (patterns) level is the objective of future work.

2. Methodology

The present study was conducted in three phases: first, we identified a set of (pedagogical) design principles for TETBLT based on a review of the relevant literature. Second, we validated the initial set of principles by means of a Delphi study. Finally, we inferred the underlying values from the principles and the qualitative comments from the experts who participated in the study.

During the initial phase of the study, we examined seminal work in the field of CALL and psycholinguistic theories of language learning in order to identify a synthesized version of an initial set of 15 pedagogical design principles that might characterize TETBLT programs. These principles were motivated by earlier work in three main areas, namely SLA theories (Doughty & Long, 2003), methodological approaches of foreign language teaching (Kramsch, 2014), and computer-assisted language learning and teaching (Chapelle & Sauro, 2017; Chun et al., 2016; González-Lloret & Ortega, 2014). During the initial literature survey, we identified publications that specifically addressed methodological principles of TBLT, CALL, and technology-enhanced language learning and teaching. The main references that came up were Doughty and Long (2003), Chapelle and Sauro (2017), Darvin (2017), Chun et al. (2016), González-Lloret and Ortega (2014), Kramsch (2014), Levy and Stockwell (2013), Sauro and Chapelle (2017), Bax (2011), and Thorne (2016).

During the second phase, we validated and refined these principles through a two-stage Delphi technique (Hsu & Sandford, 2007). The Delphi method is used as a method of forecasting technological developments by pooling expert estimates (Rescher, 1998). It has been used in a wide variety of domains for forecasting, policy, and consensus analysis. The rationale behind this approach was that a signature pedagogy should balance the ideal approach derived from theory with the pragmatically feasible. The Delphi method is designed to elicit sound practical insights by pooling the knowledge of domain experts. We assembled a panel of experts in CALL (as described in Supplementary Material A: Expert committee selection process) and we sent them an online survey asking them to (1) rate the extent to which each principle contributed to defining the essential elements of a TETBLT program (using a 5-point Likert scale), (2) comment on the principles, and (3) propose additional principles. Based on their responses, and following the process detailed below, we refined the principles and reiterated the expert survey.

The panel included 34 experts and educators in the fields of CALL and CMC. Expertise was determined by compliance with one of the following criteria:

• renowned scholars in the fields of CALL and CMC who were on the boards of the principal CALL journals (Computer Assisted Language Learning, ReCALL, CALICO Journal, Language Learning & Technology) or the main academic conferences in the field (WorldCALL, EUROCALL, CALICO)

• authors of seminal papers, handbooks, or state-of-the-art papers in the fields of CALL, CMC, foreign language education, SLA, and computer-meditated TBLT, with citations above the 200 mark according to Google Scholar.

Out of the 34 experts we approached (see Supplementary Material A for more information regarding their profiles), 23 agreed to participate in the study. Their responses to the principles in the first phase obtained agreement (4 or 5 on the scale) averaging 70.7%, ranging from 47.8% to 95.6%.

Based on the feedback received and the qualitative data gathered from the comments, we derived a refined set of 16 pedagogical principles (see Supplementary Material B for a list of the initial set of principles and the experts’ comments after the first round of consultations). This set included examples of some of the most contested principles and incorporated different nuances and perspectives to make some of the principles more inclusive, in addition to further references to the literature to support the principles. The new set of principles incorporated an additional principle based on suggestions from several experts that addressed the transformative role of language learning beyond content knowledge and affecting identities (Darvin, 2017). Some of the comments challenged the fact that some principles showed a bias towards one of the binary notions of certain language acquisition processes (e.g. inductive vs. deductive formulation of language rules, or focus on meaning vs. focus on form). Some other comments disputed the feasibility of some of the principles or provided indications to broaden their theoretical scope. The comments and suggestions from the experts helped us broaden the scope and width of the theory supporting each principle.

The second survey presented the experts with the refined set of principles and referred them to the original set and the comments on it, should they wish to trace our reasoning. We asked them once again to rate their agreement with each principle based on the same 5-point Likert scale and include any comments they deemed appropriate. The next section reports on the results of the second phase of the consultation by first presenting the results of the second survey and discussing the tensions that arose considering the revised set of principles. The discussion will specifically address the principles that posed the most problems for the experts in terms of the essential role they play in a comprehensive TETBLT program.

3. Results

3.1 Pedagogical design principles

The second questionnaire was answered by 21 out of the 22 experts (one withdrew from the second phase of the project). The principles listed in Table 1 include the modifications suggested by the experts in the second round. During the second round, they obtained an agreement (4 or 5 on the Likert scale) averaging 74% (SD = 10), ranging from 57% to 95%. The experts showed an acceptable percentage of agreement (above the average, which was 75%) on half of the principles, specifically with Principles 2, 3, 4, 5, 7, 10, 13, and 15. Although the agreement increased for most principles (10) during this second round, as can be observed in Table 1, not all of them reached the 75% threshold. In only five instances did the agreement level decrease during the second round in the case of Principles 1, 9, and 14, and quite significantly (by 20 points) in the case of Principles 11 and 15. The data set and working documents for the entire process are available at https://tbtell.iucc.ac.il/ and in the Supplementary Material B: Versions 1 and 2 of the principles. The feedback and discrepancies among experts and the distribution of values for the most contested principles during the second phase of the Delphi study will be further discussed in the discussion section.

Table 1. Essential pedagogical principles of TETBLT

Note. TETBLT = technology-enhanced task-based language teaching; TBLT = task-based language teaching; CALL = computer-assisted language learning.

† Principles that achieved consensus.

Most of the concerns raised by the experts on the comments included after each principle are related to the feasibility of the practical application of the principles, which does not undermine the principles themselves. The difficulties rely, in most cases, on several other underlying considerations one would need to consider in the design of technology-enhanced language teaching programs. These may include the level of proficiency of the learners or the variety of individual and instructional conditions that potentially constrain language learning and teaching. In the discussion section, we will detail the tensions and problems that were brought up by the specific comments on the principles that failed to reach sufficient agreement and provide an explanation of the possible reasons for the lack of agreement.

3.2 Corresponding epistemic principles

As detailed previously, we argue that any signature pedagogy reflects an implicit target signature epistemology, and consequently the pedagogical principles reflect the implicit epistemic principles. Table 2 lists the set of proposed epistemic principles corresponding to the pedagogical design principles presented in Table 1. Together, they encapsulate the deep level of the signature pedagogy. These are systematically derived from each principle by (a) switching their formulation from behavioristic to propositional statements and (b) relating the pedagogical principle to epistemic principles backed up by theoretical studies/work in the fields of SLA, foreign language education, and CALL. In other words, our process begins in the literature, synthesizes and consolidates key outcomes in the form of design principles, refines and validates those by consulting experts in a structured Delphi process, deduces epistemic principles from the resulting design principles and confirms these by referring back to the literature. Even though some of the pedagogical principles failed to reach a significant level of agreement, we decided to derive epistemic principles for each one of them given that the disagreements were mostly related to the applicability or feasibility of incorporating the principles into existing language teaching programs, rather than with the essential propositions of the principles themselves.

Table 2. Epistemic principles of TETBLT

Note. TETBLT = technology-enhanced task-based language teaching; TBLT = task-based language teaching; CALL = computer-assisted language learning.

† Principles that achieved consensus.

4. Analysis of the results and discussion of the findings

In this section, we will detail the feedback and comments obtained from the experts on the second round of the consultation, considering the second version of the pedagogical principles listed in the previous section. We will proceed to discuss the tensions raised by the experts and focus on the principles that were problematized or where consensus was not reached.

Consensus was achieved with half of the principles (2, 3, 4, 5, 7, 10, 13, 15) listed earlier. However, Principle 15 (skills and competences) exhibited a significant drop in consensus from the first to the second phase. The principle reached 96% agreement in its first formulation, which contained a general indication about the need to broaden the scope of the linguistic skills to be developed to include new literacies, genres, and skills. This dropped to 76% agreement in its second formulation where we introduced a slight change in terminology when referring to the basic skills, which changed from “basic skills” to “basic modes of communication,” and included intercultural mediation as an additional skill. The authors of a number of recent articles (Chun et al., 2016; Darvin, 2017; Sauro & Chapelle, 2017) stress the importance of developing these skills and competences by integrating them into current language learning practices, and indeed the experts did not include substantial criticisms about this principle in the second round. However, and given that they marked the principle down, we think the principle did not benefit from the reformulation in its second version.

In the next two sections, we will group the principles according to the types of comments they elicited and discuss the experts’ feedback in each case.

4.1 Principles difficult to implement

Most of the experts consulted agreed with the essence or content of Principles 8, 9, 11, and 12, and the lack of consensus derived mostly from the difficulties they anticipated in implementing them.

Even though the experts did not reach a consensus regarding Principle 8 (62% agreement), they all agreed on the need to provide some type of feedback. However, concerns were raised regarding the feasibility of providing feedback to learners in a timely manner in a CALL setting without interrupting the natural flow of conversation. Principle 9 addressed the issue of adapting teaching to individual learning paths in accordance with established psycholinguistic developmental sequences, also known as clinical teaching (Grossman, Hammerness & McDonald, 2009). In this case, again, the experts agreed with the essence of the principle, but expressed their doubts about the possibility of implementing it in a given learning context. This would require language instructors and curriculum and course designers to understand how to deal with and circumvent issues such as heterogeneous learner cohorts or large groups of learners. There are developments in intelligent tutoring systems that allow for sophisticated interactions, including feedback moves (Ferreira, Moore & Mellish, 2007; Swartz & Yazdani, 2012; Sweidan, Abu Laban, Alnaimat & Darabkh, 2021). Research in intelligent CALL (iCALL), which combines artificial intelligence, computational linguistics, natural language processing, and machine-aided translation in order to provide feedback and scaffold language learning in diverse learning environments (CMC, both form-focused and meaning-focused instruction) and adapting to different learners (Khemaja & Taamallah, 2016), has been yielding promising results for decades (Schulze & Heift, 2013). Numerous empirical studies have assessed the effectiveness of these tools and artifacts, but the fact that these have been mostly tested for specific language domains in specific languages makes their implementation in other (online) settings or languages challenging. The issue of the impracticality of implementing the pedagogical principle came up once again in the experts’ remarks about Principle 12, which tackled the personalization of instruction based on learners’ needs. We originally thought that illustrating the principle with examples of personalization based on the affordances brought by virtual learning environments could contribute to increasing the feasibility of the principle in the eyes of the experts. Nonetheless, the principle remained well below the threshold with a 62% agreement. Arguably, these results point to a gap between research results and practical feasibility in common contexts, and should serve as a challenge to the research community to derive pedagogical recommendations from their research and make these accessible and available to practitioners.

Another principle (11), which addressed collaborative learning, showed a great loss of consensus among experts from the first to the second round. We assumed that in a TBLT approach, learner collaboration could be almost taken for granted. However, after the first round, the experts raised concerns about the role of learners’ autonomy (in the sense of self-regulated and self-directed learning; Andrade & Bunker, 2009) and individual preferences and needs. Therefore, we proceeded to soften the statement and add nuances that would make the principle more inclusive. The original statement “Promote cooperative and collaborative learning” was complemented by adding “while retaining learners’ autonomy and respecting their preferences and needs,” but it went down from 87% agreement to 67%, possibly due to the fact that rephrasing the principle changed its meaning and focus. The first version of the principle focused on the idea that collaborative and cooperative learning fosters more significant learning and promotes learners’ autonomy (Edwards, Holguín-Barrera, Ortiz & Pérez, 2019). However, the second version included the importance of learners’ preferences and needs, which resulted in the experts pointing out the difficulties in implementing this principle even though collaborative learning has been extensively researched in CALL settings (Kukulska-Hulme & Shield, 2008) and there are numerous accounts of its applicability in several empirical studies (Kessler & Bikowski, 2010; Kessler, Bikowski & Boggs, 2012). Possibly, the caveat we added alerted the experts to the challenge of implementing this principle.

4.2 Principles indicative of different opinions

Principle 1, which addressed the need to use tasks as the base unit of instruction, failed to appeal as an essential principle among the experts consulted, reaching 70% agreement during the first round but decreasing to 67% on the second round. We initially thought this pedagogical principle would not be questioned, given that it constitutes the pedagogical essence of a technology-enhanced task-based language teaching program. However, the experts considered that tasks had to be used alongside other types of units of instruction – such as texts – and only when appropriate.

The difference between deductive and inductive reasoning when inferring language rules stated in Principle 6 also failed to reach enough consensus (67%) among the experts. In their comments, they disapproved of the fact that the two processes were presented in opposition and raised concerns about possible obstacles. Among others, they brought up the students’ cognitive abilities or the nature of the target language (lexical vs. grammatical languages).

Principle 14, which underscored the importance of keeping a critical stance towards the use of technology for language learning and using technology taking into account the relationship established between learners, tools’ affordances, and learning environments (Ocando Finol, 2019), obtained 78% agreement during the first round, dropping to 71% in the second round. Unfortunately, we did not manage to obtain sufficient comments that could help us understand the shortcomings of this principle other than the fact that the experts did not deem it crucial.

Finally, Principle 16, which highlights the importance of the development of learners’ digital repertoires and competences while embracing the transformative role of language learning in shaping learners’ identities, was added on the second round based on the feedback and suggestions from the experts. It was intended to capture the transformative power that learning a language can have for the learners at the identity level, in contexts that are also trying to foster learners’ digital repertoires and competences. The principle, which reached 67% agreement, was challenged and considered too institution- and learner-dependent. Additionally, the need for teachers to have a role in developing learners’ identities was contested, even though this last aspect was not explicitly stated in the formulation of the principle.

In summary, eight of the principles we identified (2, 3, 4, 5, 7, 10, 13, 15) obtained a clear consensus, and should be considered as sound advice for practitioners, grounded in research and practice. Another four (8, 9, 11, 12) received ambivalent responses due to concerns regarding the feasibility of their implementation. These principles highlight potent directions for research and development. The remaining principles (1, 6, 14, 16) indicate areas where the experts’ opinions diverged, and further debate is required.

5. Conclusions

This paper presented a step towards articulating a signature pedagogy for TETBLT. It involved reaching a consensus among experts in the field of CALL about pedagogical practices and distilling epistemic principles from them, which include underlying assumptions about the way knowledge is constructed, assessed, and transferred in the field. This was not without its challenges. Bringing together several approaches to language education and linguistics, such as interactionist SLA and sociocultural and socio-constructivist approaches, proves to be an arduous task and requires compromising and being inclusive when theories offer sometimes contradictory premises. However, we believe that the fields of language acquisition and language pedagogies advance by evolving together and supporting one another, linking theories and empirical studies that support or refute them. Any advance in either pedagogical approaches or language acquisition builds upon existing theories and pedagogies. In our current study, we tried to be as inclusive as possible because we firmly believe that to put together epistemic principles, we needed to consult experts who follow different approaches to solve the same issues.

Several authors (Chapelle, 2014; Colpaert, 2020; Zuengler & Miller, 2006) have advocated for researchers in the field of CALL to adopt an open epistemological stance, which might help advance our understanding of TBLT in CALL environments. We believe that taking an integrative theoretical and epistemological stance can be of help in identifying the affordances of educational technologies for TETBLT. Identifying these affordances is important for instructors and learning designers but also for those conducting research to assess the potential learning outcomes of a given learning activity.

The principles that gained the highest support addressed learning by doing, advocating language use, dealing with linguistic complexity while providing rich and varied but comprehensible input, promoting meaning-focused communicative tasks in an immersive learning environment, taking a critical stance towards technology, and broadening the scope of traditional linguistic skills and competences to include those supported by digital technologies. However, the principles promoting the use of tasks, encouraging inductive learning, advocating timely feedback, supporting adaptive and personalized learning, fostering collaborative learning, promoting techno-literacy, and addressing the transformative role of language learning at the identity level did not reach enough consensus among the experts.

We used a relatively low-resource and straightforward procedure to generate a set of pedagogical design principles and corresponding epistemic principles and underlying pedagogical values for TETBLT. Together, these form a significant step in the articulation of a signature pedagogy and corresponding signature epistemology for this domain. The pedagogical design principles that obtained consensus appear to be robust, and we are confident that they can serve as a useful resource for both novice and expert practitioners in the field. The other set of principles that we derived from the literature but failed to reach consensus on highlights important tensions between theory and practice; the theory presents scientific consensus, whereas the experts consulted here present a more pragmatic consensus, which we believe has an intrinsic value.

In order to complete a comprehensive and coherent articulation of the signature pedagogy, we will need to engage a larger cohort of practitioners and identify practices that implement the principles we have defined. This can be done using various “pattern mining” techniques, such as pattern workshops (Warburton & Mor, 2015), pattern mining (Kohls & Uttecht, 2009), or surveys. These observations set the plan for our future work.