Strategies for Increasing Reading Comprehension ...

93 downloads 0 Views 497KB Size Report
2013; Nation, Adams, Bowyer- Crane, & Snowling, 1999; Pressley & Af- flerbach ...... pants were at the 2nd grade level on the Jerry John's Basic Reading In-.
EDUCATION AND TREATMENT OF CHILDREN Vol. 39, No. 2, 2016

Strategies for Increasing Reading Comprehension Skills in Students with Autism Spectrum Disorder: A Review of the Lit­er­a­ture Elizabeth Finnegan Amanda L. Mazin St. Thomas Aquinas College Abstract As the number of students with Autism Spectrum Disorder (ASD) being prepared for statewide assessment rises, t­ here is increased demand for effective instructional strategies to improve reading comprehension scores in t­hese students. The authors synthesized the findings of 15 studies, which included 88 school-­aged students identified with ASD. The studies w ­ ere conducted between 1989 and  2015. Findings indicate that Direct Instruction (DI) and graphic organizers have positive effects, while cooperative learning, anaphoric cueing, and question generation show promise. Electronic supported text shows ­little to no effect on reading comprehension mea­sures in students with ASD. Keywords: autism, autism spectrum disorder, cooperative learning, direct instruction, reading comprehension, reading instruction, reading strategies

R

eading comprehension is the act of gaining meaning from print. It is a complex task that requires the integration and coordination of numerous high-­level cognitive pro­cesses, necessitating active reader engagement (Cain, Oakhill & Bryant, 2004; Garcia-­Madruga, et al., 2013; Nation, Adams, Bowyer-­Crane, & Snowling, 1999; Pressley & Afflerbach, 1995). Reading comprehension continues to be an area of weakness for students with ASD, though it is considered to be an essential component of developing literacy (National Institute of Child Health and Human Development (NICHD), 2000). It is now thought that as many as 70% of individuals with ASD have average to above average intelligence (Chakrabarti & Fombonne, 2005), but levels of reading comprehension for students with ASD have been reported as significantly lower than peers, even when groups are matched for reading accuracy and IQ (Brown, Oram-­Cardy, & Johnson, 2013; Frith &

Address correspondence to: Elizabeth Finnegan, School of Education, St. Thomas Aquinas College, Sparkill, NY 10976. Email: efinnega@stac​.­edu

Pages 187–220

188

Finnegan and Mazin

Snowling, 1983). As with other individuals with disabilities, per­for­ mance on reading comprehension tasks is correlated to individual’s verbal ability (Snowling & Frith, 1986), however, ­there are f­ actors related to reading comprehension that are unique to individuals with ASD. Autism Spectrum Disorder (ASD) is characterized by impairments in social interaction and communication, as well as restricted, repetitive, ste­reo­typed patterns of be­hav­ior (American Psychiatric Association, 2013). In the 2012–2013 school year, t­here w ­ ere 498,000 students aged 3–21 years in the US receiving educational ser­vices for Autism u ­ nder IDEA. This represents an average annual increase of over 36,000 students since the 2002–2003 school year when 137,000 students ­were receiving ser­vices in this category (U.S. Department of Education, 2013). Some individuals with ASD ­will be dependent on life-­long support and care, while o ­ thers perform at levels comparable with their typically developing peers in academic settings and go on to gradu­ate from college (Estes, Rivera, Bryan, Cali, & Dawson, 2011). Although individuals with ASD share common characteristics, they also exhibit a wide range of capabilities and strengths Many higher-­functioning, school-­aged c­hildren with ASD are placed in classrooms with typically developing peers and are working t­ oward similar academic goals in the general education curriculum (Estes et al., 2011). Impaired reading comprehension, especially when paired with normative reading accuracy, has been reported as a specific area of deficit for individuals with ASD (Nation, Clarke, Wright, & Williams, 2006). That is, individuals with ASD often are able to read text fluently without substantial comprehension of what they have read. Individuals with ASD also show mild deficits in semantic knowledge (Brown et al., 2013). A correlation does exist between semantic knowledge and reading comprehension and this may impact reading comprehension for some individuals with ASD. Saldaña & Frith (2007) demonstrated that individuals with ASD could make inferences when a limited amount of text is presented, but had difficulty when integrating specific knowledge with a global text. Limited social knowledge may also impact reading comprehension in individuals with ASD. Students with ASD perform better on reading comprehension tasks that require limited social knowledge versus t­ hose that require a high level of social knowledge (Brown et al., 2013). For example, individuals with ASD tend to lack intuitive knowledge of social be­hav­ior and often seem to be unaware of rules that govern social actions (Baron-­Cohen, Leslie, & Frith, 1985). Lack of experience and knowledge integration has been found to negatively impact comprehension for learners with ASD (Wahlberg & Magliano, 2­ 004).

Increasing Reading Comprehension Skills

189

Forty-­three states have a­ dopted the Common Core State Standards (CCSS), and as such, per­for­mance assessments in reading and mathe­matics mandated by No Child Left B ­ ehind Act (2001) have been adjusted accordingly. While many academic skills in high functioning ­children with ASD are on a par with their typically developing peers, weaknesses in reading comprehension continue to manifest themselves (Whitby & Mancil, 2009). Students’ mastery in reading and interpreting complex texts is a key component of the CCSS (National Governors Association, 2010), which in turn has led to a demand for interventions, that enable students with ASD to meet grade level standards in the area of reading comprehension. Difficulties Related to Reading Comprehension Cognitive differences in students with ASD (Mesibov, Shea, & Schopler, 2005) could influence reading comprehension. Theory of mind, executive functioning, and weak central coherence have been used to explain cognitive pro­cessing differences in individuals with ASD, which potentially could influence their reading comprehension (Carnahan, Williamson, & Christman, 2011). Many ­children with ASD lack theory of mind (Baron-­Cohen, et al., 1985; Baron-­Cohen, Richler, Bisarya, Gurunathan, & Wheelwright, 2003) that is, the ability to imagine what o ­ thers may be thinking or feeling. In the context of reading, theory of mind may affect an individual’s ability to understand characters’ perspectives, make inferences about ­people’s motives and be­hav­ior, or make accurate predictions (Carnahan, Williamson, & Haydon; 2009; Carnahan et al, 2011; Norbury, 2005). Weak central coherence, evident in many individuals with ASD (Frith, 2003) can lead to difficulties understanding the w ­ hole picture, difficulties assimilating information, and difficulties with higher-­ order thinking. Many individuals with ASD attend to specific details rather than the overall gist of an event (Happé & Frith, 2006). This may explain why individuals with ASD are able to perform tasks related to semantic knowledge and inferential information in isolation, but are challenged when applying that knowledge to a global text. In the context of reading, many individuals with ASD may focus on insignificant details rather than on the big picture, challenging their ability to comprehend and store pertinent information (Carnahan et al., 2011). Individuals with ASD exhibit impaired executive functioning (National Research Council, 2001). Executive functioning refers to complex inter-­related skills including planning, manipulating information in working memory, organ­ization and sequencing, and self-­monitoring. Individuals with ASD experience difficulties with

190

Finnegan and Mazin

organ­ization, memory, and attention (Happe & Frith, 2006; Quill, 2000). ­These impairments may contribute to the repetitive be­hav­iors and rigidity of thought seen in individuals with ASD (Boucher, 2012). In regard to reading comprehension, this rigidity of thought may impact a child’s ability to shift attention between dif­fer­ent features of a text. In addition, in individuals with ASD, impaired executive functioning may influence the ability to set a purpose for reading, monitor understanding, and integrate or make connections between information across paragraphs, texts, or experiences (Carnahan et al., 2011). Need for the Study In the 2012–2013 school year, t­ here w ­ ere 498,000 students aged 3–21 years in the US receiving educational ser­vices for Autism u ­ nder IDEA (U.S. Department of Education, 2013). Many higher-­functioning, school-­aged c­ hildren with ASD are placed in general education classrooms and are working ­toward meeting grade level standards in reading. Prac­t i­t ion­ers need guidance on choosing which interventions in reading comprehension are designed to meet the unique learning needs of individuals with ASD. “The application of an evidence-­based practice (EBP), like any other instructional practice, represents an experiment of sorts in which special educators must validate its effectiveness for each individual child” (Cook & Odom, 2013, p. 137). Educators are placed in a position where they must determine w ­ hether or not a par­tic­u­lar EBP ­will benefit their own students. This position is especially tenuous for teachers of students with ASD who are working ­toward the CCSS in Literacy, as no EBPs in teaching reading comprehension have yet been identified. Thus, ­these teachers usually rely on EBPs identified for other populations and try to extrapolate the findings or modify the procedures in ways that seem reasonable. Although reviews on interventions for reading comprehension have been recently conducted (Chiang & Lin, 2007; El Zein, Solis, Vaughn, & McCulley, 2014; Senokossoff, 2015), ­there are limitations that warrant an additional analy­sis. T ­ hese reviews have included studies with participants with intellectual and developmental disabilities, and have also included oral comprehension and vocabulary recognition as dependent variables. Thus, the findings are not specific to ­those students with ASDs and may not be directly relevant to other dependent variables of interest. In order to increase the likelihood that educators w ­ ill use research-­based interventions in a meaningful way, conventional and common use of terms such as “reading comprehension” is critical. The

Increasing Reading Comprehension Skills

191

phrase reading comprehension is commonly understood to mean that students are able to make sense of what they read . . . ​by extracting and constructing meaning through interaction and involvement with written language. Extracting meaning is to understand what an author has stated, explic­itly or implicitly. Constructing meaning is to interpret what an author has said by bringing one’s “capacities, abilities, knowledge, and experiences” to bear on what he or she is reading. (Shanahan et al., 2010, p. 5). The purpose of this review was threefold: (a) to identify studies with interventions focusing on reading comprehension, in its conventional meaning, in students with ASD; (b) to identify which of t­ hese interventions are effective; and (c) to contrast the key components of ­these studies for prac­ti­tion­ers who need to make instructional decisions for their students with ASD. Methodology All studies included in this review met specific se­lection criteria. Studies included in this review ­were published in En­glish and found in a peer-­reviewed journal published 1985–2015. Participants ­were school-­ aged individuals ages 5–18 and identified as having ASD, e­ ither through a diagnosis determined using the DSM IV or DSM V criteria or with a classification of Autism for educational ser­vices ­under IDEA. Studies included in the review had a formal research design (e.g., group experimental design, quasi-­experimental design, or single-­subject design) that included a replicable intervention. To be included in the review, the results of participants with ASD had to be able to be parsed out from results with other populations. In studies with a group design, participants with ASD had to comprise an experimental group comparable in size to other groups. Fi­nally, dependent variables had to include mea­sures of reading comprehension such as answering questions, retelling, requiring participants to “extract and construct meaning” (Shanahan et  al., 2010, p.  5). Exclusionary criteria w ­ ere also applied. Studies focusing on listening comprehension, social skills, isolated vocabulary comprehension, sight word or decoding, oral reading fluency ­were not included. Studies in which participants with ASD could not be parsed out from the remainder of the sample ­were also excluded.

192

Finnegan and Mazin

Several steps ­were taken to increase the comprehensiveness of the search of intervention studies. First, electronic searches of PsycINFO, ERIC, and Academic Search Premier databases ­were completed to locate studies in peer-­reviewed studies published between January 1985 and April 2015. All combinations of the keywords Autism or Asperger with (1) reading, (2) literacy, (3) comprehension w ­ ere used, returning over 200 citations. The researchers examined all abstracts and methods (e.g., participants, procedures, mea­sures) sections in comparison to the inclusionary and exclusionary criteria. Next, references from the studies that met the inclusionary criteria ­were reviewed to determine if the reference list included articles that would also meet the inclusionary criteria (i.e., an ancestral search). Fi­nally, a hand search of recent articles was conducted of issues of the following journals, Autism, Education and Training in Autism and Developmental Disorders, Focus on Autism and Developmental Disorders, Journal of Autism and Developmental Disorders. The point-­by-­point approach (Kazdin, 1982) was used to calculate inter-­rater agreement for the determination of inclusion. From the initial electronic search, 10% of the articles (n = 20) ­were chosen randomly. Abstracts and methods ­were reviewed against the inclusion and exclusion criteria by both authors in­de­pen­dently. Inter-­rater agreement was 100% for that sample of articles. Fi­nally, the authors reviewed all the articles identified and discussed both inclusionary and exclusionary criteria. Agreement was reached on ­whether or not the study should be included in the review. Mea­sures of Effectiveness Effect Sizes (ES) ­were used as a standard mea­sure of intervention effectiveness for group designs. If an ES was not reported, then an ES was calculated using Hedges g (Borenstein, Hedges, Higgins, & Rothstein, 2009). An intervention with an ES of 0.8 or above was considered to have a “large” effect, an ES ranging from 0.3 to 0.8, a “medium” effect, and an ES below 0.3 was considered “small.” The percentage of non-­overlapping data points (PND) was calculated for single-­subject designs and interpreted using criteria recommended by Banda & Therrien (2008). A PND was calculated for each participant. A PND of 90% or higher indicated the intervention was highly effective, a PND of 70% to 90% indicated moderate effectiveness, and a PND of 50–70% indicated minimal effectiveness. A PND below 50% indicated that the intervention had l­ittle to no effect (Scruggs, Mastropieri, Cook, & Escobar, 1986). Only data from the individuals with ASD was included.

Increasing Reading Comprehension Skills

193

Coding Procedures At first, the articles selected for the review w ­ ere coded for their attributes. The studies ­were coded by (a) study design, (b) age of participants, and (c) instructional format. Second, descriptive coding was used to categorize the studies. Descriptions of each study’s dependent variables, interventions, procedures, and materials ­were extracted from the articles, reassembled, and grouped ­u ntil meaningful patterns emerged. All the authors’ designated a study design in their articles. Pretest/posttest designs included e­ ither within or between groups comparisons and mea­sured an intervention’s effectiveness through pre and post intervention mea­sure­ment, ­either through psychometric testing, researcher-­created mea­sures or both. In repeated mea­sures designs, the same mea­sure was used ­under two or more conditions for each participant. The order of conditions (i.e., interventions) was randomly assigned to each participant. In single-­subject designs with randomized interventions, interventions w ­ ere presented at random to the participants. In multiple-­baseline studies, two or more participants ­were included. In multiple-­baseline studies in which ­there ­were three or more participants, effects ­were concurrently monitored to ensure proper control of the intervention. One study had only two participants, and the effects of the intervention w ­ ere monitored across multiple be­hav­iors. Studies with a reversal design all used an ABAB design. In studies with a multiple probe across be­hav­iors design, a multiple-­baseline with concurrent monitoring of all participants took place. Probes ­were conducted at the end of each sequence or step of the intervention. The age groupings of students ­were coded using three ­factors: (a) statements in the article that indicted the level of school of the participants, (b) statements which identified the grade level of the participants, and (c) statements about the age of the participants. Results w ­ ere categorized according to the level of schooling (e.g., elementary, ­middle school). Descriptive coding (Saldaña, 2013) was used to code information about the dependent variables, interventions, procedures, and materials in each study extracted from the articles. The information was tabulated and reassembled ­until themes emerged. The results of the coding procedures showed that nearly all the studies had a dependent variable mea­sur­ing response to comprehension questions. Since it was not pos­si­ble to categorize the studies by dependent variable in any meaningful way, studies w ­ ere then coded and grouped by intervention. At this point meaningful patterns began to emerge, categories ­were identified by an intervention which best embodied each pattern.

194

Finnegan and Mazin

The instructional format was coded according to explicit statements provided in the articles (e.g., small group). Despite the applied nature of educational research, information about the classroom setting or instructional format was not always clear and sometimes was missing. For example, if the intervention was conducted in a small group in a self-­contained classroom, it was not always clear ­whether the study participants comprised the ­whole group or not. Studies ­were grouped according to the following guidelines: one-­on-­one instruction, small group instruction, and general education classroom instruction. One-­on-­one instruction was coded if the article indicated that the intervention was carried out with a researcher, a research assistant or teacher on an individual basis with the participant. Small-­ group instruction was coded if the article indicated that fewer than ten students w ­ ere in an instructional group and it was unclear w ­ hether the group instruction occurred in a classroom or not. Small-­group instruction in a special education classroom was coded if the article indicated that the study took place in a resource room or self-­contained classroom in a small group format. In this category, it was not clearly identified in the studies ­whether the group was limited to the participants in the study or not. General education classroom was coded if the article indicated that the intervention was carried out in a general education classroom with 15 students or more. Results Participants The 15 studies that met the criteria for inclusion in this review included a total of 198 participants, 88 of whom had ASD. The other participants w ­ ere ­either members of comparison groups, participants in a single-­subject design study, or peers participating in the instructional intervention (see T ­ able 2). The 88 participants with ASD ranged from 7–17 years of age. Seven studies included elementary-­ school aged participants (Armstrong & Hughes, 2012; Bethune & Wood, 2013; Kamps, Locke, Delquadri, & Hall, 1989; Kamps, Barbetta, Leonard, & Delquadri 1994; Kamps, Leonard, Potucek, & Garrison-­ Harrell, 1995; Stringfield, Luscre, & Gast, 2011; Whalon, & Hanline, 2008). Six included predominantly ­middle-­school aged participants (Asberg & Dahlgren-­Sandburg, 2010; Carnahan & Williamson, 2013; Flores & Ganz, 2007; Flores & Ganz, 2009; Knight, Wood, Spooner, Browder, & O’Brien, 2014; Mashal & Kasirer, 2011) and two studies included high-­school aged students (O’Connor & Klein, 2004; William-

Increasing Reading Comprehension Skills

195

son, Carnahan, Birri, & Swoboda, 2014). Studies varied considerably in their descriptions of participants’ abilities; however, all participants ­were able to follow oral directions and read at the pre-­primer level or above. Instructional Formats Four of the studies included interventions with one-­on-­one instruction, usually conducted by the researcher (Armstrong & Hughes, 2012; Bethune & Wood, 2013; O’Connor & Klein, 2004; Stringfield et al., 2001). ­These studies took place in a variety of settings, such as self-­contained classrooms in public and private schools. Three of the studies included small group interventions (Asberg & Dahlgren-­ Sandberg, 2010; Mashal & Kasirer, 2011; Whalon & Hanline, 2008). Six studies took place in special education settings such as resource rooms and special education classrooms (Carnahan & Williamson, 2013; Flores & Ganz, 2007; Flores & Ganz, 2009; Kamps et al., 1989; Knight et al., 2014; Williamson et al., 2014). Two studies took place in the general education classroom (Kamps et al., 1994; Kamps et al., 1995). Dependent Variables Nearly all of the studies had a dependent variable which mea­ sured response to comprehension questions (see T ­ able  1). The two studies (Flores & Ganz, 2007; Flores & Ganz, 2009) which did not use response to comprehension questions used dependent variables that included making deductions, making statements, and interpreting analogies, which all assess participants’ ability to interpret connected text. Retelling was used to mea­sure reading comprehension in two studies (Armstrong & Hughes, 2012: O’Connor & Klein, 2004). The scores for retelling w ­ ere merged with the scores for responses to comprehension question in the latter. The scoring of a completed graphic or­ga­nizer was a dependent variable in two studies (Bethune & Wood, 2013; Stringfield et al., 2011), but in both the primary dependent variable was response to comprehension questions. Interventions All the studies incorporated some type of teacher-­led instruction (e.g., explaining an activity, modeling an activity, prompting student activity, asking guiding questions, providing definitions). Direct Instruction (DI), a very intensive teacher-­led instruction procedure, was used in two studies (Flores & Ganz, 2007; Flores & Ganz, 2009). Graphic organizers w ­ ere used as interventions in five studies (Bethune & Wood, 2013; Carnahan & Williamson, 2013; Mashal & Kasirer, 2011; Stringfield et al., 2011; Williamson et al., 2014).

­Table 1 Definitions of Coding Variables Used in the Review Coding Variable Dependent variables Responses to comprehension questions

Definition Oral response to literal question Oral response to recall questions Oral response to inferential questions Matching answers to questions Discourse Comprehension Test (Brookshire & Nicholas, 1993) Placement test for Corrective Reading Comprehension A: Thinking Basics program (Engelmann, Hadox, Hanner, & Osborn 2002) Multiple choice questions on the meaning of idioms and similes

Retelling

Morrow’s retelling score sheet (Morrow, 1985) Retelling story “in your own words” with a research-­created score sheet

Completion of a Graphic Or­ga­n izer

Sorting words into a graphic or­ga­n izer Fill in the blank story ele­ments on a story map

Other

Identify facts explaining events Identify statements as true/false/maybe Make deductions and inductions Detecting an incongruous sentence Formulating ­questions

Intervention/Procedures Teacher-­led instruction

Instruction in the use of a graphic or­ga­n izer Instruction in wh-­questions Guiding questions Teacher directions Teacher explanation Introduction of literary terms/signal words

Direct Instruction

Corrective Reading Comprehension A: Thinking Basics

Graphic Or­ga­n izer

Completion of a Venn diagram Instruction in the use of a graphic or­ga­n izer Use of thinking maps Completing character event map

Cooperative Learning

Peer tutoring Classwide peer tutoring Cooperative learning groups SCORE curriculum

Electronic Texts

Wynn Wizard software Book Builder

Self-­directed strategies

Training in Question/Answer relationships Previewing questions Anaphoric cueing Cloze tasks

Increasing Reading Comprehension Skills

197

In addition to the DI reading comprehension program and graphic organizers, the articles ­were coded as follows. Four studies used cooperative learning techniques (Kamps et al., 1989; Kamps et al., 1994; Kamps et al., 1995, Whalon & Hanline, 2008). Two studies used supported electronic texts (Armstrong & Hughes, 2012; Knight et al., 2014). The remaining two studies (Asberg & Dahlgren-­Sandberg, 2010; O’Connor & Klein, 2004) ­were grouped together ­because they encouraged participants to be active in­de­pen­dent readers by utilizing self-­ directed strategies. Details about each study and ESs can be found in ­Table 2. The interventions and the findings of each group are summarized below. Direct Instruction. DI is a systematic approach to instruction that integrates a curriculum designed to build skills sequentially and cumulatively, with a scripted teacher pre­sen­ta­tion. Signals and prompts are used to elicit correct student responses (Watkins, 2008). Tasks are broken down into component parts and each skill is taught to mastery. Teacher be­hav­ior and program procedures are designed to promote effective and efficient learning (Ganz & Flores, 2009: Stein, Silbert, & Carnine, 1997). Two studies (Flores & Ganz, 2007; Flores & Ganz, 2009) included two participants with ASD and followed a single-­subject multiple probe design. Identical scores on standardized tests suggest that the same participants w ­ ere used for both studies. Both studies used the curriculum Corrective Reading Thinking Basics: Comprehension Level A (Engelmann, Haddox, Hanner, & Osborn, 2002). The researchers taught in small groups and implemented instructional procedures as directed in the instructor’s manual, following three successive strands from the curriculum. The skills selected for the first study ­were statement inference, using facts, and analogies (Flores & Ganz, 2007). The skills selected for the second study ­were picture analogies, induction, and deductions (Flores & Ganz, 2009). The researchers created their own reading comprehension probes, modeled on the skills presented in the DI program. For example, in a statement inference probe, the instructor would read a series of questions related to a statement and allow the participant to respond to the question by saying the answer from the statement or “I ­don’t know.” All probes ­were sufficiently complex to ensure that the participant was in some way interpreting what he or she had read. The participants met criterion (i.e., 100% correct for three consecutive questions) across all three conditions in both studies. The results indicate the intervention was highly effective, using Banda & Therrien’s (2008) criteria for PND. Statement Inference and Using Facts ­were calculated at 100% PND for both participants, and Analogies

Pretest/ posttest within group

Multiple baseline

Reversal design

Multiple-­ n = 4 probe-­across-­ 2 Autism be­hav­iors 2 Intellectual Disability (ID)

Asberg & Dahlgren-­ Sandberg (2010)

Bethune & Wood (2013)

Carnahan & Williamson (2013)

Flores & Ganz (2007)

n = 3 ASD

n = 3 ASD

n = 12 ASD

n = 5 ASD

Single-­ subject with randomized intervention

Armstrong & Hughes (2012)

Study

Number of Participants

Study Design

10–14

13.4–13.7

8–10

M = 13.4

7–8

Age of Participants (years)

P1 = 98 P2 = 67 P3 = 57 P4 = 84

Not Reported

P1 = 94 P2 = 67 P3 = 90

MIQ = 102.83 RIQ = 83–125

P1 = 109 P2 = 84 P3 = 105 P4 = 86 P5 = 114

IQ

Direct Instruction

Graphic or­ga­n iz­er: Venn diagrams

Graphic or­ga­n iz­er: wh-­ questions

Self-­directed use of Question-­ Answer Relationships

Supported electronic text: Wynn Wizard vs. oral storytelling

Intervention

Study Design and Findings

­Table 2

40 sessions

16 sessions

30 sessions

4 weeks

11 weeks

Length of Intervention

20

Not reported

10

20–30

M = 47.7 (SD = 10.97)

Length of Sessions (minutes)

Scores on all tasks improved. Statement inference (PND = 100, 100) Using facts (PND = 100, 100) Analogies (PND = 88, 100)

Number of comprehension questions answered correctly increased. (PND = 100, 88, 88)

Number of wh-­questions answered correctly increased. (PND = 100, 100, 71)

Scores on Discourse Comprehension Test improved. (ES = 0.35)

Scores on comprehension questions ­were stable for both conditions. Story­book (PND  = 0, 20, 100, 20, 100) Computer (PND = 20, 0, 100, 10, 90)

Findings for Participants with ASD

Multiple baseline with reversal

Reversal design

Multiple probe with changing criteria

Kamps, Barbetta, Leonard, & Delquadri (1994)

Kamps, Leonard, & Potucek (1995)

Knight , Wood, Spooner, Browder, & O’Brien (2014)

n = 4 ASD

n = 42 3 Autism 39 TD

n = 17 3 Autism 14 TD

11–14

8–13

8–9

9–11

Multiple baseline across be­hav­iors

Kamps, Locke, Delquadri, & Hal (1989)

n = 6 2 Autism 4 Typically Developing (TD)

12–14

Multiple-­ n = 4 probe-­across-­ 2 Autism be­hav­iors 1 ID +AD/HD 1 AD/HD

Flores & Ganz (2009)

P1 = 55 P2 = 53 P3 = 63 P4 = 67

P1 = 101 P2 = 50

P1 = 101 P2 = 71 P3 = Not Reported

P1 = 50 P2 = 50

Not Reported

Supported electronic text using Bookbuilder and explicit instruction

Cooperative learning groups

Classwide peer tutoring

Peer tutoring

Direct Instruction

40 sessions

75 sessions

23 weeks

60 sessions

35 sessions

15

60

25–30

30

20

Scores in comprehension scores improved with explicit instruction (e.i.). Electronic text (PND = 50, 50, 0, 0) Electronic text + e.i. (PND = 91, 71, 0, 57)

Improvement on responding to comprehension questions and number of social interactions. (PND = 93, 89, 0)

Scores on comprehension questions improved for one participant. (PND = 27, 81, 0) Number of social interactions increased. (PND = 67, 68, 93)

Per­for­mance in academic skills improved. Money skills (PND = 100, 91) Expressive language (PND = 97, 100) Oral reading (PND = 74, 75)

Scores on all tasks improved. Analogies (PND = 100, 100) Deductions (PND = 100, 100) Induction (PND = 100, 100)

n = 3 ASD

n = 12 1 Autism 1 Asperger’s Syndrome 1 PDD-­NOS 9 TD

Repeated mea­sures

Multiple baseline

Multiple baseline

Multiple baseline

O’Connor & Klein (2004)

Stringfield, Luscre, & Gast (2011)

Whalon & Hanline (2008)

Williamson, Carnahan, Birri, & Swoboda (2014)

n = 3 ASD

n = 20 10 Autism 6 Asperger’s Syndrome 4 PDD-­NOS

n = 60 20 ASD 20 Learning Disability 20 TD

Pretest/ posttest between groups

Mashal & Kasirer (2011)

Study

Number of Participants

Study Design

16–17

7–8

8.1–11.2

M =  1 ­5.11

12–15

Age of Participants (years)

P1 = unknown P2 = 76 P3 = unknown

P1 = 101 P2 = 112 P3 = 92

P1 = 70 P2 = 71 P3 = 115

MIQ = 88.15

Not Reported

IQ

Graphic or­ga­n iz­er: character map

Cooperative learning: reciprocal questioning

Graphic or­ga­n iz­er: story maps

Self-­directed strategies: previewing question, cloze, and anaphoric cueing

Graphic or­ga­n iz­er: thinking maps

Intervention

­Table 2 (continued)

20 sessions

22 sessions

42 sessions

1 session

2 sessions

Length of Intervention

Not reported

30

15

60

Not reported

Length of Sessions (minutes)

Number of comprehension questions answered correctly increased. (PND = 100, 100, 100)

Improvement in all mea­sures. Unprompted question generation (PND = 85, 91, 100) Responses to peer questions (PND = 100, 100, 100)

Scores on comprehension test improved. (PND = 100, 88, 85)

Significant improvement on reading comprehension mea­sures. Procedural facilitation in general (ES = 0.12) Anaphoric cueing (ES = 0.42)

Significant improvement in interpreting conventional meta­phors (ES  = 0.62). No improvement in interpreting novel meta­phors.

Findings for Participants with ASD

Increasing Reading Comprehension Skills

201

was 88% PND for participant 1 and 100% for participant 2 (Flores & Ganz, 2007). Analogies, Deductions, and Induction (Flores & Ganz, 2009) ­were all calculated at 100% PND for both participants, indicating the intervention was highly effective. Results for maintenance ­were mixed, showing a functional relation between the DI and the reading comprehension skills mea­sured but only on the skills mea­ sured for Corrective Reading Thinking Basics: Comprehension Level A (Engelmann et al., 2002). It is not pos­si­ble to draw general conclusions about the effectiveness of DI for improving the reading comprehension skills of an individual with ASD from t­hese two studies. More research is needed in this area to determine the extent to which DI is an effective intervention for teaching individuals with ASD reading comprehension. Further, ­there is no indication ­these skills could be generalized to novel text. Graphic organizers. Graphic organizers provide a meaningful framework for readers to form relationships between what they know and textual information, structuring the cognitive effort required to interpret and comprehend text (Wittrock, 1992). Learners can then see how t­ hose concepts are connected, which in turns helps them understand and retain new information (Darch & Evans, 1986). A total of 32 students aged 8–12 years with ASD participated in the five studies reviewed. Each study used a dif­fer­ent type of graphic or­ga­niz­er: thinking maps (Mashal & Kasirer, 2011), wh-­question organizers (Bethune & Wood, 2013) story maps (Stringfield et al., 2011), Venn diagrams (Carnahan & Williamson, 2013), and character event maps (Williamson et al., 2014). Mashal & Kasirer (2011) used thinking maps to enhance meta­ phoric competence. Three equal groups of 20 participants w ­ ere compared: typically developing (TD), students with learning disability (LD), and students with ASD. During pre-­testing, participants in the TD group scored significantly higher than the other two groups on mea­sures testing their ability to interpret meta­phoric expressions and identify meaningless expressions. During intervention, teachers worked with the participants to discuss the meaning of common meta­phoric expressions with the assistance of thinking maps. For example, the expression “train of thought” is written in a b ­ ubble at the center of the thinking map and associations (i.e. travel/movement, brain/ideas) are then written in surrounding ­bubbles. The thinking map shows how the two ideas are connected to facilitate comprehension. All three groups showed significant improvement in their understanding of conventional meta­phoric phrases ­after the intervention. However, unlike other groups, the participants with ASD ­were unable to generalize the strategy to novel meta­phors.

202

Finnegan and Mazin

The other four studies (Bethune & Wood, 2013; Carnahan & Williamson, 2013; Stringfield at al., 2011; Williamson et al., 2014) utilized a single-­subject design. All participants w ­ ere able to read, with most having higher scores in decoding than comprehension on standardized mea­sures (Bethune & Wood, 2013; Carnahan & Williamson, 2013; Stringfield et al., 2011). Only one participant had comprehension scores higher than his decoding scores (Williamson et al., 2014). The interventions (i.e., graphic organizers) varied according to specific needs of the participants. A wh-­question graphic or­ga­n izer (Bethune & Wood, 2013) focused on improving participants’ comprehension of wh-­questions (e.g., who, where, what). This or­ga­nizer facilitated a higher number of correct responses to ­these questions in novel stories. A story map providing a visual depiction of basic story ele­ments (Gardill & Jitendra, 1999) eliminated the requirement for participants to actively remember when considering relations between ele­ ments and responding to comprehension questions (Stringfield et al., 2011). A Venn diagram illustrated similarities and differences described in expository texts to assist participants in responding to comprehension questions about science (Carnahan & Williamson, 2013). A character event map was used to help participants or­ga­nize their thoughts and interpret events in each chapter of the novel The Hunger Games (Collins, 2010), before being asked to respond to comprehension questions (Williamson et al., 2014). In all studies, participants ­were allowed to look back in the text for the answers. Two studies included additional supports in their intervention: a list of signal words like “both” and “dif­fer­ent” (Carnahan & Williamson, 2013), and instruction on literary terms such as “foreshadowing” (Williamson et al., 2014). In all four studies, the intervention was effective in improving scores on participants’ response to comprehension questions. Using a graphic or­ga­nizer was found to be highly effective in increasing the number of “wh” questions answered correctly (Bethune & Wood, 2013) with PND reported for participant 1 at 100%, participant 2 at 100%, and participant 3 at 71% (moderate effectiveness). The use of Venn diagrams to answer comprehension questions (Carnahan & Williamson, 2013) was found to be highly effective with PNDs of 100%, 88%, and 100%. The use of story maps was found to be moderately to highly effective in improving the scores on comprehension tests (Stringfield et al., 2011) with PNDs of 100%, 88%, and 85%. The use of thinking maps (Mashal & Kasirer, 2011) had a moderate effect on interpreting conventional meta­phors and no effect on interpreting novel meta­ phors. The use of a character map was found to be highly effective in increasing the number of comprehension questions answered cor-

Increasing Reading Comprehension Skills

203

rectly with PND of 100% for all three participants (Williamson et al., 2014). The studies varied on the type of questions posed with two studies including only literal questions in their probes (Bethune & Wood, 2013; Stringfield et al., 2011) while the other two included inferential questions (Carnahan & Williamson, 2013; Williamson et  al., 2014). The type of question does not seem to have impacted the overall results. All studies showed that participants ­were able to maintain and generalize the skills they had been taught by applying the intervention to new chapters or stories. In one study, scores on comprehension questions improved even when participants chose not to use the intervention (Stringfield et al., 2011). In two of the studies, students ­were able to use the graphic or­ga­nizer in­de­pen­dently (Carnahan & Williamson, 2013; Stringfield et al., 2011) while participants continued to rely on instructional support from an adult even in the maintenance phase in another study (Bethune & Wood, 2013). The research supports the use of graphic organizers to support reading comprehension in students with ASD. When choosing an intervention, it is impor­tant to match the graphic or­ga­nizer with the needs of the student and the text. From t­ hese studies, it is unclear the extent to which additional ele­ments of instruction (e.g., signal words, discussion of text, teacher prompting) enhanced the ability of participants to answer comprehension skills. The ele­ments of instruction described w ­ ere similar to ­those, students would encounter in a general education classroom and cannot easily be separated out. The most promising interventions are t­ hose which participants could use in­de­ pen­dently, could generalize with texts they had not previously seen and improved scores on both literal and inferential comprehension questions (Carnahan & Williamson, 2103; Williamson et al., 2014). Additional research is needed to investigate if instruction on identifying and interpreting figurative language w ­ ill improve the reading comprehension scores of students with ASD. Cooperative learning. Cooperative learning is another intervention that reflects common activities in general education classrooms. In cooperative learning, students work together t­oward a common learning objective (e.g., working together on a proj­ect to learn a specific domain or skill). Cooperative learning has been shown to have a positive effect on academic achievement, interpersonal relationships and self-­esteem (Slavin, 1981). Four single-­subject design studies used cooperative learning to enhance academics, including reading comprehension, in students with ASD (Kamps at al., 1989; Kamps et al., 1994; Kamps et al., 1995; Whalon & Hanline, 2008). A total of 11 elementary students with ASD, aged 7–13 years, participated in the studies alongside typically developing peers. All of the participants with

204

Finnegan and Mazin

ASD ­were able to read in­de­pen­dently, but exhibited difficulties in the area of reading comprehension. Each study used a dif­fer­ent cooperative learning arrangement: peer tutoring (Kamps et  al., 1989), class wide peer tutoring (Kamps et al., 1994), cooperative learning groups (Kamps et  al., 1995), and cooperative pairs (Whalon & Hanline, 2008). All of ­these studies embedded activities related to reading comprehension into a unit of instruction, which included previewing instructional activities (Whalon & Hanline, 2008); peer training (Kamps et al., 1989; Kamps et al., 1994); practice on other reading skills (Kamps et al., 1994, Kamps et al., 1995) and academic skills (Kamps et al., 1989); and practice in social skills (Kamps et al., 1994; Whalon & Hanline 2008). Two studies used the SCORE curriculum (Vernon, Schumaker, & Deshler, 1993, 1996), which provides direct instruction on following cooperative learning be­hav­iors (Kamps et al., 1995; Whalon & Hanline, 2008). One study also provided participants with a checklist so that they could monitor their own pro­gress through the activity while focusing on reading comprehension (Whalon & Hanline, 2008). All studies used widely available reading materials and all but Kamps et al. (1995) incorporated grade-­level reading material. Teachers and paraprofessionals provided reinforcement and corrective feedback to participants with ASD and their typically developing peers. In three of the studies, cooperative learning was used primarily to practice reading skills in fluency, vocabulary, and responding to comprehension questions (Kamps et al., 1989; Kamps et al., 1994; Kamps et al., 1995). Whalon & Hanline (2008) had participants engaged in reciprocal questioning about key ele­ments of a story (e.g., setting, character, event, prob­lem, solution). Peer tutoring was highly effective in increasing academic skills in the areas of money and expressive language and moderately effective in oral retelling (Kamps et al., 1989). Class wide peer tutoring was moderately effective (81% PND) for one participant in increasing comprehension and not effective for two participants (27% and 0% PND) (Kamps et al., 1994). It was found to be effective for increasing social interactions for one participant (93%) and not effective for two participants (67% and 68%) using PND. Cooperative learning groups was a highly effective intervention for increasing response to comprehension questions and social interactions for one participant (93% PND), moderately effective for one participant (89% PND), and not effective for one participant (0% PND). Cooperative learning with a focus on reciprocal questioning was moderately effective for one participant (85% PND) and highly effective for two participants (91% and  100% PND) in unprompted question generation (Whalon & Hanline, 2008). It

Increasing Reading Comprehension Skills

205

was highly effective for all three participants (100% PND) for responses to peer questions. The results of all four studies showed that the number of correct responses to comprehension mea­sures increased when participants with ASD engaged in cooperative learning with their peers. Although the results of the studies are promising, with such a small sample of studies and participants, conclusions about the effectiveness of cooperative learning on reading comprehension skills in students with ASD should be made cautiously, especially since each study incorporated so many different ele­ments. Further research is needed to determine ­whether peer tutoring would be effective if the sole focus was reading comprehension. Generalization of intervention effects is difficult to determine for cooperative learning. Ideally, one would need to know if participants applied cooperative learning be­hav­iors learned in one subject area to another subject area, and this is beyond the scope of t­ hese studies. Although studies date back to 1989, they cannot be overlooked, as ele­ments of their design have been incorporated into more recent studies. In addition to Whalon and Hanline’s (2008) research, which incorporated the SCORE curriculum (Vernon et al., 1996), other studies in this review have included small group discussions in their interventions (Carnahan & Williamson, 2013; Mashal & Kasirer, 2011; Williamson et al., 2014). Supported electronic texts. In contrast to cooperative learning, supported electronic texts encourages in­de­pen­dent study. Supported electronic text is a form of computer-­assisted instruction, in which texts are enhanced to promote content area learning and comprehension (Anderson-­Inman & Horney, 1996). Supported electronic text is becoming more commonly used and aligns with the princi­ples of Universal Design for Learning, increasing access to understanding with inbuilt supports (e.g., text to speech, illustrations, definitions). Two single-­subject design studies (Armstrong & Hughes, 2012; Knight et al., 2014) used supported electronic texts. The nine participants ­were aged 7–14 years and all diagnosed with ASD. In Knight et al. (2014), the reading comprehension scores of the participants ­were in the low or very low range, while in Armstrong & Hughes (2012), all participants ­were at the 2nd grade level on the Jerry John’s Basic Reading Inventory (Johns, 2005). Armstrong & Hughes focused on just the text-­to-­speech component of supported electronic text, which was compared to traditional instructor-­led read aloud of text. Knight et al (2014) utilized all the in-­built features of BookBuilder (CAST, 2014), which included vocabulary definitions, illustrations, text-­to-­speech, concept maps, and an embedded coach, which guides the reader with questions and explanations.

206

Finnegan and Mazin

Armstrong & Hughes (2012) followed a strict protocol for the repeated reading intervention they used. In the story­book condition, the researcher introduced and read the book to the participant, tracing the words with his or her fin­ger. The participant read along with the researcher, and was given an additional opportunity to retell and reread the book, before being asked to retell the story and answer questions. The computerized condition was identical except a text-­to-­ speech book was used with the computer highlighting words in place of the researcher tracing with his or her fin­ger. Results showed the three participants responded well to comprehension questions during both interventions, whereas two had similar scores to the baseline condition. Scores for retelling (e.g., recall and summarize what was read) ­were generally low. In Knight et al., (2014) two of the four participants had an increase in the percentage of correct responses to comprehension question, but a functional relation could not be established. The intervention was then modified to include explicit instruction, which included clear instructional objectives, explanations, modeling, guided, and in­de­pen­dent practice with corrective feedback. When explicit instruction was added, the number of correct responses increased for three of the four participants. The use of supported electronic text in the form of Bookbuilder (Knight et al., 2014) was not found to be effective in increasing reading comprehension, with PNDs of 50%, 50%, 0%, and 0% for the four participants. With the inclusion of explicit instruction, the intervention became somewhat more effective for some participants at 91%, 71%, 0%, and 57% PNDs. The use of Wynn Wizard was found to have varied effectiveness on comprehension with PNDs of 20%, 0%, 100%, 10%, and 90%. ­There is not sufficient evidence to suggest that supported electronic text effectively improves reading comprehension. The results of t­hese studies suggest other features of the interventions such as repeated reading (Armstrong & Hughes, 2012) or explicit instruction (Knight et al., 2014) might be the critical intervention component in improving the reading comprehension scores for some ­participants. Self-­directed strategies. Like the studies on supported electronic text, the remaining two studies prompted in­de­pen­dent engagement with the text (Asberg & Dahlgren-­Sandberg, 2010; O’Connor & Klein, 2004). In both studies, the researcher modeled a strategy before requiring the participants to use the strategy in­de­pen­dently. A total of 32 participants with ASD, aged 10–18 years, ­were included in the studies. All participants had close to normative decoding skills, but showed weaknesses in reading comprehension. Asberg & Dahlgren-­ Sandberg (2010) used a pretest/posttest design and mea­sured reading

Increasing Reading Comprehension Skills

207

comprehension using the Discourse Comprehension Test (Brookshire & Nicholas, 1993). O’Connor & Klein (2004) used a repeated mea­sures design, in which participants read randomly assigned passages ­under four dif­fer­ent instructional conditions and answered comprehension questions a­ fter each. Analy­sis of the variance was conducted to detect differences between the reading comprehension scores. Asberg & Dahlgren-­Sandberg (2010) conducted a study in which 12 students with ASD received instruction using Question-­A nswer Relationships (QARs) (Raphael, 1982). QARs provide a framework for helping students understand that t­ here is a relationship between the type of question asked and where the answer can be found in a text. In QARs, the answer is ­either “In the Book” or “In My Head.” If the answer is “In the Book,” the answers to literal questions ­will be found “Right T ­ here” (i.e., written somewhere in the text), whereas “Think and Search” questions ­will require readers to link ideas from several points in the text to figure out the answer. Questions that can be answered “In My Head” may be questions that the reader can answer “On My Own” using his or her personal experiences, or “Author and Me” questions that require the reader to connect his or her background knowledge about text structure with the intentions of the author. The instruction in using QARs was derived from a specially designed training manual (Franzén, 1997). During the three-­to four-­ week intervention phase, small group discussions ­were encouraged, and students ­either read in­de­pen­dently or had text read-­aloud to them. Post-­test results showed significant improvement ­after training for the students with ASD. However, individual results suggested that more support during the intervention phase might be required for some students. O’Connor and Klein’s (2004) study had four conditions: (a) pre-­ reading questions, (b) completing cloze sentences, (c) anaphoric cueing, and (d) a control condition. Each condition was described as a procedural facilitation, in which a reading strategy was explained to the participants. The sequence of the interventions was randomized across participants. In the pre-­reading questions conditions participants ­were instructed to review the questions before reading the text (adapted from a 6th grade reading series). In the completing cloze sentences condition, participants had to fill in words into 12 blank spaces from information given previously in the text. In the anaphoric cueing condition, participants had to from a list of three pos­si­ble referents for twelve pronouns underscored in a passage. No procedural facilitation was given in the control condition. Five passages ­were prepared for each condition and randomly assigned. The researchers used their own test to mea­sure retelling and responses to both literal

208

Finnegan and Mazin

and inferential questions ­after each condition. Although means ­were higher in all the conditions with procedural facilitation than for the control conditions, results showed that anaphoric cueing significantly improved students reading comprehension scores. The self-­directed use of QAR (Asberg & Dahlgren-­Sandberg, 2010) was found to have a small effect (ES = .35) on the participants’ scores on a discourse comprehension text. The overall use of O’Connor and Klein’s (2004) procedural facilitations was found to have a small effect (ES = .12) and the use of anaphoric cueing was found to have a moderate effect (ES = .42) on reading comprehension. ­These two studies demonstrate that students with ASD can in­ de­pen­dently use strategies that w ­ ill facilitate their reading comprehension. Both studies w ­ ere conducted over a relatively short period of time and showed positive results. Asberg & Dahlgren-­Sandberg (2010) worked with participants in small groups while O’Connor & Klein (2004) worked with participants one-­on-­one. It would be useful to know ­whether anaphoric cueing would also be effective if taught in a small group setting. It is not pos­si­ble to determine from the results of ­these studies ­whether the participants w ­ ere able to maintain their skills over time. However, skill generalization is implied as participants w ­ ere presented with novel texts during data collection. Discussion ­There w ­ ere 15 studies that met the criteria for this review. Results showed that the effectiveness of the interventions used varied (see T ­ able 2). Four studies w ­ ere found to have highly effective interventions (Flores & Ganz, 2007; Flores & Ganz, 2009; Whalon & Hanline, 2008; Williamson et al., 2014), four studies included interventions that showed a moderate to high effect (Bethune & Wood, 2013; Carnahan & Williamson, 2013; Kamps et al., 1989; Stringfield et al., 2011), two studies included intervention showing a moderate effect (Mashal & Kasirer, 2011; O’Connor & Klein, 2004), one study had a small ES (Asberg & Dahlgren-­Sandberg; 2010), and one study had interventions that showed l­ ittle to no effect (Armstrong & Hughes, 2012). It was not pos­si­ble to draw firm conclusions and extrapolations about the effectiveness of the interventions used in three studies (Kamps et al., 1994; Kamps, et al., 1995; Knight et al., 2014) ­because results varied considerably amongst participants. Kamps et  al. (1994) and Kamps et  al. (1995) ­were the only two studies that w ­ ere conducted in a general education setting, so their findings may be relevant to teachers practicing in ­those settings. In all three studies, ­there ­were participants who

Increasing Reading Comprehension Skills

209

benefited from the interventions. Given that students with ASD have a wide range of capabilities, which in turn can impact reading comprehension, t­ hese studies cannot be discounted. Educators using t­ hese interventions should closely monitor their students’ responses to evaluate their effectiveness for each individual. Interventions that w ­ ere highly effective included DI (Flores & Ganz, 2007; Flores & Ganz, 2009), cooperative learning (Whalon & Hanline, 2008), and the use of a graphic or­ga­nizer (Williamson et al., 2014). Overall, the use of graphic organizers appears to be the most effective intervention. Interventions addressing comprehension of figurative language (e.g., meta­phors, analogies) showed moderate to high effects (Mashal & Kasirer, 2011; Flores & Ganz, 2007; Flores & Ganz, 2009). This finding is impor­tant as it demonstrates that students with ASD are able to interpret and comprehend complex ele­ments of connected text. The effects of anaphoric cueing and the use of question-­ answer relationships w ­ ere each evaluated in only one study. The findings showed promise. Mixed results w ­ ere found for cooperative learning. Supported electronic text without any teacher-­led instruction does not appear to be to improve per­for­mance on reading comprehension mea­sures in students with ASD. Limitations First, ESs from studies with dif­fer­ent designs should be interpreted with caution. When conducting research with a low incidence population, such as students with ASD, a single subject design (e.g., multiple baseline; multiple probe) may be preferable to a group design due to the limited student population and the variability in characteristics of students with ASD. However, study design does have an impact on the calculation of ESs. Studies (Asberg & Dahlgren-­ Sandberg, 2010; Mashal & Kasirer, 2011; O’Connor & Klein, 2004) that had a sample size of ten or more and used statistical analy­sis to interpret results showed that the intervention had a small to moderate effect. In contrast, single-­subject studies in which participants ­were matched in IQ, age, and reading ability showed higher ESs. However, in practice students with ASD may not be grouped in this way and may be placed in classrooms with students with a range of characteristics. Second, variations in the dependent variable make comparisons between the effects obtained in each study difficult. The results of the coding procedures showed that nearly all of the studies had a dependent variable that mea­sured response to comprehension questions. Some studies used literal wh-­questions that referred to textually explicit answers (Bethune & Wood, 2013; Stringfield et  al., 2011),

210

Finnegan and Mazin

whereas other included inferential questions (Armstrong & Hughes, 2012; Carnahan & Williamson, 2013; O’Connor & Klein, 2004; Williamson et  al., 2014). In addition, in some studies participants ­were required to answer questions from memory (Armstrong & Hughes, 2012; Kamps et al., 1994), in ­others participants ­were allowed to look back at the text (Carnahan & Williamson, 2013; O’Connor & Klein, 2004; Williamson et al., 2014). This repetition may have helped participants remember details in a text that they may not have recalled with only one reading. Two other issues related to recall are also apparent. The first issue that occurs relates to answer choice. Most of the studies asked open-­ ended comprehension questions to participants, but some gave participants several answer choices (Knight et  al., 2014), from which to select the correct one. ­ These choices may have prompted participants’ memory. Additionally, the format in which questions ­were presented varied from study to study, for example, digital (Knight at al., 2014), oral (Armstrong & Hughes, 2012), and written (Carnahan & Williamson, 2013; Williamson et  al., 2014). In many studies, the nature of the comprehension questions was not clear. The two studies (Flores & Ganz, 2007; Flores & Ganz, 2009) which did not use response to comprehension questions used dependent variables that included making deductions, making statements, and interpreting analogies: all of which assess participants’ ability to interpret connected text. All of the dependent variables mea­sured participants’ ability to interpret connected text. The range of mea­ sures used to determine a student’s reading comprehension is inherent in the nature of reading instruction. Tasks ­will differ according to text complexity and purpose.  ­Unless researchers use standardized mea­sures, it is not pos­si­ble to conclude that one intervention is more effective than another by comparing across studies. Third, the overall sample size was small. Only 15 studies met the criteria for this study. In turn, the overall sample size of participants with ASD from all of t­ hose studies was relatively small for a comprehensive review. Even for t­ hose interventions that w ­ ere highly effective (e.g., graphic organizers), t­ here w ­ ere not enough data points to clearly determine ­whether or not the intervention can be considered evidence-­ based practice. Fi­nally, two of the studies ­were conducted in languages other than En­glish (Asberg & Dahlgren-­Sandberg, 2010; Mashal & Kasirer, 2011), which may influence the results and the extent to which the findings can be extrapolated to English-­speaking studies. The strategies used in t­ hese studies could be used in an En­glish language setting and f­ uture research needs to be done to determine w ­ hether the instructional language impacted the results of the studies.

Increasing Reading Comprehension Skills

211

Implications for Practice Nearly half of the studies included satisfaction surveys as a mea­ sure of social validity. This practice has become more common since social validity was identified as a quality indicator within single-­ subject designs by Horner, Carr, & Halle (2005). Data on w ­ hether or not the intervention was beneficial and would be used again was collected from both teachers and students. Most teachers would agree that reading comprehension is impor­tant and dependent variables mea­sur­ing skills in reading comprehension are socially valid. This has been established by NICHD (2000) and by the CCSS (National Governor’s Association, 2010). Most of the studies ­were conducted in small group settings or classroom-­like settings across dif­fer­ent grade levels. Many included participants’ typically developing peers, which also simulates a classroom like setting. Although it is not pos­si­ble to draw conclusions about the connection between peer relationships in academics and social domains, it is suggested throughout the studies that one impacts the other. The interventions used (e.g., graphic organizers, self-­directed reading strategies, and cooperative learning) can be applied in classroom settings. The length of an intervention did not appear to have any impact on the effectiveness of the intervention. Practicing teachers may be inclined to choose short-­term interventions, such as procedural facilitation or instruction on question-­answer relationships, which show a moderate effect over a short period of time, over ­those interventions (e.g., DI), that show a high effect over a long period of time. All of the interventions used materials that ­were practical and cost effective. Knight et al. (2014) did suggest that the creation of supported electronic texts was time consuming, suggesting this might not be a first choice intervention for teachers with larger class sizes. Additionally, training for peer tutors takes time (Kamps et  al., 1989). Teachers would be better advised to focus on interventions like graphic organizers that are readily available and effective, if time is a constraint. Interestingly, studies that included question and answer strategies, which can be done with no additional materials, show positive outcomes (Asberg & Dahlgren-­Sandberg, 2010; Whalon & Hanline, 2008). Teacher to student ratio is also a concern. Staffing costs are significant, and school districts may not be able to hire additional staff required to implement one-­on-­one interventions, so it is encouraging to see positive outcomes for group instruction. Generalization was addressed in many of the studies, most notably t­ hose that used graphic organizers (Bethune & Wood, 2013; Carnahan & Williamson, 2013; Stringfield et al., 2011; Williamson et al.,

212

Finnegan and Mazin

2014). Participants showed that the skills they had learned could be applied to text they had not previous seen before. The ability of participants to generalize a skill was also demonstrated in the same manner for anaphoric cueing (O’Connor & Klein, 2004) and reciprocal questioning in cooperative learning groups (Whalon & Hanline, 2008). Generalization did not occur when participants w ­ ere asked to interpret novel meta­phors (Mashal & Kasirer, 2011). This reflects the lit­er­a­ ture showing that students with ASD often have difficulty interpreting figurative language, but it is an area that teachers still need to address when asking students to read complex texts. Implications for ­Future Research One trend in the research is that more studies are replicating naturalistic classroom settings, with interventions that incorporate small group instruction, teacher-­led discussion and group discussion. The inherent difficulty is controlling for the dif­fer­ent potential confounding variables. Knight et  al. (2014) did attempt to do this, by marking the introduction of a new variable, and researchers should consider this approach in ­future studies. In their review El Zein et al. (2014) stated that many of the studies “appear to have been influenced largely by findings within the National Reading Panel” (p. 1318). Many of the interventions used in the studies included in this review ­were interventions and strategies that have been found effective for other populations. More research needs to be done on interventions, such as anaphoric cueing, that address the unique needs of students with ASD. Researchers should also consider developing interventions that address some of the unique needs of students with ASD, including interpreting figurative language. In addition, to meet the standards for EBP studies need to replicated and the results published. References American Psychiatric Association. (2013). Diagnostic and statistical manual of ­mental disorders (5th ed.). Arlington, VA: American Psychiatric Publishing. Anderson-­Inman, L., & Horney, M. (1996). Computer-­based concept mapping: Enhancing literacy with tools for visual thinking. Journal of Adolescent and Adult Literacy, 40(4), 302–306. Retrieved from http://­www​.­jstor​.­org​/­stable​/­40013436 Armstrong,  T.  K., & Hughes,  M.  T. (2012). Exploring computer and story­book interventions for c­ hildren with high functioning

Increasing Reading Comprehension Skills

213

autism. International Journal of Special Education, 27(3), 88–99. Retrieved from http://­eric​.­ed​.­gov​/­​?­id​=­EJ1001062 Asberg, J., & Dahlgren-­Sandberg, A. (2010). Discourse comprehension intervention for high-­functioning students with autism spectrum disorders: Preliminary findings from a school-­based study. Journal of Research in Special Educational Needs, 10(2), 91– 98. doi: 10.1111/j.1471–3802.2010.01147.x Banda, D. R., & Therrien, W. J. (2008). A teacher’s guide to meta-­analy­ sis. Teaching Exceptional ­Children, 41(2), 66–71. ­doi:  10.1177/​ 004005990804100208 Baron-­Cohen, S., Leslie, A., & Frith, U. (1985). Does the autistic child have “theory of mind”? Cognition, 21, 31–46. doi: 10.1016/​ 0010–0277(85)90022–8 Baron-­Cohen,  S., Richler,  J., Bisarya,  D., Gurunathan,  N., & Wheelwright, S. (2003). The systemizing quotient: An investigation of adults with Asperger syndrome or high-­functioning autism, and normal sex differences. In U. Frith & E. Hill (Eds.), Autism: Mind and brain (pp. 161–186). New York: Oxford University Press. Bethune, K. S., & Wood, C. L. (2013). Effects of wh-­question graphic organizers on reading comprehension skills of students with Autism Spectrum Disorders. Education and Training in Autism and Developmental Disabilities, 48(2), 236–244. Retrieved from http://­daddcec​.­org​/­Publications​/­ETADDJournal​/­ETA​DDAr​ chives​.­aspx Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta- ­analy­sis. West Sussex, UK: John Wiley & Sons. Boucher,  J. (2012). Research review: Structural language in Autistic Spectrum Disorder: Characteristics and c­ auses. Journal of Child Psy­chol­ogy and Psychiatry, 53(3), 219–233. doi:10.1111​ /j.1469​ –7610.2011.02508.x Brookshire, R. H., & Nicholas, L. E. (1993). The discourse comprehension test. Tucson, AZ: Communication Skill Builder. Brown, H., Oram-­Cardy, J., & Johnson, A. (2013). A meta-­analy­sis of the reading comprehension skills of individuals on the autism spectrum. Journal of Autism and Developmental Disorders, 43(4), 932–955. doi:10.1007/s10803–012–1638–1 Cain, K., Oakhill, J., & Bryant, P. (2004). ­Children’s reading comprehension ability: Concurrent prediction by working memory,

214

Finnegan and Mazin

verbal ability, and component skills. Journal of Educational Psy­chol­ogy, 96(1), 31–42. doi: 10.1037/0022–0663.96.1.31 Carnahan, C. R., & Williamson, P. S. (2013). Does compare-­contrast text structure help students with Autism Spectrum Disorder comprehend science text? Exceptional ­Children, 79(3), 347–363. doi: 10.1177/001440291307900302 Carnahan, C. R., Williamson, P. S., & Christman, J. (2011). Linking cognition and literacy in students with autism spectrum dis­ order. Teaching Exceptional C ­ hildren, 43(6), 54–62. doi: 10.1177​ /004005991104300606 Carnahan, C. R., Williamson, P., & Haydon, T. (2009). Matching literacy profiles with instruction for students on the spectrum: Making reading instruction meaningful. Beyond Be­hav­ior, 19(1), 10–16. Retrieved from http://­eric​.­ed​.­gov​/­​?­id​=­EJ885714 CAST (2014). Transforming education through universal design for learning. Retrieved from http://­www​.­cast​.­org/ Chakrabarti, S., & Fombonne, E. (2005). Pervasive developmental disorders in preschool ­children: Confirmation of high prevalence. The American Journal of Psychiatry, 162(6), 1133–1141. doi:10.1176/appi.ajp.162.6.1133 Chiang, H., & Lin, Y. (2007). Reading comprehension instruction for students with autism spectrum disorders: A review of the lit­ er­a­t ure. Focus on Autism and Other Developmental Disabilities, 22(4), 259–267. doi:10.1177/10883576070220040801 Collins, S. (2010). The hunger games. New York: Scholastic Press. Cook, B. G., & Odom, S. L. (2013). Evidence-­based practices and implementation science in special education. Exceptional ­Children, 79(2), 135–144. doi: 10.1007/s10803–013–1989–2 Darch, C., & Evans, R. C. (1986). Visual displays to increase comprehension of high school learning-­disabled students. Journal of Special Education, 20(3), 309–318. doi: 10.1177/​002246698602000305 El Zein, F., Solis, M., Vaughn, S., & McCulley, L. (2014). Reading comprehension interventions for students with autism spectrum disorders: A synthesis of research. Journal of Autism and Developmental Disorders, 44(6), 1303–1322. doi: 10.1007/s10803–013–1989–2 Engelmann, S., Haddox, P., Hanner, S., & Osborn, J. (2002). Corrective reading thinking basics: Comprehension level A. Columbus, OH: SRA/McGraw-­Hill. Estes, A., Rivera, V., Bryan, M., Cali, P., & Dawson, G. (2011). Discrepancies between academic achievement and intellectual dis-

Increasing Reading Comprehension Skills

215

ability in high-­functioning school-­aged c­ hildren with autism spectrum disorder. Journal of Autism and Developmental Disorders, 41(8), 1044–1052. doi: 10.1007/s10803–010–1127–3 Flores, M. M., & Ganz, J. B. (2007). Effectiveness of Direct Instruction for teaching statement inference, use of facts, and analogies to students with developmental disabilities and reading delays. Focus on Autism and Other Developmental Disabilities, 22(4), 244–251. doi:10.1177/10883576070220040601 Flores, M. M., & Ganz, J. B. (2009). Effects of Direct Instruction on the reading comprehension of students with Autism and Developmental Disabilities. Education and Training in Developmental Disabilities, 44(1), 39–53. Retrieved from http://­daddcec​.­org​ /­Publications​/­ETADDJournal​/­ETADDArchives​.­aspx Franzén, L. (1997). Läsförstå­else. Solna: Ekelunds förlag (in Swedish). Frith, U. (2003). Autism: Explaining the enigma (2nd ed.). Malden: Blackwell Publishing. Frith, U., & Snowling, M. (1983). Reading for meaning and reading for sound in autistic and dyslexic c­ hildren. British Journal of Developmental Psy­chol­ogy, 1, 329–342. doi: 10.1111/j.2044–835X.1983. tb00906.x Ganz, J. B., & Flores, M. M. (2009). The effectiveness of Direct Instruction for teaching language to students with autism spectrum disorders: Identifying materials. Journal of Autism and Developmental Disorders, 39(1), 75–83. doi: 10.1007/s10803–008–0602–6 García-­Madruga,  J., Elosúa,  M., Gil,  L., Gómez-­Veiga,  I., Vila,  J., Orjales,  I., Contreras,  A., Rodríguez,  R., Melero,  M., & Duque, G. (2013). Reading comprehension and working memory’s executive pro­cesses: An intervention study in primary school students. Reading Research Quarterly, 48(2), 155–174. Retrieved from http://­dx​.­doi​.­org​/­10​.­1002​/­rrq​.­44 Gardill, M. C., & Jitendra, A. K. (1999). Advanced story map instruction: effects on the reading comprehension of students with learning disabilities. Journal of Special Education, 33(1), 2. doi: 10.1177/002246699903300101 Happé,  F., & Frith,  U. (2006). The weak coherence account: Detail-­ focused cognitive style in Autism Spectrum Disorders. Journal of Autism and Developmental Disorders, 36(1), 5–25. doi: 10.1007/s10803–005–0039–0 Horner, R. H., Carr, E. G., & Halle, J. (2005). The use of single-­subject research to identify evidence-­ based practice in special

216

Finnegan and Mazin

e­ ducation. Exceptional ­Children, 71(2), 165–179. doi: 10.1177​ /00144​0290507100203 Johns, J. (2005). Basic Reading Inventory (9th ed.). Dubuque, Iowa: Kendall Hunt Publishing Com­pany. Kamps, D. M., Barbetta, P. M., Leonard, B. R., & Delquadri, J. (1994). Classwide peer tutoring: an integration strategy to improve reading skills and promote peer interactions among students with autism and general education peers. Journal of Applied Be­hav­ior Analy­sis, 27(1), 49–61. doi: http://­dx​.­doi​.­org​/­10​.­1901​ /­jaba​.­1994​.­27–49 Kamps, D. M., Leonard, B., Potucek, J., & Garrison-­Harrell, L. (1995). Co-­operative learning groups in reading: An integration strategy for students with autism and general education peers. Behavioral Disorders, 21(1), 89–109. doi: 10.1901/jaba.1995.28–175 Kamps, D., Locke, P., Delquadri, J., & Hall, V. R. (1989). Increasing academic skills of students with autism using fifth grade peers as tutors. Education & Treatment of ­Children, 12(1), 38–51. Retrieved from http://­www​.­jstor​.­org​/­stable​/­42899092 Kazdin, A. E. (1982). Single-­case research designs: Methods for clinical and applied settings. New York: Oxford University Press. Knight, V. F., Wood, C. L., Spooner, F., Browder, D. M., & O’Brien, C. P. (2014). An exploratory study using science eTexts with students with Autism Spectrum Disorder. Focus on Autism and Other Developmental Disabilities, 30(2), 1–14. doi: 10.1177/1088357614559214 Mashal,  N., & Kasirer,  A. (2011). The relationship between visual meta­phor comprehension and recognition of similarities in ­children with learning disabilities. Research in Developmental Disabilities, 33(1), 274–282. doi:10.1016/j.ridd.2011.08.012 Mesibov, G. B., Shea, V., & Schopler, E. (2005). The TEACCH approach to autism spectrum disorders. New York: Springer Science + Business Media. Nation, K., Adams, J. W., Bowyer-­Crane, C. A., & Snowling, M. J. (1999). Working memory deficits in poor comprehenders reflect under­ lying language impairments. Journal of Experimental Child Psy­chol­ogy, 73(2), 139–158. doi:10.1006/jecp.1999.2498 Nation,  K., Clarke,  P., Wright,  B., & Williams,  C. (2006). Patterns of reading ability in ­children with autism spectrum disorder. Journal of Autism and Developmental Disorders, 36(7), 911–919. doi: 10.1007/s10803–006–0130–1

Increasing Reading Comprehension Skills

217

National Governors Association Center for Best Practices, Council Chief State School Officers (2010). Common Core State Standards. National Governors Association Center for Best Practices, Council Chief State School Officers: Washington, D.C. National Institute of Child Health and ­Human Development. (2000). Report of the National Reading Panel. Teaching c­ hildren to read: An evidence-­based assessment of the scientific research lit­er­a­ture on reading and its implications for reading instruction (NIH Publication No. 00–4769). Washington, DC: U.S. Government Printing Office. Retrieved from online: http://­www​.­eric​.­ed​.­gov​/­content​ delivery​/­servlet​/­ERICServlet​?­accno​=­ED508381 National Research Council. (2001). Educating ­children with autism. Washington DC: National Acad­emy Press. No Child Left B ­ ehind Act of 2001, 20 U.S.C. § 6319 (2008). Norbury,  C. (2005). The relationship between theory of mind and meta­phor: Evidence from ­children with language impairment and autistic spectrum disorder. British Journal of Developmental Psy­chol­ogy, 23(3), 383–399. Retrieved from http://­dx​.­doi​.­org​ /­10​.­1348​/­026151005X26732 O’Connor I. M., & Klein, P. D. (2004). Exploration of strategies for facilitating the reading comprehension of high-­functioning students with autism spectrum disorder. Journal of Autism and Developmental Disorders, 34(2), 115–127. doi: 10.1023/B:JADD.​ 0000022603.44077.6b Pressley, M., & Afflerbach, P. (1995). Verbal protocols of reading: The nature of constructively responsive reading. Hillsdale NJ: Erlbaum. Raphael,  T.  E. (1982). Question-­Answer strategies for ­children. The Reading Teacher, 36(2), 186–190. Retrieved from http://­www​ .­jstor​.­org​/­stable​/­20198181 Quill, K. A. (2000). Do-­Watch-­Listen-­Say: Social and communication intervention for c­ hildren with autism. Baltimore, MD: Paul Brookes. Saldaña, D., & Frith, U. (2007). Do readers with autism make bridging inferences from world knowledge? Journal of Experimental Child Psy­chol­ogy, 96(4), 310–319. doi:10.1016/j.jecp.2006.11.002 Saldaña, J. (2013). The coding manual for qualitative researchers. Thousand Oaks, CA: Sage Publications. Scruggs,  T.  E., Mastropieri,  M.  A., Cook,  S.  B., & Escobar,  C. (1986). Early intervention for ­children with conduct disorders: A quantitative synthesis of single-­subject research. Behavioral

218

Finnegan and Mazin

Disorders, 11(4), 260–271. Retrieved from http://­www​.­jstor​.­org​ /­stable​/­23882207 Senokossoff, G. W. (2015). Developing reading comprehension skills in high functioning c­ hildren with Autism Spectrum Disorder: A review of the research, 1990–2012, Reading & Writing Quarterly: Overcoming Learning Difficulties 32(3). doi: 10.1080​ /10573569.2014.936574 Shanahan,  T., Callison,  K., Carriere,  C., Duke,  N.  K., Pearson,  P.  D., Schatschneider, C., & Torgesen, J. What Works Clearing­house. (2010). Improving Reading Comprehension in Kindergarten through 3rd Grade: IES Practice Guide. NCEE 2010–4038. What Works Clearing­house. Retrieved from http://­www​.­eric​.­ed​.­gov​ /­content​delivery​/­servlet​/­ERICServlet​?­accno​=­ED512029 Slavin, R. E. (1981). Synthesis of research on cooperative learning. Educational Leadership, 38(8), 655–660. Retrieved from http://­www​ .­e ric​ .­e d​ .­g ov​/­c ontentdelivery​/­s ervlet​ /­E RICServlet​ ?­a ccno​ =­EJ247023 Snowling, M., & Frith, U. (1986). Comprehension in ‘hyperlexic’ readers. Journal of Experimental Child Psy­chol­ogy, 42(3), 392–415. doi:10.1016/0022–0965(86)90033–0 Stein, M., Silbert, J., & Carnine, D. (1997). Designing effective mathe­matics instruction: A Direct Instruction approach (3rd ed.). Upper ­Saddle River, NJ: Prentice Hall. Stringfield, S. G., Luscre, D., & Gast, D. (2011). Effects of a Story Map on Accelerated Reader post-­reading test scores in students with high-­functioning autism. Focus on Autism and Other Developmental Disabilities, 26(4), 218–229. doi: 10.1177​/1088357611423543 U.S. Department of Education, National Center for Educational Statistics. (2013). The condition of education (NCES Publication No. 2013–037). Retrieved from http://­nces​.­ed​.­gov​/­pubs2012​ /­2012045​_ ­2​.­pdf Vernon,  D.  S., Schumaker,  J.  B., & Deshler,  D.  D. (1993). The SCORE skills: Social skills for cooperative groups. Lawrence, KS: Edge Enterprises, Inc. Vernon,  D.  S., Schumaker,  J.  B., & Deshler,  D.  D. (1996). The SCORE skills: Social skills for cooperative groups. Lawrence, KS: Edge Enterprises, Inc. Wahlberg, T., & Magliano, J. P. (2004). The ability of high function individuals with autism to comprehend written discourse. Dis-

Increasing Reading Comprehension Skills

219

course Pro­cesses: A Multidisciplinary Journal, 38(1), 119–144. doi: 10.1207/s15326950dp3801_5 Watkins, C. L. (2008). From DT to DI: Using Direct Instruction to teach students with ASD. The ABAI Newsletter, 31(3), 25–29. Whalon, K., & Hanline, M. F. (2008). Effects of a reciprocal questioning intervention on the question generation and responding of c­ hildren with autism spectrum disorder. Education & Training in Developmental Disabilities, 43(3), 367–387. Retrieved from h t t p://­d a d d c e c​ .­o r g​ /­P u bl i c at i o n s​ /­E TA DDJo u r n a l​ /­ETADDArchives​.­aspx Whitby, P. S., & Mancil, G. R. (2009). Academic achievement profiles of c­hildren with high functioning Autism and Asperger Syndrome: A review of the lit­er­a­t ure. Education & Training in Developmental Disabilities, 44(4), 551–560. Retrieved from http://­daddcec​.­org​/­P ublications​/­ETADDJournal​/­ETADD​ Archives​.­aspx Williamson, P., Carnahan, C. R., Birri, N., & Swoboda, C. (2014). Improving comprehension of narrative using character event maps for high school students with Autism Spectrum Disorder. The Journal of Special Education, 1–11. doi: 10.1177/0022466914521301 Wittrock,  M.  C. (1992). Knowledge acquisition and comprehension. In M. C. Alkin (Ed.), Encyclopedia of educational research 6th ed. (pp. 699–705). New York: Macmillan.

Copyright of Education & Treatment of Children is the property of West Virginia University Press and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use.