Seeing Stars

Study: Bell, Hungerford, Flowers, Worthington, & Fitler (Tech. Rep)

Bell, N, Hungerford, D, Flowers, DL, Worthington, P, Fitler, R. Improved decoding in poor readers following development of symbol imagery.

Descriptive Information

Usage

Acquisition and Cost

Program Specifications and Requirements

Training

Lindamood-Bell collaborates with schools/districts using a Professional Learning Community model to customize an RTI design to meet the aggregate learning needs of all students. We accomplish this within the mandates of IDEA, state, and local education policies. Each partnership is unique depending on existent school/district variables. Lindamood-Bell’s partnership and Professional Learning Community (PLC) philosophy is built around two main RTI concepts necessary to transform schools academically.

First, instructional methodologies are based on a theory of cognition. The process-based cognitive approach stimulates specific brain-based skills such as symbol imagery, concept imagery, and phonemic awareness. These underlying cognitive processes must be developed (Tier I) and/or remediated (Tier II & III) for all students to maximize their learning potential and benefit from standards-based instruction, strategies, materials, and curricula. Thus Lindamood-Bell adheres to and promotes a paradigm shift in how to best meet the cognitive and language processing needs of students, integrating both process and content/standards-based instruction. The skills addressed are foundational to all curricula and they cut across all standards.

Second, while Lindamood-Bell’s instructional practices are necessary, they are insufficient without simultaneously controlling for certain components or practices within the school system and/or culture in which they are to be implemented. To achieve large scale and sustainable success, Lindamood-Bell collaborates with all levels of leadership, including the school board, district administration, and site-level leaders in evidence based practices. Lindamood-Bell’s approach is to work in a collaborative effort to address and improve the existing school framework, personnel, and practices all as applied to an RTI framework. Specifically, the main district and school leadership support components include sustained and embedded professional development, data analyses and accountability, differentiated instruction, leadership institutes, parent/community outreach, and a certification process for teachers. This model mirrors the conceptual framework of Response to Intervention (RTI). By incorporating a collaborative, problem-solving framework to increase student achievement, Lindamood-Bell’s Professional Learning Community model has been shown to meet the needs of all students and sustain results over time.

The program is intended for use in kindergarten through high school. The program is intended for use with students with disabilities (specifically learning disabilities), English language learners, and any student at risk of academic failure. The academic area of focus is reading (including phonological awareness, phonics/word study, comprehension, fluency, vocabulary, spelling, and oral and written language expansion) and writing (including spelling, sentence construction, and planning and revising).

Since 1993-94, Lindamood-Bell has partnered with 99 districts in 27 states, and 3 countries to implement its programs and RTI framework. Over 7,000 teachers have received professional development in the program.

Where to Obtain:
Lindamood-Bell Learning Processes
416 Higuera Street
San Luis Obispo, CA 93401
Phone #: (800) 233-1819
Web Site: lindamoodbell.com

Cost: Below is the Lindamood-Bell summary of services and fees. The costs are the average itemized breakdown of full contracts.

Lindamood-Bell Professional Development Workshops:

  • $35,000/year, up to 3 schools
  • Provides the following Lindamood-Bell Professional Development workshops for district staff: One 2-day Seeing Stars workshop; One 2-day Visualizing & Verbalizing workshop; and One 1-day Introduction to Lindamood-Bell School Partnerships workshop, which includes the initial RtI PD.

Consulting, Coaching, and Program Management:

  • $125,000/year, up to 3 schools
  • Provides direct, full-time, on-site coaching, mentoring, and program management for all instructional staff.
  • A key component is to establish an organizational infrastructure that provides research-based intervention, body-of-evidence services.

Lindamood-Bell Instructional Leader Certification Program:

  • $15,000/year, up to 3 schools
  • A professional development plan designed to prepare instructional leaders to provide instruction and maintain a high quality, integrated, accountability-driven program for schools, all within an RtI framework.
  • Provides ongoing mentoring for candidates and advanced workshops and professional development activities.
  • Certification must be renewed annually

Leadership Institute:

  • $3,000/year, up to 3 schools
  • Leaders learn all aspects of Lindamood-Bell’s Response to Intervention framework and how to effectively manage this framework school wide.
  • Provides a 2-day in-service for district leaders prior to the start of the partnership.
  • Emphasis of learning is placed on principals as instructional leaders with specific responsibilities in monitoring program quality and fidelity.

INFORMS for Schools Orientation/Web-based data management:

  • $3,000/year, up to 3 schools
  • Teachers and administrators receive instruction and access to Lindamood-Bell’s web-based data management system. System includes an automated test-scoring module to generate student reports, progress monitoring data, and track attendance.
  • This web-base system does not require the school/district to purchase any additional software or hardware.

Test Administration Orientation and Support:

  • $3,000/year, up to 3 schools
  • Lindamood-Bell staff trains school personnel in test administration for assessing student skill level in reading and comprehension. Staff shadow and coach school personnel over the year to manage the various stages of assessment, scoring, and entering of data.

Quality Control Visits and Meetings:

  • $5,000/year, up to 3 schools
  • Corporate director visits occur at least 3 times per year to provide regular program mentoring, support, and review of key indicators.

Data Analysis and Reporting:

  • $9,000/year, up to 3 schools
  • Provides reports to site principals and to district administration on a monthly basis regarding the status and fidelity of the implementation.
  • Throughout the year the district administration and school board are provided with 4 reports: Needs Assessment Report (Fall); Mid-Year Report (Winter); End-of-Year Report (Summer); and State Achievement Test Report (Fall of following year).

Tips for Home/Community Outreach:

  • $1,000/year, up to 3 schools
  • Provides mutually agreed upon events for the families of students each semester to increase community awareness and involvement in the targeted schools.

Total Sample Fees:

  • $199,000/year, up to 3 schools
  • Include all components and services listed, including salaries, benefits, operational expenses, and workshop fees.
  • The above cost estimate serves as the 3-year budget for the school. Sample fees are based on 3-year partnership plan and may vary based on goals and objectives met each year.

Additional Sample Fees for Materials:

  • $55,000 minimum year 1; $15,000 minimum years 2 and 3
  • Instructional and testing materials must be purchased and received separately by the school. A list of publishers will be provided for the school’s convenience.

The program is designed for use with individual students and small groups of 2-6 students.

The program administration time is 55-90 minutes per session with 5-20 sessions per week for 8 or more weeks.

The program includes highly specified teacher manuals.

The program requires technology. Teachers and administrators receive instruction and access to Lindamood-Bell’s web-based data management system, including an automated test-scoring module that generates individualized real time student reports, progress monitoring data, and attendance tracking.

Training is required for the instructor. One week of training is needed initially, then mentoring throughout the program.

Our plan for professional development is job-embedded, evidence-based, and tailored to meet the desired goals of a particular school or school system. The backbone of this approach is the implementation of an RTI-based Professional Learning Community (PLC), in which educators can collaborate around a particular methodology or approach, review and discuss student data, share and problem solve issues related to classroom practice, and learn collectively from their own research and experience. A core component of this work is to review teacher and school-wide efforts to improve student learning, including sheltered instruction, specific interventions, and student support systems.
Through the use of our pedagogy and programs, teachers learn to ‘speak the same language’ when comparing progress of students within or across curricula or content areas. Ultimately, this process informs the delivery of standards-based instructional strategies and content-based instruction as well as the overall school or district plan for ongoing professional development.

The minimum qualifications of the instructor are that they are a paraprofessional. The program does not assume the instructor has expertise in a given area.

Training manuals and materials are available.

Schools using the program utilize a system-wide protocol for measuring student growth, teaching quality and relevance, and overall fidelity of the school improvement process. The process is guided by site leaders and decision makers who will review key indicators, and adjust the goals and benchmarks necessary to support students, teachers, and administrators in meeting annual yearly progress (AYP) and school improvement goals.

Ongoing professional and technical support is mandatory for practitioners.

 

Participants: Convincing Evidence

Sample size: 75 students (37 program, 38 control)

Risk Status: A tiered screening approach was used to identify students who would exhibit appropriate need for the instruction. Subjects eligible for participation met study thresholds in three criterion areas: word recognition, text reading fluency, and receptive vocabulary. A basal vocabulary score excluded cognitively or English language impaired students who would not fit into a homogeneous instructional group.

In the first step, the reading subtest from the Wide Range Achievement Test-Fourth Edition was given to all third grade students. WRAT4 reading was also given to all fourth and fifth grade students who performed “Proficient” and “Below Proficient” on the reading portion of the previous year’s state standards reading test that is first administered at the end of grade three. From that pool, those who also scored at or below a standard score of 92 (30th percentile) on WRAT4 reading were advanced to the next step.

In the second step, students who scored at or below the 25th percentile on the fluency portion of the Gray Oral Reading Test, Fourth Edition and who scored above a standard score of 70 (2nd percentile) on the Peabody Picture Vocabulary Test, Fourth Edition were retained and administered further testing of  reading and oral language.

Demographics:

  Program Control p of chi square
Number Percentage Number Percentage
Grade level
  Kindergarten 0 0% 0 0% N/A
  Grade 1 0 0% 0 0% N/A
  Grade 2 0 0% 0 0% N/A
  Grade 3 11 30% 12 32% 0.86
  Grade 4 16 43% 15 39% 0.74
  Grade 5 10 27% 11 29% 0.85
  Grade 6 0 0% 0 0% N/A
  Grade 7 0 0% 0 0% N/A
  Grade 8 0 0% 0 0% N/A
  Grade 9 0 0% 0 0% N/A
  Grade 10 0 0% 0 0% N/A
  Grade 11 0 0% 0 0% N/A
  Grade 12 0 0% 0 0% N/A
Mean Age          
Race-ethnicity
  African-American 3 8 1 3 0.29
  American Indian 0 0% 0 0% N/A
  Asian/Pacific Islander 0 0% 0 0% N/A
  Hispanic 5 14% 9 24% 0.26
  White 29 78% 28 74% 0.63
  Other 0 0% 0 0% N/A
Socioeconomic status
  Subsidized lunch 23 62% 35 92% 0.00
  No subsidized lunch 14 38% 3 8% 0.00
Disability status
  Speech-language impairments 2 5% 5 13% 0.25
  Learning disabilities 7 19% 2 5% 0.07
  Behavior disorders 0 0% 0 0% N/A
  Intellectual disabilities 0 0% 0 0% N/A
  Other 3 8% 1 3% 0.29
  Not identified with a disability 25 68% 30 79% 0.27
ELL status
  English language learner 6 16% 7 18% 0.80
  Not English language learner 31 84% 31 82% 0.80
Gender
  Female 14 38% 17 45% 0.54
  Male 23 62% 21 55% 0.54

Training of Instructors: Tier 3 instructors implementing the Lindamood-Bell® program were a certified teacher and two instructional aides. Prior to the beginning of the project, all three attended a two-day professional development workshop led by a Lindamood-Bell® trainer. They also attended a day of additional training in test interpretation, student grouping and progress monitoring, instructional pacing, and lesson planning. Teachers who have not lead students through a semester or more of instruction require an expert consultant’s assistance for pacing and devising lesson plans that efficiently address the needs of the students. This assistance, with observation and modeling, was provided in the program by a Lindamood-Bell® consultant who was in the building daily.

Design: Partially Convincing Evidence

Did the study use random assignment?: No.

If not, was it a tenable quasi-experiment?: Yes.

If the study used random assignment, at pretreatment, were the program and control groups not statistically significantly different and had a mean standardized difference that fell within 0.25 SD on measures used as covariates or on pretest measures also used as outcomes?: Not applicable.

If not, at pretreatment, were the program and control groups not statistically significantly different and had a mean standardized difference that fell within 0.25 SD on measures central to the study (i.e., pretest measures also used as outcomes), and outcomes were analyzed to adjust for pretreatment differences? Yes.

Were the program and control groups demographically comparable at pretreatment?: Yes.

Was there attrition bias1? No.

Did the unit of analysis match the unit for random assignment (for randomized studies) or the assignment strategy (for quasi-experiments)?: Yes.

1 NCII follows guidance from the What Works Clearinghouse (WWC) in determining attrition bias. The WWC model for determining bias based on a combination of differential and overall attrition rates can be found on pages 13-14 of this document: http://ies.ed.gov/ncee/wwc/pdf/reference_resources/wwc_procedures_v2_1_standards_handbook.pdf

 

Fidelity of Implementation: Unconvincing Evidence

Describe when and how fidelity of treatment information was obtained: Fidelity monitoring was obtained through regular observation and modeling by the on-site consultant.

Provide documentation (i.e., in terms of numbers) of fidelity of treatment implementation: The on-site consultant compiled notes on a score card based on at least two observations per week.

The fidelity monitoring approach undertaken by Lindamood-Bell primarily includes objective data regarding instruction in the various Tiers. The following variables were used as fidelity measures.

 

# Students per group Teacher program proficiency Level Minutes Per Day of instruction Days Per Week of instruction Coach Visits Per Week Group PLC Meetings Per Month
Recommendations 5 or less 3/4 60-90 5 1 1
             
Groups meeting Recommendations            
1st semester 89% 100% 89% 100% 100% N/A
             
2nd semester 100% 100% 100% 100% 100% 70%

 

Measures Targeted: Convincing Evidence

Measures Broader: Convincing Evidence

Targeted Measure Score type and range of measure Reliability statistics Relevance to program instructional content
Woodcock Reading Mastery =R (NU): Word Attack Age-referenced Standard Scores; 10-175 Split-half coefficient = 0.87 Seeing Stars is designed to develop decoding skills such as word attack.
Wide Range Achievement Test-3 Word Reading, and Spelling Age-referenced Standard Scores; 55-145 Median coefficient of forms combined = 0.91 Seeing Stars is designed to develop decoding skills such as word reading and spelling.
Lindamood Auditory Conceptualization (LAC-3) Test Age-referenced Standard Scores; 55-145 Averaged coefficient Alpha Reliability = 0.83 averaged across ages Seeing Stars is designed to develop phonological awareness.
Symbol Imagery Test (SIT) Age-referenced Standard Scores; 45-145 Coefficient Alpha Reliability = 0.83, averaged across ages Seeing Stars is designed to develop orthographic awareness.


 

Broader Measure Score type and range of measure Reliability statistics Relevance to program instructional content
Gray Oral Reading Test-4: Paragraph reading Rate, Accuracy, Fluency, and Comprehension Age-referenced Scaled Scores; 0-20 Coefficients averaged across age intervals = 0.97 Word level skills, if sufficiently developed, may generalize to context reading accuracy, fluency, and comprehension.
DTLA-2: Following Oral Directions Age-referenced Scaled Scores; 0-20 Average Coefficient Alpha Reliability = 0.83 Increased exposure to and success with text may extend from written to listening comprehension.
Peabody Picture Vocabulary-4 (Form A) Age-referenced Standard Scores; 52-148 Average Coefficient Alpha Reliability = 0.97 Increased exposure to and success with text may result in expanded vocabulary knowledge.

 

 

Number of Outcome Measures: 10 Reading, 1 Writing

Mean ES - Targeted: 0.49*

Mean ES - Broader: 0.19*

Effect Size:

Targeted Measures

Construct Measure Effect Size
Reading SIT 0.72**
Reading LAC-3 0.49*
Reading WRMT-R Word Attack 0.77**
Reading WRAT-4 Reading 0.42
Writing WRAT-4 Spelling 0.06

 Broader Measures

Construct Measure Effect Size
Reading GORT-4 Rate 0.10*
Reading GORT-4 Accuracy 0.69**
Reading GORT-4 Fluency 0.39
Reading GORT-4 Comprehension -0.15
Reading DTLA-2 Oral Direction 0.02
Reading PPVT-4 0.08

 

Key
*      p ≤ 0.05
**    p ≤ 0.01
***  p ≤ 0.001
–      Developer was unable to provide necessary data for NCII to calculate effect sizes
u      Effect size is based on unadjusted means
†      Effect size based on unadjusted means not reported due to lack of pretest group equivalency, and effect size based on adjusted means is not available

 

Visual Analysis (Single Subject Design): N/A

Disaggregated Data for Demographic Subgroups: No

Disaggregated Data for <20th Percentile: No

Administration Group Size: Small Group, (n=2-6)

Duration of Intervention: 90 minutes, 5 times a week, 12-15 weeks

Minimum Interventionist Requirements: Paraprofessional, 1 week initially, then mentoring

Reviewed by WWC or E-ESSA: E-ESSA

What Works Clearinghouse Review

This program was not reviewed by What Works Clearinghouse.

 

Evidence for ESSA

This program was not reviewed by Evidence for ESSA.

 

Other Research: Potentially Eligible for NCII Review: 0 studies