Seeing Stars
Study: Bell, Worthington et al. (n.d)
Summary
Lindamood-Bell collaborates with schools/districts using a Professional Learning Community model to customize an RtI design to best meet the aggregate learning needs of all students. We accomplish this within the mandates of IDEA, state and local education policies. Each partnership is unique depending on existent school/district variables. Lindamood-Bell’s partnership and Professional Learning Community (PLC) philosophy is built around two main RtI concepts necessary to transform schools academically. First, instructional methodologies are based on a theory of cognition. The process-based cognitive approach stimulates specific brain-based skills such as symbol imagery, concept imagery, and phonemic awareness. These underlying cognitive processes must be developed (Tier I) and/or remediated (Tier II & III) for all students to maximize their learning potential and benefit from standards-based instruction, strategies, materials, and curricula. Thus Lindamood-Bell adheres to and promotes a paradigm shift in how to best meet the cognitive and language processing needs of students, integrating both process and content/standards-based instruction. The skills addressed are foundational to all curricula and they cut across all standards. Second, while Lindamood-Bell’s research-proven instructional practices are necessary, they are insufficient without simultaneously controlling for certain components or practices within the school system and/or culture in which they are to be implemented. To achieve large scale and sustainable success, Lindamood-Bell collaborates with all levels of leadership, including the school board, district administration, and site-level leaders in evidence based practices. Lindamood-Bell’s approach is to work in a collaborative effort to address and improve the existing school framework, personnel, and practices all as applied to an RtI framework. Specifically, the main district and school leadership support components include sustained and embedded professional development, data analyses and accountability, differentiated instruction, leadership institutes, parent/community outreach, and a certification process for teachers. This model mirrors the conceptual framework of Response to Intervention (RtI). By incorporating a collaborative, problem-solving framework to increase student achievement, Lindamood-Bell’s Professional Learning Community model has been shown to meet the needs of all students and sustain results over time.
- Target Grades:
- K, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12
- Target Populations:
-
- Students with disabilities only
- Students with learning disabilities
- English language learners
- Any student at risk for academic failure
- Area(s) of Focus:
-
- Phonological awareness
- Phonological awareness
- Phonics/word study
- Comprehension
- Fluency
- Vocabulary
- Spelling
- Other: Oral & Written Language Expression
- Spelling
- Sentence construction
- Planning and revising
- Where to Obtain:
- Gander Publishing
- 416 Higuera Street San Luis Obispo, CA 93401
- (800) 233-1819
- lindamoodbell.com
- Initial Cost:
- Contact vendor for pricing details.
- Replacement Cost:
- Contact vendor for pricing details.
-
Lindamood-Bell® Summary of Services and Fees (Average itemized breakout for full contract) a. Lindamood-Bell® Professional Development Workshops ($35,000 per year, up to 3 schools): Our organization provides the following Lindamood-Bell® Professional Development Workshops for district staff: One 2-day Seeing Stars® workshop; One 2-day Visualizing & Verbalizing® workshop; and One 1-day Introduction to Lindamood-Bell® School Partnerships workshop, which includes the initial RtI PD. The Seeing Stars® workshops will present the use of symbol imagery to stabilize phonemic awareness and help develop sight words, fluency and spelling. The Visualizing and Verbalizing® workshop will present the theory regarding the relationship of concept imagery to language comprehension and the practice of the specific steps of the Nancibell® Visualizing and Verbalizing® Program to develop vocabulary and oral and written language comprehension. The Introduction to School Services workshop will provide a presentation of a model of language processing that unifies decoding, encoding, vocabulary and comprehension ability all within an RtI framework. The sensory-cognitive functions that affect development of decoding and comprehension skills are presented through research and case studies. Participants learn to identify students in need of remediation. b. Consulting, Coaching, and Program Management ($125,000 per year, up to 3 schools): Lindamood-Bell provides direct, full-time, on-site coaching, mentoring, and program management for all instructional staff. This support is differentiated based on skill level of classroom and small-group teachers. A key component is to establish an organizational infrastructure that provides research-based intervention, body of- evidence services to comprehensively increase student achievement. c. Lindamood-Bell® Instructional Leader Certification Program ($15,000 per year, up to 3 schools): Lindamood-Bell’s Instructional Leader Certification Program is a rigorous professional development plan designed to prepare key instructional leaders to provide instruction and maintain a high quality, integrated, accountability-driven program for schools, again, all within an RtI framework. Candidates participate in on-going mentoring—the primary function of Lindamood-Bell® consulting staff within the schools throughout the year—and advanced workshops and professional development activities. A school’s certified instructional leaders will go on to sustain the model in perpetuity. Certification is competency based, and candidates must renew their certification annually. d. Leadership Institute ($3,000 per year, up to 3 schools) As part of the PLC partnership, Lindamood-Bell provides a two-day in-service for district leaders prior to the start of the partnership. Leaders learn the framework for the PLC process-based educational model, the fundamentals of the instruction methodologies to be used, how to use data to determine differentiated instructional needs, and how to monitor classroom and small group instruction. Emphasis is placed on principals as instructional leaders with specific responsibilities in monitoring program quality and fidelity. A shared vision of program goals and expectations is developed by school/district leadership and clearly communicated to all constituents, including teachers and parents. Leaders learn all aspects of Lindamood-Bell’s Response to Intervention framework and how to effectively manage this framework school wide. SECTION 1: BASIC INFORMATION e. INFORMS for Schools Orientation/Web-based data management ($3,000 per year, up to 3 schools) Teachers and administrators receive instruction and access to Lindamood-Bell’s web-based data management system. This system includes an automated test-scoring module that generates individualized real time student reports, progress monitoring data, and attendance tracking. This is a critical tool for schools/districts, as it allows for the management of the learning needs of very large numbers of students, using nationally-normed diagnostic evaluations to comprise the “body of evidence” necessary in an Response to Intervention model. This webbased system does not require the school/district to purchase any additional software or hardware. Access is included with Lindamood-Bell’s contract for services with the district. f. Test Administration Orientation and Support ($3,000 per year, up to 3 schools) Lindamood-Bell® staff will train school personnel in test administration for assessing student skill level in various components of reading and comprehension. Lindamood-Bell® staff will shadow and coach school personnel throughout the year to help manage the various stages of assessment, scoring and entering of data. g. Quality Control Visits and Meetings ($5,000 per year, up to 3 schools) Corporate director visits occur a minimum of three times a year to provide regular program monitoring, support, and review of key indicators as a part of a continuous plan for improvement. h. Data Analysis and Reporting ($9,000 per year, up to 3 schools) We understand the importance of accountability and decision-making based on data. We continually monitor and measure the efficacy of our services and programs through comprehensive data analyses. It is our goal to provide partners with timely data analyses and recommendations to maximize program quality, fidelity, and sustainability in the Lindamood-Bell® model. On a monthly basis, we report to site principals and to the district administration regarding the status and fidelity of the implementation. Throughout the year, we will also provide the district administration and school board the following four reports: 1. Needs Assessment Report (Fall) – includes pre-test results for at-risk students identified for Lindamood-Bell® instruction 2. Mid-Year Report (Winter) – includes pre and post-test results for students participating in Lindamood-Bell® instruction during the first semester 3. End-of Year Report (Summer) – includes pre and post-test results for all students participating in Lindamood-Bell® instruction during the school year 4. State Achievement Test Report (Fall of following year) – includes cohort analyses on state achievement test results i. Tips for Home/Community Outreach ($1,000 per year, up to 3 schools) Lindamood-Bell provides mutually agreed upon events for the families of students, each semester, including our Tips for Home presentation, to increase community awareness and involvement in the targeted schools. These events are a critical component behind the success of the Professional Learning Community. j. Total Sample Fees ($199,000 per year, up to 3 schools) Sample fees include all components and services listed above, all Lindamood-Bell® salaries, benefits, operational expenses, and workshop fees. Lindamood-Bell’s focus is professional development rather than direct instruction. Therefore, the above cost estimate for professional development will serve as the 3-year budget for a school. All students in the school will benefit from the provided professional development; therefore Lindamood-Bell does not price our services per pupil. The sample fees are based on the Lindamood-Bell® 3- Year partnership plan and may vary based on goals and objectives being met each year. The Professional Development design plan can be scaled-up and customized based on the need and size of the school. Please see below for sample number of teachers and students served by one Lindamood-Bell® consultant: -Up to 16 classroom teachers (K-12), serving up to 25 students per class. Up to 400 students served. -Up to 12 push-in/small-group intervention teachers (K-12), serving up to 12 groups at 5 students per group. Up to 60 students served. k. Additional Sample Fees for Materials ($55,000 minimum year 1; $15,000 minimum years 2 and 3): Instructional and testing materials must be purchased and received separately by the school. Instructional materials are available separately through Gander Educational Publishing® (800-554-1819) and testing materials are available separately through the various test publishers. Lindamood-Bell will provide a list of publishers and contact information for the school’s convenience.
- Staff Qualified to Administer Include:
-
- Special Education Teacher
- General Education Teacher
- Reading Specialist
- Math Specialist
- EL Specialist
- Interventionist
- Student Support Services Personnel (e.g., counselor, social worker, school psychologist, etc.)
- Paraprofessional
- Other:
- Training Requirements:
- 1 week of initial training, then mentoring
-
Our plan for professional development is job-embedded, evidence-based, and tailored to meet the desired goals of a particular school or school system. The backbone of this approach is the implementation of an RtI-based Professional Learning Community (PLC), in which educators can collaborate around a particular methodology or approach, review and discuss student data, share and problem solve issues related to classroom practice, and learn collectively from their own research and experience. A core component of this work is to review teacher and school-wide efforts to improve student learning, including sheltered instruction, specific interventions, and student support systems. Through the use of our pedagogy and programs, teachers learn to ‘speak the same language’ when comparing progress of students within or across curricula or content areas. Ultimately, this process informs the delivery of standards-based instructional strategies and content-based instruction as well as the overall school or district plan for ongoing professional development.
Schools which have successfully implemented a Lindamood-Bell® Professional Learning Community model have utilized a system-wide protocol for measuring student growth, teaching quality and relevance, and overall fidelity of the school improvement process. This process is guided by site leaders and decision makers who will regularly review key indicators, and adjust the goals and benchmarks necessary to support students, teachers, and administrators in meeting annual yearly progress (AYP) and school improvement goals.
- Access to Technical Support:
- Mandatory
- Recommended Administration Formats Include:
-
- Individual students
- Small group of students
- Minimum Number of Minutes Per Session:
- 55
- Minimum Number of Sessions Per Week:
- 5
- Minimum Number of Weeks:
- 8
- Detailed Implementation Manual or Instructions Available:
- Yes
- Is Technology Required?
-
Program Information
Descriptive Information
Please provide a description of program, including intended use:
Lindamood-Bell collaborates with schools/districts using a Professional Learning Community model to customize an RtI design to best meet the aggregate learning needs of all students. We accomplish this within the mandates of IDEA, state and local education policies. Each partnership is unique depending on existent school/district variables. Lindamood-Bell’s partnership and Professional Learning Community (PLC) philosophy is built around two main RtI concepts necessary to transform schools academically. First, instructional methodologies are based on a theory of cognition. The process-based cognitive approach stimulates specific brain-based skills such as symbol imagery, concept imagery, and phonemic awareness. These underlying cognitive processes must be developed (Tier I) and/or remediated (Tier II & III) for all students to maximize their learning potential and benefit from standards-based instruction, strategies, materials, and curricula. Thus Lindamood-Bell adheres to and promotes a paradigm shift in how to best meet the cognitive and language processing needs of students, integrating both process and content/standards-based instruction. The skills addressed are foundational to all curricula and they cut across all standards. Second, while Lindamood-Bell’s research-proven instructional practices are necessary, they are insufficient without simultaneously controlling for certain components or practices within the school system and/or culture in which they are to be implemented. To achieve large scale and sustainable success, Lindamood-Bell collaborates with all levels of leadership, including the school board, district administration, and site-level leaders in evidence based practices. Lindamood-Bell’s approach is to work in a collaborative effort to address and improve the existing school framework, personnel, and practices all as applied to an RtI framework. Specifically, the main district and school leadership support components include sustained and embedded professional development, data analyses and accountability, differentiated instruction, leadership institutes, parent/community outreach, and a certification process for teachers. This model mirrors the conceptual framework of Response to Intervention (RtI). By incorporating a collaborative, problem-solving framework to increase student achievement, Lindamood-Bell’s Professional Learning Community model has been shown to meet the needs of all students and sustain results over time.
The program is intended for use in the following age(s) and/or grade(s).















The program is intended for use with the following groups.








If other, please describe:
ACADEMIC INTERVENTION: Please indicate the academic area of focus.
Early Literacy






If other, please describe:
Language





If other, please describe:
Reading







If other, please describe:
Oral & Written Language Expression
Mathematics








If other, please describe:
Writing





If other, please describe:
BEHAVIORAL INTERVENTION: Please indicate the behavior area of focus.
Externalizing Behavior








If other, please describe:
Internalizing Behavior





If other, please describe:
Acquisition and cost information
Where to obtain:
- Address
- 416 Higuera Street San Luis Obispo, CA 93401
- Phone Number
- (800) 233-1819
- Website
- lindamoodbell.com
Initial cost for implementing program:
- Cost
- Unit of cost
Replacement cost per unit for subsequent use:
- Cost
- Unit of cost
- Duration of license
Additional cost information:
Describe basic pricing plan and structure of the program. Also, provide information on what is included in the published program, as well as what is not included but required for implementation (e.g., computer and/or internet access)
Lindamood-Bell® Summary of Services and Fees (Average itemized breakout for full contract) a. Lindamood-Bell® Professional Development Workshops ($35,000 per year, up to 3 schools): Our organization provides the following Lindamood-Bell® Professional Development Workshops for district staff: One 2-day Seeing Stars® workshop; One 2-day Visualizing & Verbalizing® workshop; and One 1-day Introduction to Lindamood-Bell® School Partnerships workshop, which includes the initial RtI PD. The Seeing Stars® workshops will present the use of symbol imagery to stabilize phonemic awareness and help develop sight words, fluency and spelling. The Visualizing and Verbalizing® workshop will present the theory regarding the relationship of concept imagery to language comprehension and the practice of the specific steps of the Nancibell® Visualizing and Verbalizing® Program to develop vocabulary and oral and written language comprehension. The Introduction to School Services workshop will provide a presentation of a model of language processing that unifies decoding, encoding, vocabulary and comprehension ability all within an RtI framework. The sensory-cognitive functions that affect development of decoding and comprehension skills are presented through research and case studies. Participants learn to identify students in need of remediation. b. Consulting, Coaching, and Program Management ($125,000 per year, up to 3 schools): Lindamood-Bell provides direct, full-time, on-site coaching, mentoring, and program management for all instructional staff. This support is differentiated based on skill level of classroom and small-group teachers. A key component is to establish an organizational infrastructure that provides research-based intervention, body of- evidence services to comprehensively increase student achievement. c. Lindamood-Bell® Instructional Leader Certification Program ($15,000 per year, up to 3 schools): Lindamood-Bell’s Instructional Leader Certification Program is a rigorous professional development plan designed to prepare key instructional leaders to provide instruction and maintain a high quality, integrated, accountability-driven program for schools, again, all within an RtI framework. Candidates participate in on-going mentoring—the primary function of Lindamood-Bell® consulting staff within the schools throughout the year—and advanced workshops and professional development activities. A school’s certified instructional leaders will go on to sustain the model in perpetuity. Certification is competency based, and candidates must renew their certification annually. d. Leadership Institute ($3,000 per year, up to 3 schools) As part of the PLC partnership, Lindamood-Bell provides a two-day in-service for district leaders prior to the start of the partnership. Leaders learn the framework for the PLC process-based educational model, the fundamentals of the instruction methodologies to be used, how to use data to determine differentiated instructional needs, and how to monitor classroom and small group instruction. Emphasis is placed on principals as instructional leaders with specific responsibilities in monitoring program quality and fidelity. A shared vision of program goals and expectations is developed by school/district leadership and clearly communicated to all constituents, including teachers and parents. Leaders learn all aspects of Lindamood-Bell’s Response to Intervention framework and how to effectively manage this framework school wide. SECTION 1: BASIC INFORMATION e. INFORMS for Schools Orientation/Web-based data management ($3,000 per year, up to 3 schools) Teachers and administrators receive instruction and access to Lindamood-Bell’s web-based data management system. This system includes an automated test-scoring module that generates individualized real time student reports, progress monitoring data, and attendance tracking. This is a critical tool for schools/districts, as it allows for the management of the learning needs of very large numbers of students, using nationally-normed diagnostic evaluations to comprise the “body of evidence” necessary in an Response to Intervention model. This webbased system does not require the school/district to purchase any additional software or hardware. Access is included with Lindamood-Bell’s contract for services with the district. f. Test Administration Orientation and Support ($3,000 per year, up to 3 schools) Lindamood-Bell® staff will train school personnel in test administration for assessing student skill level in various components of reading and comprehension. Lindamood-Bell® staff will shadow and coach school personnel throughout the year to help manage the various stages of assessment, scoring and entering of data. g. Quality Control Visits and Meetings ($5,000 per year, up to 3 schools) Corporate director visits occur a minimum of three times a year to provide regular program monitoring, support, and review of key indicators as a part of a continuous plan for improvement. h. Data Analysis and Reporting ($9,000 per year, up to 3 schools) We understand the importance of accountability and decision-making based on data. We continually monitor and measure the efficacy of our services and programs through comprehensive data analyses. It is our goal to provide partners with timely data analyses and recommendations to maximize program quality, fidelity, and sustainability in the Lindamood-Bell® model. On a monthly basis, we report to site principals and to the district administration regarding the status and fidelity of the implementation. Throughout the year, we will also provide the district administration and school board the following four reports: 1. Needs Assessment Report (Fall) – includes pre-test results for at-risk students identified for Lindamood-Bell® instruction 2. Mid-Year Report (Winter) – includes pre and post-test results for students participating in Lindamood-Bell® instruction during the first semester 3. End-of Year Report (Summer) – includes pre and post-test results for all students participating in Lindamood-Bell® instruction during the school year 4. State Achievement Test Report (Fall of following year) – includes cohort analyses on state achievement test results i. Tips for Home/Community Outreach ($1,000 per year, up to 3 schools) Lindamood-Bell provides mutually agreed upon events for the families of students, each semester, including our Tips for Home presentation, to increase community awareness and involvement in the targeted schools. These events are a critical component behind the success of the Professional Learning Community. j. Total Sample Fees ($199,000 per year, up to 3 schools) Sample fees include all components and services listed above, all Lindamood-Bell® salaries, benefits, operational expenses, and workshop fees. Lindamood-Bell’s focus is professional development rather than direct instruction. Therefore, the above cost estimate for professional development will serve as the 3-year budget for a school. All students in the school will benefit from the provided professional development; therefore Lindamood-Bell does not price our services per pupil. The sample fees are based on the Lindamood-Bell® 3- Year partnership plan and may vary based on goals and objectives being met each year. The Professional Development design plan can be scaled-up and customized based on the need and size of the school. Please see below for sample number of teachers and students served by one Lindamood-Bell® consultant: -Up to 16 classroom teachers (K-12), serving up to 25 students per class. Up to 400 students served. -Up to 12 push-in/small-group intervention teachers (K-12), serving up to 12 groups at 5 students per group. Up to 60 students served. k. Additional Sample Fees for Materials ($55,000 minimum year 1; $15,000 minimum years 2 and 3): Instructional and testing materials must be purchased and received separately by the school. Instructional materials are available separately through Gander Educational Publishing® (800-554-1819) and testing materials are available separately through the various test publishers. Lindamood-Bell will provide a list of publishers and contact information for the school’s convenience.Program Specifications
Setting for which the program is designed.



If group-delivered, how many students compose a small group?
2-6Program administration time
- Minimum number of minutes per session
- 55
- Minimum number of sessions per week
- 5
- Minimum number of weeks
- 8

- If intervention program is intended to occur over less frequently than 60 minutes a week for approximately 8 weeks, justify the level of intensity:
Does the program include highly specified teacher manuals or step by step instructions for implementation?- Yes
BEHAVIORAL INTERVENTION: Is the program affiliated with a broad school- or class-wide management program?-
If yes, please identify and describe the broader school- or class-wide management program: -
Does the program require technology? - Yes
-
If yes, what technology is required to implement your program? -
Computer or tablet
Internet connection
Other technology (please specify)
If your program requires additional technology not listed above, please describe the required technology and the extent to which it is combined with teacher small-group instruction/intervention:
Teachers and administrators receive instruction and access to Lindamood-Bell’s web-based data management system including an automated test-scoring module that generates individualized real time student reports, progress monitoring data, and attendance tracking.
Training
- How many people are needed to implement the program ?
Is training for the instructor or interventionist required?- Yes
- If yes, is the necessary training free or at-cost?
Describe the time required for instructor or interventionist training:- 1 week of initial training, then mentoring
Describe the format and content of the instructor or interventionist training:- Our plan for professional development is job-embedded, evidence-based, and tailored to meet the desired goals of a particular school or school system. The backbone of this approach is the implementation of an RtI-based Professional Learning Community (PLC), in which educators can collaborate around a particular methodology or approach, review and discuss student data, share and problem solve issues related to classroom practice, and learn collectively from their own research and experience. A core component of this work is to review teacher and school-wide efforts to improve student learning, including sheltered instruction, specific interventions, and student support systems. Through the use of our pedagogy and programs, teachers learn to ‘speak the same language’ when comparing progress of students within or across curricula or content areas. Ultimately, this process informs the delivery of standards-based instructional strategies and content-based instruction as well as the overall school or district plan for ongoing professional development.
What types or professionals are qualified to administer your program?










If other, please describe:
- Does the program assume that the instructor or interventionist has expertise in a given area?
-
No
If yes, please describe:
Are training manuals and materials available?- Yes
-
Describe how the training manuals or materials were field-tested with the target population of instructors or interventionist and students: - Schools which have successfully implemented a Lindamood-Bell® Professional Learning Community model have utilized a system-wide protocol for measuring student growth, teaching quality and relevance, and overall fidelity of the school improvement process. This process is guided by site leaders and decision makers who will regularly review key indicators, and adjust the goals and benchmarks necessary to support students, teachers, and administrators in meeting annual yearly progress (AYP) and school improvement goals.
Do you provide fidelity of implementation guidance such as a checklist for implementation in your manual?-
Can practitioners obtain ongoing professional and technical support? -
Yes
If yes, please specify where/how practitioners can obtain support:
Mandatory
Summary of Evidence Base
- Please identify, to the best of your knowledge, all the research studies that have been conducted to date supporting the efficacy of your program, including studies currently or previously submitted to NCII for review. Please provide citations only (in APA format); do not include any descriptive information on these studies. NCII staff will also conduct a search to confirm that the list you provide is accurate.
Study Information
Study Citations
Bell, N., Worthington, P., Hungerford, D., Fitler, R. & Flowers, D. L. Effect of Symbol Imagery Instruction in an RtI Model for Reading Remediation. To obtain: Report available through contacting Lindamood-Bell
Participants
- Describe how students were selected to participate in the study:
- Students in grades 2-6 from two comparable schools in the same school district were identified as “at risk” or “not proficient” based on test data.
- Describe how students were identified as being at risk for academic failure (AI) or as having emotional or behavioral difficulties (BI):
- Individual screening by AIMsweb identified at risk Grade 2 students; Star testing or state standards testing from the previous year identified at risk grade 3-6 students.
-
ACADEMIC INTERVENTION: What percentage of participants were at risk, as measured by one or more of the following criteria:
- below the 30th percentile on local or national norm, or
- identified disability related to the focus of the intervention?
- %
-
BEHAVIORAL INTERVENTION: What percentage of participants were at risk, as measured by one or more of the following criteria:
- emotional disability label,
- placed in an alternative school/classroom,
- non-responsive to Tiers 1 and 2, or
- designation of severe problem behaviors on a validated scale or through observation?
- %
- Specify which condition is the submitted intervention:
- In the attached report, the treatment group is carried out at Fairmount Elementary School (FAIR) using the instructional program Seeing Stars®: Symbol Imagery for Phonemic Awareness, Sight Words and Spelling
- Specify which condition is the control condition:
- In the attached report, the control group is Anderson Elementary School (ANDER).
- If you have a third, competing condition, in addition to your control and intervention condition, identify what the competing condition is (data from this competing condition will not be used):
Using the tables that follow, provide data demonstrating comparability of the program group and control group in terms of demographics.
Grade Level
Demographic | Program Number |
Control Number |
Effect Size: Cox Index for Binary Differences |
---|---|---|---|
Age less than 1 | |||
Age 1 | |||
Age 2 | |||
Age 3 | |||
Age 4 | |||
Age 5 | |||
Kindergarten | |||
Grade 1 | 0 | 2 | 1.83 |
Grade 2 | 13 | 17 | 0.49 |
Grade 3 | 13 | 11 | 0.18 |
Grade 4 | 7 | 8 | 0.27 |
Grade 5 | 13 | 18 | 0.53 |
Grade 6 | 12 | 9 | 0.07 |
Grade 7 | |||
Grade 8 | |||
Grade 9 | |||
Grade 10 | |||
Grade 11 | |||
Grade 12 |
Race–Ethnicity
Demographic | Program Number |
Control Number |
Effect Size: Cox Index for Binary Differences |
---|---|---|---|
African American | 0 | 6 | 2.62 |
American Indian | |||
Asian/Pacific Islander | |||
Hispanic | |||
White | 59 | 59 | 0.55 |
Other |
Socioeconomic Status
Demographic | Program Number |
Control Number |
Effect Size: Cox Index for Binary Differences |
---|---|---|---|
Subsidized Lunch | 53 | 55 | 0.52 |
No Subsidized Lunch | 6 | 10 | 0.52 |
Disability Status
Demographic | Program Number |
Control Number |
Effect Size: Cox Index for Binary Differences |
---|---|---|---|
Speech-Language Impairments | |||
Learning Disabilities | |||
Behavior Disorders | |||
Emotional Disturbance | |||
Intellectual Disabilities | |||
Other | |||
Not Identified With a Disability |
ELL Status
Demographic | Program Number |
Control Number |
Effect Size: Cox Index for Binary Differences |
---|---|---|---|
English Language Learner | 0 | 1 | 1.40 |
Not English Language Learner | 59 | 64 | 0.73 |
Gender
Demographic | Program Number |
Control Number |
Effect Size: Cox Index for Binary Differences |
---|---|---|---|
Female | 27 | 33 | 0.51 |
Male | 32 | 32 | 0.34 |
Mean Effect Size
For any substantively (e.g., effect size ≥ 0.25 for pretest or demographic differences) or statistically significant (e.g., p < 0.05) pretest differences between groups in the descriptions below, please describe the extent to which these differences are related to the impact of the treatment. For example, if analyses were conducted to determine that outcomes from this study are due to the intervention and not demographic characteristics, please describe the results of those analyses here.
Design
- What method was used to determine students' placement in treatment/control groups?
- Systematic
- Please describe the assignment method or the process for defining treatment/comparison groups.
- Students in grades 2-6 from two comparable schools in the same school district were identified as “at risk” or “not proficient” based on individual screening (AIMsweb or Star) or state standards testing from the previous year (for grades 3-6). All students were administered a battery of reading and oral language tests in the fall and spring. In the program school, students were placed in small groups of 2-5 (mean 4.6), matched for severity of deficit. Small group instruction was 90 min/day, five days/week throughout the school year, administered by trained reading resource teachers under supervision by a Lindamood-Bell® expert. In addition to supervised oversight by the on-site consultant, formal fidelity monitoring took place at two time points for each teacher. Student progress was monitored by AIMsweb for grade 2 and Star testing for grades 3-6. Additional monitoring was provided by resource teachers’ and the consultant’s daily notes and observations in sessions for pacing through the program and for making recommendations about students exiting or changing the program focus. The two schools used the same basal readers. The control school used two computer programs during parts of the school year, most notably iStation during the last third of the school year.
-
What was the unit of assignment? - Students
- If other, please specify:
-
Please describe the unit of assignment: -
What unit(s) were used for primary data analysis? -
Schools
Teachers
Students
Classes
Other
If other, please specify:
-
Please describe the unit(s) used for primary data analysis:
Fidelity of Implementation
- How was the program delivered?
-
Individually
Small Group
Classroom
If small group, answer the following:
- Average group size
- 5
- Minimum group size
- 2
- Maximum group size
- 5
What was the duration of the intervention (If duration differed across participants, settings, or behaviors, describe for each.)?
- Weeks
- 28.00
- Sessions per week
- 5.00
- Duration of sessions in minutes
- 90.00
- What were the background, experience, training, and ongoing support of the instructors or interventionists?
- Tier 3 resource teachers implementing the program were certified teachers in their state; two were certified in special education. At the beginning of the study, teachers and teaching assistants at each school were asked to complete a survey. At the program school, 26 surveys were completed; at the control school, 13 surveys were completed. On those responding, 77% of the program school teachers had a bachelor’s degree and 31% had earned a master’s; 92% found teaching an effective and rewarding profession and 96% said they use data to improve instruction. At the control school, 77% of respondents had a bachelor’s degree and 38.5% had earned a master’s; 85% found teaching an effective and rewarding profession and 92% said they use data to improve instruction. Prior to the beginning of the project, professional development workshops were held for classroom teachers, reading resource teachers, and educational assistants. The six reading resource teachers who taught small groups and all 13 K-3 grade teachers attended four days of workshops, two days in Seeing Stars® for building decoding and two days for another Lindamood-Bell program (Visualizing and Verbalizing® for building comprehension). The resource teachers also attended a day of additonal training in test interpretation, student grouping and progress monitoring, instructional pacing, and lesson planning. Teachers who have not lead students through a semester or more of instruction require an expert consultant’s assistance for pacing and devising lesson plans that efficiently address the needs of the students. This assistance, with observation and modeling, was provided in the program by a Lindamood- Bell® consultant who was in the building daily.
- Describe when and how fidelity of treatment information was obtained.
- In addition to regular observation and modeling, the consultant completed a standard fidelity-monitoring
checklist during formal observation sessions for each Tier 3 teacher in December and March, scoring
compliance on 61 points during Seeing Stars® instruction and 64 points during Visualizing and Verbalizing® instruction. Each item received a score from 0 (not observed) to 3 (consistently observed) for each item of standardized, sequential instruction specific to the instruction (e.g., introducing the task, demonstrating the procedure, use of multisensory exercises, using questioning, and integrating steps).
- What were the results on the fidelity-of-treatment implementation measure?
- In December, the six reading resource teachers achieved an average of 102 points (range 84-125) out of
the 156 points required for independent competence in Seeing Stars®. In March, the same teachers achieved an average of 140.1 points (range 128-157) in Seeing Stars®.
Fidelity monitoring was quantified by scoring the resource teachers on each instructional step within these categories: introducing the task, demonstrating the procedure, use of multisensory exercises, using questioning, and integrating steps. Scoring on each item ranged from 0 (not observed) to 3 (consistently observed). The total number of cumulative points required for independent competence in Seeing Stars is 156. However, the teachers were additionally monitored and coached daily by the on-site Lindamood-Bell consultant who oversaw lesson plans for every Tier III student. In consequence, these teachers were substantially supported daily by an expert on-site practitioner.
- Was the fidelity measure also used in control classrooms?
Measures and Results

Measures Broader :

Study measures are classified as targeted, broader, or administrative data according to the following definitions:
-
Targeted measures
Assess outcomes, such as competencies or skills that the program was directly targeted to improve.- In the academic domain, targeted measures typically are not the very items taught but rather novel items structured similarly to the content addressed in the program. For example, if a program taught word-attack skills, a targeted measure would be decoding of pseudo words. If a program taught comprehension of cause-effect passages, a targeted measure would be answering questions about cause-effect passages structured similarly to those used during intervention, but not including the very passages used for intervention.
- In the behavioral domain, targeted measures evaluate aspects of external or internal behavior the program was directly targeted to improve and are operationally defined.
-
Broader measures
Assess outcomes that are related to the competencies or skills targeted by the program but not directly taught in the program.- In the academic domain, if a program taught word-level reading skill, a broader measure would be answering questions about passages the student reads. If a program taught calculation skill, a broader measure would be solving word problems that require the same kinds of calculation skill taught in the program.
- In the behavioral domain, if a program taught a specific skill like on-task behavior in one classroom, a broader measure would be academic performance in that setting or on-task behavior in another setting.
- Administrative data measures apply only to behavioral intervention tools and are measures such as office discipline referrals (ODRs) and graduation rates which do not have psychometric properties as do other, more traditional targeted or broader measures.
Click here for more information on effect size.
-
What populations are you submitting outcome data for? -
Full sample
Students at or below the 20th percentile
English language learners
Racial/ethnic subgroups
Economically disadvantaged students (low socioeconomic status)
Targeted Measure | Reverse Coded? | Reliability | Relevance | Exposure |
---|
Broader Measure | Reverse Coded? | Reliability | Relevance | Exposure |
---|
Administrative Data Measure | Reverse Coded? | Relevance |
---|
Posttest Data
Targeted Measures (Full Sample)
Measure | Sample Type | Effect Size | P |
---|
Broader Measures (Full Sample)
Measure | Sample Type | Effect Size | P |
---|
Administrative Measures (Full Sample)
Measure | Sample Type | Effect Size | P |
---|
Targeted Measures (Subgroups)
Measure | Sample Type | Effect Size | P |
---|
Broader Measures (Subgroups)
Measure | Sample Type | Effect Size | P |
---|
Administrative Measures (Subgroups)
Measure | Sample Type | Effect Size | P |
---|
- For any substantively (e.g., effect size ≥ 0.25 for pretest or demographic differences) or statistically significant (e.g., p < 0.05) pretest differences, please describe the extent to which these differences are related to the impact of the treatment. For example, if analyses were conducted to determine that outcomes from this study are due to the intervention and not pretest characteristics, please describe the results of those analyses here.
- Please explain any missing data or instances of measures with incomplete pre- or post-test data.
- If you have excluded a variable or data that are reported in the study being submitted, explain the rationale for exclusion:
- None were excluded.
- Describe the analyses used to determine whether the intervention produced changes in student outcomes:
- One-way analyses of variance (ANOVA) were used to compare group difference in the baseline to posttest
scores. Program students had statistically lower baseline scores on WRAT reading (p=0.01), WRAT
spelling (p=0.01), Gray Oral reading rate (p=0.01), and Gray Oral Fluency (p=0.02); Control students had a
lower baseline score on Following Oral Directions (p=0.005). Adjustments were made by entering the
baseline score as a covariate into the model. The program group made statistically significant gains on all
measures and greater gains than the control group on measures of WRAT reading (word recognition),
Woodcock word attack (nonword reading), Symbol Imagery (orthographic awareness), and LAC (phonemic
awareness).
Additional Research
- Is the program reviewed by WWC or E-ESSA?
- WWC & E-ESSA
- Summary of WWC / E-ESSA Findings :
What Works Clearinghouse Review
Beginning Reading
Effectiveness: LiPS® was found to have potentially positive effects on comprehension and mixed effects on alphabetics for beginning readers.
Studies Reviewed: 2 studies met standards out of 8 studies total.
Early Childhood Education
Effectiveness: As of December 2005 no studies of Lindamood Phoneme Sequencing® (LiPS®) were found that fell within the scope of the Early Childhood Education review protocol and met WWC design standards. Therefore, the WWC is unable to draw any research based conclusions about the effectiveness or ineffectiveness of Lindamood Phoneme Sequencing® (LiPS®) to improve outcomes in this area.
Studies Reviewed: N/A
Students with a Specific Learning Disability
Effectiveness: LiPS® was found to have potentially positive effects on alphabetics, reading fluency, and math, no discernible effects on reading comprehension, and potentially negative effects on writing for students with learning disabilities.
Studies Reviewed: 1 study meets standards out of 2 studies total.
Evidence for ESSA
No studies met inclusion requirements.
- How many additional research studies are potentially eligible for NCII review?
- 0
- Citations for Additional Research Studies :
Data Collection Practices
Most tools and programs evaluated by the NCII are branded products which have been submitted by the companies, organizations, or individuals that disseminate these products. These entities supply the textual information shown above, but not the ratings accompanying the text. NCII administrators and members of our Technical Review Committees have reviewed the content on this page, but NCII cannot guarantee that this information is free from error or reflective of recent changes to the product. Tools and programs have the opportunity to be updated annually or upon request.