mCLASS

Mathematics

Classification Accuracy

GradeK12
Criterion 1 FallEmpty bubbleEmpty bubbleEmpty bubble
Criterion 1 Winterdashdashdash
Criterion 1 Springdashdashdash
Criterion 2 Falldashdashdash
Criterion 2 Winterdashdashdash
Criterion 2 Springdashdashdash

Primary Sample

Criterion 1:  Woodcock-Johnson III (WJ-III) Broad Math

Time of Year: Fall

 

Grade K

n = 198

Grade 1

n = 225

Grade 2

n = 244

Grade 3

n = 200

Cut points

 

 

 

 

Base rate in the sample for children requiring intensive intervention

 

 

 

 

Base rate in the sample for children considered at-risk, including those with the most intensive needs

 

 

 

 

False Positive Rate

0.35

0.34

0.33

0.43

False Negative Rate

0.30

0.00

0.21

0.26

Sensitivity

0.70

1.00

0.79

0.74

Specificity

0.65

0.66

0.68

0.57

Positive Predictive Power

0.24

0.03

0.56

0.50

Negative Predictive Power

0.93

1.00

0.86

0.79

Overall Classification Rate

0.66

0.66

0.71

0.64

Area Under the Curve (AUC)

0.68

0.66

0.73

0.67

AUC 95% Confidence Interval Lower

Not provided

Not provided

Not provided

Not provided

AUC 95% Confidence Interval Upper

Not provided

Not provided

Not provided

Not provided

At 90% Sensitivity, specificity equals

0.00

0.00

0.10

0.15

At 80% Sensitivity, specificity equals

0.00

0.00

0.10

0.15

At 70% Sensitivity, specificity equals

0.83

0.00

0.86

0.79

 

 

Reliability

GradeK12
RatingEmpty bubbleEmpty bubbleEmpty bubble
  1. Justification for each type of reliability reported, given the type and purpose of the tool:

Not provided

 

  1. Description of the sample(s), including size and characteristics, for each reliability analysis conducted

Not provided

 

  1. Description of the analysis procedures for each reported type of reliability:

Not provided

 

  1. Reliability of performance level score (e.g., model-based, internal consistency, inter-rater reliability).

Type of Reliability

Age or Grade

n

Coefficient

Confidence Interval

Alpha

K

291

0.94

Not Provided

Alpha

1

319

0.94

Not Provided

Alpha

K

68

0.92

Not Provided

Alpha

1

69

0.93

Not Provided

Alpha

2

286

0.86

Not Provided

Alpha

3

259

0.84

Not Provided

Test-retest

K

94

0.74

Not Provided

Test-retest

1

99

0.70

Not Provided

Test-retest

2

72

0.60

Not Provided

Test-retest

3

87

0.60

Not Provided

Split-half

K

68

0.88

Not Provided

Split-half

1

69

0.92

Not Provided

 

Disaggregated Reliability

The following disaggregated reliability data are provided for context and did not factor into the Reliability rating.

Type of Reliability

Subgroup

Age or Grade

n

Coefficient

Confidence Interval

None

 

 

 

 

 

 

Validity

GradeK12
RatingEmpty bubbleEmpty bubbleEmpty bubble
  1. Description of each criterion measure used and explanation as to why each measure is appropriate, given the type and purpose of the tool

Not provided

 

  1. Description of the sample(s), including size and characteristics, for each validity analysis conducted

Not provided

 

  1. Description of the analysis procedures for each reported type of validity:

Not provided

 

  1. Validity for the performance level score (e.g., concurrent, predictive, evidence based on response processes, evidence based on internal structure, evidence based on relations to other variables, and/or evidence based on consequences of testing), and the criterion measures.

Type of Validity

Age or Grade

Test or Criterion

n

Coefficient

Confidence Interval

Concurrent

K

WJ-III (Broad Math)

318

0.53

Not Provided

Concurrent

1

WJ-III (Broad Math)

314

0.52

Not Provided

Concurrent

2

WJ-III (Broad Math)

351

0.45

Not Provided

Concurrent

3

WJ-III (Broad Math)

338

0.34

Not Provided

Concurrent

K

TEMA-3 (Overall Scale Score)

68

0.62

Not Provided

Concurrent

1

TEMA-3 (Overall Scale Score)

69

0.53

Not Provided

Predictive

K

TEMA-3 (Overall Scale Score)

63

0.53

Not Provided

Predictive

1

TEMA-3 (Overall Scale Score)

56

0.39

Not Provided

 

  1. Results for other forms of validity (e.g. factor analysis) not conducive to the table format

Not provided

 

  1. Describe the degree to which the provided data support the validity of the tool

Not provided

 

 

Disaggregated Validity

The following disaggregated validity data are provided for context and did not factor into the Validity rating.

Type of Validity

Subgroup

Age or Grade

Test or Criterion

n

Coefficient

Confidence Interval

None

 

 

 

 

 

 

 

Results for other forms of disaggregated validity (e.g. factor analysis) not conducive to the table format

Not provided

 

Sample Representativeness

GradeK12
RatingEmpty bubbleEmpty bubbleEmpty bubble

Primary Classification Accuracy Sample

 

Representation

NY and Missouri

Date

2008

Size

867

Male

45%

Female

47%

Unknown

8%

Free or reduced-price lunch

33%

White, Non-Hispanic

58%

Black, Non-Hispanic

22%

Hispanic

9%

American Indian/Alaska Native

0%

Asian/Pacific Islander

1%

Other

1%

Unknown

Not provided

Disability classification

Not provided

First language

English = 85%; Spanish = 6%; Other = 1%

Language proficiency status

Not provided

 

Bias Analysis Conducted

GradeK12
RatingNoNoNo
  1. Description of the method used to determine the presence or absence of bias:

Not provided

  1. Description of the subgroups for which bias analyses were conducted:

Not provided

  1. Description of the results of the bias analyses conducted, including data and interpretative statements:

Not provided

Administration Format

GradeK12
Data
  • Group
  • Individual
  • Group
  • Individual
  • Group
  • Individual
  • Administration & Scoring Time

    GradeK12
    Data
  • 1-12 minutes
  • 1-12 minutes
  • 1-12 minutes
  • Scoring Format

    GradeK12
    Data
  • Manual
  • Manual
  • Manual
  • Types of Decision Rules

    GradeK12
    Data
  • None
  • None
  • None
  • Evidence Available for Multiple Decision Rules

    GradeK12
    Data
  • No
  • No
  • No