Star Math

Math

Cost

Technology, Human Resources, and Accommodations for Special Needs

Service and Support

Purpose and Other Implementation Information

Usage and Reporting

Initial Cost:

There is a one-time setup fee along with a per student subscription fee. Total cost will depend on the number of schools and students. Please contact: answers@renaissance.com or (800) 338-4204 for specific details on pricing for your district.

 

Replacement Cost:

No information provided; contact vendor for details.

 

Included in Cost:

Star Math is cloud-based and purchase includes the tool, software/technical manual, installation guide, testing instructions, and remote installation and setup.

 

Technology Requirements:

  • Computer or tablet
  • Internet connection

 

Training Requirements:

  • Less than 1 hour of training

 

Qualified Administrators:

  • No minimum qualifications

 

Accommodations:

Star Math is a computer-adaptive assessment, and the difficulty of items is adjusted automatically to reflect the skill level of the student. Students can use either the keyboard or the mouse, accommodating students with limited motor skills.  Star Math offers several accommodations for students with disabilities through the accessibility options built into a computer’s operating system. For students with limited vision, the introductory screens of Star Math respond to the “high contrast” accessibility feature within Windows and the “switch to black and white” accessibility feature in MAC OS. Star Math is compatible with Mac’s “zoom in” accessibility feature, which allows users to magnify nearly all Star Math screens. 

 

Where to Obtain:

Website: http://www.renaissance.com

Address: Renaissance Learning, PO Box 8036, Wisconsin Rapids, WI 54495

Phone number: (800) 338-4204     

Email address: answers@renaissance.com


Access to Technical Support:

Renaissance Technical Support Staff

Star Math is a computer-adaptive assessment of general mathematics achievement for students in grades 1 to 12. Star Math provides information on student performance on hundreds of skills within 32 domains. Mathematics computation, mathematic application, and mathematics concepts can be assessed. The difficulty of items is adjusted automatically to reflect the skill level of all students.

Assessment Format:

  • Direct: Computerized
  • Group administered

 

Administration Time:

  • 20 minutes per student
  • 20 minutes per total group

 

Scoring Time:

  • Scoring is automatic

 

Scoring Method:

All scores are calculated automatically by the software. The software calculates a maximum likelihood Rasch ability estimate based on the calibrated difficulty of the items that were administered to the student, and the pattern of the student’s right and wrong responses to those items. Star Math uses a proprietary, Rasch-based, 1-parameter logistic response model to calculate scores. The scaled score is a non-linear, monotonic transformation of the Rasch ability estimate resulting from the adaptive test. From the scaled scores and the student’s current grade placement are derived grade equivalent, percentile, and normal curve equivalent scores. No clusters, composite, or raw scores are reported.

 

Scores Generated:

  • Percentile score
  • Grade equivalents
  • IRT-based score
  • Normal curve equivalents
  • Scale score   
  • Student Growth Percentile 

 

Classification Accuracy

Grade1234567891011
Criterion 1 FalldashFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubble
Criterion 1 WinterFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubble
Criterion 1 SpringFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleHalf-filled bubbleFull bubbleFull bubbledash
Criterion 2 FalldashFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubbledashdashdash
Criterion 2 WinterFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubbledashdashdash
Criterion 2 SpringFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubbledashdashdashdash

Primary Sample

 

Criterion 1, Fall

 

Grade 1

Grade 2

Grade 3

Grade 4

Grade 5

Grade 6

Grade 7

Grade 8

Grade 9

Grade 10

Grade 11

Criterion Test Name

Not Provided

PARCC Math

PARCC Math

PARCC Math

PARCC Math

PARCC Math

PARCC Math

PARCC Math

ACT Math

ACT Math

ACT Math

Cut points

Not Provided

Star SS < 339

PARCC PR<20

Star SS < 446

PARCC PR<20

Star SS <542
PARCC PR <20

Star SS < 592 PARCC PR<20

Star SS < 625 PARCC PR<20

Star SS < 657 PARCC PR<20

Star SS <692
PARCC PR <20

Star SS <776 / ACT PR <20

Star SS <797 / ACT PR <20

Star SS 809 </ ACT PR <20

Base rate in the sample for children requiring intensive intervention

Not Provided

20%

18%

27%

19%

19%

19%

28%

25%

29%

27%

Base rate in the sample for children considered at-risk, including those with the most intensive needs

Not Provided

29%

26%

31%

28%

28%

28%

33%

30%

34%

32%

False Positive Rate

Not Provided

19%

15%

15%

17%

16%

17%

18%

16%

20%

16%

False Negative Rate

Not Provided

28%

26%

24%

26%

24%

24%

29%

30%

29%

23%

Sensitivity

Not Provided

72%

74%

76%

74%

76%

76%

71%

70%

71%

77%

Specificity

Not Provided

81%

85%

85%

83%

84%

83%

82%

84%

80%

84%

Positive Predictive Power

Not Provided

48%

52%

65%

51%

52%

51%

61%

60%

59%

64%

Negative Predictive Power

Not Provided

92%

94%

90%

93%

94%

94%

88%

89%

87%

91%

Overall Classification Rate

Not Provided

79%

83%

83%

81%

82%

82%

79%

81%

78%

82%

Area Under the Curve (AUC)

Not Provided

0.86

0.89

0.89

0.88

0.88

0.88

0.85

0.87

0.85

0.89

AUC 95% Confidence Interval Lower

Not Provided

0.84

0.88

0.88

0.86

0.87

0.87

0.84

0.85

0.83

0.88

AUC 95% Confidence Interval Upper

Not Provided

0.87

0.90

0.90

0.89

0.89

0.89

0.87

0.90

0.87

0.91

 

Criterion 1, Winter

 

Grade 1

Grade 2

Grade 3

Grade 4

Grade 5

Grade 6

Grade 7

Grade 8

Grade 9

Grade 10

Grade 11

Criterion Test Name

PARCC Math

PARCC Math

PARCC Math

PARCC Math

PARCC Math

PARCC Math

PARCC Math

PARCC Math

Smarter Balanced

Smarter Balanced

Smarter Balanced

Cut points

Star SS <269
PARCC Math PR <20

Star SS < 405
PARCC PR < 20

Star SS < 495
PARCC PR < 20

Star SS <587
PARCC PR <20

Star SS <647
PARCC PR <20

Star SS < 656
PARCC PR < 20

Star SS <708
PARCC PR <20

Star SS <714
PARCC PR <20

Star SS < 741

SBA PR < 20

Star SS < 777

SBA PR < 20

Star SS < 799

SBA PR < 20

Base rate in the sample for children requiring intensive intervention

15%

20%

19%

25%

29%

18%

28%

28%

29%

24%

26%

Base rate in the sample for children considered at-risk, including those with the most intensive needs

25%

29%

26%

30%

33%

25%

30%

35%

35%

30%

32%

False Positive Rate

17%

18%

14%

13%

17%

14%

13%

20%

20%

17%

18%

False Negative Rate

24%

29%

20%

21%

26%

21%

28%

27%

30%

27%

27%

Sensitivity

76%

71%

80%

79%

74%

79%

72%

73%

70%

73%

73%

Specificity

83%

82%

86%

87%

83%

86%

87%

80%

80%

83%

82%

Positive Predictive Power

44%

48%

56%

67%

63%

55%

68%

60%

58%

58%

59%

Negative Predictive Power

95%

92%

95%

92%

89%

95%

89%

88%

87%

91%

90%

Overall Classification Rate

82%

79%

85%

85%

80%

85%

83%

78%

77%

81%

80%

Area Under the Curve (AUC)

0.88

0.87

0.91

0.92

0.87

0.91

0.89

0.85

0.84

0.87

0.87

AUC 95% Confidence Interval Lower

0.84

0.85

0.90

0.91

0.86

0.90

0.87

0.84

0.82

0.86

0.85

AUC 95% Confidence Interval Upper

0.92

0.88

0.92

0.93

0.89

0.92

0.90

0.87

0.86

0.89

0.89

 

Criterion 1, Spring

 

Grade 1

Grade 2

Grade 3

Grade 4

Grade 5

Grade 6

Grade 7

Grade 8

Grade 9

Grade 10

Grade 11

Criterion Test Name

PARCC Math

PARCC Math

PARCC Math

PARCC Math

PARCC Math

PARCC Math

PARCC Math

PARCC Algebra I

Smarter Balanced

ACT Math

Not Provided

Cut points

Star SS <382
PARCC PR <20

Star SS < 455
PARCC PR < 20

Star SS <558
PARCC PR <20

Star SS < 615
PARCC PR < 20

Star SS < 649
PARCC PR < 20

Star SS < 678
PARCC PR < 20

Star SS <711
PARCC PR <20

Star SS <712
PARCC PR <20

Star SS < 768

SBA PR < 20

Star SS <813

ACT PR <20

Not Provided

Base rate in the sample for children requiring intensive intervention

15%

20%

27%

20%

19%

20%

29%

28%

24%

23%

Not Provided

Base rate in the sample for children considered at-risk, including those with the most intensive needs

23%

29%

33%

29%

29%

28%

34%

44%

32%

31%

Not Provided

False Positive Rate

14%

18%

18%

19%

18%

17%

19%

30%

20%

18%

Not Provided

False Negative Rate

27%

29%

27%

27%

27%

28%

30%

21%

29%

28%

Not Provided

Sensitivity

73%

71%

73%

73%

73%

72%

70%

79%

71%

72%

Not Provided

Specificity

86%

82%

82%

81%

82%

83%

81%

70%

80%

82%

Not Provided

Positive Predictive Power

47%

49%

59%

49%

49%

50%

60%

50%

53%

54%

Not Provided

Negative Predictive Power

95%

92%

89%

92%

93%

92%

87%

90%

90%

90%

Not Provided

Overall Classification Rate

84%

79%

79%

80%

80%

81%

78%

72%

78%

79%

Not Provided

Area Under the Curve (AUC)

0.88

0.85

0.86

0.85

0.86

0.86

0.85

0.81

0.85

0.86

Not Provided

AUC 95% Confidence Interval Lower

0.84

0.84

0.85

0.84

0.85

0.85

0.83

0.76

0.83

0.84

Not Provided

AUC 95% Confidence Interval Upper

0.92

0.87

0.88

0.87

0.88

0.88

0.86

0.85

0.86

0.89

Not Provided

 

Criterion 2, Fall

 

Grade 1

Grade 2

Grade 3

Grade 4

Grade 5

Grade 6

Grade 7

Grade 8

Grade 9

Grade 10

Grade 11

Criterion Test Name

Not Provided

Smarter Balanced Math

Smarter Balanced Math

Smarter Balanced Math

Smarter Balanced Math

Smarter Balanced Math

Smarter Balanced Math

Smarter Balanced Math

Not Provided

Not Provided

Not Provided

Cut points

Not Provided

Star SS <350

 SBA PR <20

Star SS <457

SBA PR <20

Star SS <542

 SBA PR <20

Star SS <613

 SBA PR <20

Star SS <661

 SBA PR <20

Star SS <694

 SBA PR <20

Star SS <723

 SBA PR <20

Not Provided

Not Provided

Not Provided

Base rate in the sample for children requiring intensive intervention

Not Provided

16%

16%

15%

18%

15%

16%

18%

Not Provided

Not Provided

Not Provided

Base rate in the sample for children considered at-risk, including those with the most intensive needs

Not Provided

27%

24%

24%

26%

23%

24%

26%

Not Provided

Not Provided

Not Provided

False Positive Rate

Not Provided

18%

13%

14%

14%

12%

13%

15%

Not Provided

Not Provided

Not Provided

False Negative Rate

Not Provided

26%

20%

19%

20%

19%

18%

22%

Not Provided

Not Provided

Not Provided

Sensitivity

Not Provided

74%

80%

81%

80%

81%

82%

78%

Not Provided

Not Provided

Not Provided

Specificity

Not Provided

82%

87%

86%

86%

88%

87%

85%

Not Provided

Not Provided

Not Provided

Positive Predictive Power

Not Provided

44%

54%

51%

55%

54%

55%

52%

Not Provided

Not Provided

Not Provided

Negative Predictive Power

Not Provided

95%

96%

96%

95%

96%

96%

95%

Not Provided

Not Provided

Not Provided

Overall Classification Rate

Not Provided

81%

86%

86%

85%

87%

86%

84%

Not Provided

Not Provided

Not Provided

Area Under the Curve (AUC)

Not Provided

0.88

0.92

0.92

0.91

0.93

0.93

0.9

Not Provided

Not Provided

Not Provided

AUC 95% Confidence Interval Lower

Not Provided

0.86

0.91

0.92

0.91

0.92

0.92

0.89

Not Provided

Not Provided

Not Provided

AUC 95% Confidence Interval Upper

Not Provided

0.89

0.93

0.93

0.92

0.93

0.93

0.91

Not Provided

Not Provided

Not Provided

 

Criterion 2, Winter

 

Grade 1

Grade 2

Grade 3

Grade 4

Grade 5

Grade 6

Grade 7

Grade 8

Grade 9

Grade 10

Grade 11

Criterion Test Name

Smarter Balanced

Smarter Balanced Math

Smarter Balanced Math

Smarter Balanced Math

Smarter Balanced Math

Smarter Balanced Math

Smarter Balanced Math

Smarter Balanced Math

Not Provided

Not Provided

Not Provided

Cut points

Star SS < 345 SBA PR < 20

Star SS <416

SBA PR <20

Star SS <512

SBA PR <20

Star SS <584

SBA PR <20

Star SS <646

SBA PR <20

Star SS <678

SBA PR <20

Star SS <712

SBA PR <20

Star SS <740

SBA PR <20

Not Provided

Not Provided

Not Provided

Base rate in the sample for children requiring intensive intervention

19%

16%

15%

16%

19%

17%

18%

19%

Not Provided

Not Provided

Not Provided

Base rate in the sample for children considered at-risk, including those with the most intensive needs

27%

25%

23%

22%

26%

23%

26%

27%

Not Provided

Not Provided

Not Provided

False Positive Rate

16%

15%

13%

11%

13%

12%

14%

16%

Not Provided

Not Provided

Not Provided

False Negative Rate

27%

19%

17%

15%

18%

19%

20%

24%

Not Provided

Not Provided

Not Provided

Sensitivity

73%

81%

83%

85%

82%

81%

80%

76%

Not Provided

Not Provided

Not Provided

Specificity

84%

85%

87%

89%

87%

88%

86%

84%

Not Provided

Not Provided

Not Provided

Positive Predictive Power

52%

51%

55%

59%

59%

58%

57%

53%

Not Provided

Not Provided

Not Provided

Negative Predictive Power

93%

96%

97%

97%

95%

96%

95%

94%

Not Provided

Not Provided

Not Provided

Overall Classification Rate

82%

85%

87%

88%

86%

87%

85%

83%

Not Provided

Not Provided

Not Provided

Area Under the Curve (AUC)

0.89

0.91

0.93

0.94

0.93

0.93

0.92

0.9

Not Provided

Not Provided

Not Provided

AUC 95% Confidence Interval Lower

0.85

0.9

0.92

0.94

0.92

0.93

0.91

0.89

Not Provided

Not Provided

Not Provided

AUC 95% Confidence Interval Upper

0.93

0.92

0.94

0.95

0.94

0.94

0.93

0.91

Not Provided

Not Provided

Not Provided

 

Criterion 2, Spring

 

Grade 1

Grade 2

Grade 3

Grade 4

Grade 5

Grade 6

Grade 7

Grade 8

Grade 9

Grade 10

Grade 11

Criterion Test Name

Smarter Balanced Math

Smarter Balanced Math

Smarter Balanced Math

Smarter Balanced Math

Smarter Balanced Math

Smarter Balanced Math

Smarter Balanced Math

Not Provided

Not Provided

Not Provided

Not Provided

Cut points

Star SS <366

SBA PR <20

Star SS <460

 SBA PR <20

Star SS <554

SBA PR <20

Star SS <623

 SBA PR <20

Star SS <662

SBA PR <20

Star SS <708

 SBA PR <20

Star SS <735

 SBA PR <20

Not Provided

Not Provided

Not Provided

Not Provided

Base rate in the sample for children requiring intensive intervention

10%

15%

16%

19%

16%

15%

15%

Not Provided

Not Provided

Not Provided

Not Provided

Base rate in the sample for children considered at-risk, including those with the most intensive needs

19%

24%

24%

27%

23%

24%

24%

Not Provided

Not Provided

Not Provided

Not Provided

False Positive Rate

13%

13%

13%

14%

13%

14%

14%

Not Provided

Not Provided

Not Provided

Not Provided

False Negative Rate

23%

20%

18%

20%

20%

17%

21%

Not Provided

Not Provided

Not Provided

Not Provided

Sensitivity

77%

80%

82%

80%

80%

83%

79%

Not Provided

Not Provided

Not Provided

Not Provided

Specificity

87%

87%

87%

86%

87%

86%

86%

Not Provided

Not Provided

Not Provided

Not Provided

Positive Predictive Power

39%

52%

54%

57%

53%

51%

50%

Not Provided

Not Provided

Not Provided

Not Provided

Negative Predictive Power

97%

96%

96%

95%

96%

97%

96%

Not Provided

Not Provided

Not Provided

Not Provided

Overall Classification Rate

86%

85%

86%

85%

86%

86%

85%

Not Provided

Not Provided

Not Provided

Not Provided

Area Under the Curve (AUC)

0.92

0.92

0.93

0.91

0.93

0.93

0.91

Not Provided

Not Provided

Not Provided

Not Provided

AUC 95% Confidence Interval Lower

0.88

0.91

0.92

0.9

0.92

0.92

0.89

Not Provided

Not Provided

Not Provided

Not Provided

AUC 95% Confidence Interval Upper

0.95

0.93

0.94

0.92

0.94

0.93

0.92

Not Provided

Not Provided

Not Provided

Not Provided

 

 

Additional Classification Accuracy

The following are provided for context and did not factor into the Classification Accuracy ratings.

 

Cross-Validation Sample

Criterion 1, Fall

 

Grade 1

Grade 2

Grade 3

Grade 4

Grade 5

Grade 6

Grade 7

Grade 8

Grade 9

Grade 10

Grade 11

Criterion Test Name

Not Provided

PARCC Math

PARCC Math

PARCC Math

PARCC Math

PARCC Math

PARCC Math

PARCC Math

Not Provided

Not Provided

Not Provided

Cut points

Not Provided

Star SS < 339
PARCC PR < 20

Star SS < 446
PARCC PR < 20

Star SS <542
PARCC PR <20

Star SS < 592
PARCC PR < 20

Star SS < 625
PARCC PR < 20

Star SS < 657
PARCC PR < 20

Star SS <692
PARCC PR <20

Not Provided

Not Provided

Not Provided

Base rate in the sample for children requiring intensive intervention

Not Provided

4%

5%

7%

5%

4%

5%

8%

Not Provided

Not Provided

Not Provided

Base rate in the sample for children considered at-risk, including those with the most intensive needs

Not Provided

11%

11%

17%

13%

11%

12%

19%

Not Provided

Not Provided

Not Provided

False Positive Rate

Not Provided

8%

7%

11%

9%

8%

8%

13%

Not Provided

Not Provided

Not Provided

False Negative Rate

Not Provided

31%

12%

17%

9%

21%

23%

18%

Not Provided

Not Provided

Not Provided

Sensitivity

Not Provided

69%

88%

83%

91%

79%

77%

82%

Not Provided

Not Provided

Not Provided

Specificity

Not Provided

92%

93%

89%

91%

92%

92%

87%

Not Provided

Not Provided

Not Provided

Positive Predictive Power

Not Provided

29%

37%

37%

33%

30%

36%

36%

Not Provided

Not Provided

Not Provided

Negative Predictive Power

Not Provided

98%

99%

98%

100%

99%

99%

98%

Not Provided

Not Provided

Not Provided

Overall Classification Rate

Not Provided

91%

93%

88%

91%

92%

91%

86%

Not Provided

Not Provided

Not Provided

Area Under the Curve (AUC)

Not Provided

0.94

0.93

0.95

0.97

0.93

0.93

0.94

Not Provided

Not Provided

Not Provided

AUC 95% Confidence Interval Lower

Not Provided

0.92

0.90

0.93

0.95

0.90

0.91

0.92

Not Provided

Not Provided

Not Provided

AUC 95% Confidence Interval Upper

Not Provided

0.97

0.97

0.98

0.98

0.95

0.96

0.97

Not Provided

Not Provided

Not Provided

 

Criterion 1, Winter

 

Grade 1

Grade 2

Grade 3

Grade 4

Grade 5

Grade 6

Grade 7

Grade 8

Grade 9

Grade 10

Grade 11

Criterion Test Name

PARCC Math

PARCC Math

PARCC Math

PARCC Math

PARCC Math

PARCC Math

PARCC Math

PARCC Math

Not Provided

Not Provided

Not Provided

Cut points

Star SS <269
PARCC PR <20

Star SS < 405
PARCC PR < 20

Star SS < 495
PARCC PR < 20

Star SS <587
PARCC PR <20

Star SS <647
PARCC PR <20

Star SS < 656
PARCC PR < 20

Star SS <708
PARCC PR <20

Star SS <714
PARCC PR <20

Not Provided

Not Provided

Not Provided

Base rate in the sample for children requiring intensive intervention

6%

4%

6%

7%

6%

10%

12%

8%

Not Provided

Not Provided

Not Provided

Base rate in the sample for children considered at-risk, including those with the most intensive needs

19%

7%

10%

14%

14%

15%

16%

16%

Not Provided

Not Provided

Not Provided

False Positive Rate

15%

4%

6%

9%

9%

8%

9%

12%

Not Provided

Not Provided

Not Provided

False Negative Rate

27%

31%

26%

15%

12%

22%

30%

38%

Not Provided

Not Provided

Not Provided

Sensitivity

73%

69%

74%

85%

88%

78%

70%

63%

Not Provided

Not Provided

Not Provided

Specificity

85%

96%

94%

91%

91%

92%

91%

88%

Not Provided

Not Provided

Not Provided

Positive Predictive Power

25%

44%

46%

42%

38%

53%

53%

33%

Not Provided

Not Provided

Not Provided

Negative Predictive Power

98%

99%

98%

99%

99%

97%

96%

96%

Not Provided

Not Provided

Not Provided

Overall Classification Rate

84%

95%

93%

91%

91%

91%

89%

86%

Not Provided

Not Provided

Not Provided

Area Under the Curve (AUC)

0.89

0.95

0.96

0.96

0.97

0.94

0.93

0.92

Not Provided

Not Provided

Not Provided

AUC 95% Confidence Interval Lower

0.84

0.92

0.94

0.94

0.95

0.92

0.90

0.88

Not Provided

Not Provided

Not Provided

AUC 95% Confidence Interval Upper

0.95

0.98

0.98

0.98

0.98

0.97

0.96

0.95

Not Provided

Not Provided

Not Provided

 

 

Criterion 1, Spring

 

Grade 1

Grade 2

Grade 3

Grade 4

Grade 5

Grade 6

Grade 7

Grade 8

Grade 9

Grade 10

Grade 11

Criterion Test Name

PARCC Math

PARCC Math

PARCC Math

PARCC Math

PARCC Math

PARCC Math

PARCC Math

PARCC Algebra I

Not Provided

Not Provided

Not Provided

Cut points

Star SS <382
PARCC PR <20

Star SS < 455
PARCC PR <20

Star SS <558
PARCC PR <20

Star SS < 615
PARCC PR <20

Star SS < 649
PARCC PR <20

Star SS <701
PARCC PR <20

Star SS <711
PARCC PR <20

Star SS <712
PARCC PR <20

Not Provided

Not Provided

Not Provided

Base rate in the sample for children requiring intensive intervention

6%

4%

6%

4%

2%

11%

8%

8%

Not Provided

Not Provided

Not Provided

Base rate in the sample for children considered at-risk, including those with the most intensive needs

14%

9%

12%

11%

8%

16%

16%

11%

Not Provided

Not Provided

Not Provided

False Positive Rate

11%

6%

7%

8%

7%

8%

11%

9%

Not Provided

Not Provided

Not Provided

False Negative Rate

36%

25%

18%

8%

38%

26%

23%

61%

Not Provided

Not Provided

Not Provided

Sensitivity

64%

75%

82%

92%

62%

74%

77%

39%

Not Provided

Not Provided

Not Provided

Specificity

89%

94%

93%

92%

93%

92%

89%

91%

Not Provided

Not Provided

Not Provided

Positive Predictive Power

29%

34%

42%

30%

15%

54%

37%

29%

Not Provided

Not Provided

Not Provided

Negative Predictive Power

97%

99%

99%

100%

99%

96%

98%

94%

Not Provided

Not Provided

Not Provided

Overall Classification Rate

88%

93%

92%

92%

93%

90%

88%

87%

Not Provided

Not Provided

Not Provided

Area Under the Curve (AUC)

0.89

0.93

0.96

0.96

0.92

0.94

0.94

0.86

Not Provided

Not Provided

Not Provided

AUC 95% Confidence Interval Lower

0.84

0.90

0.94

0.95

0.89

0.91

0.91

0.81

Not Provided

Not Provided

Not Provided

AUC 95% Confidence Interval Upper

0.94

0.96

0.98

0.98

0.95

0.96

0.97

0.91

Not Provided

Not Provided

Not Provided

 

Reliability

Grade1234567891011
RatingFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubble
  1. Justification for each type of reliability reported, given the type and purpose of the tool:

The internal consistency reliability coefficient estimates the proportion of variability within a single administration of a test that is due to inconsistency among the items that comprise the test.

 

  1. Description of the sample(s), including size and characteristics, for each reliability analysis conducted:

For each grade, a large sample (n = 131,103) of students completed Star Math assessments throughout the 2012–2013 and 2013–2014 school year.

 

  1. Description of the analysis procedures for each reported type of reliability:

Reliability was defined as the proportion of test score variance that is attributable to true variation in the trait the test measures.

The variance of the test scores was calculated from Scaled Score data. The variance of the errors of measurement was estimated from the conditional standard error of measurement (CSEM) statistics that accompany each of the IRT-based test scores, including the Scaled Scores. The conditional standard error of measurement (CSEM) was calculated along with the IRT ability estimate and Scaled Score. Squaring and summing the CSEM values yielded an estimate of total squared error; dividing by the number of observations yielded an estimate of error variance.

Generic reliability was calculated by subtracting the ratio of error variance to Scaled Score variance from 1.

 

  1. Reliability of performance level score (e.g., model-based, internal consistency, inter-rater reliability).

Type of Reliability

Age or Grade

n

Coefficient

Confidence Interval

Generic

Grade 1

131,103

0.90

0.90, 0.90

Generic

Grade 2

131,103

0.91

0.91, 0.91

Generic

Grade 3

131,103

0.91

0.91, 0.91

Generic

Grade 4

131,103

0.92

0.92, 0.92

Generic

Grade 5

131,103

0.92

0.92, 0.92

Generic

Grade 6

131,103

0.93

0.93, 0.93

Generic

Grade 7

131,103

0.93

0.93, 0.93

Generic

Grade 8

131,103

0.93

0.93, 0.93

Generic

Grade 9

131,103

0.93

0.93, 0.93

Generic

Grade 10

131,103

0.94

0.94, 0.94

Generic

Grade 11

131,103

0.94

0.94, 0.94

Generic

Grade 12

131,103

0.95

0.95, 0.95

 

Disaggregated Reliability

The following disaggregated reliability data are provided for context and did not factor into the Reliability rating.

Type of Reliability

Subgroup

Age or Grade

n

Coefficient

Confidence Interval

None

 

 

 

 

 

 

Validity

Grade1234567891011
RatingFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleFull bubbleHalf-filled bubbleFull bubble
  1. Description of each criterion measure used and explanation as to why each measure is appropriate, given the type and purpose of the tool:

All criterion measures were external to the screening tool system and represent widely used assessments of general math ability.

  • CAT-5. The California Achievement Test, is a nationally normed standardized test that measures achievement in mathematics.
  • NWEA MAP. Measures of Academic Progress offers an adaptive computerized test for Mathematics.
  • PARCC. The Partnership for Assessment of Readiness for College and Careers end-of-year assessment covers mathematics and is intended to be used as an indicator of student needs and progress.
  • SBA. Smarter Balanced assessments are summative tests designed to measure student achievement and growth in math to support teaching and learning.
  • ACT. The American College Testing college readiness assessment is a national standardized test for high school achievement and college admissions.
  • IA. Iowa Assessments provide standardized mathematics tests as a service to schools by the College of Education of the University of Iowa.
  • SAT. The SAT Math Test is a standardized test widely used for college admissions in the United States that covers a range of math practices, including problem solving, modeling, using tools strategically, and using algebraic structure.
  • M-CAP. The aimsweb Mathematics Concepts and Applications is a brief, standardized test of problem solving skills and elements included in typical math curriculum.

 

  1. Description of the sample(s), including size and characteristics, for each validity analysis conducted:

Samples included students who had taken both Star Math and the criterion measure. The sample sizes varied across criterion and grades, ranging from 17 to 10,800 students.

 

  1. Description of the analysis procedures for each reported type of validity:

Concurrent and predictive correlations were calculated. A criterion assessment was considered concurrent if it was taken during the same school year as the Star Math assessment. The correlation was considered predictive if the criterion assessment was one school year or more after the Star Math assessment.

 

  1. Validity for the performance level score (e.g., concurrent, predictive, evidence based on response processes, evidence based on internal structure, evidence based on relations to other variables, and/or evidence based on consequences of testing), and the criterion measures.

Type of Validity

Age or Grade

Test or Criterion

n

Coefficient

Confidence Interval

Concurrent

Grade 1

CAT-5

105

0.74

0.64-0.81

Concurrent

Grade 1

NWEA MAP

230

0.74

0.68-0.79

Concurrent

Grade 2

NWEA MAP

702

0.79

0.76-0.82

Concurrent

Grade 2

IA

279

0.81

0.77-0.85

Concurrent

Grade 3

PARCC

4,103

0.80

0.79-0.81

Concurrent

Grade 3

SBA

10,800

0.84

0.83-0.85

Concurrent

Grade 4

PARCC

4787

0.83

0.82-0.84

Concurrent

Grade 4

SBA

10,582

0.86

0.85-0.86

Concurrent

Grade 5

PARCC

4,266

0.79

0.78-0.80

Concurrent

Grade 5

SBA

9,750

0.86

0.85-0.86

Concurrent

Grade 6

PARCC

5,050

0.80

0.79-0.81

Concurrent

Grade 6

SBA

7,852

0.86

0.85-0.86

Concurrent

Grade 7

PARCC

4,368

0.77

0.85-0.87

Concurrent

Grade 7

SBA

6,344

0.86

0.85-0.86

Concurrent

Grade 8

PARCC

5,424

0.83

0.82-0.84

Concurrent

Grade 8

SBA

4,196

0.75

0.82-0.84

Predictive

Grade 9

SAT grade 11

928

0.76

0.73-0.79

Concurrent

Grade 9

M-CAP

68

0.81

0.71-0.88

Predictive

Grade 10

SBA grade 11

2,262

0.78

0.76-0.80

Predictive

Grade 10

SAT grade 11

17

0.89

0.72-0.96

Concurrent

Grade 11

SBA

3,685

0.72

0.71-0.74

Predictive

Grade 11

ACT

7,246

0.72

0.71-0.73

Predictive

Grade 1

ACT Aspire grade 3

3,000

0.70

0.68-0.72

Predictive

Grade 2

ACT Aspire grade 3

3,713

0.79

0.78-0.8

Predictive

Grade 3

SBA

17,898

0.67

0.66-0.68

Predictive

Grade 4

SBA

8,571

0.88

0.87-0.89

Predictive

Grade 5

SBA

8,595

0.88

0.87-0.89

Predictive

Grade 6

SBA

8,575

0.88

0.87-0.89

Predictive

Grade 7

SBA

4,066

0.80

0.79-0.81

Predictive

Grade 8

SBA

3,748

0.76

0.74-0.77

 

  1. Results for other forms of validity (e.g. factor analysis) not conducive to the table format:

None provided

 

  1. Describe the degree to which the provided data support the validity of the tool:

The provided data indicate that Star Math results correspond to other various respected measures of general mathematics ability.

 

Disaggregated Validity

The following disaggregated validity data are provided for context and did not factor into the Validity rating.

Type of Validity

Subgroup

Age or Grade

Test or Criterion

n

Coefficient

Confidence Interval

None

 

 

 

 

 

 

 

Results for other forms of disaggregated validity (e.g. factor analysis) not conducive to the table format:

Not provided

 

Sample Representativeness

Grade1234567891011
Data
  • National with Cross-Validation
  • National with Cross-Validation
  • National with Cross-Validation
  • National with Cross-Validation
  • National with Cross-Validation
  • National with Cross-Validation
  • National with Cross-Validation
  • National with Cross-Validation
  • National with Cross-Validation
  • National with Cross-Validation
  • National with Cross-Validation
  • Primary Classification Accuracy Sample

     

    Criterion 1, Fall

     

    Grade 1

    Grade 2

    Grade 3

    Grade 4

    Grade 5

    Grade 6

    Grade 7

    Grade 8

    Grade 9

    Grade 10

    Grade 11

    Criterion Test Name

    Not Provided

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    ACT Math

    ACT Math

    ACT Math

    Date

    Not Provided

    Fall 2013

    Fall 2014

    Fall 2014

    Fall 2014

    Fall 2014

    Fall 2014

    Fall 2014

    Fall 2005-2012

    Fall 2006-2013

    Fall 2007-2014

    Size

    Not Provided

    3,132

    3,484

    3,891

    3,557

    4,016

    3,802

    3,278

    1,512

    1,521

    2,680

    Male

    Not Provided

    51.90%

    47.70%

    50.40%

    50.70%

    52.50%

    52.60%

    52.10%

    48.08%

    45.56%

    45%

    Female

    Not Provided

    48.00%

    52.20%

    49.40%

    49.10%

    47.40%

    47.40%

    47.90%

    48.88%

    44.25%

    41.16%

    Other SES Indicators (Title I)

    Not Provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Free or reduced-price lunch

    Not Provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    White, Non-Hispanic

    Not Provided

    4.7%

    5.10%

    9.2%

    6.9%

    6.5%

    9.8%

    10.00%

    77.18%

    74.42%

    54.66%

    Black, Non-Hispanic

    Not Provided

    9.9%

    10.00%

    13.8%

    11.2%

    11.8%

    12.6%

    13.90%

    0.93%

    1.38%

    1.9%

    Hispanic

    Not Provided

    53.2%

    52.30%

    45.5%

    50.0%

    53.5%

    54.9%

    59.70%

    8.2%

    6.11%

    1.79%

    American Indian/ Alaska Native

    Not Provided

    0.5%

    0.60%

    0.7%

    0.4%

    0.3%

    0.6%

    0.60%

    0.46%

    0.46%

    0.41%

    Asian/Pacific Islander

    Not Provided

    3.3%

    3.30%

    2.6%

    3.1%

    2.7%

    3.6%

    2.60%

    1.32%

    0.79%

    0.63%

    Other

    Not Provided

    1.9%

    1.9%

    3.1%

    2.5%

    2.5%

    2.2%

    2.4%

    0%

    0%

    0%

    Unknown

    Not Provided

    26.4%

    26.9%

    25.1%

    25.9%

    22.7%

    16.4%

    10.8%

    11.9%

    16.83%

    40.6%

    Disability classification

    Not Provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    English Language Learner

    Not Provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    States/Regions covered

    Not Provided

    AR, CO, IL, NJ, NM, RI (Regions: South, West, Midwest, and Northeast; Divisions: West South Central, Mountain, East North Central, Middle Atlantic, New England)

    AR, CO, IL, NJ, NM, RI (Regions: South, West, Midwest, and Northeast; Divisions: West South Central, Mountain, East North Central, Middle Atlantic, New England)

    AR, CO, IL, NJ, OH, RI (Regions: South, West, Midwest, and Northeast; Divisions: West South Central, Mountain, East North Central, Middle Atlantic, New England)

    AR, CO, IL, NJ, NM, OH, RI (Regions: South, West, Midwest, and Northeast; Divisions: West South Central, Mountain, East North Central, Middle Atlantic, New England)

    AR, CO, IL, NJ, NM, OH, RI (Regions: South, West, Midwest, and Northeast; Divisions: West South Central, Mountain, East North Central, Middle Atlantic, New England)

    AR, CO, IL, NJ, OH, RI (Regions: South, West, Midwest, and Northeast; Divisions: West South Central, Mountain, East North Central, Middle Atlantic, New England)

    AR, CO, IL, NJ, OH, RI (Regions: South, West, Midwest, and Northeast; Divisions: West South Central, Mountain, East North Central, Middle Atlantic, New England)

    AL, AR, KY (South; East South Central & West South Central divisions)

    AL, AR, KY, NC, TN  (South; South Atlantic, East South Central & West South Central divisions)

    AL, AR, KY, NC, TN, WI (Midwest, South; East North Central, South Atlantic, East South Central & West South Central divisions)

     

     

    Criterion 1, Winter

     

    Grade 1

    Grade 2

    Grade 3

    Grade 4

    Grade 5

    Grade 6

    Grade 7

    Grade 8

    Grade 9

    Grade 10

    Grade 11

    Criterion Test Name

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    Smarter Balanced

    Smarter Balanced

    Smarter Balanced

    Date

    Winter 2012-13

    Winter 2013-14

    Winter 2014-15

    Winter 2014-15

    Winter 2014-15

    Winter 2014-15

    Winter 2014-15

    Winter 2014-15

    Winter 2013 - 2016

    Winter 2013 - 2017

    Winter 2014 - 2018

    Size

    396

    3,154

    3,109

    3,533

    2,525

    2,918

    2,489

    2,326

    1,441

    2,818

    1,198

    Male

    51.30%

    51.90%

    51.90%

    50.10%

    51.20%

    52.30%

    52.00%

    53.40%

    51.63%

    50.00%

    50.17%

    Female

    48.70%

    47.90%

    48.00%

    49.70%

    48.50%

    47.70%

    48.00%

    46.60%

    48.37%

    50.00%

    49.83%

    Other SES Indicators (Title I)

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Free or reduced-price lunch

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    White, Non-Hispanic

    5.60%

    4.7%

    5.00%

    9.7%

    7.3%

    6.5%

    11.2%

    10.40%

    11.03%

    5.61%

    22.79%

    Black, Non-Hispanic

    2.30%

    10.1%

    10.20%

    13.4%

    11.7%

    10.8%

    13.5%

    14.10%

    0.90%

    4.72%

    14.02%

    Hispanic

    2.50%

    53.2%

    53.30%

    44.4%

    54.2%

    50.2%

    51.2%

    57.90%

    83.28%

    66.43%

    50.67%

    American Indian/ Alaska Native

    0.00%

    0.5%

    0.60%

    0.7%

    0.5%

    0.2%

    0.3%

    0.30%

    0.21%

    0.07%

    0.42%

    Asian/Pacific Islander

    0.01%

    3.3%

    3.10%

    2.1%

    2.9%

    2.4%

    3.1%

    2.50%

    3.75%

    3.02%

    7.26%

    Other

    0.0%

    2.0%

    1.9%

    3.0%

    2.7%

    2.3%

    2.3%

    2.6%

    0.28%

    0.18%

    1.67%

    Unknown

    88.9%

    26.3%

    26.0%

    26.7%

    20.8%

    27.7%

    18.4%

    12.2%

    0.56%

    19.98%

    3.17%

    Disability classification

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    English Language Learner

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    States/Regions covered

    CO, IL (Regions: West and Midwest; Divisions: Mountain, East North Central)

    AR, CO, IL, NJ, RI (Regions: South, West, Midwest, and Northeast; Divisions: West South Central, Mountain, East North Central, Middle Atlantic, New England)

    AR, CO, IL, NJ, NM, RI (Regions: South, West, Midwest, and Northeast; Divisions: West South Central, Mountain, East North Central, Middle Atlantic, New England)

    AR, CO, IL, NJ, OH, RI (Regions: South, West, Midwest, and Northeast; Divisions: West South Central, Mountain, East North Central, Middle Atlantic, New England)

    AR, CO, IL, NJ, NM, OH, RI (Regions: South, West, Midwest, and Northeast; Divisions: West South Central, Mountain, East North Central, Middle Atlantic, New England)

    AR, CO, IL, NJ, NM, OH, RI (Regions: South, West, Midwest, and Northeast; Divisions: West South Central, Mountain, East North Central, Middle Atlantic, New England)

    AR, CO, IL, NJ, OH, RI (Regions: South, West, Midwest, and Northeast; Divisions: West South Central, Mountain, East North Central, Middle Atlantic, New England)

    AR, CO, IL, NJ, OH, RI (Regions: South, West, Midwest, and Northeast; Divisions: West South Central, Mountain, East North Central, Middle Atlantic, New England)

    CA, WA (West; Pacific division)

    CA, CT, OR, WA (Northeast & West; New England & Pacific divisions

    CA, CT, OR, WA (Northeast & West; New England & Pacific divisions

     

    Criterion 1, Spring

     

    Grade 1

    Grade 2

    Grade 3

    Grade 4

    Grade 5

    Grade 6

    Grade 7

    Grade 8

    Grade 9

    Grade 10

    Grade 11

    Criterion Test Name

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    Smarter Balanced

    ACT Math

    Not Provided

    Date

    Spring 2013

    Spring 2014

    Spring 2014

    Spring 2014

    Spring 2014

    Spring 2014

    Spring 2014

    Spring 2014

    Spring 2013 - 2016

    Spring 2007-2014

    Not Provided

    Size

    433

    3,127

    3,469

    3,232

    3,089

    2,984

    2,495

    419

    3,068

    1,017

    Not Provided

    Male

    52.00%

    52.10%

    50.20%

    50.20%

    52.90%

    52.40%

    52.20%

    49.40%

    50.55%

    45.92%

    Not Provided

    Female

    48.00%

    47.80%

    49.60%

    49.60%

    47.00%

    47.60%

    47.80%

    50.60%

    49.45%

    45.62%

    Not Provided

    Other SES Indicators (Title I)

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    Free or reduced-price lunch

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    White, Non-Hispanic

    5.1%

    4.7%

    9.5%

    6.5%

    6.7%

    11.0%

    12.2%

    4.1%

    9.75%

    71.88%

    Not Provided

    Black, Non-Hispanic

    2.3%

    10.1%

    13.6%

    11.1%

    12.4%

    13.7%

    15.1%

    4.8%

    0.98%

    1.87%

    Not Provided

    Hispanic

    2.5%

    52.7%

    44.9%

    50.7%

    49.0%

    50.1%

    54.2%

    1.2%

    84.52%

    11.41%

    Not Provided

    American Indian/ Alaska Native

    0.0%

    0.5%

    0.7%

    0.4%

    0.3%

    0.4%

    0.5%

    0.0%

    0.23%

    0.49%

    Not Provided

    Asian/Pacific Islander

    0.9%

    3.3%

    2.6%

    3.2%

    3.0%

    4.2%

    2.9%

    0.2%

    3.19%

    1.47%

    Not Provided

    Other

    0.0%

    2.0%

    3.2%

    2.4%

    2.4%

    2.1%

    2.6%

    0.5%

    0.98%

    0%

    Not Provided

    Unknown

    89.1%

    26.7%

    25.6%

    25.6%

    26.2%

    18.5%

    12.5%

    89.3%

    0.36%

    12.88%

    Not Provided

    Disability classification

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    English Language Learner

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    States/Regions covered

    AR, CO, IL (Regions: South, West, Midwest; Divisions: West South Central, Mountain, East North Central)

    AR, CO, IL, NJ, NM, RI (Regions: South, West, Midwest, and Northeast; Divisions: West South Central, Mountain, East North Central, Middle Atlantic, New England)

    AR, CO, IL, NJ, OH, RI (Regions: South, West, Midwest, and Northeast; Divisions: West South Central, Mountain, East North Central, Middle Atlantic, New England)

    AR, CO, IL, NJ, NM, OH, RI (Regions: South, West, Midwest, and Northeast; Divisions: West South Central, Mountain, East North Central, Middle Atlantic, New England)

    AR, CO, IL, NJ, NM, OH, RI (Regions: South, West, Midwest, and Northeast; Divisions: West South Central, Mountain, East North Central, Middle Atlantic, New England)

    AR, CO, IL, NJ, OH, RI (Regions: South, West, Midwest, and Northeast; Divisions: West South Central, Mountain, East North Central, Middle Atlantic, New England)

    AR, CO, IL, NJ, OH, RI (Regions: South, West, Midwest, and Northeast; Divisions: West South Central, Mountain, East North Central, Middle Atlantic, New England)

    AR, CO, NM, OH (Regions: South, West, Midwest; Divisions: West South Central, Mountain, East North Central)

    CA, WA (West; Pacific division)

    AL, AR, KY, TN (South; East South Central & West South Central divisions)

    Not Provided

     

     

    Criterion 2, Fall

     

    Grade 1

    Grade 2

    Grade 3

    Grade 4

    Grade 5

    Grade 6

    Grade 7

    Grade 8

    Grade 9

    Grade 10

    Grade 11

    Criterion Test Name

    Not Provided

    Smarter Balanced Math

    Smarter Balanced Math

    Smarter Balanced Math

    Smarter Balanced Math

    Smarter Balanced Math

    Smarter Balanced Math

    Smarter Balanced Math

    Not Provided

    Not Provided

    Not Provided

    Date

    Not Provided

    Fall 2012

    Fall 2013

    Fall 2014

    Fall 2014

    Fall 2014

    Fall 2014

    Fall 2014

    Not Provided

    Not Provided

    Not Provided

    Size

    Not Provided

    3,914

    8,244

    8,323

    8,307

    8,208

    8,295

    8,478

    Not Provided

    Not Provided

    Not Provided

    Male

    Not Provided

    50.59%

    50.32%

    51.09%

    51.35%

    51.01%

    50.16%

    51.23%

    Not Provided

    Not Provided

    Not Provided

    Female

    Not Provided

    49.26%

    49.45%

    48.67%

    48.47%

    48.81%

    49.61%

    48.27%

    Not Provided

    Not Provided

    Not Provided

    Other SES Indicators (Title I)

    Not Provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    Not Provided

    Not Provided

    Free or reduced-price lunch

    Not Provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    Not Provided

    Not Provided

    White, Non-Hispanic

    Not Provided

    31.73%

    40.81%

    40.9%

    42.23%

    38.54%

    39.06%

    39.71%

    Not Provided

    Not Provided

    Not Provided

    Black, Non-Hispanic

    Not Provided

    5.7%

    4.73%

    4.71%

    4.79%

    4.48%

    5.24%

    5.28%

    Not Provided

    Not Provided

    Not Provided

    Hispanic

    Not Provided

    40.98%

    34.18%

    33.55%

    31.19%

    31.46%

    30.55%

    29.9%

    Not Provided

    Not Provided

    Not Provided

    American Indian/ Alaska Native

    Not Provided

    0.18%

    0.95%

    1.06%

    1.17%

    0.97%

    1.28%

    0.91%

    Not Provided

    Not Provided

    Not Provided

    Asian/Pacific Islander

    Not Provided

    14.67%

    12.47%

    13.24%

    12.3%

    13.69%

    12.63%

    12.79%

    Not Provided

    Not Provided

    Not Provided

    Other

    Not Provided

    3.68%

    4.2%

    3.82%

    4.44%

    3.56%

    3.89%

    3.37%

    Not Provided

    Not Provided

    Not Provided

    Unknown

    Not Provided

    3.07%

    2.67%

    2.73%

    3.88%

    7.3%

    7.34%

    8.03%

    Not Provided

    Not Provided

    Not Provided

    Disability classification

    Not Provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    Not Provided

    Not Provided

    English Language Learner

    Not Provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    Not Provided

    Not Provided

    States/Regions covered

    Not Provided

    CA, CT, OR, WA (Northeast & West; New England & Pacific divisions

    CA, CT, OR, WA (Northeast & West; New England & Pacific divisions

    CA, CT, OR, WA (Northeast & West; New England & Pacific divisions

    CA, CT, OR, WA (Northeast & West; New England & Pacific divisions

    CA, CT, OR, WA (Northeast & West; New England & Pacific divisions

    CA, CT, OR, WA (Northeast & West; New England & Pacific divisions

    CA, CT, OR, WA (Northeast & West; New England & Pacific divisions

    Not Provided

    Not Provided

    Not Provided

     

     

    Criterion 2, Winter

     

    Grade 1

    Grade 2

    Grade 3

    Grade 4

    Grade 5

    Grade 6

    Grade 7

    Grade 8

    Grade 9

    Grade 10

    Grade 11

    Criterion Test Name

    Smarter Balanced Math

    Smarter Balanced Math

    Smarter Balanced Math

    Smarter Balanced Math

    Smarter Balanced Math

    Smarter Balanced Math

    Smarter Balanced Math

    Smarter Balanced Math

    Not Provided

    Not Provided

    Not Provided

    Date

    Winter 2012-13

    Winter 2013-14

    Winter 2014-15

    Winter 2014-15

    Winter 2014-15

    Winter 2014-15

    Winter 2014-15

    Winter 2014-15

    Not Provided

    Not Provided

    Not Provided

    Size

    273

    4,579

    6,064

    6,028

    6,014

    4,764

    4,662

    5,009

    Not Provided

    Not Provided

    Not Provided

    Male

    49.45%

    50.36%

    51.22%

    50.81%

    51%

    50.34%

    49.46%

    52.23%

    Not Provided

    Not Provided

    Not Provided

    Female

    50.55%

    49.49%

    48.42%

    48.81%

    48.75%

    49.39%

    50.09%

    46.94%

    Not Provided

    Not Provided

    Not Provided

    Other SES Indicators (Title I)

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    Not Provided

    Not Provided

    Free or reduced-price lunch

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    Not Provided

    Not Provided

    White, Non-Hispanic

    37%

    32.1%

    40.58%

    40.03%

    41%

    36.38%

    38.8%

    40.45%

    Not Provided

    Not Provided

    Not Provided

    Black, Non-Hispanic

    1.47%

    5.28%

    5.19%

    5.31%

    5.45%

    5.81%

    7.1%

    6.99%

    Not Provided

    Not Provided

    Not Provided

    Hispanic

    35.53%

    40.62%

    31.88%

    30.66%

    30.28%

    28.15%

    27.01%

    25.99%

    Not Provided

    Not Provided

    Not Provided

    American Indian/ Alaska Native

    0%

    0.15%

    1.04%

    1.24%

    1.28%

    1.24%

    1.72%

    1.14%

    Not Provided

    Not Provided

    Not Provided

    Asian/Pacific Islander

    15.38%

    14.52%

    14.35%

    16.03%

    14.45%

    14.61%

    12.08%

    12.78%

    Not Provided

    Not Provided

    Not Provided

    Other

    9.16%

    4.13%

    4.37%

    4.16%

    4.71%

    3.32%

    3.2%

    2.4%

    Not Provided

    Not Provided

    Not Provided

    Unknown

    1.47%

    3.19%

    2.59%

    2.57%

    2.83%

    10.5%

    10.1%

    10.26%

    Not Provided

    Not Provided

    Not Provided

    Disability classification

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    Not Provided

    Not Provided

    English Language Learner

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    Not Provided

    Not Provided

    States/Regions covered

    CA, WA (West; Pacific division)

    CA, CT, OR, WA (Northeast & West; New England & Pacific divisions

    CA, CT, OR, WA (Northeast & West; New England & Pacific divisions

    CA, CT, OR, WA (Northeast & West; New England & Pacific divisions

    CA, CT, OR, WA (Northeast & West; New England & Pacific divisions

    CA, CT, OR, WA (Northeast & West; New England & Pacific divisions

    CA, CT, OR, WA (Northeast & West; New England & Pacific divisions

    CA, CT, OR, WA (Northeast & West; New England & Pacific divisions

    Not Provided

    Not Provided

    Not Provided

     

    Criterion 2, Spring

     

    Grade 1

    Grade 2

    Grade 3

    Grade 4

    Grade 5

    Grade 6

    Grade 7

    Grade 8

    Grade 9

    Grade 10

    Grade 11

    Criterion Test Name

    Smarter Balanced Math

    Smarter Balanced Math

    Smarter Balanced Math

    Smarter Balanced Math

    Smarter Balanced Math

    Smarter Balanced Math

    Smarter Balanced Math

    Not Provided

    Not Provided

    Not Provided

    Not Provided

    Date

    Spring 2013

    Spring 2014

    Spring 2014

    Spring 2014

    Spring 2014

    Spring 2014

    Spring 2014

    Not Provided

    Not Provided

    Not Provided

    Not Provided

    Size

    360

    4,583

    5,504

    5,261

    4,869

    5,046

    4,709

    Not Provided

    Not Provided

    Not Provided

    Not Provided

    Male

    47.78%

    49.77%

    50.93%

    50.85%

    51.84%

    49.9%

    50.41%

    Not Provided

    Not Provided

    Not Provided

    Not Provided

    Female

    52.22%

    50.05%

    48.96%

    49.12%

    48%

    49.92%

    48.99%

    Not Provided

    Not Provided

    Not Provided

    Not Provided

    Other SES Indicators (Title I)

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    Not Provided

    Not Provided

    Not Provided

    Free or reduced-price lunch

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    Not Provided

    Not Provided

    Not Provided

    White, Non-Hispanic

    38.89%

    32.03%

    30.49%

    32.83%

    28.42%

    30.66%

    37.25%

    Not Provided

    Not Provided

    Not Provided

    Not Provided

    Black, Non-Hispanic

    1.67%

    5.04%

    4.81%

    4.94%

    4.27%

    4.6%

    4.27%

    Not Provided

    Not Provided

    Not Provided

    Not Provided

    Hispanic

    27.5%

    40.65%

    42.31%

    38.74%

    38.02%

    35.1%

    27.37%

    Not Provided

    Not Provided

    Not Provided

    Not Provided

    American Indian/ Alaska Native

    0%

    0.17%

    0.2%

    0.4%

    0.47%

    0.42%

    0.62%

    Not Provided

    Not Provided

    Not Provided

    Not Provided

    Asian/Pacific Islander

    19.72%

    14.55%

    14.77%

    13.61%

    14.71%

    14.86%

    14.53%

    Not Provided

    Not Provided

    Not Provided

    Not Provided

    Other

    10.83%

    4.15%

    4.07%

    5.02%

    3.94%

    4.24%

    3.84%

    Not Provided

    Not Provided

    Not Provided

    Not Provided

    Unknown

    1.39%

    3.4%

    3.34%

    4.47%

    10.17%

    10.13%

    12.13%

    Not Provided

    Not Provided

    Not Provided

    Not Provided

    Disability classification

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    Not Provided

    Not Provided

    Not Provided

    English Language Learner

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    Not Provided

    Not Provided

    Not Provided

    States/Regions covered

    CA, WA (West; Pacific division)

    CA, CT, OR, WA (Northeast & West; New England & Pacific divisions

    CA, CT, OR, WA (Northeast & West; New England & Pacific divisions

    CA, CT, OR, WA (Northeast & West; New England & Pacific divisions

    CA, CT, OR, WA (Northeast & West; New England & Pacific divisions

    CA, CT, OR, WA (Northeast & West; New England & Pacific divisions

    CA, CT, OR, WA (Northeast & West; New England & Pacific divisions

    Not Provided

    Not Provided

    Not Provided

    Not Provided

     

     

     

     

    Cross Validation Sample

     

    Criterion 1, Fall

     

    Grade 1

    Grade 2

    Grade 3

    Grade 4

    Grade 5

    Grade 6

    Grade 7

    Grade 8

    Grade 9

    Grade 10

    Grade 11

    Criterion Test Name

    Not Provided

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    Not Provided

    Not Provided

    Not Provided

    Date

    Not Provided

    Fall 2013

    Fall 2014

    Fall 2014

    Fall 2014

    Fall 2014

    Fall 2014

    Fall 2014

    Not Provided

    Not Provided

    Not Provided

    Size

    Not Provided

    652

    709

    715

    711

    732

    660

    480

    Not Provided

    Not Provided

    Not Provided

    Male

    Not Provided

    48.80%

    49.90%

    49.70%

    51.70%

    53.30%

    53.00%

    50.90%

    Not Provided

    Not Provided

    Not Provided

    Female

    Not Provided

    51.20%

    50.10%

    50.30%

    48.30%

    46.70%

    47.00%

    49.10%

    Not Provided

    Not Provided

    Not Provided

    Other SES Indicators (Title I)

    Not Provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    Not Provided

    Not Provided

    Free or reduced-price lunch

    Not Provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    Not Provided

    Not Provided

    White, Non-Hispanic

    Not Provided

    12.3%

    11.3%

    11.3%

    12.6%

    11.2%

    12.4%

    11.9%

    Not Provided

    Not Provided

    Not Provided

    Black, Non-Hispanic

    Not Provided

    6.4%

    7.2%

    6.3%

    6.0%

    8.3%

    9.3%

    10.3%

    Not Provided

    Not Provided

    Not Provided

    Hispanic

    Not Provided

    49.1%

    50.1%

    51.7%

    51.2%

    51.8%

    50.1%

    49.9%

    Not Provided

    Not Provided

    Not Provided

    American Indian/ Alaska Native

    Not Provided

    0.0%

    0.0%

    0.3%

    0.3%

    0.1%

    0.0%

    0.0%

    Not Provided

    Not Provided

    Not Provided

    Asian/Pacific Islander

    Not Provided

    29.9%

    29.3%

    28.7%

    28.3%

    26.7%

    26.3%

    26.7%

    Not Provided

    Not Provided

    Not Provided

    Other

    Not Provided

    2.3%

    2.1%

    1.7%

    1.6%

    1.9%

    2.0%

    1.2%

    Not Provided

    Not Provided

    Not Provided

    Unknown

    Not Provided

    0.0%

    0.0%

    0.0%

    0.0%

    0.0%

    0.0%

    0.0%

    Not Provided

    Not Provided

    Not Provided

    Disability classification

    Not Provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    Not Provided

    Not Provided

    English Language Learner

    Not Provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    Not Provided

    Not Provided

    States/Regions covered

    Not Provided

    NJ (Region: Northeast, Division: Middle Atlantic)

    NJ (Region: Northeast, Division: Middle Atlantic)

    NJ (Region: Northeast, Division: Middle Atlantic)

    NJ (Region: Northeast, Division: Middle Atlantic)

    NJ (Region: Northeast, Division: Middle Atlantic)

    NJ (Region: Northeast, Division: Middle Atlantic)

    NJ (Region: Northeast, Division: Middle Atlantic)

    Not Provided

    Not Provided

    Not Provided

     

     

    Criterion 1, Winter

     

    Grade 1

    Grade 2

    Grade 3

    Grade 4

    Grade 5

    Grade 6

    Grade 7

    Grade 8

    Grade 9

    Grade 10

    Grade 11

    Criterion Test Name

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    Not Provided

    Not Provided

    Not Provided

    Date

    Winter 2012-13

    Winter 2013-14

    Winter 2014-15

    Winter 2014-15

    Winter 2014-15

    Winter 2014-15

    Winter 2014-15

    Winter 2014-15

    Not Provided

    Not Provided

    Not Provided

    Size

    590

    658

    588

    657

    702

    731

    664

    483

    Not Provided

    Not Provided

    Not Provided

    Male

    48.80%

    48.90%

    50.50%

    49.60%

    51.00%

    53.50%

    53.30%

    54.00%

    Not Provided

    Not Provided

    Not Provided

    Female

    51.20%

    51.10%

    49.50%

    50.40%

    49.00%

    46.50%

    46.70%

    46.00%

    Not Provided

    Not Provided

    Not Provided

    Other SES Indicators (Title I)

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    Not Provided

    Not Provided

    Free or reduced-price lunch

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    Not Provided

    Not Provided

    White, Non-Hispanic

    12.70%

    12.20%

    10.90%

    11.10%

    12.40%

    11.40%

    11.10%

    10.60%

    Not Provided

    Not Provided

    Not Provided

    Black, Non-Hispanic

    5.80%

    6.70%

    7.10%

    6.50%

    6.10%

    8.20%

    9.60%

    11.20%

    Not Provided

    Not Provided

    Not Provided

    Hispanic

    47.60%

    48.90%

    49.80%

    51.80%

    52.00%

    52.00%

    53.00%

    59.40%

    Not Provided

    Not Provided

    Not Provided

    American Indian/ Alaska Native

    0.00%

    0.00%

    0.00%

    0.30%

    0.30%

    0.10%

    0.00%

    0.00%

    Not Provided

    Not Provided

    Not Provided

    Asian/Pacific Islander

    31.40%

    29.90%

    29.90%

    28.80%

    27.60%

    26.50%

    24.10%

    18.00%

    Not Provided

    Not Provided

    Not Provided

    Other

    2.5%

    2.3%

    2.2%

    1.5%

    1.6%

    1.8%

    2.1%

    0.8%

    Not Provided

    Not Provided

    Not Provided

    Unknown

    0.0%

    0.0%

    0.0%

    0.0%

    0.0%

    0.0%

    0.0%

    0.0%

    Not Provided

    Not Provided

    Not Provided

    Disability classification

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    Not Provided

    Not Provided

    English Language Learner

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    Not Provided

    Not Provided

    States/Regions covered

    NJ (Region: Northeast, Division: Middle Atlantic)

    NJ (Region: Northeast, Division: Middle Atlantic)

    NJ (Region: Northeast, Division: Middle Atlantic)

    NJ (Region: Northeast, Division: Middle Atlantic)

    NJ (Region: Northeast, Division: Middle Atlantic)

    NJ (Region: Northeast, Division: Middle Atlantic)

    NJ (Region: Northeast, Division: Middle Atlantic)

    NJ (Region: Northeast, Division: Middle Atlantic)

    Not Provided

    Not Provided

    Not Provided

     

    Criterion 1, Spring

     

    Grade 1

    Grade 2

    Grade 3

    Grade 4

    Grade 5

    Grade 6

    Grade 7

    Grade 8

    Grade 9

    Grade 10

    Grade 11

    Criterion Test Name

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    PARCC Math

    Not Provided

    Not Provided

    Not Provided

    Date

    Spring 2013

    Spring 2014

    Spring 2014

    Spring 2014

    Spring 2014

    Spring 2014

    Spring 2014

    Spring 2014

    Not Provided

    Not Provided

    Not Provided

    Size

    601

    637

    664

    666

    659

    629

    447

    456

    Not Provided

    Not Provided

    Not Provided

    Male

    49.40%

    48.70%

    49.40%

    52.30%

    51.70%

    53.50%

    50.70%

    50.70%

    Not Provided

    Not Provided

    Not Provided

    Female

    50.60%

    51.30%

    50.60%

    47.70%

    48.30%

    46.50%

    49.30%

    49.30%

    Not Provided

    Not Provided

    Not Provided

    Other SES Indicators (Title I)

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    Not Provided

    Not Provided

    Free or reduced-price lunch

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    Not Provided

    Not Provided

    White, Non-Hispanic

    12.8%

    11.8%

    11.3%

    13.2%

    11.7%

    12.6%

    12.6%

    11.8%

    Not Provided

    Not Provided

    Not Provided

    Black, Non-Hispanic

    6.2%

    6.4%

    5.7%

    5.4%

    7.4%

    8.0%

    10.7%

    9.9%

    Not Provided

    Not Provided

    Not Provided

    Hispanic

    47.6%

    49.6%

    51.8%

    50.2%

    51.1%

    50.5%

    48.6%

    55.7%

    Not Provided

    Not Provided

    Not Provided

    American Indian/Alaska Native

    0.0%

    0.0%

    0.3%

    0.3%

    0.2%

    0.0%

    0.0%

    0.0%

    Not Provided

    Not Provided

    Not Provided

    Asian/Pacific Islander

    30.9%

    29.8%

    29.4%

    29.3%

    27.9%

    26.9%

    26.9%

    21.7%

    Not Provided

    Not Provided

    Not Provided

    Other

    2.5%

    2.4%

    1.5%

    1.7%

    1.7%

    2.0%

    1.3%

    0.9%

    Not Provided

    Not Provided

    Not Provided

    Unknown

    0.0%

    0.0%

    0.0%

    0.0%

    0.0%

    0.0%

    0.0%

    0.0%

    Not Provided

    Not Provided

    Not Provided

    Disability classification

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    Not Provided

    Not Provided

    English Language Learner

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not provided

    Not Provided

    Not Provided

    Not Provided

    States/Regions covered

    NJ (Region: Northeast, Division: Middle Atlantic)

    NJ (Region: Northeast, Division: Middle Atlantic)

    NJ (Region: Northeast, Division: Middle Atlantic)

    NJ (Region: Northeast, Division: Middle Atlantic)

    NJ (Region: Northeast, Division: Middle Atlantic)

    NJ (Region: Northeast, Division: Middle Atlantic)

    NJ (Region: Northeast, Division: Middle Atlantic)

    NJ (Region: Northeast, Division: Middle Atlantic)

    Not Provided

    Not Provided

    Not Provided

     

    Bias Analysis Conducted

    Grade1234567891011
    RatingYesYesYesYesYesYesYesYesYesYesYes
    1. Description of the method used to determine the presence or absence of bias:

    Logistic regression analyses conditional on ability, group membership,

    and ability by group interaction were conducted to assess the presence of both uniform and non-uniform DIF simultaneously. Additionally, an effect size measure – Nagelkerke R-squared – was computed to quantify the magnitude of DIF where present.

     

    1. Description of the subgroups for which bias analyses were conducted:

    DIF analyses were conducted for gender (males and females) and race/ethnicity (Caucasian, African American, American Indian, Asian, and Hispanic subpopulations). Due to insufficient samples sizes on English Language Learner (ELLs) and students with disabilities (SWD), DIF analyses for these two subgroups were not possible at the time of the analyses.

     

    1. Description of the results of the bias analyses conducted, including data and interpretative statements:

    Using a blended criterion that flagged items for uniform/non-uniform DIF if they had a p-value less than 0.01 and Nagelkerke R2 greater than or equal to 0.035, the results indicated that Star Math is sufficiently bias-free. A total of 391 items (4% of the Star Math items) were flagged for DIF. Those flagged items were removed from the item banks for review and recalibration.

     

    Administration Format

    Grade1234567891011
    Data
  • Individual
  • Group
  • Individual
  • Group
  • Individual
  • Group
  • Individual
  • Group
  • Individual
  • Group
  • Individual
  • Group
  • Individual
  • Group
  • Individual
  • Group
  • Individual
  • Group
  • Individual
  • Group
  • Individual
  • Group
  • Administration & Scoring Time

    Grade1234567891011
    Data
  • 20 minutes
  • 20 minutes
  • 20 minutes
  • 20 minutes
  • 20 minutes
  • 20 minutes
  • 20 minutes
  • 20 minutes
  • 20 minutes
  • 20 minutes
  • 20 minutes
  • Scoring Format

    Grade1234567891011
    Data
  • Automatic
  • Automatic
  • Automatic
  • Automatic
  • Automatic
  • Automatic
  • Automatic
  • Automatic
  • Automatic
  • Automatic
  • Automatic
  • Types of Decision Rules

    Grade1234567891011
    Data
  • Risk Benchmarks
  • Risk Benchmarks
  • Risk Benchmarks
  • Risk Benchmarks
  • Risk Benchmarks
  • Risk Benchmarks
  • Risk Benchmarks
  • Risk Benchmarks
  • Risk Benchmarks
  • Risk Benchmarks
  • Risk Benchmarks
  • Evidence Available for Multiple Decision Rules

    Grade1234567891011
    Data
  • No
  • No
  • No
  • No
  • No
  • No
  • No
  • No
  • No
  • No
  • No