top of page

Review Methodologies
How We Do Our Reviews
-
Alignment Verification MethodologyReview Methodology Learning List’s alignment verification process is a multi-step process overseen by Learning List’s Director of Alignment. Multiple Learning List subject matter experts sequentially review citations listed in the publisher’s correlation for alignment to each of the state standards the material is designed to cover. After the subject matter experts have completed their alignment reviews for a grade level, Learning List’s Director of Alignment checks the alignment reports for completeness and arbitrates differences of opinion among the reviewers both within and across grade levels. Once the alignment reports are complete, we calculate the percentage of standards to which the material is aligned for each grade level. Definition of Alignment Learning List considers a citation (i.e., page, lesson, activity, quiz) to be aligned to a standard only if the citation addresses the content, cognitive rigor, and context specified in the standard. Publisher Preview Once the reviews are complete, the publisher has the opportunity to preview the alignment reports and submit additional citations for the standards for which Learning List initially found no aligned citations. The additional citations are reviewed and integrated into the alignment report, and the alignment percentage is recalculated before the review is published.
-
Texas State-Adopted ProductsFor materials that have gone through the Texas state adoption process, Learning List publishes the state review panel’s detailed alignment report and the alignment percentage calculated by the Texas Education Agency.
-
Calculating the Alignment PercentageFor Materials Aligned to the Texas Essential Knowledge and Skills (TEKS) The alignment percentage represents the proportion of Student Expectations to which the material is aligned (number of Student Expectations aligned divided by total number of Student Expectations). Learning List uses the same alignment templates and methodology as the Texas Education Agency (TEA) when calculating the alignment percentage. Before beginning a state review process, TEA staff break each Student Expectation (for the relevant grade and subject area) out into its key components (Breakouts). In some cases, the Breakouts are further subdivided into Elements and even Sub-Elements. For purposes of calculating the alignment percentage, a material is considered aligned to a Student Expectation only if Learning List has found at least one aligned citation in the material for each of the Breakouts, Elements, and Sub-Elements of that Student Expectation. For Materials Aligned to the Common Core State Standards (CCSS) The alignment percentage represents the proportion of Standards to which the material is aligned (number of Standards aligned divided by total number of Standards). For purposes of calculating the alignment percentage, a material is considered aligned to a Standard if Learning List has found at least one aligned citation in the material for that Standard. If the Standard has related Expectations, Learning List must have found at least one aligned citation for each of the Expectations to consider the material aligned to the Standard. For Materials Aligned to the Next Generation Science Standards (NGSS) Learning List reviews citations in the publisher’s correlation for alignment to each Performance Expectation and its components (DCIs, SEPs, CCs). However, the alignment percentage reflects the proportion of Performance Expectations to which the material is aligned. For purposes of calculating the alignment percentage, a material is considered aligned to a Performance Expectation only if Learning List has found at least one aligned citation in the material for that Performance Expectation.
Alignment Reviews
-
Alignment Verification MethodologyReview Methodology Learning List’s alignment verification process is a multi-step process overseen by Learning List’s Director of Alignment. Multiple Learning List subject matter experts sequentially review citations listed in the publisher’s correlation for alignment to each of the state standards the material is designed to cover. After the subject matter experts have completed their alignment reviews for a grade level, Learning List’s Director of Alignment checks the alignment reports for completeness and arbitrates differences of opinion among the reviewers both within and across grade levels. Once the alignment reports are complete, we calculate the percentage of standards to which the material is aligned for each grade level. Definition of Alignment Learning List considers a citation (i.e., page, lesson, activity, quiz) to be aligned to a standard only if the citation addresses the content, cognitive rigor, and context specified in the standard. Publisher Preview Once the reviews are complete, the publisher has the opportunity to preview the alignment reports and submit additional citations for the standards for which Learning List initially found no aligned citations. The additional citations are reviewed and integrated into the alignment report, and the alignment percentage is recalculated before the review is published.
-
Texas State-Adopted ProductsFor materials that have gone through the Texas state adoption process, Learning List publishes the state review panel’s detailed alignment report and the alignment percentage calculated by the Texas Education Agency.
-
Calculating the Alignment PercentageFor Materials Aligned to the Texas Essential Knowledge and Skills (TEKS) The alignment percentage represents the proportion of Student Expectations to which the material is aligned (number of Student Expectations aligned divided by total number of Student Expectations). Learning List uses the same alignment templates and methodology as the Texas Education Agency (TEA) when calculating the alignment percentage. Before beginning a state review process, TEA staff break each Student Expectation (for the relevant grade and subject area) out into its key components (Breakouts). In some cases, the Breakouts are further subdivided into Elements and even Sub-Elements. For purposes of calculating the alignment percentage, a material is considered aligned to a Student Expectation only if Learning List has found at least one aligned citation in the material for each of the Breakouts, Elements, and Sub-Elements of that Student Expectation. For Materials Aligned to the Common Core State Standards (CCSS) The alignment percentage represents the proportion of Standards to which the material is aligned (number of Standards aligned divided by total number of Standards). For purposes of calculating the alignment percentage, a material is considered aligned to a Standard if Learning List has found at least one aligned citation in the material for that Standard. If the Standard has related Expectations, Learning List must have found at least one aligned citation for each of the Expectations to consider the material aligned to the Standard. For Materials Aligned to the Next Generation Science Standards (NGSS) Learning List reviews citations in the publisher’s correlation for alignment to each Performance Expectation and its components (DCIs, SEPs, CCs). However, the alignment percentage reflects the proportion of Performance Expectations to which the material is aligned. For purposes of calculating the alignment percentage, a material is considered aligned to a Performance Expectation only if Learning List has found at least one aligned citation in the material for that Performance Expectation.
Instructional Quality Reviews
bottom of page