Table of Contents
Introduction ............................................................................................................................... 3
AdvancED Standards Diagnostic Results .................................................................................... 4
Leadership Capacity Domain............................................................................................................... 4
Learning Capacity Domain .................................................................................................................. 5
Resource Capacity Domain ................................................................................................................. 6
Effective Learning Environments Observation Tool® (eleot®) Results ....................................... 7
eleot Narrative.................................................................................................................................. 11
Findings .................................................................................................................................... 12
Improvement Priorities ..................................................................................................................... 12
Insights from the Review .................................................................................................................. 15
Next Steps......................................................................................................................................... 16
Team Roster ............................................................................................................................. 18
Addenda................................................................................................................................... 20
Student Performance Data for Semple Elementary Schools ............................................................. 20
Schedule ........................................................................................................................................... 23
Introduction
The AdvancED Diagnostic Review is carried out by a team of highly qualified evaluators who examine the
institution’s adherence and commitment to the research aligned to AdvancED Standards. The Diagnostic Review
Process is designed to energize and equip the leadership and stakeholders of an institution to achieve higher levels
of performance and address those areas that may be hindering efforts to reach desired performance levels. The
Diagnostic Review is a rigorous process that includes the in-depth examination of evidence and relevant
performance data, interviews with stakeholders, and observations of instruction, learning, and operations.
Standards help delineate what matters. They provide a common language through which an education community
can engage in conversations about educational improvement, institution effectiveness, and achievement. They
serve as a foundation for planning and implementing improvement strategies and activities and for measuring
success. AdvancED Standards were developed by a committee composed of educators from the fields of practice,
research, and policy. These talented leaders applied professional wisdom, deep knowledge of effective practice,
and the best available research to craft a set of robust standards that define institutional quality and guide
continuous improvement.
The Diagnostic Review Team used the AdvancED Standards and related criteria to guide its evaluation, looking not
only for adherence to standards, but also for how the institution functioned as a whole and embodied the
practices and characteristics of quality. Using the evidence they gathered, the Diagnostic Review Team arrived at a
set of findings contained in this report.
As a part of the Diagnostic Review, stakeholders were interviewed by members of the Diagnostic Review Team
about their perspectives on topics relevant to the institution's learning environment and organizational
effectiveness. The feedback gained through the stakeholder interviews was considered with other evidence and
data to support the findings of the Diagnostic Review. The following table lists the numbers of interviewed
representatives of various stakeholder groups.
1.1 The institution commits to a purpose statement that defines beliefs about teaching Needs
and learning, including the expectations for learners. Improvement
1.3 The institution engages in a continuous improvement process that produces Needs
evidence, including measurable results of improving student learning and Improvement
professional practice.
1.6 Leaders implement staff supervision and evaluation processes to improve Emerging
professional practice and organizational effectiveness.
1.7 Leaders implement operational process and procedures to ensure organizational Needs
effectiveness in support of teaching and learning. Improvement
1.8 Leaders engage stakeholders to support the achievement of the institution’s Emerging
purpose and direction.
1.9 The institution provides experiences that cultivate and improve leadership Needs
effectiveness. Improvement
1.10 Leaders collect and analyze a range of feedback data from multiple stakeholder Needs
groups to inform decision-making that results in improvement. Improvement
2.1 Learners have equitable opportunities to develop skills and achieve the content Needs
and learning priorities established by the institution. Improvement
2.2 The learning culture promotes creativity, innovation and collaborative problem- Needs
solving. Improvement
2.5 Educators implement a curriculum that is based on high expectations and prepares Needs
learners for their next levels. Improvement
2.7 Instruction is monitored and adjusted to meet individual learners’ needs and the Needs
institution’s learning expectations. Improvement
2.9 The institution implements, evaluates, and monitors processes to identify and Needs
address the specialized social, emotional, developmental, and academic needs of Improvement
students.
2.10 Learning progress is reliably assessed and consistently and clearly communicated. Needs
Improvement
2.11 Educators gather, analyze, and use formative and summative data that lead to Needs
demonstrable improvement of student learning. Improvement
2.12 The institution implements a process to continuously assess its programs and Needs
organizational conditions to improve student learning. Improvement
3.1 The institution plans and delivers professional learning to improve the learning Needs
environment, learner achievement, and the institution’s effectiveness. Improvement
3.2 The institution’s professional learning structure and expectations promote Emerging
collaboration and collegiality to improve learner performance and organizational
effectiveness.
3.4 The institution attracts and retains qualified personnel who support the institution’s Needs
purpose and direction. Improvement
3.7 The institution demonstrates strategic resource management that includes long- Needs
range planning and use of resources in support of the institution’s purpose and Improvement
direction.
3.8 The institution allocates human, material, and fiscal resources in alignment with the Needs
institution’s identified needs and priorities to improve student performance and Improvement
organizational effectiveness.
Every member of the Diagnostic Review Team was eleot certified and passed a certification exam that established
inter-rater reliability. Team members conducted 21 observations during the Diagnostic Review process, including
all core content learning environments. The following charts provide aggregate data across multiple observations
for each of the seven learning environments.
2.4
2.2 2.3
2.0 2.0
1.9
1.1
Environment Averages
Not Observed
Very Evident
Somewhat
Indicators Average Description
Evident
Evident
Learners strive to meet or are able to articulate the high
B1 2.0 22% 56% 22% 0%
expectations established by themselves and/or the teacher.
Overall rating on a 4
point scale:
1.9
Not Observed
Very Evident
Somewhat
Indicators Average Description
Evident
Evident
Learners demonstrate a sense of community that is positive,
C1 2.2 11% 61% 22% 6%
cohesive, engaged, and purposeful.
Overall rating on a 4
point scale:
2.4
Not Observed
Very Evident
Somewhat
Indicators Average Description
Evident
Evident
Learners' discussions/dialogues/exchanges with each other
D1 2.4 11% 39% 44% 6%
and teacher predominate.
D3 2.6 Learners are actively engaged in the learning activities. 6% 39% 50% 6%
Not Observed
Very Evident
Somewhat
Indicators Average Description
Evident
Evident
Learners monitor their own progress or have mechanisms
E1 2.0 33% 33% 33% 0%
whereby their learning progress is monitored.
Overall rating on a 4
point scale:
2.0
Not Observed
Very Evident
Somewhat
Indicators Average Description
Evident
Evident
Learners speak and interact respectfully with teacher(s) and
F1 2.7 6% 28% 61% 6%
each other.
Overall rating on a 4
point scale:
2.3
Not Observed
Very Evident
Somewhat
Indicators Average Description
Evident
Evident
Learners use digital tools/technology to gather, evaluate,
G1 1.1 89% 11% 0% 0%
and/or use information for learning.
Overall rating on a 4
point scale:
1.1
eleot Narrative
The Diagnostic Review Team conducted 21 classroom observations, including core content classes. These
observations provided the team with information about teaching and learning at Semple Elementary School.
Overall, the team found teacher-directed instruction was typically delivered to the whole class, with few instances
of differentiated student learning tasks. Instances of students who “engage in differentiated learning opportunities
and/or activities that meet their needs” (A1) were evident/very evident in six percent of classrooms. It was
evident/very evident in 33 percent of classrooms that students “collaborate with their peers to
accomplish/complete projects, activities, tasks and/or assignments” (D4). It was evident/very evident in 50 percent
of classrooms that student “discussions/dialogues/exchanges with each other and teacher predominate” (D1).
Also concerning to the Diagnostic Review Team was the High Expectations Learning Environment that earned a
rating of 1.9 on a four-point scale. In this learning environment, it was evident/very evident in six percent of
classrooms that students “take responsibility for and are self-directed in their learning” (B5). Instances of students
who “demonstrate and/or are able to describe high quality work” (B3) were evident/very evident in 11 percent of
classrooms, and in 17 percent of classrooms, students “engage in rigorous coursework, discussions, and/or tasks
that require the use of higher order thinking (e.g., analyzing, applying, evaluating, synthesizing)” (B4).
The Digital Learning Environment earned an overall rating of 1.1 on the four-point scale, making it the lowest-rated
learning environment. The Diagnostic Review Team rarely observed technology used by students to complete tasks
beyond working on educational programs. In six percent of classrooms, for example, it was evident/very evident
that students used digital tools/technology to “communicate and work collaboratively for learning” (G3) or
“conduct research, solve problems, and/or create original works for learning” (G2). In addition, in zero percent of
classrooms, it was evident/very evident that students “use digital tools/technology to gather, evaluate, and/or use
information for learning” (G1).
The Diagnostic Review Team encourages school leaders and staff members to carefully review each item in all
seven learning environments to identify those that can be immediately leveraged to improve teaching and
learning.
Findings
Improvement Priorities
Improvement priorities are developed to enhance the capacity of the institution to reach a higher level of
performance and reflect the areas identified by the Diagnostic Review Team to have the greatest impact on
improving student performance and organizational effectiveness.
Improvement Priority #1
Evaluate and revise the quality and effectiveness of the current curriculum to ensure it meets the level of rigor in
the Kentucky Academic Standards (KAS) and prepares students for the next level. Develop, document, and
implement a formal process to monitor instruction to ensure it matches the level of rigor in the standards and is
implemented with fidelity. (Standard 2.5)
Evidence:
In 2016-2017, for example, 40.7 percent of fifth-grade students scored Proficient/Distinguished in social studies,
but that dropped to 20 percent in 2017-2018, whereas the state average was 60 percent in 2016-2017 and 53
percent in 2017-2018. Likewise, in fifth-grade writing, student scores dropped from 22.2 percent
Proficient/Distinguished to 14.4 percent, compared to the state averages of 45.9 percent in 2016-2017 and 40.5
percent in 2017-2018. According to the 2017-2018 K-PREP science assessment results, fourth-grade students at
Semple Elementary School scored significantly lower than their peers across the state. In addition, student
performance data indicated that the student growth indexes for reading, mathematics, and growth indicator were
all lower than the state indexes in 2017-2018.
differentiated instruction rarely occurred, as it was evident/very evident in six percent of classrooms that students
“engage in differentiated learning opportunities and/or activities that meet their needs” (A1). One stakeholder, for
example, stated, “We need to get to the point where we are truly differentiating for all students.” Additionally, the
interview data showed that stakeholders respected the principal. In interviews, the Diagnostic Review Team
repeatedly heard that the school culture had vastly improved under the direction of the school principal. The
teacher turnover rate, according to the interview data, was lower than similar schools in the district. Interview
data also revealed that staff members had delved into standards alignment; however, they were unable to explain
the process for consistently using data to develop an aligned curriculum or revise the existing curriculum.
Improvement Priority #2
Create a formal process to evaluate all academic and organizational programs, practices, and services that have a
direct impact on student learning. Use findings from analysis of data (e.g., student performance, instructional
practices, surveys) to make informed decisions (e.g., adjust, add, eliminate) to improve these programs, services,
and practices implemented with quality and fidelity. (Standard 2.12)
Evidence:
Engagement is the level of involvement and frequency with which stakeholders are engaged in the desired
practices, processes, or programs within the institution. Implementation is the degree to which the desired
practices, processes, or programs are monitored and adjusted for quality and fidelity of implementation. Results
represent the collection, analysis, and use of data and evidence to demonstrate attaining the desired result(s).
Sustainability is results achieved consistently to demonstrate growth and improvement over time (minimum of
three years). Embeddedness is the degree to which the desired practices, processes, or programs are deeply
ingrained in the culture and operation of the institution.
Strengths:
Parents, teachers, support staff, and district leaders shared a common belief that the principal at Semple
Elementary School has created a positive school culture. As one stakeholder noted, “The school culture is a
compassionate family environment.” A consistent belief among staff and community members is that everyone is
willing to do whatever it takes to positively affect the lives of their students. This starts with school leadership, as
one teacher commented, “Principal Randle wants to make you better. She is special—something about her that
drives you internally.”
A plethora of resources to support student learning and instructional practices were accessible to school staff
members. These supports have allowed the school to implement different programs and provide teachers with
professional learning opportunities to develop and enhance their professional practice. Survey data showed 88
percent of staff members agreed/strongly agreed with the statement, “Our school provides instructional time and
resources to support our school’s goals and priorities” (F2). Additionally, 88 percent of parents agreed/strongly
agreed that “Our school provides students with access to a variety of information resources to support their
learning.” (F4). The Diagnostic Review Team generally observed a supportive learning environment and a well-
maintained facility.
The principal has focused on creating a positive school culture while also creating a supportive and collaborative
working environment. The staff survey data revealed that 98 percent of staff members agreed/strongly agreed
with the statement, “Our school’s leaders support an innovative and collaborative culture.” (D3). One staff
member captured the sentiment of many with the positive statement, “Principal Randle is the heart of the school.”
Another teacher stated, “I would beg, plead, and barter to work at this school under her leadership.”
starting in 2016-2017, fourth-grade mathematics scores, as measured by the K-PREP, showed student performance
decreased. Students performed significantly lower than state averages in 2016-2017 and 2017-2018. Survey data
revealed that 87 percent of staff members agreed/strongly agreed “Our school has a systematic process for
collecting, analyzing, and using data” (G3).
The school had structures (e.g., PLCs, multi-tiered system of supports, academies, faculty meetings) to provide
time for teachers to collaborate, review, and analyze student data. Also, the master schedule and personalized
learning initiative provided teachers with time to create differentiated student learning groups based on the
identified needs of students. Survey data showed that 94 percent of staff members agreed/strongly agreed with
the statement, “In our school, all staff members participate in continuous professional learning based on identified
needs of the school” (E17). The Diagnostic Review Team found few instances of instruction designed specifically to
meet individual student needs. While teachers were trained in a variety of instructional strategies, inconsistent
implementation of effective teaching strategies was observed across classrooms.
The school could benefit from the development of processes to improve the systematic evaluation of instructional
practices and programs that determine the impact on student learning. The Diagnostic Review Team found that
the school used Powerwalks, the Fundamental Five, and the Danielson Framework evaluation system to evaluate
the quality and effectiveness of teacher instructional practices. However, these strategies had not resulted in
sustained and systematic improvements in instruction practices, as evidenced by few changes in student
achievement. The Diagnostic Review Team suggests that school leaders and staff members increase instructional
rigor, align instructional practices, and vet assessment questions to ensure they match the level of rigor required
for students to be Proficient/Distinguished on the K-PREP assessment.
Finally, to provide the level of instruction necessary to meet the individual needs of students and the learning
expectations of the school, school leaders are encouraged to establish and implement systematic processes for
monitoring and adjusting instruction based on the rigor of the Kentucky Academic Standards and current research
about the effectiveness of instructional practices and student learning needs. This could include frequent
classroom observations, meaningful and targeted feedback, follow-up observations, ongoing support, and data-
driven decisions to identify and address individual student academic needs. Lastly, the Diagnostic Review Team
encourages the school to use these findings as leverage points for establishing processes to monitor instruction in
order to ensure that students are engaged in differentiated learning opportunities that meet their diverse needs.
Next Steps
The results of the Diagnostic Review provide the next step for guiding the improvement journey of the institution
with their efforts to improve the quality of educational opportunities for all learners. The findings are aligned to
research-based criteria designed to improve student learning and organizational effectiveness. The feedback
provided in the Diagnostic Review Report will assist the institution in reflecting on current improvement efforts
and adapting and adjusting their plans to continuously strive for improvement.
Upon receiving the Diagnostic Review Report, the institution is encouraged to implement the following steps:
• Review and share the findings with stakeholders.
• Develop plans to address the Improvement Priorities identified by the Diagnostic Review Team.
• Use the findings and data from the report to guide and strengthen the institution’s continuous improvement
efforts.
• Celebrate the successes noted in the report.
Team Roster
Diagnostic Review Teams comprise professionals with varied backgrounds and professional experiences. All Lead
Evaluators and Diagnostic Review Team members complete AdvancED training and eleot® certification to provide
knowledge and understanding of the AdvancED tools and processes. The following professionals served on the
Diagnostic Review Team:
Sam Watkins Sam Watkins is currently in year 33 of serving students in Kentucky. He has served
in the capacity of teacher, assistant principal, athletic director, principal, director
of districtwide programs and Education Recovery Leader. Mr. Watkins earned his
bachelor’s degree in teaching at Eastern Kentucky University and a master’s
degree in business administration. He currently is working with focus districts
across the Commonwealth of Kentucky to improve student academic
performance.
Peebles Lancaster Ms. Pebbles Lancaster currently serves as an Education Recovery Specialist for the
Kentucky Department of Education and is assigned to Dawson Springs Elementary
School and Carr Elementary School. She is in her 28th year of education. Her
experiences consist of classroom elementary educator and school improvement
specialist. For the past 11 years, she has been actively involved with school
improvement work and has extensive experience with analysis of curriculum,
instruction, assessments, and systems. She holds a bachelor’s degree in early
childhood education, a master’s degree in gifted and talented education, and a
Rank I in reading. She has also earned additional certifications, including National
Board, principal, instructional supervisor, superintendent, and School
Improvement Specialist.
John Slone Mr. Slone is currently the director of technology and federal programs for the Bath
County School System. He has 23 years of educational experience as both a
teacher and administrator. Mr. Slone received his bachelor’s and master’s degrees
in vocational education at Morehead State University. He received his Rank I in
educational administration from Xavier University. Mr. Slone served most recently
as principal for four years at Bath County Middle School and eight years as
assistant principal at Scott High School where he developed his skills in curriculum,
continuous school improvement, finance, and personnel. As an agriculture
teacher, he worked in Ohio and Kentucky with students on leadership
development and served as a state officer for the Kentucky Vocational Agriculture
Teachers Association. Mr. Slone has served on several Diagnostic Reviews and he
has also received training through the Center for Creative Leadership.
Addenda
Student Performance Data for Semple Elementary Schools
Section I:
School and Student Proficiency and Separate Academic Indicator Results
Content Area %P/D School %P/D State %P/D School %P/D State
(16-17) (16-17) (17-18) (17-18)
“All Student “All Student Group”
Group”
Reading 3rd 21.0 55.8 19.4 52.3
Plus
• The percentage of students scoring Proficient/Distinguished in fifth-grade math increased from 25.9
percent in 2016-2017 to 28.9 percent in 2017-2018.
• The percentage of students scoring Proficient/Distinguished in third-grade math increased from 18.5
percent in 2016-2017 to 19.4 percent in 2017-2018.
Delta
• In all grade levels and all content areas, the percentage of students scoring Proficient/Distinguished was
below the state average in both 2016-2017 and 2017-2018.
• Science had the lowest percentage of students scoring Proficient/Distinguished in 2017-2018 with 9.5
percent of students reaching that level.
• The percentage of students scoring Proficient/Distinguished in writing was 14.4 in 2017-2018.
Section II:
Student Growth Index (2017-2018)
EL 30.9 31.9
Plus
• The student Growth Index for English learners (EL) was within one point of the state index.
Delta
• The student Growth Index in 2017-2018 in reading, math, English learners (EL) and Growth Indicator all
lagged behind the state.
Plus
• The percentage of Hispanic students scoring Proficient/Distinguished in math was 31 percent in 2017-
2018.
• The percentage of students of two or more races scoring Proficient/Distinguished in reading was 30.4
percent in 2017-2018.
Delta
• The percentage of students in the consolidated student group scoring Proficient/Distinguished in reading
was 16.1 in 2017-2018.
• The percentage of students in the consolidated student group scoring Proficient/Distinguished in science
was 5.6 in 2017-2018.
• The percentage of students with disability (no ALT) with accommodation scoring Proficient/Distinguished
in math was four percent in 2017-2018.
Schedule
Monday, February 11, 2019
12:30 p.m. – Lunch – Team Members eat when it can fit into their individual School/District
1:00 p.m. schedule
1:00 p.m. – Continued classroom observations and stakeholder interviews School/District Diagnostic Review
2:30 p.m. Team Members
2:30 p.m. – Interviews Diagnostic Review
5:30 p.m. Team Members
5:30 p.m. – Team returns to hotel (after dismissal) and has dinner on their own Diagnostic Review
6:00 p.m. Team Members
6:00 p.m. – Team Work Session #2 Hotel Conference Diagnostic Review
9:00 p.m. Room Team Members
Written The written report will be provided to the institution or DOE within 30 AdvancED
Report days following the on-site Diagnostic Review.
About AdvancED
professionals in the world. Founded on more than 100 years of work in continuous improvement,
AdvancED combines the knowledge and expertise of a research institute, the skills of a management
consulting firm and the passion of a grassroots movement for educational change to empower
Pre-K-12 schools and school systems to ensure that all learners realize their full potential.
©Advance Education, Inc. AdvancED® grants to the Institution, which is the subject of the Engagement Review Report,
and its designees and stakeholders a non-exclusive, perpetual, irrevocable, royalty-free license, and release to
reproduce, reprint, and distribute this report in accordance with and as protected by the Copyright Laws of the United
States of America and all foreign countries. All other rights not expressly conveyed are reserved by AdvancED.