EES Joint Survey Results

Aloha Colleagues,



The DOE recently wrote that the EES is a work in progress.



HSTA, the DOE, and the BOE have agreed to a process in reviewing the implementation of EES and make recommendations for adjustments by the end of the year. The agreed-upon process is that we will make necessary changes based on input from stakeholders like you, the practitioners and experts in the classroom.



Part of this process is giving teachers a chance to have direct input through an advisory committee and a joint committee where teachers sit at the table with the DOE.
We are encouraged by their work throughout the year and I want to thank not only the teachers on these committees, but you for responding to the monthly polls, the recent joint survey, and all you are doing inside and outside the classroom.



Please see the HSTA-DOE news release below regarding the results of the recent joint EES survey.  It reflects input from teachers, the agreed-upon EES process, and steps forward to make changes and improvements that support an evaluation system that is designed to improve the practice of teaching that results in improved student learning.



As teachers, we, want a system that works in the best interests of teachers and the students they teach, but it needs to be done right.


Wil Okabe
President


For Immediate Release: April 7, 2014

Hawaii State Department of Education and Hawaii State Teachers Association
Release Teacher Survey Results Regarding Educator Effectiveness System

HONOLULU – The Hawaii State Department of Education (DOE) and the Hawaii State Teachers Association (HSTA) recently conducted a joint survey regarding the Educator Effectiveness System (EES), which was implemented statewide at the beginning of the 2013-14 school year. The purpose of the joint survey was to gather teacher feedback on their experiences and opinions regarding the EES to help better understand its strengths and identify areas for improvement.

Funded by the Castle Foundation and conducted by Ward Research Inc., the online survey was sent to the HSTA’s 13,500 teacher members, 4,280 (30%) of which completed the survey between the Feb. 25 and March 11 survey period. Respondents represented all districts and types of teachers. This level of response provides a maximum sampling error of only +/- 1.3 percent.

Results from the survey indicate varying degrees in understanding the EES and provide a good starting point in better identifying areas for improvement. Key survey findings include:

•One in five respondents indicated high levels of understanding of the EES (18% rating ‘top three’ box or 8-10 where 10 = completely understand) while a comparable proportion indicated low levels of understanding of the EES (20% rating ‘bottom three’ box or 1-3 where 1 = do not understand at all)
•Classroom Observations reflected the highest levels of reported understanding (36%) and the Hawaii Student Growth Model the lowest (12%)
•One in five respondents indicated strong agreement (‘top three’ box or 8-10 rating where 10 = strongly agree) that they have applied the EES information towards improving their professional practice (18%), their instructional practice (18%), and toward improving student growth and learning (18%)
•An emerging theme identified in the survey was providing teachers more time to prepare for the various requirements within the components, more guidance and clarity, and providing examples of successful stories by distinguished teachers

“The Department of Education is actively engaged in an ongoing data review process that involves working with teachers, principals and other groups,” said Schools Superintendent Kathryn Matayoshi. “The EES is intended to provide timely, actionable and professional feedback, and support to improve teacher practice and student outcomes. We’re grateful to the teachers and various groups who are ensuring that the system fairly assesses the effectiveness of educators. This survey will be used as part of a collective process to help better understand strengths and identify areas for improvement.”

“The HSTA’s goal is to make sure that every child in Hawaii has access to the best teachers in our public school system,” said Wil Okabe, HSTA president. “When we started this process, we agreed that the Joint Committee of DOE and HSTA representatives would gather data and feedback from our members in order to implement collaborative adjustments and improvements to the EES.”

“The joint survey reflected what we have been hearing from teachers. That the EES is a work in progress, and teachers feel that more needs to be done so that the EES can help improve the practice of teaching. Our teachers clearly expressed the need for more time to implement the EES, more guidance, and more clarity of the expectations and process,” said Okabe.

“We are committed to the EES and will continue to collaborate with the DOE to improve this system and develop a fair and effective resource that should be designed to, ultimately, improve our educational system for Hawaii’s students,” added Okabe. 

The committee has met four times over the last nine months and provided areas of potential recommendations to Superintendent Matayoshi, including:

•Improving support for implementation (e.g. training structure, educator engagement strategy),
•Solutions for new teachers (e.g. personnel consequences for SY 13-14 first-year teachers, differentiating evaluation criteria for first and second year teachers),
•Supporting structures for teachers based on EES feedback and results (e.g. searchable database for teachers to find quality professional development opportunities based on area of need),
•Transitioning between student assessments (impact on student growth as the state shifts from the Hawaii State Assessments, to the bridge assessments, and Smarter Balanced Assessments),
•Differentiating frequency of evaluation components within the annual evaluation cycle, based on the needs of teachers,
•Reviewing scoring methodology for the Tripod student perception survey, and
•Monitoring the use of multiple measures.

The Joint Committee is one of several feedback groups the DOE relies upon for structured input about EES. Other groups include the Teacher Leader Workgroup and Technical Advisory Group and a newly established Principal Workgroup.

“The survey results reinforce priority issues that are being discussed by the Joint Committee and raise some additional concerns for further discussion,” noted Matayoshi. “Teachers, administrators and the HSTA are all involved in this process, and this is just the beginning.”

The DOE and HSTA are committed to working together to improve the EES and teacher feedback is an important part of the improvement process. Following the first full year of implementation, the DOE will make any design improvements necessary based on reviews of data and consideration of feedback from the field.

# # #

About the Hawaii State Department of Education
The Hawaii State Department of Education is the ninth-largest U.S. school district and the only statewide educational system in the country. It is comprised of 255 schools and 33 charter schools, and serves more than 185,000 students.  King Kamehameha III established Hawaii’s public school system in 1840. The DOE is in the midst of a range of historic efforts to transform its public education system to ensure graduates succeed in college or careers. To learn more, visit HawaiiPublicSchools.org.

About the Hawaii State Teachers Association
The Hawaii State Teachers Association is the exclusive representative of more than 13,500 public school teachers statewide. As the state affiliate of the more than 3-million-member National Education Association, HSTA represents and supports teachers in collective bargaining, as well as with legislative and professional development issues.

Contacts:

DOE
Donalyn Dela Cruz
Director of Communications
Phone:  (808) 586-3232
E-mail:  .(JavaScript must be enabled to view this email address)

HSTA
Lea Okudara
Stryker Weiner & Yokota
Phone: (808) 523-8802
E-mail: .(JavaScript must be enabled to view this email address)

Read Ward Research Executive Summary HERE » (pdf)

NEWS COVERAGE:
Note the following links take users away from the HSTA Web site and may be moved or time sensitive.

HONOLULU STAR-ADVERTISER

Evaluation system unclear to isle teachers, survey finds


By Nanea Kalani

Fewer than 1 in 6 Hawaii public school teachers say they fully understand how their performance rating is calculated under the state’s controversial new evaluation system for teachers — which starting next school year will tie ratings to pay raises, tenure and termination — according to survey results released Monday.

A joint survey of teachers by the state Department of Education and Hawaii State Teachers Association also found 20 percent of respondents do not understand the evaluation system overall.

The head of the teachers union says the results are consistent with concerns teachers have been raising since the evaluations were implemented statewide last fall, including a lack of clarity about the system’s design and the need for more time to prepare for the six areas measured by the evaluations.

“Eighteen percent (of teachers) felt they truly understand this evaluation system — only 18 percent of the whole membership,” HSTA President Wil Okabe said in an interview. “Twenty percent said they don’t know anything about it. Everyone else is somewhere in the middle. There needs to be a way to create understanding for everybody in order for these evaluations to be equitable and fair.”

A joint committee made up of state DOE and HSTA officials conducted the survey, which was done by Ward Research and funded by the Castle Foundation. About 32 percent of HSTA’s 13,500 members, or 4,280 teachers, completed the online survey, which has a margin of error of 1.3 percentage points.

The joint committee is called for in teachers’ 2013-17 labor contract to review the design, validity, reliability and supports for the performance evaluations — known as the Educator Effectiveness System, or EES — and recommend changes to improve its design and implementation. The committee has met four times in the past nine months.

“The DOE has made very clear that this is a work in progress,” Okabe said. “What’s clear from this survey and polls that HSTA has been doing is that the current system is taking a lot of time. We don’t want to have a system that’s taking away from student learning.”

An executive summary prepared by Ward Research said that “when asked for suggestions or comments as to what else can be done to improve their performance or understanding of the (Educator Effectiveness System), respondents, overall, asked for more time” to prep for evaluation as well as more constructive feedback and guidelines.

Overhauling teacher evaluations was a key pledge in the state’s application for its $75 million federal Race to the Top grant.

Under the EES, half of a teacher’s annual evaluation is based on student learning and growth, measured in part by academic growth on student test scores. The other half is based on teaching practices and is rated through classroom observations and student surveys.

Overall, there are six parts comprising an evaluation: classroom observations, student surveys, core professionalism, student learning objectives, working portfolio, and academic growth on test scores.

The joint survey found varying degrees of understanding among teachers of the six pieces. For example, more respondents said they understand the classroom observation (36 percent) and student survey (25 percent) pieces, while fewer said they understand how test scores are counted (12 percent).

Only teachers rated as effective or highly effective will be eligible for pay increases in the year after an evaluation. Teachers rated as marginal will be given an opportunity to improve and appeal the rating.

An unsatisfactory rating will be cause for termination.

The joint survey found only 16 percent of teachers fully understand how their final performance rating is calculated for their evaluation.

“We are hopeful that the results will be looked at with an objective eye and that refinements will be made to the current system so that the ultimate goal of an effective and caring teacher in every classroom is achieved,” said Deanne Yoshi­oka, coordinator of Aina Haina Elementary School’s International Baccalaureate program.

Yoshioka and 36 other Aina Haina Elementary teachers signed a letter earlier this year that aimed to highlight challenges teachers are facing with the evaluation system and offer sug­gestions to improve it. The letter was sent to state lawmakers, DOE and HSTA officials, and the U.S. Department of Education.


HAWAII NEWS NOW
http://www.hawaiinewsnow.com/story/25186569/hawaii-teacher-evaluation

Hawaii teachers rate new evaluation system

Posted: Apr 07, 2014 2:20 PM HST
Updated: Apr 07, 2014 6:55 PM HST
By Lisa Kubota


HONOLULU (HawaiiNewsNow) -
More than a year after Hawaii’s teachers agreed to their new contract, some still don’t understand the student evaluation system that will factor into their salaries. The Hawaii State Department of Education and the Hawaii State Teachers Association just released results of a teacher survey on the Educator Effectiveness System (EES). The online survey was sent to the HSTA’s 13,500 teacher members. 30% of them completed the survey between Feb. 25 to March 11.

Key findings include:

20% of respondents indicated low levels of understanding of the EES by marking the “bottom three” box or 1-3 where 1 = do not understand at all. 18% indicated high levels of understanding of the EES by marking the “top three” box or 8-10 where 10 = completely understand.

Based on top-three box ratings, more respondents understand Classroom Observations (36%), while fewer understand the Hawaii Growth Model (12%).

Teachers are now evaluated by students in grades K-12 as part of the EES. The student survey, which is administered twice during the school year, is designed to provide classroom feedback to improve teaching and learning.

Kaimuki High School teacher M.J. Matsushita took the EES survey. She believes the state has not done a good job rolling out the evaluation system statewide.

“We’d have some professional development training and we’d frankly come out more confused or upset than when we went into it in the first place,” said Matsushita.

According to the survey, a common complaint was that teachers need more guidance and time to prepare for the requirements.

“It’s taking the teachers so much time to do this, which is a snapshot of the evaluation piece of what they do,” said HSTA president Wil Okabe.

“It gives us a lot of information that we can act on. It gives us points of validation and also points of challenge where we need to improve. I think it’s premature to be issuing a grade, so to speak, on it,” said DOE deputy superintendent Ronn Nozoe.

As part of the controversial system, children grade the teachers in seven areas. The student surveys will count for 10% of the instructor’s evaluation. For most teachers, next year’s results will be used to determine whether they receive a pay raise.

“This is a huge transformational shift for our entire Department of Education, and I would argue, for the state of Hawaii,” said Nozoe. “So to expect that there are going be bumps along the way, there are going to be disagreements, there’s gonna be questions and apprehension, of course”

A joint committee of DOE and HSTA representatives will use the data to recommend improvements to the DOE superintendent.


KHON - CHANNEL 2 NEWS

(SEE PICTURE OF CLASSROOM - CLICK ON ARROW TO VIEW STORY)

http://khon2.com/2014/04/07/hi-teachers-evaluate-educator-effectiveness-system/

HI teachers evaluate Educator Effectiveness System
By Web StaffPublished: Monday, April 7, 2014, 8:03 pm

According to Hawaii teachers, more needs to be done to improve the Educator Effectiveness System which was implemented statewide at the beginning of the 2013 to 2014 school year.

The Department of Education and the Hawaii State Teachers Association recently surveyed over 13,000 teachers between Feb. 25 and Mar 11.

Of the 4,200 who responded, only 18 percent felt like they really understood the system.

“I think that our teachers clearly expressed the need for more time to implement the EES. More guidance, more clarity of the expectations of the process. And I think that’s what the data shows,” HSTA President Will Okabe said.

The EES is designed to help students learn in the classroom by evaluating teachers and their effectiveness with their students.

The next step is for the Hawaii State Teachers Association and the Department of Education to work together to come up with recommendations to present to the schools superintendent.

THE GARDEN ISLAND

‘A work in progress’

 
Posted: Tuesday, April 8, 2014
Lisa Ann Capozzi

LIHUE — Survey results released Monday said some state teachers are looking for a change.

The joint survey, conducted by the Hawaii State Department of Education and the Hawaii State Teachers Association, took in feedback on the Educator Effectiveness System and found some educators want the program revamped.

About 30 percent of teachers polled statewide responded. It found that one in five respondents indicated high levels of understanding the EES program while a comparable proportion indicated low levels of understanding of the EES.

One in five respondents indicated strong agreement that they have applied the EES information toward improving their professional practice, their instructional practice and toward improving student growth and learning.

“The joint survey reflected what we have been hearing from teachers,” said Wil Okabe, HSTA president. “That the EES is a work in progress, and teachers feel that more needs to be done so that the EES can help improve the practice of teaching. Our teachers clearly expressed the need for more time to implement the EES, more guidance, and more clarity of the expectations and process.”

A news release from the governor’s office said there were varying degrees in understanding the EES, but that it provided a good starting point in better identifying areas for improvement.
·An emerging theme identified in the survey was providing teachers more time to prepare for the various requirements within the components, more guidance and clarity, and providing examples of successful stories.

Kathryn Matayoshi, state schools superintendent, said the Department of Education is working with teachers, principals and other groups to review the survey results.
“The EES is intended to provide timely, actionable and professional feedback, and support to improve teacher practice and student outcomes,” she said.

The system has been controversial on Kauai, as some educators believe it places too much burden on teachers.
Kilauea School sixth-grade teacher Judy Waite said her first impression of the results and the state’s reaction means the state isn’t listening to teachers’ concerns.
“It seems that they are looking at the results through the filter of their desire and assumption that the EES works,” she said. “It doesn’t. We were lied to by the state, and were told that we would have an equal voice in changing or eliminating parts of the evaluation, and now we learn that we could get fired as early as next year for poor evaluations, on standards that we have not been trained in or learned. I feel that for the board to say that survey results show success of the EES is just one more bullying blow.”
Terry Low, Kauai High School teacher, agreed.

“The release of the findings of the joint survey provides nothing to change my views,” he said. “My fear is that the DOE will continue to try and roll out what Michael Kline has termed a train wreck, believing that it just needs tweaking. If that happens, I believe morale will be even lower next year than this year.”