[1. Agenda for the May 4, 2021 Superintendent Evaluation Criteria Development Committee] [00:00:03] >> SO WHAT WE'RE SUPPOSED TO BE WORKING ON IS TALKING ABOUT THE 360. WE ASKED FOR THE TEAM TO JOIN US TO KIND OF GIVE INSIGHT AROUND YOU KNOW THE CONCEPT THAT WE WORKED ON. WE WANTED TO MAKE SURE IT WAS ALIGNED WITH WHAT THE COMMITTEE SHARED WITH US PREVIOUSLY. CINDY, YOU WEREN'T A PART OF THAT PARTICULAR SESSION BUT IT'S REALLY THE GOAL OF A 360 IS TO GIVE FEEDBACK ON PROGRESS AND KIND OF LIKE WHAT WE'RE AIMING TO SEEK AS OUR OUTCOMES. HOW FAR HAVE WE COME WITH THAT. I THINK IT'S BETTER FOR A THIRD PARTY TO JOIN US. I DON'T KNOW, JENNIFER, MARY KATE, SUSAN HAVE YOU INTRODUCED US. >> HAPPY TO DO THAT NOW IF THAT'S HELPFUL. >> OKAY. PERFECT. APPRECIATE THE TIME WITH THIS GROUP THIS MORNING. SO AS DR. HUTCHINGS MENTIONED, WE'RE THE TEAM FROM HANOVER RESEARCH. I'M MARY KATE HANOVER AND SEVEN WITH ACPS. I AM JOINED WITH JENNIFER JONES WHO SERVES AS DIVISION'S CONTENT DIRECTOR. MANAGES THE RESEARCH THAT WE DO ON THE DIVISION'S BEHALF AND DR. SUSAN GROUNDWATER WHO IS A SENIOR RESEARCH ADVISOR ON OUR TEAM. WHAT WE'RE HOPING TO USE THE TIME FOR THIS MORNING IS TO BE ABLE TO PLUG INTO THE SUB COMMITTEE WALKING THROUGH THE 360 SURVEY DRAFT WE HAVE DESIGNED. TALK THROUGH THE HIGH LEVEL THE CONTRACTS WE'RE FOCUSING ON. CERTAINLY ANSWER QUESTIONS AND GET FEEDBACK ON THE SURVEY INSTRUMENT AS WE PREPARE TO LAUNCH THAT AS A COMPONENT OF THE EVALUATION. >> THANK YOU. MARY KATE. CONGRATULATIONS TO CLINT PERHAPS. HE WILL WATCH THIS. YOUR STORY REMINDS ME WHEN I HAD MY FIRST SON AND I HAVE FOUR. I MADE IT TO THE HOSPITAL WITHIN 30 MINUTES BECAUSE I WAS WATCHING THE CLEVELAND CAVALIERS IN THE PLAYOFFS THAT YEAR. I WAS REFUSING TO GO UNTIL THESE WERE THE GOOD OLD DAYS WHEN LEBRON WAS REALLY DOING HIS THING. SO YOUR STORY REMINDS ME OF THAT. SO CONGRATULATIONS TO HIM. AND THANK YOU ALL SO MUCH FOR INVITING US HERE ON THIS TUESDAY MORNING TO REALLY SHARE THE DESIGN OF THIS SURVEY. I'M HAPPY TO WALK THROUGH IT AT A HIGH LEVEL. BUT I'M ALSO HAPPY TO STOP AND PAUSE WHEREVER NECESSARY TO ANSWER ANY QUESTIONS AND TAKE ANY FEEDBACK THAT YOU MAY HAVE AWAY. I DID SEND IT TO TINA YESTERDAY BUT I KNOW IT WAS A BUSY MONDAY MORNING. SO I WILL JUST ASK IF THERE ARE ANY INITIAL QUESTIONS BEFORE I DO THE FAVORED SCREEN SHARE AND KIND OF WALK THROUGH THE INSTRUMENT. >> NO, I THINK GOING -- >> HOPEFULLY I HAVE RIGHTS TO DO THAT. YES, YOU SHOULD BE ABLE TO SCREEN SHARE. >> WONDERFUL. THANK YOU FOR THAT. I DO NOT WANT TO SHARE MY WHOLE SCREEN BECAUSE I'M NOTORIOUS FOR HAVING A LOT OF WINDOWS OPEN. YOU CAN LET ME KNOW. IF YOU SEE TABLE OF CONTENT IS THAT WHAT YOU'RE SEEING RIGHT NOW? >> YES. >> OKAY. WONDERFUL. SO HOW WE CAME ABOUT BASICALLY DESIGNING THIS SURVEY IS WE DID OUR HOMEWORK BY REALLY CLOSELY REVIEWING THE SEVEN PERFORMANCE STANDARDS THAT WERE SHARED FROM THE DIVISION AND THAT REALLY ORIGINATED FROM THE DEPARTMENT OF EDUCATION THERE IN VIRGINIA. AND SO YOU WILL NOTE HERE THAT WITHIN THE SURVEY INSTRUMENT WE HAVE DIVIDED REALLY THE CONTRACT CONSTRUCTS OF THE SURVEY BASED ON THE SEVEN STANDARDS. IN TERMS OF KIND OF THE LOGISTICS OF THE SURVEY, WE HAVE STARTED TALKING ABOUT THE STAKEHOLDERS THAT WOULD BE ACTUALLY TAKING THE SURVEY AND KNOW THAT WE TALKED WITH DR. HUTCHINGS AND CLINT AND OTHERS ON THE TEAM ABOUT THAT. SO, WE KNOW THAT, THAT'S WHY I HAVE DRAFT ACROSS THIS INSTRUMENT BECAUSE WE'RE STILL WAITING FOR MORE FEEDBACK FROM THE DIVISION IN TERMS OF THE SPECIFIC STAKEHOLDERS THAT WILL BE RECEIVING THE INSTRUMENT. THEN AT THE BEGINNING OF THE INSTRUMENT WE JUST HAVE IMPORTANT BACKGROUND QUESTIONS AND THESE BACKGROUND QUESTIONS ALLOW US TO REALLY SEGMENT THE DATA ONCE THE SURVEY HAS BEEN COMPLETE. SO FOR EXAMPLE, SEGMENTING THE SPECIFIC STAFF ROLES AT ACPS, THE COMMITTEES, SO IF THERE ARE ANY COMMITTEE MEMBERSHIPS THAT WOULD BE IMPORTANT TO NOTE WHEN WE [00:05:03] BEGIN TO THINK ABOUT OUR COMMUNITY MEMBERS AND BEING ABLE TO SEGMENT THEM BASED ON THEIR BACKGROUND. AND THEN ALSO FOR PARENTS. SO, IF WE PROVIDE THE INSTRUMENT TO PARENTS, FINDING OUT WHAT SCHOOL THEY ARE ASSOCIATED WITH, WHICH IS ON THE NEXT PAGE, HUM CHILDREN THEY HAVE AND STUDENTS AS WELL. WE BEGAN TALKING ABOUT PERHAPS HIGH SCHOOL STUDENTS WITH THIS SURVEY. ANYONE BELOW THE GRADE OF NINE MAY NOT RECEIVE THIS AND THAT'S WHY WE HAVE THEM DISQUALIFIED. IT'S IMPORTANT TO BEGIN WITH THE BACKGROUND SO WHEN WE SEGMENT THE DATA, EVEN THOUGH IT'S AN ANONYMOUS SURVEY, WE'RE ABLE TO SEE WHERE THE PERCEPTIONS ARE ORIGINATING. ANY QUESTIONS ON THE BACKGROUND SECTION? OKAY. SO WHAT I DID, IS I KNOW THE PERFORMANCE STANDARDS ARE VERY SPECIFIC BUT BECAUSE WE'RE IN A VIRTUAL MEETING AND THERE'S A LOT OF TEXT, I HAVE JUST GONE THROUGH AND HIGHLIGHTED THE KEY POINTS OF EACH PERFORMANCE STANDARD AND SO THAT'S WHY YOU WILL SEE THE GOLD HIGHLIGHTING. WITHIN EACH SURVEY CONSTRUCT, THERE ARE SEVERAL DESCRIPTORS AND I HAVE ALSO HIGHLIGHTED ONE OR TWO THAT REALLY SPEAK TOWARD THAT PERFORMANCE STANDARD. THE FIRST DISCUSSES HOW WELL THE SUPERINTENDENT WORKS WITH THE SCHOOL BOARD IN ORDER TO REALLY IMPLEMENT THE DIVISION MISSION, VISION AND GOALS. AND SO AGAIN THIS FULL CONSTRUCT HERE REALLY GETS AT HOW WELL THE SUPERINTENDENT HAS ESTABLISHED A PRODUCTIVE RELATIONSHIP WITH THE BOARD, HOW HE'S GONE FROM DEVELOPING THAT RELATIONSHIP TO IMPLEMENTING MANY OF THESE ACTION ITEMS AND THEN OVERSEEING THE ADMINISTRATION OF THE MISSION, VISION AND GOALS. GOING FROM DEVELOPING TO IMPLEMENTING TO OVERSEEING. AND AGAIN THERE ARE DESCRIPTORS THAT REALLY CONNECT TO THAT FIRST PERFORMANCE STANDARD ABOUT THE SUPERINTENDENT'S ABILITY TO WORK WELL WITH THE BOARD. ANY QUESTIONS ON THE FIRST STANDARD? OKAY. MOVING RIGHT ALONG TO THE SECOND STANDARD WHICH REALLY DISCUSSES HOW WELL THE SUPERINTENDENT USES A VARIETY OF DATA AND A VARIETY OF METRICS TO REALLY GUIDE THE PLANS, GUIDE KEY DECISIONS THAT ULTIMATELY RESULT IN ACADEMIC PROGRESS IN STUDENT SUCCESS. SO WE HEARD FROM DECADES. I HAVE BEEN IN EDUCATION OVER 20 YEARS NOW AND ALWAYS HEARD DATA DRIVES INSTRUCTION. HOW DOES DATA DRIVE INSTRUCTION? WHAT METRICS ARE AVAILABLE IN THE DISTRICT THAT CAN BE ANALYZED IN ORDER TO LEAD TO ACADEMIC SUCCESS? AND SO THAT IS WHAT THIS CONSTRUCT FOCUSES ON HERE. I JUST HIGHLIGHTED THAT THIS RELATES TO PROMOTING THE AWARENESS AND USE OF RELEVANT DATA AMONG THE DIVISION TO IMPROVE INSTRUCTIONAL PROGRAMS. A KEY POINT HERE IS WE'RE TALKING ABOUT RELEVANT DATA. IN 2021, THERES NO SHORTAGE OF DATA. I'M SURE IT'S COMING AT YOU LEFT AND RIGHT ALL DAY LONG. WHAT PART OF THAT DATA IS RELEVANT AND HELPS LET YOU KNOW THE DIVISION KNOW WHETHER WE'RE HEADED TOWARD AN INCREASE IN STUDENT SUCCESS. THIS IS A LONGER SECTION, THERE ARE ACTUALLY TWO PAGES THAT CONNECT TO THAT SECOND PERFORMANCE STANDARD. THE THIRD PERFORMANCE STANDARD TALKS ABOUT MAKING SURE THAT THE SUCCESS OF TEACHERS STAFF, STUDENTS ARE ALL TAKEN INTO ACCOUNT IN ORDER TO REALLY DEVELOP AN IMPLEMENTATION OF EFFECTIVE TEACHING AND LEARNING. THIS REALLY GETS AT THE CORE OF WHAT WE'RE HERE FOR. [00:10:02] WE'RE HERE TO MAKE SURE TEACHERS ARE EFFECTIVELY INSTRUCTING THE STUDENTS THAT ARE BEFORE THEM TO LEAD TO THAT KEY LEVEL OF ACADEMIC SUCCESS. HOW WELL IS THE SUPERINTENDENT ABLE TO FOSTER THIS LEVEL OF SUCCESS FOR TEACHERS AND STAFF. AND HERE I HAVE JUST HIGHLIGHTED THE FIRST DESCRIPTOR WHICH DISCUSSING THE SUPERINTENDENT'S ABILITY TO REALLY COMMUNICATE A CLEAR VISION OF EXCELLENCE AND CONTINUOUS IMPROVEMENT FOR THE DIVISION. THIS PERFORMANCE STANDARD ALSO TALKS ABOUT THE CURRICULUM THERE IN ACPS. HOW WELL ARE WE ENSURING THAT CURRICULUM IS MOST IMPORTANT FOR THE KEY STAKEHOLDERS AND OUR KEY IS TO MAXIMIZE STUDENT LEARNING. THE FOURTH PERFORMANCE STANDARD IS DISCUSSES HOW WELL THE SUPERINTENDENT IS ABLE TO FOSTER REALLY THE SAFETY AND SUCCESS OF ALL TEACHERS, STAFF AND STUDENTS BY SUPPORTING, MANAGING AND EVALUATING THE DIVISION'S ORGANIZATION OPERATION AND USE OF RESOURCES. SO AGAIN, I'M SURE THERE ARE A LOT OF RESOURCES THERE IN ACPS BUT HOW WELL ARE THEY UTILIZED IN ORDER TO ENSURE THE SUCCESS OF THE STUDENTS AND HOW WELL ARE OR HOW QUICKLY I WOULD SAY IS SUPERINTENDENT ABLE TO IDENTIFY AND ANALYZE ANY PROBLEMS THAT MAY ARISE AND USE THESE RESOURCES TO WORK TOWARDS A SOLUTION. SO HERE WE HAVE LISTED ANY PROBLEMS RELATING TO FACILITIES, SCHOOL SAFETY, THE TAG PROGRAM, STUDENTS WITH DISABILITIES, HUMAN RESOURCES, AND I DON'T REALLY WANT TO HONE IN BUT RETRACT WHAT I SAID. I DON'T WANT TO HONE IN ON THESE BEING A PROBLEM, THESE ARE NOT PROBLEMS BUT GO BACK TO THE VERB THAT SAYS RESOLVING OR ADDRESSING THE PROBLEMS AND, WORKING TOWARDS SOLUTION. THIS PERFORMANCE STANDARD ALSO DISCUSSES THE ABILITY TO IMPLEMENT SOUND JUDGMENT AND SOUND PERSONNEL PROCEDURES WHEN WE THINK ABOUT RECRUITING, HIGHLY-QUALIFIED TEACHERS AND STAFF. >> SO AS YOU'RE GOING THROUGH -- >> GO AHEAD. >> AS YOU'RE GOING THROUGH THIS. ONE THING I WANT TO REITERATE TO THE TEAM, I THINK WE'RE GOING TO NEED TO GO THROUGH SOME OF THESE KIND OF LIKE INDICATORS TO MAKE SURE THAT THEY ARE ALIGNED WITH THE AREAS OF FOCUS FOR THIS YEAR. THE THINGS THAT ARE NOT ALIGNED WITH THE AREAS OF FOCUS FOR THIS YEAR, I THINK WE NEED TO TAKE OUT OF THE SURVEY AND THE REASO WHY I SAY THAT IS BECAUSE AT THE BEGINNING OF THE YEAR, THE BOARD APPROVED AREAS OF FOCUS FOR THE SCHOOL DIVISION AND THAT DROVE MY EVALUATION ARTIFACTS. SO I WANT TO MAKE SURE THAT I'M BEING EVALUATED EVEN THROUGH A 360 FEEDBACK ON THE THINGS I WAS FOCUSED ON FOR THE YEAR. SO THIS COULD CHANGE EACH YEAR. NOT SUPPOSED TO BE A SURVEY THAT'S USED WITH THE SAME QUESTIONS EVERY SINGLE YEAR. REALLY IT'S SUPPOSED TO BE FOCUSED ON THE AREAS THAT I HAVE BEEN CHALLENGED TO FOCUS ON FOR THIS YEAR. ANOTHER PIECE I THINK WE'RE GOING TO HAVE TO DO IS ENSURE THAT WE HAVE ARTIFACTS THAT GO ALONG WITH THIS BECAUSE ONE THING THAT I KNOW WE DISCUSSED AS A COMMITTEE AT THE BEGINNING OF THIS AND COMMITTEE MEMBERS, I KNOW CINDY YOU WEREN'T HERE BUT CHRIS WAS A PART AND VERONICA NOLAN WAS A PART AND MEAGAN, MAKING SURE THAT WE ARE NOT BEING SUBJECTIVE WITH OUR ANALYSIS BECAUSE YOU KNOW MY EVALUATION CANNOT BE BASED OFF OF PEOPLE'S FEELINGS OR OPINIONS. IT REALLY HAS TO BE BASED OFF FACTS, AND THAT IS GOING TO BE KEY FOR US. SO HAVING ARTIFACTS THAT GO ALONG WITH THIS IS VERY IMPORTANT SO THAT PEOPLE CAN MAKE AN OBJECTIVE KIND OF DECISION WHEN THEY'RE SELECTING WHETHER IT'S EFFECTIVE OR INEFFECTIVE. SO I JUST THINK THOSE ARE KEY POINTS THAT I THINK THIS IS SOLID, I JUST WANT TO MAKE SURE IT'S ALIGNED WITH WHAT WE HAVE IN REGARDS TO OUR AREAS OF FOCUS. ALL OF THE ARTIFACTS THAT I AM COLLECTING THROUGHOUT THE YEAR, THEY'RE GOING TO BE AVAILABLE FOR OUR PARTICIPANTS IN THIS 360. >> I THINK THAT IS A KEY POINT AND ONE THAT MARY KATE AND SUSAN AND I WERE ANYTHING TO BRING UP. THERE ARE SPECIFIC INDICATORS WITHIN THE EVALUATION THAT WE WILL CERTAINLY MAKE OR WE CAN MAKE BASED UPON YOUR FEEDBACK, HYPER LINKS TOO SO THAT THOSE WHO TAKE THE SURVEY ARE AWARE OF THE INDICATORS AND SECONDLY LIKE YOU MENTIONED, YOUR ABILITY TO PROVIDE THOSE KEY LEVELS OF EVIDENCE. [00:15:02] I THINK WILL HELP MAKE SURE THOSE WHO ARE RESPONDING TO THE SURVEY ARE DOING SO IN AN OBJECTIVE WAY BECAUSE THEY HAVE THE EVIDENCE OF WHAT WE'RE DISCUSSING RIGHT THERE IN FRONT OF THEM. >> CAN I MAKE A COMMENT? >> SURE. >> YEAH, SO THANKS FOR PRESENTING THIS AND SORRY FOR MY TARDINESS. I HAD A COUPLE SCREAMING BABIES I WAS MANAGING FOR A FEW MINUTES THERE. YEAH, I AGREE WITH EVERYTHING THAT DR. HUTCHINGS SAID. I WOULD ASK YOU THIS DR. HUTCHINGS TO GET YOUR FEEDBACK. IT SEEMS TO ME THAT MORE DATA IS A USEFUL THING. BUT YOUR POINT IS WELL TAKEN. IF THIS IS NOT GROUNDED IN WHAT ARE THE ARTIFACTS ARE THE OBJECTIVE MEASURES THEN IT'S NOT AS USEFUL AS DATA. WHAT I DO WONDER IS FROM THIS COMMITTEE'S PERSPECTIVE AND FROM THE SCHOOL BOARD'S PERSPECTIVE, IF YOU KNOW, I THINK IT'S USEFUL TO KNOW HOW THE TEACHERS AND STAFF PERCEIVES THAT WE'RE DOING AND ALL OF THESE AREAS. YOU KNOW NOTWITHSTANDING THE AREAS OF FOCUS. FOR THE PURPOSES OF THE EVALUATION, THE QUESTION THAT IS RELATE TO THE AREAS OF FOCUS ARE THE ONES THAT WE WILL BEAR DOWN OR GOING TO BEAR MORE HEAVILY ON THE EVALUATION. THOSE ARE THE ONES WE FOCUS ON. I WONDER IF THERE'S A WAY TO STILL COLLECT ALL OF THIS DATA BUT HAVE AN UNDERSTANDING WITH THIS COMMITTEE AND WITH YOU, DR. HUTCHINGS, THE ONES WE'RE FOCUSED ON ALIGN. IT WOULD BE NICE TO LOOK AT DATA YEAR TO YEAR TO SEE HOW FROM A 360 PERSPECTIVE EVERYONE PERCEIVES WE'RE DOING AND I ALSO THINK IT'S IMPORTANT PARTICULARLY FOR THE ONES YOU'RE FOCUSED ON, THERE ARE WAYS FOR THE STAFF AND WHOEVER IS FILLING THIS OUT TO SORT OF SEE THE ARTIFACTS YOU'RE PRODUCING. SO, I'M CURIOUS WHAT YOUR THOUGHTS ARE ON THAT. YOU KNOW, IT WOULD BE NICE TO HAVE A DATA SET THAT'S SORT OF LOOKS AT THINGS OVER TIME AND IT WOULD BE NICE TO SEE LIKE OH, OKAY, WELL THE AREAS OF FOCUS WE SCORED HIGH AND THE AREAS THAT WERE NOT FOCUSED ON WERE LOW. THIS SHOWS IT WORKS AND WE WANT TO MAKE SURE WE'RE DOING AS GOOD AS POSSIBLE ON ALL MEASURES ALL THE TIME. I THINK IT'S USEFUL TO HAVE THAT. I'M CURIOUS AS TO WHAT YOUR THOUGHTS ARE ON THAT. >> I THINK THERE ARE TWO DIFFERENT ASSESSMENTS. I THINK THE CLIMATE AND CULTURE SURVEY AND WHAT IS GIVEN TO THE STAFF TO GET AN IDEA OF HOW WE'RE DOING. AND WHERE AREAS WE NEED TO FOCUS ON. THAT INFORMATION WILL HELP DRIVE IN THE FUTURE. THAT'S GOING TO HELP US KIND OF DRIVE THE AREAS OF FOCUS ARE. MOVING FORWARD. BUT THOSE ARE TWO SEPARATE YOU KNOW TOOLS. THIS IS SPECIFICALLY AROUND THE SUPERINTENDENT'S 360 LEADERSHIP. AND IT'S NOT BASED ON HOW THE BOARD IS DOING OR HOW IT'S SOLELY ON THE SUPERINTENDENT'S LEADERSHIP. AND I THINK THAT YOU KNOW WE WANT TO MAKE SURE THAT THOSE ARE, IT'S NOT THAT THEY'RE SEPARATE BUT WE'RE TARGETING DIFFERENT AUDIENCES WHEN WE ADMINISTER THE TWO SURVEYS. THE CLIMATE SURVEY, THE CLIMATE AND CULTURE SURVEY IS FOR ALL STAFF. EVERYBODY. 100% INVOLVED IN THAT. FOR A 360 LEADERSHIP AND HANOVER, YOU CAN ASSIST ME IN THIS, I KNOW WHEN WE TALKED LAST, I BELIEVE THE TERM WE DISCUSSED IS IT'S MORE OF A RANDOM SAMPLING THAT OCCURS FOR A 360 FEEDBACK. IT'S NOT 100% OF EVERYBODY FILLS IT OUT ON THE SUPERINTENDENT. IT HAS TO BE A LITTLE MORE TARGETED BECAUSE YOU ARE IDENTIFYING DIFFERENT STAKEHOLDER GROUPS BUT PEOPLE WHO WILL BE ABLE TO ANALYZE THIS DATA AND BE ABLE TO GIVE THEIR PERSPECTIVE BASED ON THEIR STAKEHOLDER GROUP. SO IT'S NOT JUST -- I'M SORRY, IT'S NOT JUST EVERYBODY SIGNS UP TO DO A 360 LEADERSHIP SURVEY. BUT HANOVER, YOU MAY WANT TO REITERATE THAT AND MAKE SURE I GOT ALL THAT RIGHT. OUR MEETING WAS A MONTH OR SO AGO. I BELIEVE I REMEMBER. >> YOU DO. YOUR MEMORY SERVES YOU WELL. WE DISCUSSED AND CLINT WAS ACTUALLY CREATING A DOCUMENT WHICH I HAVE ACCESS TO, A LIVE DOCUMENT AND LISTING THE SPECIFIC RESPONDENTS THAT WERE GOING TO RECEIVE THIS SURVEY, VERSUS THE CLIMATE AND CULTURE SURVEY WE ARE WORKING ON GOING TO EVERYONE ACROSS THE BOARD. THIS WOULD BE A SMALLER GROUP OF RESPONDENTS FOR THIS PARTICULAR SURVEY. [00:20:02] >> SO, SORRY CINDY, I DIDN'T MEAN TO CUT YOU OFF. IS IT GOING TO BE A REPRESENTATIVE SAMPLE OR RANDOM SAMPLE OF PEOPLE SORT OF ALL THE WAY AROUND THE DIVISION THEN? THE SENIOR LEADERSHIP TEAM ALL THE WAY DOWN TO CUSTODIANS AND YOU'RE GOING TO HAVE THAT SAMPLE OR FOCUSED MORE ON SENIOR LEADERSHIP? >> IT'S A SAMPLE OF ALL STAKEHOLDERS FROM SENIOR LEADERSHIP ALL THE WAY DOWN TO COMMUNITY MEMBERS FROM PARENTS TO CITY OFFICIALS AND THINGS OF THAT NATURE. SO, IT'S ARRANGED AND WE ARE WORKING THROUGH THE STAKEHOLDER GROUP TO IDENTIFY ALL OF THOSE DIFFERENT PERSPECTIVES BECAUSE YOU KNOW EVERYBODY HAS A DIFFERENT LENS THEY'RE LOOKING THROUGH. IT'S NOT JUST ABOUT THE SENIOR LEADERSHIP TEAM. NOW IT WILL BE ALL SENIOR LEADERSHIP, ALL, I'M SORRY, DID I LOG OFF? CAN YOU ALL HEAR ME? >> OKAY. SORRY MY SCREEN JUST WENT AWAY. >> I WAS SWITCHING SCREENS SO YOU ALL COULD SEE THE DOCUMENT WE STARTED WORKING ON. >> OKAY. PERFECT. THAT'S THE LIST. I AM GOING TO LET YOU GO THROUGH THIS. >> NO. NO WORRIES. THIS IS THE WORKING DOC THAT WE WERE WORKING ON CHRIS IN TERMS OF THOSE THAT WOULD RECEIVE THE SURVEY. >> GOT IT. OKAY. GREAT. SO I'LL JUST SCROLL THROUGH THIS. THE GROUP HERE. A SELECTION OF 20 PRINCIPALS, AND THIS LOOKS LIKE GOING DOWN, WE'VE GOT THE SCHOOL BOARD ADVISORY CHAIRS, CHAMBER OF COMMERCE PRESIDENT, THE CITY MANAGER, MAYOR, SOME REPRESENTATIVES FROM THE UNIVERSITIES NEAR THERE. NAACP PRESIDENT, AND ALL THE WAY DOWN TO THE DIRECTOR OF THE DEPARTMENT OF COMMUNITY AND HUMAN RESOURCES. SO AS DR. HUTCHINGS WAS MENTIONING, A SAMPLING FROM SEVERAL KEY AREAS. >> WHEN YOU GO UP, I KNOW YOU CROSSED OVER THE STRATEGIC PLAN GROUP. IF YOU GO UP A LITTLE HIGHER, ANNUAL REVIEW COMMITTEE. BECAUSE THAT, WE WERE TARGETING SPECIFIC STAKEHOLDERS ON THAT STRATEGIC PLANNING LIKE ANNUAL COMMITTEE GROUP. SO IT HAS SUPPORT STAFF, TEACHERS REPS, SO THAT WE'RE GETTING DIVERSE PERSPECTIVE WITH ALL OF THOSE NAMES RIGHT THERE. I THINK WE HAVE THE NAMES. THAT WE JUST NEED TO PLUG IN. THAT TACKLES ALL OF A DIFFERENT GROUP. LIKE CUSTODIAN REPRESENTATIVE, A SUPPORT STAFF REPRESENTATIVE, A PARAPROFESSIONAL AND THAT TYPE OF THING. >> GOT IT. >> I HAVE A QUESTION ABOUT THE DATA. I UNDERSTAND CHRIS' POINT. I THINK LOOKING AT THE LIST WOULD BE TOO MANY QUESTIONS FOR SUCH A DIVERSE GROUP IN TERMS OF THE FUNCTION AND THE SCHOOL SYSTEM AND THE CITY. I KIND OF WORRY ABOUT THE DATA BEING DUMPED AND WHETHER PEOPLE WILL REALLY WILL BE ACCESSIBLE TO PEOPLE WHO ARE FILLING IT OUT OR WILL WE HAVE SOME WAY OF SUMMARIZING BY SCHOOL? I DON'T KNOW HOW TO DO IT. I'M A LITTLE WORRIED, IT'S GREAT TO HAVE THE ARTIFACTS. IF PEOPLE DON'T FEEL THEY CAN EITHER INTERPRET THEM OR THERE'S SO MANY THEY DON'T HAVE TIME TO REVIEW THEM, THEN IT'S AS IF THEY DIDN'T EXIST AND GET THE SUBJECTIVE RESPONSE ANYWAY. HOW DOES THAT GET SOLVED? >> SO, I'M NOT SURE IF THAT'S A QUESTION. I THINK IT'S A QUESTION FOR THE WHOLE GROUP. I THINK IT WOULD BE IMPORTANT TO DISCUSS HOW DR. HUTCHINGS, I KNOW YOU MENTIONED YOU HAD BEEN COLLECTING THE ARTIFACTS. A STREAM LINED WAY OF SHARING THOSE ARTIFACTS SO WHEN ONE IS GOING THROUGH THE SURVEY, THEY HAVE THOSE ARTIFACTS AS THEIR READY. SO I THINK IT WOULD BE IMPORTANT TO DISCUSS HOW YOU HAVE BEEN GATHERING THOSE UP UNTIL THIS POINT. >> YEAH. SO THE ARTIFACTS ARE GATHERED IN MULTIPLE WAYS FROM PRESENTATIONS TO MEMOS TO ARTIFACTS FROM DIFFERENT SESSIONS, I'M SORRY, HOLD ON, THIS THING WENT AWAY [00:25:08] AGAIN. FROM ARTIFACTS FROM DIFFERENT MEETINGS AND THINGS OF THAT NATURE. I THINK A WAY FOR US TO BE ABLE TO CONSOLIDATE SOME OF THAT TO CINDY'S POINT AND I'M GOING TO USE AN EXAMPLE WHEN I HAD A 360 IN MY FORMER SCHOOL DIVISION, THERE WAS AN OVERVIEW GIVEN TO ALL PEOPLE WHO WERE GOING TO PARTICIPATE IN THE SUPERINTENDENT'S 360 FEEDBACK. AND IT WAS A SESSION THAT WAS PROVIDED TO ALL OF THE PARTICIPANTS AND PROVIDED AN OVERVIEW OF THE WORK THAT HAPPENED FOR THAT YEAR, THE EXPECTATIONS THAT CAME FROM THE BOARD. THE INITIATIVES THAT WERE IMPLEMENTED AND THE CHALLENGES. THAT WAS A COMPLETE OVERVIEW AND GAVE A SNAPSHOT OF WHAT OUTCOMES WERE BEING SOUGHT AFTER BY THE SUPERINTENDENT. THEN PARTICIPANTS DID HAVE THE ABILITY TO GO IN AND TO LOOK AT EACH ARTIFACTS AND THEY HAD THE CHIEF OF STAFF WAS THE PERSON THEY HAD TO CONTACT BECAUSE, THEY'RE NOT SUPPOSED TO CONTACT ME ABOUT THOSE TYPES OF THINGS. BUT THE CHIEF OF STAFF WHO WAS STEVE, IN SHAKER HEIGHTS WHO IS ALSO THE CHIEF OF STAFF HERE, WOULD BE ABLE TO FILTER QUESTIONS OR PROVIDE GUIDANCE OR INSIGHT FOR THOSE PARTICIPANTS. WE SAW THAT MOST PEOPLE WHO HAD QUESTIONS WERE TYPICALLY OUR SUPPORT STAFF AND COMMUNITY MEMBERS WHO WEREN'T FAMILIAR WITH SCHOOLS AND SCHOOL DIVISIONS AND THAT TYPE OF THINGS. THOSE WERE THE PEOPLE WHO NEEDED COACHING AND SUPPORT. EVERYONE ELSE BECAUSE AND I THINK WE WILL SEE THAT EVEN HERE IN ALEXANDRIA BECAUSE A LOT OF THESE THINGS WE ARE DOING PARTICULARLY ARE INTERNAL FOLKS ARE FAMILIAR WITH MANY OF THOSE ARTIFACTS AND PEOPLE LIKE THE CITY MANAGER, THE MAYOR MAYBE NOT SO MUCH SOME BITS AND PIECES SOME OF OUR COMMUNITY PARTNERS BECAUSE THEY HAVE BEEN SERVING ON OUR TRANSITION TEAMS AND THOUGHT PARTNERSHIPS, SOME OF THOSE INDIVIDUALS THAT WILL BE YOU KNOW SOME OF THE INFORMATION WILL BE NEW TO THEM, IT IS NOT GOING TO BE ALL BE UNFAMILIAR INFORMATION. SO THAT JUST GIVES YOU AN IDEA OF WHAT I HAVE DONE IN THE PAST. WE NEED TO CUSTOMIZE IT FOR ALEXANDRIA OF COURSE, BUT THE CONCEPT I THINK IS APPLICABLE TO YOU KNOW TO HOW WE'RE GOING TO FUNCTION HERE. >> I WOULD AGREE. SOUNDS LIKE WE WOULD NEED TO WAREHOUSE THOSE ARTIFACTS AND THEN HAVE THEM WITH A SPECIFIC PERSON. I THINK YOU MENTIONED THAT'S HOW IT WAS DEVELOPED IN SHAKER SO THEY DIDN'T COME TO YOU AND SAY, HEY, DR. HUTCHINGS, DID YOU DO SUCH AND SUCH. WE COULD ALSO HAVE A PLACE FOR QUESTIONS. IF ONE IS GOING THROUGH THE SURVEY AND REALLY NEED CLARIFICATION OR SOME QUESTIONS BEFORE THEY JUST GUESS, THAT'S WHAT WE DON'T WANT. WE DON'T WANT THEM TO GUESS. WHETHER I THINK HE DID OR DID NOT. THIS IS WHAT I'M GOING TO CHECK. WE NEED TO HAVE A PLACE OR A PERSON WHERE THEY CAN GO TO WITH SPECIFIC QUESTIONS AND WHERE THEY CAN IMMEDIATELY RETURN TO THAT WAREHOUSE OF ARTIFACTS. >> AND ONE THING WE DID NOTICE WHEN WE DID THE REPORTING, I DIDN'T GET TO SEE THE INDIVIDUAL BUT OVERALL REPORTING, YOU HAD SECTION THAT WASN'T APPLICABLE THAT PEOPLE COULD SELECT. BECAUSE THEY HAD A STAKEHOLDER GROUP THEY SELECTED, IT ALLOWED US TO KNOW WHICH GROUPS DIDN'T KNOW CERTAIN INFORMATION. YOU KNOW SO FOR EXAMPLE, WE MAY HAVE SEEN A TREND THAT I'M JUST MAKING THIS UP BECAUSE I DON'T REMEMBER EVERYTHING FROM THE REPORT A FEW YEARS AGO. LET'S SAY WE SAW A TREND WITH SUPPORT STAFF THEY DIDN'T KNOW ABOUT THE STRATEGIC PLANNING GOALS. THAT THEN WAS AN AREA THAT WE KNEW WE WERE GOING TO NEED TO DO MORE WORK IN AND MAKING SURE THAT OUR SUPPORT STAFF KNOW OUR STRATEGIC GOALS AND KNOW WHAT THEY STAND FOR AND THAT TYPE OF THING. WHEN YOU HAVE NOT APPLICABLE, THAT IS WHEN PEOPLE THEY JUST FEEL LIKE THEY DON'T HAVE ENOUGH INFORMATION OR DON'T KNOW ENOUGH TO ANSWER IT. THAT'S USEFUL TOO AS WE'RE LOOKING AT OUR OVERALL RESULTS BECAUSE IT CAN LET [00:30:06] US KNOW IF THERE ARE CERTAIN GROUPS THAT ARE NOT INFORMED OR DON'T UNDERSTAND WHAT IS HAPPENING. >> I AGREE. DEFINITELY LOOKING AT THOSE TRENDS AND DETERMINING WHICH SEGMENTS ARE MOST LIKELY TO SAY THEY DON'T KNOW OR IT'S NOT APPLICABLE. ANY OTHER QUESTIONS? >> THANKS. THANKS FOR THAT. >> ABSOLUTELY. SO I WAS AT HALF-TIME BACK TO MY SPORTS ANALOGY. I HAD GO UP INTO THE PERFORMANCE STANDARD FOUR. I WILL RE-SHARE AND GET THROUGH THE FINAL THREE. OKAY. MY SCREEN SHOULD BE BACK TO THE INSTRUMENT. THANK YOU SUSAN. SO, PERFORMANCE STANDARD FIVE DISCUSSES COMMUNICATION AND SO HOW WELL THE SUPERINTENDENT FOSTERS THE SUCCESS OF ALL STUDENTS THROUGH EFFECTIVE COMMUNICATION WITH ALL STAKEHOLDERS. AND SO THIS PERFORMANCE STANDARD REALLY DISCUSSES THE SUPERINTENDENT'S ABILITY TO ESTABLISH AND MAINTAIN EFFECTIVE AND TIMELY CHANNELS OF COMMUNICATION WITH STAKEHOLDERS INCLUDING BOARD MEMBERS, THE SCHOOLS AND THE COMMUNITY AND THEN ALSO HOW WELL THE SUPERINTENDENT USES TECHNIQUES TO GATHER INPUT. WE KNOW COMMUNICATION IS A 2-WAY STREET AS THE OLD SAYING GOES. HOW WELL IS HE ABLE TO RECEIVE THE COMMUNICATION AND UTILIZE IT AS A KEY PART OF HIS DECISIONMAKING PROCESS. THIS IS A LONGER CONSTRUCT HERE. ONE OTHER POINT I WANTED TO HIGHLIGHT IS THIS PERFORMANCE STANDARD DISCUSSES HOW WELL INFORMATION IS RECEIVED OR SENT OUT WHEN THERE'S A CRISIS. CRISIS COMMUNICATION. I KNOW WE HAD NO SHORTAGE OF THAT AND HOPEFULLY THAT WILL NOT RETURN AND WE WON'T HAVE TO USE THE CRISIS COMMUNICATIONS, BUT IN TIMES OF CRISIS, WE WANT TO MAKE SURE THERE'S A STREAMLINED METHOD FOR DELIVERING THAT IMPORTANT COMMUNICATION. THE SIXTH PERFORMANCE STANDARD DISCUSSING PROFESSIONALISM. THIS IS PRETTY STRAIGHTFORWARD AND THAT'S WHY I HIGHLIGHTED THE FIRST DESCRIPTOR HERE. MODELLING PROFESSIONAL, MORAL AND ETHICAL STANDARDS AS WELL AS PERSONAL INTEGRITY IN ALL ACTIONS. STANDARDS, ETHICS AND HOW WELL THE SUPERINTENDENT REALLY EXUDS THAT THROUGHOUT HIS PROFESSION. AND LUCKY NUMBER SEVEN REALLY WRAPS UP ALL OF THE PREVIOUS PERFORMANCE STANDARDS. SO, AS YOU WILL SEE, IT READS THAT THE SUPERINTENDENT'S LEADERSHIP RESULTS IN ACCEPTABLE, MEASURABLE DIVISION WIDE STUDENT ACADEMIC PROGRESS. BASED ON THE FIRST SIX STANDARDS THEY SHOULD OR HIS PERFORMANCE SHOULD RESULT IN MEASURABLE DIVISION-WIDE STUDENT ACADEMIC PROGRESS. THE SEVENTH STANDARD JUST SUMMARIZES OR REITERATES THE DESCRIPTORS FROM THE PREVIOUS STANDARDS. FINALLY THERE ARE TWO OPEN-ENDED QUESTIONS THAT ARE OFFERED AT THE END OF THE SURVEY. AS WELL AS SOME DEMOGRAPHICS QUESTIONS WHICH YOU KNOW A RESPONDENT AS THE OPTION TO CHOOSE PREFER NOT TO RESPOND IF THEY DON'T WANT TO BE IDENTIFIED BY THESE SPECIFIC AREAS. ANY QUESTIONS THERE? OKAY. I'M GOING TO STOP SHARING. IT'S GOING TO BLINK DR. HUTCHINGS, ONE MOMENT WHILE WE TELEPORT BACK. I WANTED TO REVIEW AND YOU MAY HAVE QUESTIONS ABOUT THIS. THE LOGISTICAL SIDE OF THE RESEARCH. THE SURVEY TAKES LESS THAN 10 MINUTES TO COMPLETE. THAT'S USUALLY A QUESTION. HOW LONG IS THE SURVEY. WE DON'T WANT ANYONE TO GET SURVEY FATIGUE AND TIME OUT. LESS THAN 10 MINUTES TO COMPLETE AND AFTER THE SURVEY IS CLOSED AND OUT OF [00:35:01] THE FIELD, WE PROVIDE A SURVEY ANALYSIS. AND OUR DEDICATED SURVEY TEAM DOES A DATA CLEANING WHERE THEY GO THROUGH ALL OF THE RESULTS AND REALLY CLEAN THE DATA BECAUSE THERE WILL BE PEOPLE WHO DIDN'T COMPLETE THE WHOLE SURVEY, WE CALL THEM PARTIALS. THERE WILL BE SURVEY RESPONDENTS WHO ARE DISQUALIFIED BECAUSE THEY DIDN'T MEET THE CRITERIA. THEY DO ALL THE DATA CLEANING AND THEN THEY PROVIDE OR WE PROVIDE A FULL SURVEY ANALYSIS. THAT WILL INCLUDE AN EXECUTIVE SUMMARY, THAT INCLUDES REALLY ACTIONABLE HIGH LEVEL KEY FINDINGS, WE ALSO INCLUDE RECOMMENDATIONS AND NEXT STEPS AND WE ALSO INCLUDE GRAPHS, CHARTS, TABLES THAT REALLY ARE ABLE TO EXPLAIN WHAT WE CALL THE DATA STORY. AND LOOK AT KEY DATA POINTS BASED UPON THE SEVEN PERFORMANCE STANDARDS AND DELIVER A REPORT THAT REALLY HIGHLIGHTS THE KEY FINDINGS FROM THE DATA FROM THE SURVEY. WE ALSO PROVIDE A DATA SUPPLEMENT AND THE DATA SUPPLEMENT REALLY GIVES YOU AN OPPORTUNITY TO LOOK AT THE SPECIFIC SEGMENTATION OF THE DATA. IT'S MORE OF AN EXCEL FORMAT. THE FIRST PART OF THE ANALYSIS I MENTIONED IS IN THE FORM OF POWER POINT SLIDES. DATA SUPPLEMENT IS AN EXCEL SPREADSHEET WHERE YOU CAN FILTER AND SEGMENT THE DATA AND REALLY KIND OF DRILL DOWN ON SPECIFIC RESPONSES PER SUB GROUP. >> THAT SOUNDS LIKE SOMETHING THAT CLINT WOULD BE VERY INTERESTED IN. >> HE DOES LIKE THAT STUFF. CLINT AND JENNIFER, MY NAMESAKE BOTH ENJOY THE DATA SUPPLEMENT PIECE. ANY OTHER QUESTIONS? >> WHAT IS THE NUMBER OF RESPONDENTS YOU NEED TO FEEL LIKE YOU HAVE A GOOD REPRESENTATION, YOU KNOW, IN OTHER WORDS, I'M NOT SURE THAT EVERYBODY YOU SEND IT OUT TO WILL COMPLETE IT. WHAT IS SORT OF THE NUMBER YOU'RE STRIVING FOR? >> THAT'S A GREAT QUESTION. I WOULD SAY AS MANY AS POSSIBLE BUT LIKE YOU SAID, WE DON'T, WE KNOW EVERYONE WON'T COMPLETE IT. I DON'T THINK THERE'S, THERE MAYBE TWO SMALL OF A DATA SET, SUSAN. YOU MAY KNOW THERE'S A SPECIFIC NUMBER BUT I'M NOT AWARE OF ONE TO WHICH WE SAY WE DON'T HAVE ENOUGH OF A SAMPLE SIZE. I KNOW KEY THINGS WE CAN DO ON OUR BEHALF ARE SEND OUT REMINDERS. SEND OUT WARM OUTREACH LANGUAGE SO PEOPLE WHO RECEIVE THE SURVEY DON'T SAY GOSH, WHY AM I RECEIVING THIS. WE SEND THAT WARM OUTREACH TO GARNER A NUMBER. SUSAN IS THERE A NUMBER THAT IS TOO LOW? >> THERE'S NOT A NUMBER WE HAVE TO WORRY ABOUT WITH THE SURVEY. THERE WILL BE A GOOD RESPONSE RATE FOR A SURVEY OF THIS TYPE AND REALLY YOU KNOW ANYTHING A RESPONSE BELOW 20 WOULD BE SOMETHING THAT YOU KNOW WE WOULD NOT WANT TO SEE THAT KIND OF RESPONSE RATE. IT WOULD BE VERY LOW BUT AGAIN IT REALLY DEPENDS ON THE TYPE OF SURVEY THAT IT IS. AND YOU KNOW THE STAKEHOLDER GROUPS THAT IT'S GOING TO. SO IT'S NEVER JUST A SINGLE NUMBER WE CAN THROW OUT THERE AND SAY, YOU KNOW, UNDER 20% IS NOT STATISTICALLY SIGNIFICANT. BUT IT'S SOMETHING THAT WE WILL MONITOR THROUGHOUT THE COURSE OF THE SURVEY BEING IN THE FIELD AND AS JENNIFER NOTED, IF WE FEEL AT THAT TIME LIKE THE RESPONSE IS NOT WHAT IT SHOULD BE, WE WILL BE MAKING RECOMMENDATIONS ABOUT HOW YOU CAN INCREASE THAT RESPONSE RATE. AND THEN YOU KNOW, WE CAN WORK WITH YOU ON WHAT THAT LOOKS LIKE. >> THIS IS ONE OF REASONS WHY IT'S IMPORTANT TO WHEN YOU'RE DOING KIND OF LIKE A RANDOM SAMPLING, IT'S A TARGETED RANDOM SAMPLE. IT'S NOT JUST LIKE ANYBODY. BECAUSE WHEN YOU DO A TARGETED RANDOM SAMPLE, YOU ARE IDENTIFYING PEOPLE WHO ARE IN ROLES THAT WILL COMPLETE IT. FOR EXAMPLE, WE KNOW LIKE AN EAA REPRESENTATIVE WILL COMPLETE THAT. WE KNOW THAT A PTECH REPRESENTATIVE WILL COMPLETE IT. WE KNOW THAT A BUSINESS PARTNER WILL COMPLETE IT. YOU KNOW THESE ARE PEOPLE THAT ARE IN SPECIFIC ROLES THAT ARE SPEAKING FOR A LARGER GROUP OF PEOPLE THAT FEEL AN OBLIGATION TO MAKE SURE THEY ARE COMPLETING THAT ON BEHALF OF WHATEVER GROUP THEY SERVE. [00:40:02] AND THAT IS GOING TO BE KEY SO THAT YOU KNOW WE CAN MAKE SURE WE GET A GOOD PARTICIPATION RATE. I CAN TELL YOU THAT IN SHAKER HEIGHTS WITH OUR METHOD, WE HAD ABOUT A 90% PARTICIPATION RATE FOR BECAUSE IT WAS A TARGETED RANDOM SAMPLE. AND THEY WERE PEOPLE WHO FELT LIKE THEY WERE OBLIGATED TO COMPLETE IT. YOU NEVER FIND ISSUES WITH PEOPLE INTERNALLY COMPLETING IT BECAUSE YOU KNOW THEY FEEL HONORED TO BE ABLE TO HAVE A SAY IN THE SUPERINTENDENT'S OR TO CONTRIBUTE TO THE SUPERINTENDENT'S EVALUATION. SO A LOT OF TIMES YOU KNOW PEOPLE ARE EXCITED. I WILL SAY THE THIRD YEAR THAT WE DID OUR 360 IS WHEN WE HAD TO START REALLY TWISTING PEOPLE'S ARMS. THE FIRST TWO YEARS, EVERYBODY WAS LIKE THIS IS NEW. THIS IS SO GREAT. YEAR THREE YOU HAVE TO SAY, OKAY EVERYBODY WE REALLY NEED YOU TO COMPLETE IT AND YOU HAVE TO DO FOLLOW UPS. THE FIRST COUPLE YEARS THERE WAS NO FOLLOW UP. >> A 90% RESPONSE RATE IN THE SURVEY WORLD IS ABSOLUTELY UNHEARD OF. WE GET EXCITED ABOUT 50%. SO YOU KNOW, AS I SAID, IT REALLY DEPENDS ON THE SURVEY AND THIS SURVEY IS NOT GOING TO POSE A PROBLEM AS FAR AS RESPONSE RATES AT ALL. OKAY. MANAGING OUR EXPECTATIONS ABOUT THE 90. NOW YOU KNOW WHERE WE HAVE TO SHOOT FOR 91 OR ABOVE. ALSO WE TYPICALLY LEAVE THE SURVEY IN THE FIELD FOR ABOUT TWO WEEKS. SO WITHIN THE FIRST THREE DAYS, YOU KNOW SOMETIMES WE SEE EBBS AND FLOWS. THE IMMEDIATE RUSH AND THEN KIND OF LEVELS OUT AND THE IMMEDIATE RUSH BEFORE WE CLOSE SURVEY. THAT'S WHY THOSE REMINDERS ARE HELPFUL. >> I THINK THAT ONE THING I KNOW I HAVE TO JUMP OFF BECAUSE WE HAVE OUR THOUGHT PARTNER MEETING THAT'S ABOUT TO HAPPEN. ONE THING I THINK THAT REALLY DOES HELP, I THINK IT HELPED WHEN WE CONDUCTED THIS IN MY PREVIOUS DISTRICT WAS HAVING THAT INFORMATIONAL SESSION. THEN YOU HAVE THE THIRD PARTY GROUP COMING IN TO SHARE INFORMATION ABOUT THE INSTRUMENT AND THEN YOU HAVE AN ORGANIZATIONAL REPRESENTATIVE WHICH WOULD BE LIKE THE CHIEF OF STAFF OR THE ACCOUNTABILITY, IT PROBABLY WILL BE CLINT NOT OUR CHIEF OF STAFF GIVING AN OVERVIEW AROUND THE DATA AND THE INFORMATION OR SOMEONE FROM HIS TEAM. IT MAY NOT BE CLINT BECAUSE HE'S ON PATERNITY LEAVE. THAT HELPED BECAUSE PEOPLE WEREN'T GOING IN BLIND. THEY FEEL LIKE YOU HAVE TAKEN TIME TO INFORM THEM AND NOW THEY WANT TO REWARD YOU BY COMPLETING IT. YOU KIND OF NOT FORCE PEOPLE BUT YOU MAKE PEOPLE FEEL GUILTY IF THEY DON'T. YOU INVESTED TIME IN THEM. THAT MAKES IT FEEL LIKE YOU INVESTED THE TIME. ALSO THE BOARD CHAIR WAS AT THAT MEETING AND UNDERSTANDING THE IMPORTANCE OF WHY THE BOARD NEEDS THIS INFORMATION, AND ONE THING THAT HELPED WAS AS WE WERE NAVIGATING, WHICH WE'RE DOING HERE IN ACPS. THEY DIDN'T HAVE AN EVALUATION FOR THE SUPERINTENDENT. SO, THIS WAS SOMETHING I SAID LISTEN, I NEED TO HAVE AN EVALUATION. YOU CAN'T JUST SIT HERE AND TELL ME WHAT I'M DOING WRONG. WE NEED INFORMATION AND DATA. WHILE WE WERE REVAMPING THE TEACHER EVALUATION, THIS WAS REALLY HELPFUL BECAUSE IT ALLOWED TEACHERS TO SEE IT'S NOT ABOUT A GOT YOU MOMENT. IT'S NOT DR. HUTCHINGS, I REMEMBER THE DAY YOU DID X. IT'S MORE ABOUT WHAT IS THE DATA TELLING US ABOUT DR. HUTCHINGS AND WHAT WE ASKED HIM TO DO? AND THAT IS SOMETHING THAT WE HAVE TO TRAIN OUR LEADERS IN OUR ORGANIZATION TO DO AS WELL. OUR TEACHER EVALUATION, I KNOW CINDY YOU KNOW THIS VERY WELL. STAFF DIDN'T TRUST THEM BECAUSE THEY FELT LIKE PEOPLE WERE OUT TO GET THEM. IT WAS BASED ON WHAT I FELT ABOUT YOU AND NOT ABOUT WHAT YOU'RE PRODUCING IN YOUR POSITION. AND I THINK THAT THIS IS GOING TO BE IMPORTANT FOR US TO MAKE SURE THAT WE'RE DOING THAT. WE HAVE TO LEAD BY EXAMPLE BECAUSE IT'S EASY FOR US TO POINT FINGERS AT WHAT WE DON'T LIKE ABOUT DR. HUTCHINGS. BUT IT'S NOT WHAT YOU LIKE ABOUT DR. HUTCHINGS. I'M NOT HIRED FOR PEOPLE TO LIKE ME. I AM HIRED TO DO A JOB. AM I DOING THE JOB I WAS ASKED TO DO IS REALLY THE QUESTION. NOT DO WE LIKE DR. HUTCHINGS. IS HE WARM AND FUZZY? IS HE NICE, WHATEVER. PEOPLE PROBABLY SAY ALL THE ABOVE. DEPENDS ON THE SITUATION. DEPENDS ON THE SITUATION. >> DEPENDS ON WHO YOU ASK. I HEAR YOU. BUT, I DON'T KNOW IF THERE'S ANYTHING THAT CHRIS OR CINDY HAVE. [00:45:03] I HAVE TO GO TO OUR PRE MEETING BEFORE OUR 10 O'CLOCK. BUT I THINK WE SHOULD PROBABLY TAKE SOME OF THIS INFORMATION THAT WE KIND OF TALKED THROUGH TODAY AND MAYBE TALK WITH OUR INTERNAL TEAM ABOUT AND ALSO WITH HANOVER ABOUT JUST MAKING SOME ADJUSTMENTS AND REFINEMENTS. ONE THING WE WERE TRYING TO REALLY KEEP THE QUESTIONS AND RESPONSES LIMITED ESPECIALLY BECAUSE THEY DO HAVE ARTIFACTS AND THINGS THAT GO ALONG WITH THEM, WE MAY WANT TO MAKE SURE WE'RE STICKING TO THE AREAS OF FOCUS WHICH COULD HELP WITH THE PARTICIPANT OR THE PERSON SURVEYED. THAT'S MY PERSPECTIVE. I WANT TO HEAR FROM CLINT AND HIS TEAM AND HANOVER TO SEE WHAT YOU THINK ABOUT THAT. >> CLINT MENTIONED THAT SOME OF THE SAME NEXT STEPS, MY NEXT STEP WAS GOING TO BE TO SEND THIS DOCUMENT TO YOU ALL ALSO IN WORD VERSION SO YOU ARE FREE TO GO THROUGH, PROVIDE FEEDBACK. TRACK CHARGES AND MARGIN COMMENTS AND PUT FEEDBACK ON THE ACTUAL DOCUMENT SO WE CAN TAKE IT BACK TO OUR SURVEY TEAM AND MAKE THE NECESSARY UPDATES. CLINT ALSO MENTIONED. THE SURVEY MAY NEED TO BE REVIEWED WITH THE LARGER BOARD. TIMING IS IMPORTANT. HE MENTIONED THERE MAY BE A NEED TO HAVE THE SURVEY IN THE FIELD MID JUNE. IF WE THINK FROM A BACKWARDS TIMELINE PERSPECTIVE, WE NEED TO GET THE BALL ROLLING ON THE FEEDBACK SO WE CAN FINALIZE THE INSTRUMENT AND HAVE A FIRM DETERMINATION OF TWO WEEK WINDOW IN WHICH WE WANT THE SURVEY TO BE IN THE FIELD. WE DON'T HAVE TO FINALIZE THIS ON THIS CALL. I KNOW YOU HAVE TO JUMP. BUT I HAVE BEEN SPEAKING WITH TINA AND OTHERS AND WE CAN MAKE SURE WE GET THE BALL ROLLING ON THOSE LOGISTICAL ASPECTS THAT ARE IMPORTANT TO THE TIMELINE OVERALL. >> YEAH, WHY DON'T WE WORK ON THE LOGISTICAL, WHY DON'T WE DO IT IN A GOOGLE DOC VERSUS MICROSOFT. WE'RE JUST FAMILIAR. WE USE THAT INTERNALLY. IT CAPTURES EVERYBODY'S VOICE AND COMMENTS AND WHEN WE SHARE JUST SHARE IT FOR SUGGESTIONS AND COMMENTS SO IT'S NOT THEY CAN DO A FULL EDIT. THEN SOMETIMES PEOPLE MESS THE DOCUMENT UP BY ACCIDENT. BUT IF THEY CAN DO SUGGESTIONS WE CAN THEN CAPTURE EVERYBODY'S INPUT. I THINK THAT WOULD BE HELPFUL. TINA IS FAMILIAR WITH THAT PRACTICE BECAUSE THAT'S WHAT WE DO INTERNALLY. SO. I AM JUST ALWAYS PLEASED WITH HANOVER. I MEAN THE BRAND IS EXCELLENT. THE CREDIBILITY IS SPOT ON. I LOVE THE FACT THAT YOU ALL ARE A THIRD PARTY. SO IT'S NOT DR. HUTCHINGS MANIPULATING ANYTHING OR PEOPLE WHO WORK FOR ME OR CHANGING ANSWERS OR SOMETHING LIKE THAT. THAT IT GOES THROUGH A THIRD PARTY AND IT'S CONFIDENTIAL HELPS PEOPLE TO BE YOU KNOW MORE HONEST ON THEIR DOCUMENTS. BUT I THINK THE ONE THING WE HAVE TO CONTINUE TO REMEMBER IS HOW A PART OF THE EVALUATIONS IS UNDERSTANDING PEOPLE'S WORK PERFORMANCE. NOT PERSONALITY CONFLICTS AND THINGS OF THAT NATURE. THERE'S A PLACE FOR THAT BECAUSE THERE'S A SECTION THAT TALKS ABOUT COMMUNICATION. BUT, THAT'S NOT THE WHOLE DOCUMENT. YOU KNOW IT MIGHT BE ONE ASPECT OF IT. WHERE IT COMES OUT. THEN WE ALSO NEED TO I THINK INCLUDE A SECTION THAT JUST HAS OTHER FOR ANYBODY TO PUT IN SOMETHING ELSE THAT HAS NOTHING TO DO WITH THE EVALUATIONS. THAT'S ALSO HELPFUL TO HAVE. I BELIEVE IT'S NOT ANYTHING THAT CAN BE USED IN THE CURRENT EVALUATION IF IT'S NOT PERTAINING TO THE AREAS OF FOCUS, BUT IT'S SOMETHING THAT MIGHT LEAD TO YOU KNOW, AN AREA FOCUS FOR NEXT YEAR. SOMETHING WE MAY NEED TO WORK ON FOR THE FUTURE. THAT'S ALWAYS GOOD TO HAVE SOME OF THAT FEEDBACK. THE GOOD, THE BAD AND THE UGLY. ABSOLUTELY. YEAH, THAT'S WHAT WE HEARD FROM TEACHERS. THEY DO WRITE IN. THEY LIKE READING AND WRITING. SO THEY LIKE TO PUT SOMETHING DOWN THAT MAY NOT ALL MULTIPLE CHOICE. YOU KNOW OR NOT ALL CHECK THE BOX THINGS. >> YEAH. I DEFINITELY AGREE. WE DON'T WANT TO JUST HAVE THE CHECK THE BOX. EVEN IF DR. HUTCHINGS YOU HAVE TO JUMP OFF. I HAVE A QUESTION FOR THE GROUP IN TERMS OF LOOKING AT DATES AND WONDERING IF [00:50:05] THE 14TH WOULD BE A REASONABLE TIMELINE FOR US TO GET ALL OF THE UPDATES THAT WE NEED SO WE CAN INCORPORATE THEM INTO THE INSTRUMENT. >> I GUESS I'M THE ONLY ONE LEFT. AND THIS IS MY FIRST MEETING. SO I'M NOT SURE WHAT, I THINK WHAT I WILL DO. I DON'T THINK SUSAN IS ON ANYMORE. LET ME LET SUSAN KNOW ABOUT THAT TARGET DATE. >> NO, I'M HERE. I'M HERE. I'M THE ACPS SCHOOL. SO, I'M LOOKING AT THE CALENDAR RIGHT NOW. SO THE 14TH IS A FRIDAY. IF WE WANT TO SCHEDULE IT AROUND THIS TIME IN THE MORNING, I THINK THAT PROBABLY WORKS FOR MOST PEOPLE. IF THAT WORKS FOR YOU ALL. WE CAN PUT IT TENTATIVELY AND I WILL CHECK IN WITH EVERYONE ELSE. >> OKAY. >> AND SO WHAT WE COULD DO, BUT IF YOU COULD SEND THE FEEDBACK PRIOR TO THAT SO THERE'S A TWO-PHASED APPROACH I'M THINKING ABOUT. ONE WOULD BE WE RECEIVE THE FEEDBACK FROM YOU ALL AND WE HAVE OUR SURVEY TEAM INCORPORATE THE FEEDBACK INTO THE SURVEY INSTRUMENT THAT WE REVIEWED TODAY. THEN WE COULD RE-DELIVER THAT SURVEY IN THE SAME FORMAT AND KIND OF HIGHLIGHT THE KEY AREAS WHERE WE MADE THE REQUESTED UPDATES. >> OKAY. SO YOU WANT THE FEEDBACK ON THE 14TH? I'M LOOKING AT MY CALENDAR AS WELL AND I HAVE ANOTHER QUESTION, ANOTHER LOGISTICAL QUESTION. DO WE NEED TO PRESENT THIS TO THE BOARD ON JUNE 3RD? IS THAT STILL A NECESSITY? >> WELL, YES. THAT WAS PART OF THE PROPOSED TIMELINE AND PLAN. >> OKAY. SO, IF WE WANT TO PRESENT THIS, THE THIRD IS A THURSDAY. IT WOULD BE HELPFUL IF WE COULD HAVE THE FEEDBACK EARLIER NEXT WEEK SO WE CAN IMPLEMENT THE FEEDBACK AND MAKE THE ADJUSTMENTS AND MEET BACK ON THE 14TH AND SHARE WITH YOU ALL THE UPDATED SURVEY. SO I'M GOING TO GO BACK A FEW DAYS. IF WE COULD HAVE THE FEEDBACK ON A WEEK FROM NOW, BY THE 11TH, THEN WE COULD GET BACK WITH THE GROUP AT THE END OF THE WEEK AND SHARE THE UPDATED TIMELINE. BUT I WOULD LOVE TO HEAR IF THAT IS A TARGET DATE THAT WE WOULD BE PLEASIBLE FROM THE DISTRICT. >> SUSAN, I HAVE A PROCEDURAL QUESTION. IF THEY COME TO US ON THE THIRD, IS THAT FOR INFO OR WE HAVE TO VOTE? >> EVENTUALLY, I THINK WE HAVE TO VOTE ON THE CHANGE TO THE SUPERINTENDENT'S EVALUATION. BUT, I HAD THE SAME QUESTION. JUST FYI. BECAUSE I WAS GOING TO ASK, TINA, THE PURPOSE OF THEM COMING BEFORE THE BOARD IS THAT JUST TO PRESENT WHAT THE SURVEY IS? >> YEAH. THAT'S MY UNDERSTANDING. YEAH. JUST TO GIVE AN OVER VIEW AND COMMUNICATION FOR THE PUBLIC AWARENESS AS WELL. >> GOT IT. >> SO IT'S NOT REALLY SOMETHING WE'RE VOTING ON. >> YEAH, I DON'T BELIEVE THIS IS SOMETHING THE BOARD WOULD HAVE TO VOTE ON. >> RIGHT. SO HANOVER REPORT TO THE BOARD ABOUT THIS PROGRESS AND WHAT IT'S GOING TO LOOK LIKE. OKAY. >> YEAH. >> THAT SEEMS LIKE INFO TO ME. >> SO NO ACTION NEEDED. SO JUNE 3RD WOULD BE SUFFICIENT. >> RIGHT. I DO THINK, THOUGH, THAT YOU ALL HAVE TO INCORPORATE OF YOUR STUFF INTO THE EVALUATION AS QUICKLY AS POSSIBLE ONLY BECAUSE YOU WOULD HAVE TO PRESENT THAT FOR INFORMATION ON THE THIRD AND THEN ADOPT IT ON THE 17TH BECAUSE THEN YOU WOULD EVALUATE THE SUPERINTENDENT AFTER THE 30TH. >> YEAH, OH, SO YOU'RE TALKING ABOUT THE OTHER CRITERIA. NOT THIS SURVEY THOUGH. >> NOT THE SURVEY. >> YEAH. YEAH. OKAY. >> THE ACTUAL SUPERINTENDENT'S EVALUATION INSTRUMENT. >> THIS IS MY FIRST MEETING. >> IT'S OKAY. >> I DON'T KNOW WHERE THAT STANDS. YOU DON'T WANT TO DO THIS IN JULY. YOU DON'T WANT TO END UP DOING THIS SURVEY IN JULY. THAT WON'T BE GOOD AT ALL. JUNE IS PUSHING IT A LITTLE BIT ACTUALLY. BUT WE NEED TO GET IT OUT THERE BEFORE SCHOOL IS OVER. >> YEAH. SO, SO WE HAVE TO MODIFY THE INSTRUMENT AND ADOPT IT. SO THAT'S WHERE WE MIGHT HAVE A LITTLE BIT OF A TIMELINE CRUNCH. [00:55:03] ALTHOUGH, WE USUALLY SCHEDULE A JULY MEETING. WE HADN'T DONE SO YET. WHERE WE COULD ADOPT IT AT A SPECIAL CALLED OR SEPARATE MEETING IF NEEDED. >> I GUESS THE OTHER THING IS, HOW IT'S SUPPOSED TO IN TERMS OF NOT, OF HAVING THE TIMELINE OUT OF WHACK, IF OUR INSTRUMENT IS SUPPOSED TO PROPERLY BE REFLECTED IN THE SURVEY. THIS IS FOR NEXT YEAR'S. I'M ALWAYS CONFUSED ABOUT WHAT WE'RE REALLY EVALUATING NOW. ARE WE EVALUATING WHAT HAS BEEN, WHAT WE HAVE BEEN DOING. THIS ONE SHOULD REALLY LINE UP WITH THE ONE WE ALREADY HAVE. THAT WE HAVE BEEN HAVING FOR THE LAST YEAR. >> SO, MY UNDERSTANDING OF THE EVALUATION INSTRUMENT FOR THE SUPERINTENDENT THAT THIS WAS AN AREA THEY WANTED TO INCORPORATE FOR THIS YEAR BECAUSE CORRECT ME IF I AM WRONG, BECAUSE I'M NOT LIKE, IF THE SURVEY DOESN'T GO OUT UNTIL NEXT YEAR, THEN IT WOULDN'T BE -- >> YEAH, I THINK THE IDEA WOULD BE TO HAVE IT GO OUT THIS YEAR AND ALIGNED AS DR. HUTCHINGS SAID, THE AREAS OF FOCUS SO WE HAVE DATA THAT WE'RE ABLE TO USE FOR THE FINAL EVALUATION. THIS ACADEMIC YEAR BECAUSE WE ALREADY DID THE MIDTERM EVALUATION AND GAVE DR. HUTCHINGS FEEDBACK ON THAT. THIS IS ANOTHER DATA POINT TO USE FOR THE FINAL EVALUATION THIS YEAR. I AGREE WE SHOULD DEFINITELY PUT THIS BEFORE THE BOARD FOR INFO NO LATER THAN JUNE SO EVERYONE IS ON THE SAME PAGE. IN TERMS OF BOARD ACTION, I DON'T THINK ANY BOARD ACTION IS NEEDED. YOU KNOW UNTIL WE ACTUALLY INCORPORATE THIS INTO THE FINAL EVALUATION AND HAVE THAT BOARD DISCUSSION. >> YEAH, I THINK WE NEED TO DECOUPLE WORKING ON NEXT YEAR'S BECAUSE IT WILL BE CONFUSING TO PEOPLE TO HAVE THAT CERTAINLY AT THE SAME MEETING OR TALK ABOUT THEM TOGETHER. THIS SURVEY COULD INFORM WHAT WE WANT TO DO FOR NEXT TIME. I DON'T KNOW WHAT WOULD THE RESULTS OF THE SURVEY BE AVAILABLE? WHEN IS THIS WHOLE PROJECT PROBABLY GOING TO BE DONE? >> WE TYPICALLY HAVE A SIX WEEK TIMELINE FROM THE TIME OF SURVEY IS OUT OF THE FIELD TO WHEN WE CAN DELIVER THE SURVEY ANALYSI AND KNOW THAT WE HAVE BEEN WORKING WITH CLINT AND TINA ON THAT SPECIFIC TIMELINE. WE ALSO TALKED ABOUT ACTUALLY HAVING A SURVEY IN THE FIELD. JUNE 14TH THROUGH THE 28TH. SO WE WOULD BE TRYING TO GET CLOSE TO OUR SIX-WEEK TIMELINE. DOES THAT STILL SOUND LIKE A GOOD WINDOW OF TIME? BECAUSE I KNOW I HEARD SOMEONE MENTION THE 17TH. THE SURVEY MAY NEED TO BE VOTED ON. THE SURVEY ITSELF DOESN'T NEED TO BE VOTED ON. BUT THE DOCUMENT HAS TO BE APPROVED BY THE BOARD IN ORDER TO BE USED. >> OKAY. SO THAT'S WHERE WE'RE KIND OF REALLY HAVING A TIMELINE ISSUE. >> AND ACTUALLY -- >> THEY WOULD NEED THE RESULTS LIKE THEY COULD NOT HOLD THE EVALUATION UNTIL THEY HAD THOSE RESULTS. SO THAT'S THE OTHER HALF OF THAT. >> OKAY. >> JENNIFER, I HAD NOTED THE ADMINISTRATION WINDOW JUNE 7TH-21. >> OKAY. >> I THINK WE CAN TALK OFFLINE ABOUT HOW OUR STUFF LINES UP BECAUSE WE ARE COME A LONG WAY IN THE LAST FIVE YEARS, BUT WE'RE STILL I THINK THE, WE'VE HAD A LOT OF THINGS SUCH AS A PANDEMIC WHEN WE WERE FINALLY GETTING IT ALL RIGHT IN TERMS OF TIME FRAME, WE HAD THAT COME IN AND BROAD SIDE US IN TERMS OF EVEN WHAT THE CRITERIA WAS THAT WE'RE USING TO EVALUATE. SO I THINK WE PROBABLY NEED TO HAVE AN OFFLINE DISCUSSION ABOUT HOW WE USE THESE RESULTS. WE DON'T WANT TO HAVE THEM OUT OF SYNC WITH WHAT WE'RE DOING BECAUSE THAT WOULD BE SILLY. EVEN IF WE HAVE TO HAVE A DELAY IN WHAT WE'RE DOING AS WE HAVE DONE BEFORE, IT STILL WILL BE OKAY. I THINK IT'S A CONVERSATION WE CAN HAVE OFFLINE PROBABLY. >> I AGREE WITH YOU, CINDY. I THINK THAT IN THE PAST YOU KNOW IT'S NOT LIKE WE'RE DOING THE EVALUATION TO JULY 1ST. AND PLUS. SO IF YOU'RE SURVEY ENDS ON THE 21ST, FOUR WEEKS AFTER THAT. [01:00:03] SORRY I'M LOOKING AT MY CALENDAR. I JUST WANT TO SEE WHAT FOUR WEEKS PAST THAT. YOU SAID YOU NEEDED SIX WEEKS TOTAL. >> CORRECT. >> SO, THE 19TH OF JULY. >> THANK YOU. OKAY. SO THAT MIGHT WORK BECAUSE IT'S SORT OF LIKE AT LEAST TWO WEEKS PAST THE END OF THE SCHOOL, YOU KNOW THE END OF THE FISCAL YEAR AND THEN SO YEAH. WE'LL DISCUSS THAT WITH THE BOARD ITSELF, BOARD MEMBERS JUST TO MAKE SURE THAT ALIGNS ALTHOUGH I DON'T KNOW THERE'S -- >> IS THERE A SPECIFIC DATE THAT THE TEAM HAS IN MIND WHICH YOU NEED THE SURVEY ANALYSIS REPORTS BY? >> I DON'T KNOW IF A SPECIFIC DATE AT THIS TIME. AFTER WE TALK WITH THE CHAIR AND MAYBE SORT OF REGROUP, WE CAN SORT OF FIGURE OUT WHAT OUR SPECIFIC GOAL POINT IS. SO, AND I WILL TALK WITH THE CHAIR JUST SEE IF YOU KNOW THE 19TH IF WE HAVE THAT ANALYSIS AND DATA ON THE 19TH, IS THAT OKAY? AND THEN WE JUST DO THE EVALUATION IN TIME. YOU KNOW, LIKE WE KNOW WE WILL GET IT THEN. AND THEN, WE'LL SET OUR EVALUATION DATE BASED ON THAT. SO I JUST NEED TO CHECK IN WITH THE CHAIR TO MAKE SURE SHE IS NOT ANTICIPATING HOLDING IT MUCH SOONER THAN THAT. OKAY. AND JUST SO WE'RE CLEAR, IF THE SURVEY COMES OUT OF THE FIELD ON FRIDAY THE 18TH OR MONDAY THE 21ST, AS YOU MENTIONED, TINA SIX WEEKS FROM THAT TIME WOULD TAKE US INTO AUGUST. BECAUSE WE'RE LOOKING AT -- >> YOU'RE TALKING ABOUT SIX WEEK AFTER THE CLOSE -- >> YES, AFTER THE CLOSE OF SURVEY. GOT IT. GOT IT. I WAS THINKING IT WAS SIX WEEKS TOTAL PROCESS. SO WE WOULD BE LOOKING AT MID AUGUST IF WE TAKE THE SIX WEEKS FROM THE TIME OF SURVEY CLOSES. >> SUSAN. WE HAVE BEEN HAVING AN AUGUST MEETING FOR THE LAST COUPLE YEARS. I THINK THAT WOULD BE FINE. I THINK IT'S, THIS IS IMPORTANT AND I THINK IT'S, ARE WE FINDING THE PROCESS FROM EVERY YEAR FROM HAVING A PROCESS THAT WAS LIKE THE KITCHEN SINK AND TOTALLY SUBJECTIVE. I THINK THIS IS PROGRESS STILL. >> IT IS. AND I THINK THAT YOU KNOW, AS WE MOVE FORWARD AND MORE FORWARD, WE'RE GETTING BACK TO A BETTER TIMELINE. WE'RE STILL WORKING ON THAT. BUT, I THINK THAT THAT WILL PROBABLY BE OKAY. BUT I STILL WILL CHECK WITH THE CHAIR JUST TO MAKE SURE THAT DOESN'T SET OFF ANY ALARM BELLS. JUST SAYING. I DON'T THINK IT WILL. JUST WANT TO CHECK. OKAY. I'M GOING TO SIGN OFF I HAVE BEEN TO BE AT A DIFFERENT MEETING. GOOD TO SEE YOU GUYS. >> OKAY. HAVE A GOOD ONE EVERYONE. TAKE CARE. >> OKAY. SO, I WILL SEND OUT AN INVITE FOR THE 14TH FOR EVERYONE. >> OKAY. AT 9:00 AND THEN WE WILL JUST MAKE SURE EVERYONE CAN ATTEND ON THAT. >> TWO MORE QUESTIONS. I KNOW I'M THE QUESTION GIRL TODAY. >> THAT'S OKAY. WOULD WE BE ABLE TO HAVE THAT FEEDBACK ONE WEEK FROM TODAY ANY ADDITIONAL FEEDBACK SO THAT BY THE TIME WE MEET ON THE 14TH, I'M SHARING AN UPDATED SURVEY DRAFT? >> SO, YOU WANT THE FEED BACK ON THE 11TH. IS THAT CORRECT? >> IF THAT'S POSSIBLE. >> I WOULD THINK THAT'S POSSIBLE. QUEER JUST DEALING WITH THREE BOARD MEMBERS ON THIS COMMITTEE. DR. HUTCHINGS. TINA IS SERVING ON BEHALF OF CLINT BECAUSE I DON'T KNOW WHEN HE COMES BACK. I DON'T THINK HE COMES BACK UNTIL AUGUST. >> I'M NOT SURE EITHER. IT SEEMS LIKE THE BOARD SUBCOMMITTEE IS PROVIDING THE FEEDBACK. MYSELF AND COLLEAGUES CAN ALSO TAKE A LOOK WITH THAT SMALL GROUP OF NUMBER. I'M HOPEFUL WITHIN A WEEK THAT'S FEASIBLE. >> I WOULD THINK SO. I WILL JUST REMIND THEM. I KNOW VERONICA WAS UNABLE TO GET HERE BECAUSE SHE WAS STUCK IN A WORK EMERGENCY AND WAS TRYING, SHE JUST WASN'T ABLE TO. EVEN THOUGH YOUR WORKING WITH THIS COMMITTEE BOARD MEMBERS HAVE ACCESS TO EVERYTHING THAT WAS POSTED AT THIS MEETING. AS WE POST MORE THINGS, THEY WILL GET TO SEE FEEDBACK AND THINGS LIKE THAT. THEN WHEN YOU PRESENT IT AT THE BOARD MEETING, YOU WILL HAVE TO POST THAT IT'S [01:05:03] ABOUT A WEEK IN ADVANCE. AND I WOULD, I WILL PROBABLY ENCOURAGE BOARD MEMBERS TO YOU KNOW ASK QUESTIONS TO DR. HUTCHINGS IF THEY HAVE QUESTIONS BECAUSE HERE'S A QUESTION FOR YOU. SO SHOULD AT THAT MEETING WHERE YOU PRESENT IT, BOARD MEMBERS ARE DISCUSSING SOMETHING WHERE THEY WANT TO CHANGE. IS THAT POSSIBLE TO MAKE A CHANGE AFTER THE THIRD BEFORE YOUR RELEASE? >> IT WOULD BE TOUGH TO BE HONEST WITH FOR THEM TO MAKE A CHANGE ON THE THIRD BECAUSE WE WOULD BE PUTTING THE SURVEY IN THE FIELD THAT MONDAY MORNING. >> OKAY. OKAY. OKAY. AND IS IT DIFFERENT TO MAKE IT WHEN YOU SAY CHANGE, VERSUS A TWEAK? LIKE IF SOMEONE HAS LANGUAGE ISSUES VERSUS, WE DON'T WANT, I DON'T THINK ANYONE WILL ASK YOU TO REDO THE SURVEY. JUST QUESTIONING WHAT WE MEAN BY CHANGE. >> SO, IT WOULD BE TOUGH BUT WE DEFINITELY WANT TO MAKE SURE EVERYONE IS PLEASED WITH THE SURVEY. JUST TO SHARE WITH YOU OUR PROCESS. AFTER WE MEET WITH YOU ON THE 14TH AND SHARE THE UPDATED SURVEY, WE CAN THEN ACTUALLY ALSO SHARE A PREVIEW LINK ONCE THAT BECOMES AVAILABLE WHERE YOU WITH SEE THE ELECTRONIC VERSION OF THE SURVEY. YOU'RE ABLE TO CLICK THROUGH AND SEE WHAT IT WOULD LIKE LOOK ON A PHONE OR TABLET. OR MOVING TOWARDS A FINALIZED INSTRUMENT TO SHARE WITH THE BOARD AT THAT JUNE 3RD MEETING. BUT IF IT'S CHANGING HAPPY TO GLAD AND JUST ONE SMALL AREA, WE WOULD TRY OUR BEST TO ACCOMMODATE YOU. BUT BY THAT TIME, IT WOULD BE PRETTY MUCH FINALIZED TO CONTINUE TO WORK BACKWARDS TOWARDS CLOSING THE SURVEY ON THE 18TH. >> I ONLY ASK THAT BECAUSE YOU KNOW, I THINK THAT WITH THE SURVEY IN GENERAL, THE BOARD LOOKS AT IT, READS IT AND THEN SAYS GREAT. THANK YOU. BUT I JUST WANT TO ANTICIPATE THAT SOMETIMES THAT'S NOT ALWAYS THE CASE. >> SO, I'M SORRY. >> IT'S OKAY. AND -- >> I JUST WANTED TO ALSO LET YOU KNOW BETWEEN THE TIME YOU GIVE US YOUR FINAL CHANGES AND THE TIME WE PRESENT IT TO THE BOARD WE ALSO PUT SURVEYS THROUGH PRETTY RIGOROUS TESTING WITH OUR SURVEY TESTING TEAM. AND YOU KNOW, OUT OF THAT OUR SURVEY TESTING TEAM MAY COME UP WITH TWEAKS AND THEN IT HAS TO GO BACK INTO LIKE SURVEY ADMINISTRATION WHERE WE MAKE THE TWEAKS. SO, YOU KNOW THERE ARE A LOT OF BEHIND THE SCENES STEPS TO THE SURVEY THAT WILL GO ON FROM THAT PERIOD. SO ONCE WE GET TO THE THIRD AND WE GET SO CLOSE TO THAT LAUNCH DATE, YOU KNOW AS JENNIFER SAID, WE CAN MAKE MINOR WORD TWEAKS THAT'S NOT A PROBLEM. BUT IF IT BECOMES LIKE MORE COMPLEX WE'RE NOT REALLY COMFORTABLE PUTTING A SURVEY IN THE FIELD THAT HAS NOT BEEN THOROUGHLY TESTED. >> I UNDERSTAND THAT. I JUST WANTED TO UNDERSTAND WHAT IF, WHAT LIKE DEPENDING ON THE BOARD -- >> YEAH. AND FOR SURE YOU KNOW IF THEY, JUST IMAGINE THEY CAME AWAY AND SAID, WOW, WE WANT TO SEE MAJOR STRUCTURAL CHANGES TO THIS. IT'S NOT WE CAN'T DO IT. IT'S JUST IT'S GOING TO PUSH THE TIMELINE BACK FURTHER. SO YOU KNOW, TIME IS ALWAYS THE GREAT EQUALIZER. >> I KNOW. I KNOW. SO JUST A FOLLOW UP QUESTION, IS THIS A SURVEY ACPS WILL USE YEAR AFTER YEAR OR A ONE-TIME SURVEY. >> WE CAN DEFINITELY DO WHAT WE CALL A LONGITUDINAL ANALYSIS. DO THIS IN FOLLOWING YEARS AND COMPARE THE RESULTS. THAT'S CERTAINLY SOMETHING WE CAN DO. >> BUT ON THE NOT PART OF THE PROCESS AT THIS POINT? >> NO. NOT, IT IS NOT. >> OKAY. OKAY. SO OKAY. WELL, ALL OF THAT IS GOOD INFORMATION. SO, WE CAN TINA ARE YOU SILL ON? >> I AM. FOR THE JUNE 3RD MEETING. WHAT THE DEADLINE FOR POSTING THE MATERIALS? WE HAVE TO PUBLISH FRIDAY AND ASK IT'S UPLOADED WEDNESDAY PRIOR TO THE [01:10:04] FRIDAY. SO, THE THIRD IS GOING TO BE -- MAY 26TH. >> WELL WE HAVE TO PUBLISH ON THE 25TH SO IT -- SO WE ASK YOU TO UPLOAD ON THE 23RD BECAUSE THAT'S WHEN IT GOES TO THE SUPERINTENDENT. BUT I WILL TELL YOU THAT THERE ARE MANY THINGS THAT DON'T GET TO THE SUPERINTENDENT UNTIL THE 25TH. SO I WOULD ASK YOU TO AIM FOR THE 23RD BECAUSE WE HAVE TO HAVE IT POSTED AND PUBLISHED ON THE 25TH. SO, IF WE'RE JUST SEEING NOT WE BUT IT SOMEONE IS JUST SEEING IT ON THE 25TH AND SAYS, NO, NO, YOU GOT TO FIX THIS, FIX THAT, MEETING LIKE THE MEMO AND WHATEVER, YOU KNOW YOU HAVE TO HAVE TIME TO MAKE THE CHANGES I ORDER FOR US TO PUBLISH. AND I'M NOT TALKING ABOUT THE SURVEY AS MUCH, I'M TALKING ABOUT THE POSTING PROCESS. >> OKAY. AND OUR DEPARTMENT HAS TO MAKE SURE THAT THE CORRESPONDING MEMO IS IN ALIGNMENT IN ALL OF THAT. >> CORRECT. AND THEN TINA, I JUST WANTED TO THROW OUT WITH YOU. YOU TALKED ABOUT THE PREVIEW LINK IF THAT WOULD BE A BOARD BRIEF SO THE BOARD COULD SEE IT. THAT WOULD PROBABLY BE ON THE 18TH. I DON'T KNOW IF THAT'S EVEN POSSIBLE. BUT, YOU WERE SAYING ABOUT A PREVIEW LINK IF YOU WERE GOING TO DO THAT, WE MIGHT HAVE TO POST IT AS A BOARD BRIEF FOR BOARD MEMBERS. IS THAT POSSIBLE? IS THAT TIMELINE POSSIBLE? IF NOT -- >> IT WOULD PROBABLY BE A LITTLE LATER IN THE WEEK. ONCE WE MEET WITH YOU ON THE 14TH, THAT'S WHEN WE SEND TO THE TESTING TEAM THAT SUSAN WAS MENTIONING AND MAKING SURE THAT YOU KNOW THERE ARE NO ROAD BUMPS AND SO IT WOULD BE LATER ON IN THAT WEEK. >> OKAY. SO, LATER ON THE 14TH OR LATER THE WEEK OF THE 14TH OR THE NEXT WEEK. >> LATER ON IN THE WEEK OF 17TH. THE 14TH IS A FRIDAY. OF JUNE? >> OF MAY. OH, SORRY. I'M SO SORRY. I'M LOOKING AT JUNE. I HAVE A JUNE CALENDAR IN FRONT OF ME. THE 14TH AND YOU'RE TALKING ABOUT THE FOLLOWING WEEK. OKAY. SO MY ALL OF MY DATES ARE WRONG FOR WHEN IT NEEDS TO BE POSTED. SO, THE POSTING FOR THE THIRD WOULD BE THE 26 TO POST AND THE 28TH TO PUBLISH. SO. >> OKAY. SORRY ABOUT THAT. I HAD THE WRONG CALENDAR. >> SO, DEFINITELY BY THAT 26TH DATE OR A LITTLE PREVIOUS TO THAT, WE WOULD BE ABLE TO PROVIDE THE PREVIEW LINK. BY THAT TIME, THE SURVEY WOULD HAVE FINISHED GOING THROUGH THE TESTING PROCESS. >> OKAY. SO, AT THAT POINT, I'M NOT SURE WE NEED A PREVIEW LINK. YOU CAN SEND ONE BECAUSE ON THE 28TH, THAT ITEM WOULD BE LIVE. SO THEY WOULD BE ABLE TO PREVIEW IT AT THAT POINT. BUT, YOU KNOW, TINA, IT'S UP TO YOU. >> YEAH. I'M THINKING ABOUT IT. JUST WONDERING LIKE IF THE PULL PDF IS GOING JUST A FEW DAYS LATER, I'M NOT SURE I SEE THE VALUE IN THE PREVIEW LINK AND KNOWING THAT ULTIMATELY THAT LINK WILL BE A DEAD INACTIVE LINK AND DO WE WANT THAT OUT THERE. >> RIGHT. FOR THE FUTURE. SO I'M LEANING AGAINST THE PREVIEW LINK BECAUSE THE CONTENT WILL BE IN THE PDF VERSION. >> OKAY. SO, 14TH, YOU GET FEEDBACK BY THE 11TH. 14TH WE HAVE MEETING AT 9 O'CLOCK. AND THEN YOU GUYS ARE RUNNING WITH WHATEVER YOU'RE DOING. >> YEAH. AND THEN THE 28TH WILL BE PUBLISHING THE SURVEY. AND THEN THE BOARD IF THEY HAVE FEEDBACK OR QUESTIONS, WELL ACTUALLY THEY CAN WAIT TO THE MEETING FOR QUESTIONS AND STUFF. I THINK THIS INSTRUMENT IT WILL BE PRETTY THOROUGH AND I DON'T THINK THAT THE BOARD IS GOING TO HAVE MUCH TO REALLY CHANGE ABOUT IT. BUT THERE MAYBE QUESTIONS THAT SOUND LIKE YOU KNOW, SO. BUT, THEY WILL, YOU KNOW, WHO KNOWS. IT'S HARD TO TELL WITH THE BOARD WHAT THEIR QUESTIONS WILL BE OR THEIR THOUGHTS [01:15:02] SOMETIMES. ANYWAY. THIS IS A PRETTY THOROUGH INSTRUMENT. I THINK -- >> THANK YOU. >> THAT WOULD BE GOOD. >> AND WHILE YOU ALL ARE REVIEWING, CAN YOU COULD MAKE KEY LINKS TO THE HYPER LINKS FOR INDICATORS. THAT WOULD BE HELPFUL. I KNOW YOU'RE GOING TO WAREHOUSE ALL OF THE EVIDENT THAT DR. HUTCHINGS MENTIONED IN TERMS OF THE EVIDENCE. BUT IF THERE ARE AREAS IN THE SURVEY WHERE YOU WOULD LIKE FOR US TO HYPER LINK THE INDICATORS THAT ARE ON THE VBOE DOCUMENT, PLEASE INCLUDE THAT IN YOUR FEEDBACK AS WELL. >> OKAY. OKAY. AND WHEN YOU SAY THE VDOE DOCUMENT, YOU MEAN DR. HUTCHINGS EVALUATION INSTRUMENT? >> YES. SO WE HAVE DEVELOPED OUR OWN NOT THAT, IT'S BASED ON THE VDOES, BUT WE DIDN'T TAKE THE VDOE'S STRICTLY AS THE. >> OKAY. AND A LOT OF THAT IS BECAUSE OF HOW WE NEEDED TO COLLECT DATA. YOU KNOW WE ALLOWED FOR A SPECIFIC DATA SO WE ASKED OUR QUESTIONS I THINK DIFFERENTLY. >> OKAY. SO ANYWAY. BUT, OKAY. SO I DON'T HAVE ANYTHING ELSE IF ANYONE ELSE DOES. I THINK WE'RE OKAY. I LOOK FORWARD TO RECEIVING YOUR FEEDBACK BY THE 11TH AND THEN SEEING YOU ALL VIRTUALLY AGAIN ON THE 14TH. >> OKAY. AWESOME. ANOTHER ZOOM. ANOTHER ZOOM. >> SO. ANYWAY. THANK YOU SO MUCH. IT'S VERY NICE TO MEET YOU ALL. AND -- >> THANK YOU. YOU AS WELL. SO, WE LOOK FORWARD TO GIVING FEEDBACK AND MEETING YOU AGAIN ON THE 14TH. SO. THANK YOU SUSAN. THANK YOU TINA. >> THANK YOU EVERYONE. * This transcript was compiled from uncorrected Closed Captioning.