{"id":15989,"date":"2020-02-14T09:37:57","date_gmt":"2020-02-14T15:37:57","guid":{"rendered":"https:\/\/www.teachersoftomorrow.org\/?p=15989"},"modified":"2020-02-27T06:45:38","modified_gmt":"2020-02-27T12:45:38","slug":"edtpa-studies","status":"publish","type":"post","link":"https:\/\/www.teachersoftomorrow.org\/blog\/insights\/edtpa-studies\/","title":{"rendered":"edTPA studies"},"content":{"rendered":"
I will keep updating this post as it seems that more and more edTPA news comes in – on 2\/26\/2020 – The Pearson-scored test<\/a> is meant to assess whether prospective educators have the skills to teach, but critics question the time and cost involved, its reliability and Pearson’s “corporate profits.”<\/p>\n The new study by Drew Gitomer from Rutgers (a very solid researcher) and others entitles \u201cAssessing the Assessment: Evidence of the Reliability and Validity in the edTPA<\/a>\u201d is pretty clear.\u00a0 Their conclusion:<\/p>\n \u201c<\/em>We argue that, in light of the evidence available, the current proposed and actual uses of edTPA in evaluating PSTs and programs are not sufficiently supported on technical and empircal groups. We recommend that serious consideration be given to a moratorium on using edTPA scores for consequential decisions at the individual level, pending provision of appropriate evidence of the reliability, precision and validity of the scores produced by the assessments and given the stakes involved, an independent technical review of this evidence by an expert panel.\u201d<\/em><\/p>\n A podcast<\/a>\u00a0that covers the\u00a0recent AERA study<\/a>\u00a0on the edTPA problems actually got me to listen to the whole thing.\u00a0 This is pretty amazing stuff and you should listen to the researchers talk about the MAJOR issues with the edTPA.<\/p>\n costs $300 per test \u2013 if you fail you are now up to $600 in testing. The number 1 reason people do not enter teaching is because of the cost and this is a HUGE barrier.<\/p>\n edTPA scorers<\/a> only receive $75 per portfolio \u2013 they are supposed to grade it \u201cholistically\u201d \u2013 ie not spend that much time on something it took an entire year to create and is the sole determinant if a person gets to stay teacher or not.<\/p>\n California \u2013<\/p>\n Connecticut \u2013<\/strong><\/p>\n Georgia \u2013 <\/strong><\/p>\n Illinois \u00a0–<\/strong> held hearings on edTPA this spring \u2013 concerned that cost and other issues with the edTPA is making their teacher shortage worse. https:\/\/www.rrstar.com\/news\/20190320\/teacher-licensing-tests-come-under-fire-in-illinois<\/a><\/p>\n Oregon – <\/strong>https:\/\/pilotscholars.up.edu\/cgi\/viewcontent.cgi?article=1074&context=etd<\/a><\/p>\n National <\/strong>–\u00a0\u00a0 Stop using edTPA for certification due to the many issues with reliability\u00a0 http:\/\/blogs.edweek.org\/teachers\/teaching_now\/2019\/12\/edtpa_scores_teacher_certification_decisions.html<\/a><\/p>\n Lesson Six: The edTPA Privileges Candidates from Certain Linguistic and Cultural Backgrounds<\/p>\n A teaching candidate may have carefully planned and successfully taught an effective \u201clearning segment\u201d but unless the candidate has also learned the language of the edTPA exam, followed particular directives, understood rubric objectives, and crafted their commentary by thoroughly reflecting the terminology designed and used by SCALE, she or he risks a failing score. This goal of learning the language of a teacher \u201cbar exam\u201d specifically disadvantages teacher candidates of color, as noted by Christine D. Clayton, Department chair of the Pace University School of Education:<\/p>\n Recent data from other states (where the assessment is not a certification exam) indicate that some groups, including teaching candidates of color and those from linguistic minority groups, were failing edTPA at disproportionate rates. Other reports showed evidence of candidates who performed well on edTPA, but did not earn fair supervision reports when actually teaching students.26<\/p>\n Wayne Au, associate professor in the education program at the University of Washington, expresses a legitimate concern, \u201cGiven the severe lack of teachers of color and teachers from working-class backgrounds, I wonder if the edTPA will systematically reproduce race and class inequalities, like every other high-stakes standardized test.\u201d27<\/sup><\/p>\n https:\/\/blogs.edweek.org\/teachers\/teaching_now\/2018\/09\/edtpa_study.html<\/a><\/p>\n https:\/\/journals.sagepub.com\/doi\/abs\/10.1177\/0042085918795020<\/a> – Carrie if your person could access \u2013<\/p>\n NOTE\u00a0 – lack of cultural competency in the edTPA is a big criticism as well \u2013 another issue that our urban leaders should be concerned with.<\/p>\n Assessment Is Repetitive and Misaligned, Students Say<\/p>\n But many students surveyed said they didn’t think the assessment would help them become better teachers. In response to the question about how edTPA helped them grow, 40 percent of the teacher-candidates either explicitly said that they couldn’t identify any value in the process or left the question blank. (Findings on the test’s reliability at predicting good teaching are mixed. A 2016 study from the American Institutes of Research found that the students of teachers who passed edTPA on their first try scored higher in reading than students whose teachers didn’t. But passing the test didn’t have any effect on students’ math scores.)<\/p>\n “Trying to satisfy all of the instruction rubrics’ requirements forced me to (unsuccessfully) coerce steps in the natural learning process,” wrote one of the participants. The assessment requires teachers to record themselves conducting one of the lessons that they submit as part of their portfolio. To demonstrate all of the skills edTPA requires demonstrated in the video, this participant wrote that they had to artificially speed up the pace of the lesson, “prematurely assigning group work” and “using ineffective written assessments.”<\/p>\n About one-fifth of students also said that the test was repetitive. In open-ended responses, students wrote that they felt they were asked to justify and analyze the same parts of their lesson over and over, without moving onto broader instructional applications, said Dover.<\/p>\n And while about 90 percent of candidates said using culturally responsive pedagogy was an important part of their teaching practice, only 47 percent said that edTPA prepared them to use it. “My program focused on cultural\/social justice issues, but that did not help much when it came down to writing commentaries for the [edTPA],” one participant wrote, referring to the section of the assessment that requires written self-analysis of the teacher’s lesson planning<\/p>\n NPR \u2013 http:\/\/www.nprillinois.org\/post\/teacher-testing-1-2-3#stream\/0<\/a><\/p>\n So if you want a critical teacher shortage and an all white teacher workforce \u2013 go edTPA! (just kidding JP \u2013 I know it is not causal)<\/p>\n Critics point to these requirements as one big reason that\u00a085 percent of superintendents say they have a teacher shortage<\/a>. And that shortage is compounded by a lack of diversity.\u00a0More than 80 percent of Illinois teachers white<\/a>, while\u00a0fewer than half of students<\/a>\u00a0are white<\/p>\n I did purchase the report and it is very thorough.\u00a0 They bring into question the way SCALE is analyzing the data and that until they better analyzing the subgroups, there should be a moratorium on using edTPA as a test to determine if someone should become a teacher.\u00a0 Essentially the data is not good enough to make this call.<\/p>\n They have a great section on resourced and under-resourced institutions that edTPA will hurt those under-resourced. With the attention of the rich buying slots in universities \u2013 this is a big part of what the NEA has issue with as well -more wealthy teachers pay for better quality videos to send in to ensure they pass.<\/p>\n Some specific examples from institutions in North Carolina help illustrate this point. Large, comparatively resourced institutions such as UNC-Charlotte, UNCWilmington, and North Carolina State University each contain web-housed edTPresources for students and faculty. NC State has half-credit courses specifically targeted toward edTPA, such as how to write the extensive commentaries necessary for passing. UNC-Charlotte has an edTPA lesson plan template to assists interns aligning their planning to edTPA along with extensive literature for students, faculty, and staff. The state\u2019s HBCUs, much smaller institutions by comparison, have fewer of these resources available to candidates. In our brief search, we found some HBCUs such as North Carolina A&T provide links to edTPA handbooks created by SCALE but few resources and supports beyond those. Winston-Salem State University is an important exception to this trend, which we discuss in the recommendations section below. Overall, the resources and labor necessary for edTPA implementation and candidate support disadvantage small HBCUs that prepare a disproportional percentage of Black teachers.<\/p>\n Overall, the small subsamples of Black candidates and candidates of color more broadly limit the administrative reports from providing meaningful information about the exam\u2019s potential adverse impact on candidates of color. Thus, while confirmatory analyses reported in the technical manuals demonstrate reasonable validity and reliability evidence for the constructs, rubrics, and scores, the evidence is based on the large group only. To appropriately make group comparisons on derived scores, it is necessary to establish measurement equivalence.<\/p>\n Otherwise, one cannot make claims that inferences are valid (Raju et al. 2002; Stark et al. 2006). To date, there is no evidence that the constructs examined demonstrate measurement equivalency for different racial groups. This absence of evidence calls into question high-stakes and consequential decisions made about candidates. While regular reports such as these initiate an important conversation about bias and adverse impact, the reports\u2014from the body that owns edTPA\u2014 leave much to be desired<\/p>\n Winter is Coming edTPA on African American Teachers – https:\/\/link.springer.com\/article\/10.1007\/s11256-018-0453-1<\/a><\/p>\n Calder Center Study – https:\/\/caldercenter.org\/publications\/evaluating-prospective-teachers-testing-predictive-validity-edtpa-update<\/a><\/p>\n edTPA Disproportionately Impacts Minority Teachers. <\/strong><\/p>\n edTPA also Disadvantages Teachers in Minority or Low-Income Communities. <\/strong><\/p>\n \u00a0<\/strong>edTPA Takes Time Away from the Classroom.<\/strong><\/p>\n edTPA is not transparent and is not a good tool for high-stakes decision making. <\/strong><\/p>\n I will keep updating this post as it seems that more and more edTPA news comes in – on 2\/26\/2020 – The Pearson-scored test is meant to assess whether prospective …<\/p>\n","protected":false},"author":22,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"content-type":"","rank_math_lock_modified_date":false,"footnotes":""},"categories":[24,2891],"tags":[2892,2893,2894],"class_list":["post-15989","post","type-post","status-publish","format-standard","hentry","category-insights","category-test-preparation","tag-teacher-scholarships","tag-teacher-scholarships-texas","tag-texas-scholarships"],"acf":[],"publishpress_future_action":{"enabled":false,"date":"2025-02-12 08:35:10","action":"change-status","newStatus":"draft","terms":[],"taxonomy":"category"},"publishpress_future_workflow_manual_trigger":{"enabledWorkflows":[]},"_links":{"self":[{"href":"https:\/\/www.teachersoftomorrow.org\/wp-json\/wp\/v2\/posts\/15989"}],"collection":[{"href":"https:\/\/www.teachersoftomorrow.org\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.teachersoftomorrow.org\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.teachersoftomorrow.org\/wp-json\/wp\/v2\/users\/22"}],"replies":[{"embeddable":true,"href":"https:\/\/www.teachersoftomorrow.org\/wp-json\/wp\/v2\/comments?post=15989"}],"version-history":[{"count":7,"href":"https:\/\/www.teachersoftomorrow.org\/wp-json\/wp\/v2\/posts\/15989\/revisions"}],"predecessor-version":[{"id":16106,"href":"https:\/\/www.teachersoftomorrow.org\/wp-json\/wp\/v2\/posts\/15989\/revisions\/16106"}],"wp:attachment":[{"href":"https:\/\/www.teachersoftomorrow.org\/wp-json\/wp\/v2\/media?parent=15989"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.teachersoftomorrow.org\/wp-json\/wp\/v2\/categories?post=15989"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.teachersoftomorrow.org\/wp-json\/wp\/v2\/tags?post=15989"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}\n
\n
\n
\nImplementation of the Pre-Service Assessment, edTPA, as Adopted by the Connecticut State Board of Education – does not quite recommend repealing but admits the financial burden is HUGE and EPPs really struggle to implement.<\/li>\n\n
\n
\n
\n
\n
\n
\n
\n
\n
[1]<\/a> Goldhaber, Cowan, Throbald: Evaluating Prospective Teachers: Testing the Predictive Validity of the edTPA.<\/em>\r\n\r\n[2]<\/a> Barnum, Matt: Certification Rules and Tests are Keeping Would-be Teachers of Color out of America\u2019s Classrooms. <\/em>\r\n\r\n[3]<\/a> Barmore, Peggy: Will Controversial New Tests for Teachers Make the Profession Even More Overwhelmingly White?<\/em>\r\n\r\n[4]<\/a> Petchauer, Bowe, Wilson: Winter is Coming: Forecasting the Impact of edTPA on Black Teachers and Teachers of Color.<\/em>\r\n\r\n[5]<\/a> Paugh, Wendell, Power, Gilbert: \u2018It\u2019s not that easy to solve\u2019: edTPA and preservice teacher learning. <\/em>\r\n\r\n[6]<\/a> Meuwissen, Choppin, Cloonan, Shang-Butler: Teaching Candidates\u2019 Experiences with the edTPA as an Initial Certification Test in New York and Washington States: Survey Results from the Second Year of a Two-Year Study.<\/em>\r\n\r\n[7]<\/a> Meuwissen, Choppin, Cloonan, Shang-Butler: Teaching Candidates\u2019 Experiences with the edTPA as an Initial Certification Test in New York and Washington States: Survey Results from the Second Year of a Two-Year Study.<\/em>\r\n\r\n[8]<\/a> Goldhaber, Cowan, Throbald: Evaluating Prospective Teachers: Testing the Predictive Validity of the edTPA.<\/em>\r\n\r\n[9]<\/a> Hebert, Cristyne: What Do We Really Know About the edTPA? Research, PACT, and Packaging a Local Teacher Performance Assessment for National Use.<\/em>\r\n\r\n[10]<\/a> Petchauer, Bowe, Wilson: Winter is Coming: Forecasting the Impact of edTPA on Black Teachers and Teachers of Color.<\/em>\r\n\r\n[11]<\/a> Greenblatt, O\u2019Hara: Buyer Beware: Lessons Learned from edTPA Implementation in New York State.<\/em>\r\n\r\n[12]<\/a> Hebert, Cristyne: What Do We Really Know About the edTPA? Research, PACT, and Packaging a Local Teacher Performance Assessment for National Use.<\/em><\/pre>\n","protected":false},"excerpt":{"rendered":"