The PISA-syndrome - How the OECD has hijacked the way we perceive pupils, schools and education
DOI:
https://doi.org/10.3384/confero.2001-4562.190125Abstract
From the mid 1990s, the OECD started the planning of the Program for International Student Assessment, now well known as PISA. 1 The first PISA testing took place early in 2000, and the results were published in December 2001. Since then, PISA results have gradually become a kind of global “gold standard” for educational quality, and educational policy has been globalized, lifted out of the domestic policy, as proudly stated by the PISA director, Andreas Schleicher in the TED-talk quoted below. The presentation is transcribed in 29 languages and has been seen by some 758 thousand viewers.
References
Alexander, R. “Moral Panic, Miracle Cures and Educational Policy: what can we really learn from international comparison?” Scottish Educational Review 44.1 (2012), 4-21.
Alliance for Excellent Education. “Joint Statement: National Groups Co-Host Briefing On 2006 PISA Results.” Washington: Alliance for Excellent Education https://all4ed.org/wp-content/uploads/2013/09/JointStatement_2006PISA.pdf [Retrieved 12 February 2019]
Arffman, I. The problem of equivalence in translating texts in international reading literacy studies. A text analytic study of three English and Finnish texts used in the PISA 2000 reading test. Jyväskylä: University of Jyväskylä, Institute for Educational Research, 2007.
Arffman, I. “Equivalence of Translations in International Reading Literacy Studies”, Scandinavian Journal of Educational Research, 54.1 (2010): 37–59. https://doi.org/10.1080/00313830903488460
Ball, S.J. Global education Inc: New policy networks and the neo-liberal imaginary. London: Routledge, 2012.
Bieber, T., & Martens, K. “The OECD PISA study as a soft power in education? Lessons from Switzerland and the US.” European Journal of Education, 46.1 (2011): 101–116. https://doi.org/10.1111/j.1465-3435.2010.01462.x
Breakspear, S. “The Policy Impact of PISA: An Exploration of the Normative Effects of International Benchmarking in School System Performance”, OECD Education Working Papers, No. 71, OECD Publishing, 2012. https://doi.org/10.1787/5k9fdfqffr28-en
Breakspear, S. How does PISA shape education policy making? Why how we measure learning determines what counts in education. Centre for Strategic Education, 2014. Available at: http://simonbreakspear.com/wp-ontent/uploads/2015/09/Breakspear-PISA-Paper.pdf
Bybee, R., & McCrae, B. J. “Scientific Literacy and Student Attitudes: Perspectives from PISA 2006 science”, International Journal of Science Education, 33.1 (2011): 7-26. https://doi.org/10.1080/09500693.2010.518644
Education International. “Letter to the OECD: Pearson Stakeholders’ Report.” 2016. http://download.ei-ie.org/Docs/WebDepot/Letter_Pearson_Report.pdf [Retrieved 12 February 2019]
Eide, K. OECD og norsk utdanningspolitikk. En studie av internasjonalt samspill, (OECD and Norwegian education policy. A study of international interaction). Oslo: NAVFs Utredningsinstitutt, 1995.
El Masri, Y., Baird, J-A., & Graesser, A. ”Language effects in international testing: The case of PISA 2006 science items.” Assessment in Education: Principles, Policy & Practice, 23.4 (2016).
EU. Science Education Now: A renewed pedagogy for the future of Europe, (The Rocard report), Brussels: European Commission, 2007.
Goldstein, H. “Measurement and evaluation issues with PISA.” The PISA effect on global educational governance. Ed. Louis Volante Louis. New York and London: Routledge, 2017. https://doi.org/10.4324/9781315440521-4
Grek, S. “Governing by numbers: the PISA ‘effect’ in Europe.” Journal of Education Policy, 24.1 (2009): 23-37. https://doi.org/10.1080/02680930802412669
Grisay A. de Jong J.H., Gebhardt E., Berezner A., Halleux-Monseur B. “Translation equivalence across PISA countries.” Journal of Applied Measurement. 8.3 (2007): 249-66.
Hopmann, S.T., Brinek, G. & Retzl, M. eds. PISA zufolge PISA – PISA According to PISA Berlin: LIT Verlag, 2007.
ICSU. Report of the ICSU Ad-hoc Review Panel on Science Education. Paris: International Council for Science, 2011.
Kjærnsli, M. & Jensen, F., eds. Stø kurs. Norske elevers kompetanse i naturfag, matematikk og lesing i PISA 2015. Oslo: Universitetsforlaget, 2016.
Kjærnsli, M. & Lie, S. “Students’ preference for science careers: International comparisons based on PISA 2006” International Journal of Science Education, 33.1 (2011): 121–144. https://doi.org/10.1080/09500693.2010.518642
Komatsu, H. & Rappleye, J. “A new global policy regime founded on invalid statistics? Hanushek, Woessmann, PISA, and economic growth” Comparative Education, 53:2 (2017): 166-191. https://doi.org/10.1080/03050068.2017.1300008
Kreiner S. & Christensen K.B. “Analyses of model fit and robustness. A new look at the PISA scaling model underlying ranking of countries according to reading literacy.” Psychometrika. 79.2 (2014): 210-31. https://doi.org/10.1007/s11336-013-9347-z
Lundgren, U. P. “PISA as a Political Instrument” PISA Under Examination. Changing Knowledge, Changing Tests, and Changing Schools. Eds. Pereyra, M.A., Kotthoff, H.G and Cowen, R., Rotterdam: Sense Publishers, 2011. https://doi.org/10.1007/978-94-6091-740-0_2
Meyer, H. D et al. ”Open letter to Andreas Schleicher on PISA.” The Guardian, 13 Dec. 2014. https://www.theguardian.com/education/2014/may/06/oecd-pisa-tests-damaging-education-academics [Retrieved 12 February 2019]
Meyer, H.D & Benavot, A. eds. PISA, Power and Policy: the emergence of global educational governance. Oxford: Symposium Books, 2013.
OECD. Measuring Student Knowedge and skills. A New Framework for Assessment. Paris: OECD Publications, 1999.
OECD. Knowedge and skills for life. First results from PISA 2000. Paris: OECD Publications, 2001.
OECD. PISA 2003 Technical Report. Paris: OECD Publishing, 2005.
OECD. Assessing Scientific, Reading and Mathematical Literacy, A framework for PISA 2006. Paris: OECD Publications, 2006.
OECD. Education at a Glance 2007: OECD Indicators. Paris: OECD Publications, 2007.
OECD. OECD Economic Surveys, Norway Volume 2008/13. Paris: OECD Publications, 2008.
OECD. PISA 2006 Technical Report. Paris: OECD Publications, 2009. http://www.oecd.org/dataoecd/0/47/42025182.pdf [Retrieved 12 February 2019]
OECD. PISA 2009 Results: What Makes a School Successful? Resources, Policies and Practices, Vol. 4. Paris: OECD Publications, 2010a.
OECD. The High Cost of Low Educational Performance: The long run Economic Impact of Improving PISA Outcomes. Paris: OECD Publications, 2010b. https://doi.org/10.1787/9789264077485-en
OECD. Lessons from PISA for the United States, strong performers and successful reformers in education. Paris: OECD Publishing, 2012.
OECD. PISA 2012 Assessment and Analytical Framework: Mathematics, Reading, Science, Problem Solving and Financial Literacy. Paris: OECD Publishing, 2013. https://doi.org/10.1787/9789264190511-en
OECD. Students, Computers and Learning: Making the Connection. Paris, OECD Publishing, 2015a. https://doi.org/10.1787/9789264239555-en [Retrieved 12 February 2019]
OECD. OECD’s video “PISA – Measuring student success around the world”. (2015b.)
OECD. PISA 2015 Assessment and Analytical Framework: Science, Reading, Mathematic and Financial Literacy. Paris: OECD Publishing, 2016a. https://doi.org/10.1787/9789264255425-en
OECD. PISA 2015 Results (Volume I): Excellence and Equity in Education. Paris: OECD Publishing, 2016b.
OECD. PISA 2015 Results (Volume II): Policies and Practices for Successful Schools. Paris: OECD Publishing, 2016c.
OECD. Skills Matter: Further Results from the Survey of Adult Skills. Paris: OECD Publishing, 2016d. https://doi.org/10.1787/9789264258051-en [Retrieved 12 Feb 2019]
OECD. Starting Strong 2017: Key OECD Indicators on Early Childhood Education and Care. Paris: OECD Publishing, 2017a. https://doi.org/10.1787/9789264276116-en [Retrieved 12 Feb 2018]
OECD. Education at a Glance 2016: OECD Indicators. Paris: OECD Publishing, 2017b. https://doi.org/10.1787/eag-2017-en [Retrieved 12 Feb 2019]
OECD. PISA for Development. Policy Briefs. Paris: OECD, 2018a. http://www.oecd.org/pisa/aboutpisa/pisafordevelopment-documentation-briefs.htm [Retrieved, 12 Feb 2019]
OECD. “PISA in Focus. Policy Briefs.” Paris: OECD, 2018b. http://www.oecd.org/pisa/pisaproducts/pisa-in-focus-all-editions.htm [Retrieved 12 Feb 2019]
OECD. “PISA-based test for schools” Paris: OECD, 2018c. http://www.oecd.org/pisa/aboutpisa/pisa-based-test-for-schools.htm [Retrieved, 18 Feb 2018]
Pearson. “The Learning Curve”, 2018. http://www.edmide.gr/anakoinoseis/The-Learning-Curve-Report-2014%20(1).PDF [Retrieved 12 June 2017]
Pereyra, M. A., Kotthoff, H.-G., & Cowan, R. eds. PISA under examination: Changing knowledge, changing tests, and changing schools. Rotterdam: Sense, 2011. https://doi.org/10.1007/978-94-6091-740-0
Pons X. “Fifteen years of research on PISA effects on education governance: A critical review.” European Journal of Education 52.2 (2017): 131–144. https://doi.org/10.1111/ejed.12213
Popkewitz, T., “PISA: Numbers, Standardizing Conduct, and the Alchemy of School Subjects.” PISA Under Examination. Changing Knowledge, Changing Tests, and Changing Schools. Eds. Pereyra, M.A., Kotthoff, H.G and Cowen, R. Rotterdam: Sense, 2011.
Ravitch, D. The Death and Life of the Great American School System. How Testing and Choice Are Undermining Education. New York: Basic Books, 2011.
Rinne, R. “The growing supranational impacts of the OECD and the EU on national education policies and the case of Finland”, Policy Futures in Education, 6.6 (2008): 665–680. https://doi.org/10.2304/pfie.2008.6.6.665
Rutkowski, L., & Rutkowski, D. “A call for a more measured approach to reporting and interpreting PISA results.” Educational Researcher, 45.4 (2016): 252–257. https://doi.org/10.3102/0013189X16649961
Sahlberg, P. Finnish Lessons: what can the world learn from educational change in Finland? New York: Teachers College, 2011.
Schleicher, A. “Use data to build better schools.” TEDGlobal 2012. http://www.ted.com/talks/andreas_schleicher_use_data_to_build_better_schools?language=en [Retrieved 12 feb 2018]
Schleicher, A. “Vietnams stunning rise in school standards.” BBC News 17 Jun. 2015. http://www.bbc.com/news/business-33047924 [Retrieved 12 Feb 2018]
Sellar, S., and Lingard, B. “The OECD and the expansion of PISA: New global modes of governance in education.” British Educational Research Journal 40.6 (2014): 917-936. https://doi.org/10.1002/berj.3120
Sellar, S., Thompson, G., and Rutkowski, D. The global education race: taking the measure of PISA and international testing. Alberta: Brush Education Inc, 2017.
Sjøberg, S. “PISA and "Real Life Challenges": Mission Impossible?” PISA zufolge PISA – PISA According to PISA. Ed. Hopmann, S.T., Brinek, G., and Retzl, M. Berlin: LIT Verlag, 2007. 203-224.
Sjøberg, S. “OECD, PISA, and Globalization. The Influence of the International Assessment Regime.” Education Policy Perils. Tackling the Tough Issues. Ed. Tienken, C. H., and Mullen, C. A. New York: Routledge, 2016. 102-133.
Sjøberg, S. “The power and paradoxes of PISA: Should Inquiry-Based Science Education be sacrificed to climb on the rankings?” NorDiNa, Nordic studies in science education 14.2 (2018): 186-202. https://www.journals.uio.no/index.php/nordina/article/view/6185/5249 [Retrieved 12 Feb 2019]
Sjøberg, S. “PISA: A success story? Global Educational Governance by standardization, rankings, comparisons and "successful" examples.” Handbuch Educational Governance-Theorien. Ed. Langer, L., and Brüsemeister T. Springer VS, 2019. 653-690.
Steffen, B., and Hößle, C. Decision-making Competence in Biology Education: Implementation into German Curricula in Relation to International Approaches. Eurasia Journal of Mathematics, Science & Technology Education, 10.4 (2014): 343-355.
Steiner-Khamsi, G. The politics of league tables. Journal of Social Science Education, 1 (2003): 1-6. https://doi.org/10.4119/UNIBI/jsse-v2-i1-470
Steiner-Khamsi, G. Cross-national policy borrowing: understanding reception and translation. Asia Pacific Journal of Education, 34.2 (2014): 153-167. https://doi.org/10.1080/02188791.2013.875649
UNESCO. International Standard Classification of Education ISCED 2011. Montreal: UNESCO Institute for Statistics, 2012. http://uis.unesco.org/sites/default/files/documents/international-standard-classification-of-education-isced-2011-en.pdf [Retrieved 12 feb 2019]
Verger, A., Lubienski, G., and Steiner-Khamsi, G. “The Emergence and Structuring of the Global Education Industry: Towards an Analytical Framework”.World Yearbook of Education 2016: The Global Education Industry. Eds. Verger, A., Lubienski, G and Steiner-Khamsi, G. New York: Routledge, 2016.
Wuttke, J. ”Uncertainty and Bias in PISA”. PISA According to PISA — Does PISA Keep What It Promises?. Eds. Hopman, S., Brinek, T.G., and Retzl, M. Berlin: Lit Verlag, 2007. 241-263.
Zhao, Y. What works may hurt: Side effects in education. Journal of Educational Change, 18.1 (2017): 1-19. https://doi.org/10.1007/s10833-016-9294-4
Downloads
Published
Issue
Section
License
Copyright (c) 2019 Svein Sjöberg
This work is licensed under a Creative Commons Attribution 4.0 International License.
As Confero is an open access journal, this means that anyone who can access the Internet can freely download and read the journal. There are no commercial interests for Linköping University Electronic Press or Confero in publishing the journal.
The core idea of open access is that copyright remains with the author(s). However, we publish with the agreement of the author that if she or he decides later to publish the article elsewhere, that the publisher will be notified, prior to any acceptance, that the article has already been published by Confero.
When publishing with Confero, it is with the agreement of the author that if they make their article available elsewhere on the internet (for example, on their own website or an institutional website), that they will do so by making a link to the article as published in Confero using the Digital Object Identifier (DOI) number of the article and acknowledge in the text of the site that the article has been previously published in Confero.
As evident by the markers on our homepage, Confero falls under the Creative Commons licence abbreviated BY. This means that we allow others to use, spread and elaborate on the published articles, as long as they acknowledge who published it and where it was originally published.
