International Large-Scale Assessments and the Global Regulation of Educational Systems: An Integrative Analysis
Keywords:
international large-scale assessments, global regulation, big science, governmentalityAbstract
Since the 1990s, international large-scale assessments of educational performance have expanded throughout the world. Although with different origins, they have given shape to a technical device, both connected with national governments and overlapping them, that affects in various ways the global and national regulations of education. The article focuses on answering two questions: 1) what is the source of their expansive and regulatory force; and 2) what do these evaluation mechanisms produce. The answers provided converge in showing that these international evaluation systems constitute a global governmentality device that is redesigning education systems’ functioning throughout the world, establishing new normative standards and redefining the notions of quality, opening educational systems to review and discussion in a global frame of reference. Such a device is grounded on an operational structure based on international networks, on research to a big science scale, and guided by a growing practical concern for designing educational policies. In the last two decades, this device has acquired great adaptive potential that is continuously expanding its regulatory and performative force.Downloads
References
Baird, J., Isaacs, T., Johnson, S., Stobart, G., Yu, G., Sprague, T. y Daugherty, R. (2011). Policy Effects of PISA. Report Commissioned by Pearson UK. Oxford: Oxford University Centre for Educational Assessment.
Baker, D. y Letendre, G. (2005). National Differences, Global Similarities. World Culture and the Future of Schooling. Stanford: Stanford University Press.
Ball, S. y Junemann, C. (2012). Networks, New Governance and Education. Bristol: Policy Press.
Bhanji, Z. (2016). The Business Case for Transnational Corporate Participation, Profits, and Policy Making in Education. En K. Mundy, A. Green, B. Lingard y A. Verger (Eds.), The Handbook of Global Education Policy (419-432). Nueva York: John Wiley & Sons.
Benveniste, L. (2002). The Political Structuration of Assessment: Negotiating State Power and Legitimacy. Comparative Education Review, 46(1), 89-118.
Breakspear, S. (2012). The Policy Impact of PISA: An Exploration of the Normative Effects of International Benchmaking in School System Performance. OECD Education Working Papers, 71. París: OECD Publishing.
Burgi, R. y Trohler, D. (2018). Producing the “Right Kind of People”. En S. Lindblad, D. Pettersson y T. Popkewitz (Eds.), Education by the Numbers and the Making of Society. The Expertise of International Assessment (75-91). Nueva York: Routledge.
Busch, L. (2011). Standards. Recipes for Reality. Cambridge. Massachusetts: MIT Press.
Callon, M. (1998). The Law of the Markets. Oxford: Blackwell Publishers.
Carvalho, L. (2018). International Assessments and Its Expertise Fabricating Expert Knowledge for Policy. En S. Lindblad, D. Pettersson y T. Popkewitz (Eds.), Education by the Numbers and the Making of Society. The Expertise of International Assessment (110-126). Nueva York: Routledge.
Carnoy, M. (2015). International Test Score Comparison and Education Policy: A Review of the Critiques. Boulder: National Educational Policy Centre.
Eklof, H. y Hopfenbeck, T. (2019). Self-Reported Effort and Motivation in the PISA Test. En B. Maddox (Ed.), International Large-Scale Assessments in Education (121-136). Londres: Bloomsbury Academic.
Fischman, G., Topper, A., Silova, I., Goebel, J. y Holloway, J. (2018). Examining the Influence of International Large-scale Assessments on National Education Policies. Journal of Education Policy, 34(4), 470-499.
Foucault, M. (2000a). Essential Works, 1954-1984. Volume 3: Power. Nueva York: The New Press.
Foucault, M. (2000b). Defender la Sociedad. Curso en el College de France (1975-1976). México DF: Fondo de Cultura Económica.
Fulge, T., Bieber, T. y Martens, K. (2016). Rational Intentions and Unintended Consequences: On the Interplay Between International and National Actors in Education Policy. En K. Mundy, A. Green, B. Lingard y A. Verger (Eds.), The Handbook of Global Education Policy (453-469). Nueva York: John Wiley & Sons.
Gorur, R. (2011). ANT on the PISA Trail: Following the Statistical Pursuit of Certainty. Educational Philosophy and Theory, 43(1), 76-93.
Gorur, R. (2016a). Seeing like PISA: A Cautionary Tale about the Performativity of International Assessments. European Educational Research Journal, 15(5), 598-616.
Gorur, R. (2016b). The “Thin Descriptions” of the Secondary Analyses of PISA. Educação & Sociedade, 37(136), 647-668.
Gorur, R. (2018). Standards: Normative, Interpretative, and Performative. En S. Lindblad, D. Pettersson y T. Popkewitz (Eds.), Education by the Numbers and the Making of Society. The Expertise of International Assessment (92-109). Nueva York: Routledge.
Grek, S. (2009). Governing by Numbers: the PISA “Effect” in Europe. Journal of Education Policy, 24(1), 23-37.
Grek, S. (2018). OECD as a Site of Coproduction: The European Education Governance and the New Politics of “Policy Mobilization”. En S. Lindblad, D. Pettersson y T. Popkewitz (Eds.), Education by the Numbers and the Making of Society. The Expertise of International Assessment (185-200). Nueva York: Routledge.
Hoptmann, S., Brinek, G. y Retzl, M. (2007). PISA According to PISA. Berlín: LIT Verlag.
Husen, T. (1975). Multi-national evaluation of school systems. IIЕР Occasional Papers, 37. París: Unesco, International Institute for Educational Planning.
IEA (2018). 60 Years of IEA (1958-2018). Amsterdam: IEA.
Keeves, J. (2011). IEA – From the Beginning in 1958 to 1990. En C. Papanastasiou, T. Plomp y E. Papanastasiou (Eds.), IEA 1958-2008: 50 Years of Experiences and Memories (3-40). Amsterdam: IEA.
Latour, B. (1988). The Pasteurization of France. Cambridge: Harvard University Press.
Latour, B. (2010). On the Modern Cult of the Factish Gods. Durham: Duke University Press.
Latour, B. (2001). La esperanza de Pandora. Ensayos sobre la realidad de los estudios de la ciencia. Barcelona: Gedisa Editorial.
Lawn, M. (2008). An Atlantic Crossing. The Work of the International Examination Inquiry, its Researchers, Methods and Influence. Oxford: Symposium Books.
Lingard, B. y Sellar, S. (2016). The Changing Organizational and Global Significance of the OECD’s Education Work. En K. Mundy, A. Green, B. Lingard y A. Verger (Eds.), The Handbook of Global Education Policy (357-373). Nueva York: John Wiley & Sons.
Lietz, P., Cresswell, J., Rust, K. y Adams, R. (2017). Implementation of Large-Scale Education Assessments. Chichester: John Wiley & Sons.
Lockheed, M. (2011). Reflections on IEA from the Perspective of a World Bank Official. En C. Papanastasiou, T. Plomp y E. Papanastasiou (Eds.), IEA 1958-2008: 50 Years of Experiences and Memories (711-720). Amsterdam: IEA.
Lockheed, M. (2013). Causes and Consequences of International Assessments in Developing Countries. En H. Meyer y A. Benavot (Eds.), PISA, Power and Policy. The Emergence of Global Educational Governance (163-184). Oxford: Symposium Books.
Lundahl, C. (2018). The “Beauty” of PISA: The Politics of How PISA Scores Are Used to Represent Public Education. Ponencia presentada en AERA 2018 Annual Meeting. Abril 13-17, Nueva York.
Mackenzie, D. (2006). An Engine not a Camera. How Financial Models Shape Markets. Cambridge: MIT Press.
Mendelovits, J. (2017). Test Development. En P. Lietz, J. Cresswell, K. Rust y R. Adams (Eds.), Implementation of Large-Scale Education Assessments (63-91). Chichester: John Wiley & Sons.
Meyer, H. y Benavot, A. (2013). PISA, Power and Policy. The Emergence of Global Educational Governance. Oxford: Symposium Books.
Mundy, K. y Verger, A. (2015). The World Bank and the Global Governance of Education in a Changing World Order. International Journal of Education Development, 40, 9-18.
Muniesa, F. (2014). The Provoked Economy. Economic Reality and the Performative Turn. Londres: Routledge.
Novoa, A. y Yariv-Mashal, T. (2003). Comparative Research in Education: A Mode of Governance or a Historical Journey? Comparative Education, 39(4), 423-438.
OCDE (2014). PISA 2012. Technical Report. París: OECD Publishing.
OCDE (2019). PISA 2018 Results. What School Life Means for Students’ Lives. Volume III. París: OECD Publishing.
Osborne, T. y Rose, N. (1999). Do the Social Sciences Create Phenomena? The Example of Public Opinion Research. British Journal of Sociology, 50(3), 367-396.
Ozga, J. y Lingard, B. (2006). Globalization, Education Policy and Politics. En B. Lingard y J. Ozga (eds.), The RoutledgeFalmer Reader in Education Policy and Politics. Londres: Routledge Falmer.
Porter, T. (1995). Trust in Numbers. The Pursuit of Objectivity in Science and Public Life. Princeton: Princeton University Press.
Ramos Zincke, C. (2012). El ensamblaje de ciencia social y sociedad. Conocimiento científico, gobierno de las conductas y producción de lo social. Santiago: Ediciones Universidad Alberto Hurtado.
Ramos Zincke, C. (2014). Datos y relatos de la ciencia social como componentes de la producción de realidad social. Convergencia. Revista de Ciencias Sociales, 21(66), 151-177.
Ramírez, F., Schofer, E. y Meyer, J. (2018). International Tests, National Assessments, and Educational Development (1970-2012). Comparative Education Review, 62(3), 344-364.
Ramírez, F., Meyer, J. y Lerch, J. (2016). World Society and the Globalization of Educational Policy. En K. Mundy, A. Green, B. Lingard y A. Verger (Eds.), The Handbook of Global Education Policy (43-63). Nueva York: John Wiley & Sons.
Rivas, A. y Scasso, M. (2017). ¿Qué países mejoraron la calidad educativa? América Latina en las evaluaciones de aprendizaje. Documento de Trabajo, 16. Buenos Aires: CIPPEC.
Rizvi, F. y Lingard, B. (2010): Globalizing Education Policy. Londres: Routledge.
Rutkowski, L., Von Davier, M. y Rutkowski, D. (2014). Handbook of International Large-Scale Assessment. Background, Technical Issues, and Methods of Data Analysis. Boca Raton: Taylor & Francis Group.
Sellar, S. y Lingard, B. (2013). PISA and the Expanding Role of the OECD in Global Educational Governance. En H. Meyer y A. Benavot (Eds.), PISA, Power and Policy. The Emergence of Global Educational Governance (185-206). Oxford: Symposium Books.
Sahlberg, P. (2016). The Global Educational Reform Movement and Its Impact on Schooling En K. Mundy, A. Green, B. Lingard y A. Verger (Eds.), The Handbook of Global Education Policy (128-144). Nueva York: John Wiley & Sons.
Schneider, S. (2013). The International Standard Classification of Education 2011. Comparative Social Research, 30, 365-379.
Sjoberg, S. (2019). The PISA Syndrome. How the OECD has Hijacked the Way we Perceive pupils, Schools and Education. Confero, 7(1), 12-65.
UNESCO-OREALC (1998). Primer Estudio Internacional Comparativo sobre lenguaje, matemática y factores asociados en tercero y cuarto grado. Santiago: Unesco.
UNESCO-OREALC (2008). SERCE. Los aprendizajes de los estudiantes de América Latina y el Caribe. Primer reporte. Santiago: Unesco.
UNESCO-OREALC (2014). Comparación de resultados del segundo y tercer estudio regional comparativo y explicativo. SERCE y TERCE 2006-2013. Santiago: Unesco.
UNESCO-OREALC (2015). TERCE. Informe nacional de resultados. Santiago: Agencia de Calidad de la Educación y Unesco.
Verger, A., Fontdevila, C. y Parcerisa, L. (2019). Reforming Governance through Policy Instruments: How and to What Extent Standards, Tests and Accountability in Education Spread Worldwide. Discourse Studies in the Cultural Politics of Education, 40(2), 248-270.
Volante, L. (2016). The Intersection of International Achievement Testing and Educational Policy. Global Perspectives on Large-Scale Reform. Londres: Routledge.
Wagemaker, H. (2014). International Large-Scale Assessments: From Research to Policy. En L. Rutkowski, M. von Davier y D. Rutkowski (Eds.), Handbook of International Large-Scale Assessment. Background, Technical Issues, and Methods of Data Analysis (11-36). Boca Raton: Taylor & Francis Group.
Ydesen, C. y Andreasen, K. (2019). Los antecedentes históricos de la cultura evaluativa global en el ámbito de la educación. Foro de Educación, 17(26), 1-24.
Downloads
Published
How to Cite
Issue
Section
License
All CTS's issues and academic articles are under a CC-BY license.
Since 2007, CTS has provided open and free access to all its contents, including the complete archive of its quarterly edition and the different products presented in its electronic platform. This decision is based on the belief that offering free access to published materials helps to build a greater and better exchange of knowledge.
In turn, for the quarterly edition, CTS allows institutional and thematic repositories, as well as personal web pages, to self-archive articles in their post-print or editorial version, immediately after the publication of the final version of each issue and under the condition that a link to the original source will be incorporated into the self-archive.
