OverviewTranscriptTranslationResources

We often think of international assessments as being synonymous with PISA, the OECD international assessment that has been the focus of many shows in FreshEd’s mini-series on global learning metrics.

But international assessments have a history far beyond PISA. In fact, it was the International Association for the Evaluation of Educational Achievement, known as the IEA, that first introduced large-scale comparative studies of educational systems in the late 1950s.

This history is important to consider when thinking about global learning metrics today.

My guest today is Dirk Hastedt, Executive Director of the IEA. He’s spent many years working with the IEA, seeing the development of assessments in new subjects, such as citizenship and computer literacies, and the emergence of league tables, which rank education systems and have become popular today. Drik offers valuable insight for any discussion on the feasibility or desirability of global learning metrics.

Citation: Hastedt, Dirk, interview with Will Brehm, FreshEd, 49, podcast audio, November 7, 2016. https://freshedpodcast.com/dirkhastedt/

Will Brehm 1:54
Dirk Hastedt, welcome to FreshEd.

Dirk Hastedt 1:56
Thank you, Will. It’s a pleasure for me.

Will Brehm 2:00
The history of international assessments reveals many different actors and debates about the role and purpose and presentation of assessments that we sometimes forget today. I mean, today, we often talk about PISA or TIMSS, but we don’t remember the history of those tests and international testing in general. Can you give us a brief kind of background to the history of international assessments?

Dirk Hastedt 2:26
Sure, Will. It’s a pleasure. I think it’s also very important to go back and think about what it’s all about. Well, the IEA’s origin dates back to 1958 already. And it started as a collaborative venture between measurement scholars, educational psychologists, sociologists, and psychometricians from different countries. They first gathered at the UNESCO Institute for Lifelong Learning in Hamburg, and then also in London, they met a couple of times. And the idea was to exchange ideas about educational processes in order to improve educational systems. And at that time, little was known about the process of education across the world. And the founders of the IEA proposed to engage in cross-national comparisons to student achievement, as they believe that the country’s educational systems can better be understood when comparing educational systems of different countries. And their opinion was that surveys must take into account not only inputs but both input and outcomes of educational processes. And outcomes were defined quite broadly, as achieved knowledge but also as attitudes and participation in education, which now is also another focus that we have in developing countries. And their interest was to collect data that would enable to better understand educational systems and to identify relevant factors that had an impact on student learning. So, the target of their analysis was notably the educational system, not the individual student. And to facilitate further cooperation of researchers, finally, the IEA became a legal entity in 1967. And that’s when all of this started.

Will Brehm 4:25
A legal entity of a particular country?

Dirk Hastedt 4:29
Well, that’s an interesting question. At that time, the researchers tried to found an umbrella organizations to do international research with international people from around the world. And so, they finally decided that this is only possible under the Belgium law. So, it first was emerged as a Belgium association with board members from different countries actually.

Will Brehm 4:59
And you said that originally it was focused on improving education systems, not the achievement of individual students. So, has that changed over time?

Dirk Hastedt 5:12
No, not really. The focus is still on the system level. But the focus always was on comparing systems, and not as we sometimes see today, the competition of systems. So, who is first in league tables? That was never the intention, and I think it still should not be. The question was, what can we learn from other countries’ practices? And in that sense, at that time, it was unclear if cross- cultural and cross language assessment at the beginning were feasible at all. So, they first conducted a study just to prove that this kind of assessment makes sense at all in general.

Will Brehm 6:05
Can you tell us a little bit about that first test? What exactly was uncovered and found?

Dirk Hastedt 6:11
Oh, that’s a good question. The first study was the pilot 12 country study. And that was done in the 1960s beginning. And the subjects included mathematics, reading comprehension, geography, science, and also non-verbal abilities. And the first study, however, started with mathematics because, at that time, the researchers also believed that the subject mathematics would be most language and cultural independent, and consequently, easiest to assess in international study. Later on, the six subject study that was conducted in 1970, and 71, expanded also the scope to science, reading comprehension, literature, education, English as a foreign language, and civic education. So, you can see that the target was very broadly defined in the beginning.

Will Brehm 7:18
And is that target still broadly defined today?

Dirk Hastedt 7:23
Well, there are different projections taking place. One is it’s always a question of what’s a focus in a particular time. So, for example, in the 1990s and late 80s, computers in education also became a focus. So, the IEA, at that time, started a ‘Computers in Education Study,’ COMPED, which was conducted in 1989 and 92, and provided data on the educational use of computers. This trend also was followed later on with our computer information study size and also the current International Computer Information Literacy study. And also, political changes in the world of the 1970s gave rise to the subject of citizenship. As a response, the IEA conducted, at that time, the civic education study, CIVED, and it investigated civic knowledge and engagement and policies and practices.

Will Brehm 8:39
So, different subjects or topics become of interest to the IEA depending on what’s going on in the world. So, today, what’s going on in the world? And what are the topics that are kind of trending?

Dirk Hastedt 8:56
Well, actually, there’s a little shift also in the 1990s, which we sometimes called the empirical shift also. And at that time, international large-scale assessment started to be used increasingly by policymakers, also outside the domain of education. And also, at that time, an extension to more developing countries took place. Before, these studies were more academic studies, and support from policy side was not that big. But at that time, this whole environment changed. And on one hand, this also had a change of the focus in skills like reading and numeracy, which are seen as preconditions for further learning of students. So, without reading abilities, textbooks and other areas can’t be read and understood. But also, economists were interested in relating educational outcomes to economic wealth. And this also resulted in a focus and change of interest of subjects to subjects that are useful for employability and regarded as preconditions for economic wealth. And here again, reading, numeracy, and also science became a focus of international assessments.

Will Brehm 10:32
So, it sounds like these assessments, they change for all sorts of reasons over time, and different actors maybe get more influence inside the testing agencies. And one of the moments that you referenced earlier was when league tables came about. And you were part of the IEA when this debate was happening. Can you give us a little insight about what were the different sides of the debate to either include or exclude league tables?

Dirk Hastedt 11:08
Oh, that’s a very good question. League tables were highly debated also in the studies, and that most of these debates took place in the 1980s, actually already, and beginning of 1990s. The IEA was always interested in understanding educational processes, and which education system is first or second or seventh doesn’t matter too much, actually. And it’s also not very informative for most policymakers. So, consequently, in the early studies, the IEA produced reports and related background instruments and background information to achievement but did not produce league tables. But then, the IEA realized that if they don’t do it, other people created league tables. And we found league tables in magazines, newspapers, and also in some academic journals. But these league tables were also then created in a wrong way. So, they were wrong. So, at that time –

Will Brehm 12:21
How were they wrong?

Dirk Hastedt 12:23
Well, we have a very complex system for assessing the achievement. For example, we use rotated booklet. That means that we want to cover different areas, and consequently, not all students are getting all items, because then every student would have to sit down for six or 10 hours to cover all the areas, which we, of course, do not do. So, that’s one thing. And secondly, also, we are taking a random sample of schools. And then, within the schools, we are sampling one or two classrooms with students. And the researchers call this a cluster sample. And a cluster sample is very different psychometrically from having a simple random sample. And we use different mathematical procedures to calculate, for example, standard errors, or if differences are statistically significant different. And when not considering this, you get wrong results, and you consider results different that are statistically not different. So, there are some parts that really require a good and deep understanding of the projects and its procedures.

Will Brehm 13:46
So, these league tables that weren’t necessarily considering all these statistical and methodological considerations as the IEA was considering. These league tables were basically being produced with potentially wrong information. And so, the IEA decided that it needed to jump in and actually produce accurate tables?

Dirk Hastedt 14:08
That is right. So, when we saw that other people are producing, obviously, these league tables anyway, because of interest. Then the IEA decided, well, if it’s done, then it should be done correctly. So, we decided to include this also in the report.

Will Brehm 14:25
So, over the last 30 years or so, when these league tables have been included in the report, what sort of effects or outcomes have you seen being used of these league tables? Because this is, for the most part in like the popular press, this is what we read about. We read about which school system or country is ahead of another country. And so, these league tables have really, in a way, have become the defining feature of these international assessments.

Dirk Hastedt 14:56
Yeah, well, I think there are different components and different things that our international large-scale assessments are good for. On one hand, of course, this international large-scale assessment describes the status quo in terms of how educational practice in a country is conducted. And this helps researchers and policymakers to compare a country to other countries. And then there’s a comparative perspective. So, identifying differences in ways in which education is organized and practiced across cultures and societies. Then this gives you an understanding of where you are actually. Secondly, I think international assessments like our Trends in International Mathematics and Science Study (TIMSS), or the Progress in International Reading Literacy Study (PIRLS), or the ICILS study, and the Civic and Citizenship Education study that I mentioned, they are measuring trends. And this helps policymakers and researchers to understand changes in educational outcomes and processes, also in comparison to other countries’ development. And especially when curricula or educational policies are changed, it is important to monitor changes. Imagine a captain of a big ship on the ocean. Which captain would not look at his instruments or look outside the window to see where his ship is heading to? And I think there is also the value of maybe also the league tables if you take them and interpret them correctly, in its context, and also looking at trends over time.

Will Brehm 16:42
So, looking at these trends and monitoring and describing the status quo, have these helped policymakers, do you think?

Dirk Hastedt 16:53
Oh, sure. I think policymakers also have seen different impacts from these studies, actually. And it depends very much on the country itself, actually. Since we are research organizations, we are conducting these studies, and we also help countries understanding and interpreting the data. But we do not give any policy recommendations from our side. But we help the countries to do that. And the focus in different countries is very different. We have some countries which, even before the actual assessment start, when we look at the curriculum, they realized that their curriculum is not in line too much with other countries curricula in terms of curriculum expectations. So, some countries, when they looked at this, changed the curriculum expectations and have now higher expectations for the students to be also international comparable. Other countries looked at different sub-populations. For example, immigrants, or they looked at boy-girl differences. So, there’s a lot of questions around equity in education. And policymakers, after looking at the results, took measures to provide more equal learning opportunities to students. One example that we can see is that there was always a discussion about differences of boys and girls in mathematics and science in particular. And 20 years ago, in most countries, boys were performing much better than girls actually. So, researchers and policymakers asked, is this a natural given that boys are better in these areas? And actually, it is not. But it depends very much on motivation, and what are the textbooks, and what are the examples that they used in textbooks? Are they also engaging for girls? So, in a lot of countries, there’s now a shift also to have more relevant and interesting materials that also engaged student girls more in science and mathematics education with the outcome that now the girls are doing as good as boys in most countries. And in a lot of countries, girls are even outperforming the boys in mathematics and science. So, there’s a lot of different conclusions that policymakers have drawn from looking at the results of these international large-scale assessments like the IEA studies.

Will Brehm 20:01
Have there ever been any misuses by policymakers of large-scale international assessments?

Dirk Hastedt 20:10
Misuses. Well, I think it’s not only maybe a question of misusing the data, but maybe also misunderstanding the data. What we do is we do statistically analysis. And there’s always a certain error margin around it. So, coming back to this league tables, again, some of the misunderstandings around these league tables by policymakers, or also the general public, are that if a country is one score point better on a scale with a mean of 500 and a standard deviation of 100, it is better. But we always have a measurement error and sampling error around it. So, there’s some variance around it. So, if one country’s achievement is one score point better than another one, or if one country’s achievement increased by one score point, that doesn’t mean anything, actually. But it might just be a question of the error term around it. So, actually, no change has happened, but it appears as if there would be an increase. But this is statistically not significant, and consequently, there are some misinterpretations of these results if you look only at league tables.

Will Brehm 21:48
So, in your experience, how many policymakers actually understand the statistics behind these studies?

Dirk Hastedt 21:55
Well, probably not many policymakers. And actually, I don’t think it’s something that they need to understand, actually. But I think it’s also something that researchers in the field have to explain to policymakers. And this is probably one of the crucial aspects to communication between researchers and policymakers. Policymakers have their perspective, and they want to have a clear and straight answer. But educational systems are quite complex. And if you look at the outcome of the studies and what researchers think about it, their answer is usually not that simple. And simplifying the results of educational studies in a way that it’s not over-interpreting the results of the studies is very difficult and challenging. So, I think we need more and more to pay attention about how to communicate results and a good communication between researchers who have the technical terms, and policymakers and the general public.

Will Brehm 23:17
But of course, we also have to be realistic that policymakers are navigating domestic politics and may use these international assessments to further their own interests, even if they use a finding in a wrong way or something like that. That will happen, and I think many researchers have shown that that happens.

Dirk Hastedt 23:41
I think you’re right. There’s also, maybe some misuse from policymaker side. But my experience, actually, is that this happens sometimes in a way that policymakers want to look good from the outside. So, they want to have good results for their educational systems, which I think is very natural. Everyone wants to have good results from the work that you do. But I think when it comes to making use of the results, there’s a strong focus from a lot of policymakers that they really want to improve their system. And this can be only done if you really interpret the results correctly. So, maneuvering blind and pretending you’re good might be good for that day, if there’s a day of election, but in a long-term process, you need to understand the educational system. And I think this is also what policymakers understand. That they use the data, and we call it “data-driven policies,” to look what are the strengths and weaknesses of their systems, and then, by that, also try to improve their systems. And if you look at policies today, they really make use of the data with the aim to improve educational systems. And this is, I think, what policymakers are mostly doing.

Will Brehm 25:20
What I find so interesting about the IEA and the history that you’ve recounted is that in the beginning in 1958, doing these cross-national assessments was very much an academic pursuit. You know, is it possible? Can we statistically compare education systems in different countries? And it seems, over time, it’s shifted to being not only an academic pursuit but also very much an issue of policy, and it seems like the role of the IEA, in a way, has slightly changed.

Dirk Hastedt 26:03
That’s a good point, I think. I don’t know if the role of IEA has changed. But it’s clear that we have member institutions, and these member institutions are sometimes research institutes from different countries, and we have member institutions from more than 60 countries. But it’s also people from ministries of education, or institutes that are connected directly to the ministries of education. And surely, they want to learn which policies can help improving achievement in their countries, which is very different from maybe the researchers point who for purely academic intents how … want to understand how educational processes are working and to understand these processes more in-depth.

Will Brehm 27:05
It’s also interesting that originally the test was -mathematics was the subject. Because, as you said, it was, in a sense, “easier” to control for context and local variation, and language variation, for that matter, around the world. But today, you’ve now talked all about all these different subject areas that are tested. How has the issue of context and variation been controlled in these various tests?

Dirk Hastedt 27:40
Oh, that’s a good question. What we are using in IEA is, we are looking at what we call the curriculum model. So, we are looking at the intended curriculum in the different countries. So, what they have written as policy documents, what should be taught in schools, and what are the aims. Then we look at the implemented curriculum. So, what teachers are actually doing in the different countries. And finally, we look at the attained curriculum. So, what have students learned. And this is what we measure with our assessments. But there are also these other fields like the intended and implemented curriculum, and we look at this whole process. And of course, when curricula are changing in participating countries, then also, there is a slight shift in what we are measuring in our international assessment. And I think what’s also very important is to understand that in these studies, we are not only having an assessment, but we also have a huge amount of background variables. So, when we are doing one of this assessment, we are looking at system- level information. So, the curriculum and other relevant information. We have a questionnaire to the school principals of the schools where the students are in about how education is organized, what’s the school’s size and background instruments on that. We have questionnaires to the teachers of the actual students so that we can directly relate teachers’ attitudes, perceptions, and background to student achievement. And then, we also have background questionnaires for all the students. And in grade four, we also have questionnaires to the students’ parents. So, we have huge amounts of background information to analyze what are the factors related to student outcome. And outcome are still not only achievement but also opinions, self-confidence, etc.

Will Brehm 30:14
And this wide range of measures allows IEA, or the tests, to compare across nations and account for the cultural variation?

Dirk Hastedt 30:34
Well, the cross-country cultural comparisons are, of course, always challenging. Education always takes place in a different culture, in different societies, with a history and with a background. But what we can see is that there are a lot of similarities across countries. Sometimes more than you would expect at first glance. Let me cite one of the results from one of our recent studies, which was the Computer Information Literacy study, ICILS, where we looked at what matters most for the usage of computers and computer information literacy of the students. And we had 22 educational systems taking part in that study. And we found that in all these educational systems, the crucial points were the teachers and the teacher education and what they think about computers, and if they want to use computers, and how self-confident they were in using computers in their teaching. And that was the same across all 22 different educational systems. And we had participants from Europe, from Latin America, from Asia. So, for more or less all around the world, and you see that you find the same patterns across different cultures, which was a surprise to us. But also, probably, to a lot of countries because we often hear that, “Well, our educational system is very different. And we have a problem in our country that’s probably very unique.” And when you look at these international assessments, you can see that a lot of countries are facing very similar problems.

Will Brehm 32:45
So, you’ve been involved with the IEA for quite some time, and you’ve mentioned all of these different shifts that have happened. So, in the 1970s, the focus became citizenship, and in the 1980s, it became computers, and in the 1990s, you talked about this empirical shift, I wanted to see -kind of reading the tea leaves- do you see any shifts occurring now? Or do you envision any future shifts about what the focus will be for these international assessments?

Dirk Hastedt 33:20
Well, on one hand, I think that the current process will continue. But on the other hand, I think a huge influence currently is with the UN and the Declaration for the Sustainable Development Goals, where the UN declarations set under target four is concerning with education. So, there’s also in all member countries also UN which means mostly all the world. There’s a common agreement that education plays a more and more important role. And when we look at the target four of the Sustainable Development Goals, one is universal primary and more and more secondary education. And here I see, for example, also a shift on the UN side, which before looked mostly on enrollment rates, now also target minimum standards of outcomes in literacy and numeracy for all countries. So, I see that there will be an expansion also to more developing countries, but still with a focus on numeracy and literacy abilities. But under the target 4.7, it also targets, for example, global citizenship and sustainable development. So, it’s also seen that this is an increasingly important aspect, which we see. And I think that’s a very, very important thing to understand that education is not only with means of educating the future workforce, but education is much broader and also helps us to live together in peace and to also understand the needs of future generations. And there I see also a shift on looking also at global citizenship competencies around the world.

Will Brehm 35:54
Well, Dirk Hastedt, thank you so much for joining FreshEd.

Dirk Hastedt 35:58
Thank you very much. It was a pleasure to meet.

Want to help translate this show? Please contact info@freshedpodcast.com
Have useful resources related to this show? Please send them to info@freshedpodcast.com

 

OverviewTranscriptTranslationResources

Today we continue our focus on global learning metrics during the lead up to the inaugural CIES symposium, which will take place in Scottsdale, AZ from November 10-11.

The past shows in this mini-series have focused broadly on global learning metrics: We’ve looked at the history and value of learning metrics for the perspective of national governments; we’ve examined the power of tests like PISA; and we’ve heard critiques of policy borrowing and outcome-based approaches to education that rely on learning metrics and their subsequent rankings.

But we haven’t yet looked at some of the questions on the tests that form the proxies for global learning metrics.

My guest today is Dr. Inés Dussel, Researcher and Professor at the Department of Educational Research, Center for Advanced Studies and Research (DIE-CINVESTAV) in Mexico.

She argues that global learning metrics are not culturally sensitive and uses examples from her work on digital literacy to show why.

Inés critiques PISA for taking a narrow focus of learning as only related to cognitive skills — the ability for students to read or write or problem solve. By contrast, she takes a broad view of learning, which encompasses not only cognitive skills but also a collection of interpersonal and social skills. Of course, these latter skill sets are nearly impossible to measure in one school let alone worldwide using universal metrics.

And this is the crux of the issue: how can global learning metrics measure any skill set across so many different contexts and cultures worldwide?

Photo credit: La Nación

Citation: Dussel, Inés, interview with Will Brehm, FreshEd, 47, podcast audio, October 25, 2016. https://freshedpodcast.com/inesdussel/

Will Brehm 2:00
Inés Dussel, welcome to FreshEd.

Inés Dussel 2:03
Hi, hello. Thank you for inviting me.

Will Brehm 2:07
You’ve done some research on digital literacies in Argentina, where one computer per student program was implemented universally throughout that country. Are there global learning metrics that try to measure digital learning, or digital literacy, in education?

Inés Dussel 2:29
Yes, there are. Although they were not used in Argentina or in some other countries that have implemented the one computer per student program. There have been correlations between what you would say traditional learning metrics about reading, mathematics, and the introduction of computers. So, one could say that there was an assumption that if you have more computers in the classroom, then children will improve their learnings. And that was not what happened. For example, in Uruguay, there were no significant improvements in standardized tests because of the introduction of computers or related to the introduction of computers. However, there are global learning studies about digital competencies or digital literacies. For example, one that was carried by the OECD, it was published in 2015 and based on PISA results from 2012. This, I think, to my knowledge, is the most serious study that has been done on the improvement of digital literacies because of the access to computers and the use of computers in schools. The findings of this report have been controversial because what they say is that there is no direct relationship between higher availability of computers in school and the improvement of digital literacies. So, for example, a country like Singapore where children don’t use computers so much in schools, however, they ranked first. And so, these digital literacies or digital literacy skills do not seem related to what is learned in school, but to what children do outside or inside schools, but to how cultures relate to computers too. Also, the widespread availability of computers. And for example, in many East Asian countries, there is wide access to computers, and children and teenagers use them extensively. So, apparently, it is this use at home, in schools, that makes them more fluent for doing better searches in the internet and being more critical about the information they read.

Will Brehm 5:32
Why do you think PISA is trying to develop these metrics on digital literacies?

Inés Dussel 5:41
Digital literacies seem to be a significant part of what is called the 21st-century skills. It’s very obvious to say that we now live in a digital culture. Digital media is everywhere. Our lives, one could say, are digitally mediated in many, many aspects of banking, consumption, health, of course, entertainment and culture. And so, these skills seem to be very crucial for our well-being and also for our social and economic participation in contemporary society. So, I think everybody’s concerned about what is going on with the skills? How do children and young people learn the skills? Is school any relevant for this learning? Can we do better? What are they learning on their own? So, I think, in this area of digital literacies, we have many, many questions. And PISA is trying to grasp some things, I would say not all but at least some things that are related to academic skills or things we could relate to academic performance.

Will Brehm 7:03
So, can you give an example of how PISA would test sort of these digital literacy skills for children?

Inés Dussel 7:12
Yeah. There are some examples. One could be they asked the students, I mean, these are tests that are taken online. So, they can see, for example, how well they do in order to obtain practical information from the internet. I don’t know. I’m trying to look for the information more precisely, but for example, how do they browse? How are their navigation skills? So, do they look around? Do they go more directly to what they want? If they’re given a task, how many clicks? How much time does it take it to get where they should get? But also, the quality of navigation steps is also important. So, there are, I would say, several measurements. However, and I think, of course, the people who do these tests are -I would say they’re very knowledgeable, and they’ve tried it extensively. However, many of these things could be, I would say, interpreted differently, because I don’t know, you browse. Are you efficient? In what terms? Is it time-related? Is it quantifiable? Do we really know what kids understood because of this browsing activity by how many clicks they made? So, I think we get, as probably with other tests, we get proxies of what they’re learning. But I am not sure that we really know what they are learning through this kind of quantifiable measurements. And I would say very general. In order to have massive data, you also tend to look at very general things. And these things say little. That would be my point about how children learn.

And I would relate this to the research I’ve done in schools. Because I think that if you look in- depth at some schools, and if you look in-depth at some children: What are they doing, how are they doing? Then you understand more things. For example, also a colleague of mine in Mexico, she has done very interesting research on in which sites do children trust. How do they search online? And she found that they generally don’t take many steps. They get tired very quickly. Their efficiency is related to going through well-known places, either Wikipedia, but if Wikipedia is not a consider as valuable or as trustable by their teachers, then Wikipedia is forbidden. Okay, then no. But then how should I orient myself? And for example, see, this colleague of mine posed them a problem. So, now you have two websites that have contradictory information about how the Egyptians mummified their deceased. One side says that they had to take away their heart. And the other one says that they didn’t. And so, who do you trust? Or which one do you trust? And what do you do with that? And so, she found that children had very loose ideas about which website to trust. For example, a blog is no good because I can produce a blog. So, that’s no good at all. Then “.com” is better because “.com” then is a fixed page. So, if it cannot be intervened, then that’s okay. And they didn’t know, for example, the academic sites. I mean, they knew in Mexico, UNAM, the National University. Oh, this might be good. But this knowledge did not come from the internet. This knowledge came from the families, from the teachers. So, what my colleague says is that we have to do much better. I mean, we don’t get to know that by how many clicks they performed. We have to look qualitatively who they trust, which are the steps they are doing, and why, what are they looking for? And I think the most important finding of her research was that children said, “You know, I really don’t care. If you hadn’t asked me, I really don’t care which website is right, because what difference does it make?” And it was not only related to the Egyptian mummies, one could say, yeah, who cares? I think the value of truth -and this is a philosophical, I would say, question, but also a political and ethical question- is in decline. And so, you have to be fast. It doesn’t matter whether you get it right, it doesn’t matter whether you are going in the right direction. And my point would be that there are some similarities between this idea of going fast and being efficient and some of the learning metrics that are not really concerned about what is going on and the depth of the challenges we face, and the ethical question we have about what are we learning?

Will Brehm 12:58
It’s interesting to hear that PISA uses a proxy measure of digital literacy of the speed of a search online by students and how many clicks they do. But like you said that it’s much more complex than that, and PISA might be using the wrong proxy measure for one of these 21st-century skills, but do you think it’s simply a matter of like could PISA come up with a better proxy measure or a better test item to use that could get us closer to this understanding digital literacy?

Inés Dussel 13:40
I think that at a massive scale, it is difficult to get through these other indicators that are much more complex. I also think there should be other conversations of the Global Learning Task Force that they’re producing. And people who understand that learning cannot be captured by metrics. I would say that all metrics are proxies, and I would say probably all measurements are proxies, not only the metrics. Because I have several colleagues who are very good psychologists, I can think of Emilia Ferreiro, for example, who trained with Jean Piaget and many others, newer generations say similar things that really, we are not sure about how children learn and what they learn. And maybe some of the things you see their effects in decades from now or years from now, or months from now. Performance in tests can be tricky because it has to do with many other things. I mean, the language the test is taken, the relationship you have with evaluation, with a school system. If you are shy and if you feel marginalized by the school system, it’s very likely that you will not perform to your best potential. So, I would say there are many things there are that, for me, make the test proxies. Do we have to have test? I would say yes, we have to have tests, but we have to be very careful about how we use that information, what effects they have, and also make very clear arguments about the limitations of the information we collect with these tests.

Will Brehm 15:32
So, like assuming that these sort of skills are universal?

Inés Dussel 15:40
I would say the skills are never universal. I would say they are cultural, and culture is not universal. And again, if one think of reading and I have some examples from my own research and from this comparative research done by close colleagues, in France, in Argentina, in Mexico. In France, for example, reading and writing is very central to the educational system. Young people, by the end of their secondary school, they are able to read novels or literature that is being submitted for national prizes. And the relationship of educational system towards consider high culture or literature is very close. In Argentina, that relationship is very distant, I would say. And perhaps Argentinian children are much better at arguing orally, they have very good oral skills. And these are nurtured, I would say, these are learned through many, many years of schooling in which children have to participate in group activities, they have to even contradict their teacher. And that’s very well regarded. I mean, if the students say, “Oh no, you are wrong. And I have this other opinion.” Whereas in Mexico, I would say these oral skills are not that developed. And I would say these oral skills are important as a 21st-century skill if you want to call them like that. Because there are many things that today go through our presentation, to our ability to persuade and communicate. So, oral skills should not be devalued. They’re not second to other skills, they’re important. And how do we measure them? So, again, now are these universal skills or are they related to cultures that value some kind of competency skills or language dispositions? Or do we think that they are universally processed or owned? And I don’t agree with the idea that skills are universal. And I would say we have to take a cultural approach to skills, understand these skills in cultures in the current debates that cultures have. I remember one of PISA’s question about ecology and pollution. And I was thinking, well, this question would be much easier to first understand and then to solve in a European country than in a Latin American country where the ecological discourse is not a public issue, or not as much, and it was not ten years ago. So, are we measuring what children know innately, or are we measuring what society’s value and how they think about problems, and how they think about how to solve problems? This has been widely discussed, the cultural biases of tests, but I think we have to make the case again because there are still people who think it is possible to get rid of this cultural bias. And I would say, no, it is not possible, then let’s work with that and make more humble claims about what we find.

Will Brehm 19:22
Do you remember the example of this ecology and pollution question?

Inés Dussel 19:27
Ah, I don’t exactly. It was a question about the Greek, the Athens Parthenon, and it was about the pollution that was eroding the statues. And they had to make a calculus variable thinking, well, for many countries, this is not a relevant question. And I don’t mean you can’t solve it. Yes, you can solve it at any rate. But no, it’s not the same. If this is something you hear all the time on the news, and you’re used to this kind of argument, and you are bringing in some other kind of knowledge. For example, I don’t know, does the air pollute, do carbon emissions pollute? I mean, these are things some people hear on the media all the time and on the newspapers and on the families and some other people don’t. So, we have to take that into account.

Will Brehm 20:24
So, with PISA privileging one particular perspective over others, would you see it as a form of like neo-colonialism? Like pushing one idea globally through these tests like PISA?

Inés Dussel 20:39
I think there is a risk of neo-colonialism. Yes. On the one hand, because there is an assumption of a problem-solving individual that is isolated and acts upon knowledge and information and choice. And I think that for many other children, this is not the normal life. I would say, for example, in Latin America, but also in India and Africa, many children who live in shanty towns, in marginalized populations. One thing that is very important is that they learn to go by. They learn to, for example, keep silent and feign ignorance because they know some things shouldn’t be told because they’re dangerous, there are risk, they might be illegal. This is a skill, a very important skill. Not necessarily one that I like, but how does it come into the school knowledge? I’m sure it is there, too. I’m sure it is there in relation to how they feel, for example, with invitation to speak up, to participate, to express themselves, if they know in their daily life that they shouldn’t, that it’s better for them, it’s safer for them not to express themselves. So, what are we measuring when we take them the same test, then we take to children who are raised in societies where this is the norm -speak up, express yourself, be creative, be autonomous? And I think there are lots of cultural biases that we have to take into account. So, yes, there is a risk of neocolonialism when we don’t understand how this norm that we think is universal is not universal, how it is being played in different contexts. And I think that the worst neocolonialism comes with the truth claims of PISA and many other tests that say, this is what it is, these are the best school systems, these are the worst school systems, and they don’t consider how they are performing in their own societies and to their own goals and problems.

Will Brehm 22:56
Do you think it would be possible to construct global learning metrics in a way that is culturally sensitive? It seems as if there are, on the one hand, global learning metrics need to be uniform, globally, to do this sort of comparisons. But at the same time, listening to all of the different examples you’ve given, it’s clear that a universal test question isn’t going to actually work in different contexts around the world. So, it poses a serious problem to global learning metrics that the very essence of them being universal. So, do you think it’s possible for global learning metrics to be culturally sensitive?

Inés Dussel 23:42
I hope it would be possible. I’m not sure it might be possible. One thing I would say is that we have to have more diverse agencies. And it’s not only a matter of representation, but people who work there are aware of all these issues that we are discussing. I would also say –

Will Brehm 24:07
So, you mean. I’m sorry. So, you mean like inside the OECD, we need people making these test questions that come from more countries than just where they currently come from. Is that what you’re saying?

Inés Dussel 24:19
That’s partly what I say. But I would say if people come from, for example, Latin America and share the same kind of understanding there, then that is not any good, I would say. Because it’s not a matter of the country of origin, but it’s can you really bring in different perspectives and discussions? Can you really bring in people who challenged some of these assumptions and who have done work on different kind of methodologies? And related to what we were saying about the comparison, I think the problem is that this would be much more expensive. But what if the reading test took into account cultural differences? I don’t think that’s impossible. Of course, that would make the comparison probably looser, more flexible. But yes, I can think that we can still make some claims about how children read in some countries and how children read in some others. They are not reading exactly the same question. They are, for example, or you could make subsets of countries with similar problems -in terms of violence or human rights or even ecological concerns- but that are not framed in the same language and way which it is framed in the Northern countries. So, I don’t know I’ll give it a try at least. I think we have to give it a try.

Will Brehm 25:51
So, you say that you want to see a shift from learning to schooling. What do you mean by that shift or that difference?

Inés Dussel 25:59
I think education cannot be reduced to learning. Also, because learning is very difficult to measure, really. I do believe that. So, many of the metrics I’ve seen are really not measuring learning. They are measuring what is being offered to children, the kind of access they have, the kind of exposure they have, the preparation of the teachers, but not necessarily what they are learning. And I think that’s because learning -even if you look at children’s notebooks, or if you make interviews with them individually, then it is very difficult to see what they have learned. And as I said before, maybe you know, and they know what they learned in ten years from now, and not now. So, I think that’s very complex. But also, education is not only about learning cognitive skills. There are many things we learn in schools that are important and not necessarily taught by the teacher. But we learn to live with others, we learn to listen, or I hope we learn to listen to others, we learn to be with ourselves, to be outside our homes, we learn that there are other people in society that think differently, we learn that we have to abide by certain rules, and these rules might be flexible, but not too much because that’s what societies do. And I think these other kinds of learnings are very important. School is a public space, and if you want, you can call it socialization, you can call it education in a broader sense. They provide us with other references, with other languages, tastes, and this is also a very important social function. And I would say today, in a world where the risk of isolationism is bigger, where there are many fundamentalisms threatening the possibility of a civilized or peaceful world, then learning to live together is a very important task for schools. And can we measure that? How do we measure that? I think we have to be careful about what we put in the test. And also, the focus of these. We make these the focus of schools while schools have many other functions that are very, very important.

Will Brehm 28:47
So, it’s like the global learning metrics, like PISA, have taken a very narrow focus of what learning is being just cognitive skills that can supposedly be measured. But you’re saying that schools actually have such a broad function for children in society -far beyond just cognitive skills.

Inés Dussel 29:08
Exactly. I think it’s very important that we keep these broader functions alive and as a focus of schools. And I think there are many studies I don’t know in the US, one, which caused much uproar was Diane Ravitch’s 2010 book on the decline of American schools and of the great American public school, and how all this test madness has made things really bad for teachers and children to work in schools, to be together, to decide for themselves what are their goals, what do they want to do, and again, learn some basic things about social life. And I think you can say the same thing. Maybe in Chile, sometimes in Mexico, but there has been very strong pressure on teachers to improve the performance in tests. And then they forget about other things. So, you just train to the test, and you forget that you are there to really educate a human being and to really contribute to a better life and a good society for all.

Will Brehm 30:27
Well, Inés Dussel, thank you so much for joining FreshEd.

Inés Dussel 30:31
Thank you for this conversation.

Want to help translate this show? Please contact info@freshedpodcast.com
Have useful resources related to this show? Please send them to info@freshedpodcast.com

Today marks the first installment of a seven-part miniseries on Global Learning Metrics. In effort to promote the inaugural Symposium of the Comparative and International Education Society, FreshEd will air interviews with some of the invited speakers.

OverviewTranscript中文翻译Resources

How can we think about inequality and education? My guest today, Mario Novelli, dives into the subject by looking at the role of schools in the production of inequality.

Since 2010, Mario has researched issues related to the role of education in peace building processes, working with UNICEF on a series of projects.

In our conversation, Mario not only details how modernity, capitalism, and colonialism combine to create systems of inequality inside school systems but also publicly struggles with his role in the production of inequality through his work in international educational development.

Mario Novelli is Professor of the Political Economy of Education and Director of the Centre for International Education (CIE) at the University of Sussex. His latest article discussed in this podcast can be found in the most recent issue of the British Journal of the Sociology of Education.

Citation: Novelli, Mario, Interview with Will Brehm, FreshEd, 41, September 12, 2016. https://www.freshedpodcast.com/marionovelli/

Will Brehm:  1:58
Mario Novelli, welcome to Fresh Ed.

Mario Novelli:  2:01
Thanks very much for having me.

Will Brehm:  2:03
The British Journal of Sociology of Education has put out a special issue on the work of the French economist Thomas Piketty, who wrote a pretty famous book in 2013 called Capitalism in the Twenty-First Century. And you have a piece in this special issue. What is Piketty’s main argument in Capitalism in the Twenty-First Century? And why does it warrant a whole issue of an education journal?

Mario Novelli:  2:33
Okay, well, Piketty’s book is a big one. And it really focuses around the rise of inequality over the last 200, 220 years.

And his central argument is that, unlike orthodox economic belief that as capitalism has developed, and as nations develop, inequality reduces. In fact, what he highlights is that, apart from a brief interlude between the first and second world war, inequality has tended to increase and what that leads into develop is a kind of the assertion of an economic law, which is that private wealth, inherited wealth increases faster than productive investment or economic growth.

And that has a tendency to increase inequality in the long run. And I think that for education, there are lots of implications, there are lots of implications around the role of education in the reproduction of inequality, the role of education in potentially redressing inequality and being in a sense an equalizing factor in society. So there are many dimensions that we thought in the special issue we might be able to explore. And as you know, my particular work focuses on the relationship between education and conflict. So I went a bit more deeply into that area.

Will Brehm:  4:11
And we will touch on that in a second. But first, just generally speaking, in your opinion, does Piketty have any weaknesses in his argument that you were able to uncover during your research?

Mario Novelli:  4:28
I mean, I think there are a lot of weaknesses, I would like to say that I think it’s a great book, I think it’s a really important book. And I think that in an accessible way, despite the length of the book, and he puts on the table, some really important ideas around issues of inequality, which for many years, has not been a problem for orthodox economists, inequality seems to be something that should be embraced as a natural part of economic development.

In terms of challenges, I think the first one is that Piketty is an economist. And although he’s much more open than neoclassical economists, his focus is firmly on the economic domain and economic inequality, which, for me, is important, but insufficient. I think, if we look at the history of popular movements, who have struggled against the inequality over the last 70 years, economic inequality is only one domain of confrontation, it’s a key domain. But nevertheless, it’s just one site of contestation, I think, what we need to explore are other modes of inequality alongside economic inequality, cultural, political, national, and their effects on genders, identities, political rights, human rights, etc. So I think, you know, the big area is the kind of narrow economism within which we approach inequality. So I think there are lots of more depth different dimensions to focus on.
The second thing, and I think this is linked to his empiricism, the focus on numbers on evidence that is attainable is that I don’t think that everything that is important can necessarily be measured, and not everything that’s measured is necessarily important. And I think that’s why theory matters, because theory sometimes helps us to get under the surface of things that we can’t see unequal structures, social classes, racism, things like that, that exists, but are not necessarily visible in, you know, the classic, countable ways of empiricism.
And I think, then, the third difficulty in Piketty’s work, or the third omission, at least for me, particularly, is his failure to explore the issue of imperialism, the role of the north and the south, slavery, the history of colonialism in the history of capitalist development. It’s as if capitalist development unfolded through economic laws. But actually, what we know is that capitalism has also unfolded through conquest, colonialism, etc.

Will Brehm:  7:03
It sounds like he misses some of the, my guess, more complex issues of inequality as a social and cultural phenomenon. But how does Piketty or does Piketty bring up the issue of education in his work?

Mario Novelli:  8:07
Well, I guess as an economist, it’s not surprising that Piketty sees education as a kind of an engine of growth. And potentially, I think, an engine of equity and the reduction of inequality. And, you know, that’s linked to his understanding of human capital. And the idea that we invest in education in order to improve both our own personal economic wealth, but also the wealth of the nation. Though, of course, this is challenged, the relevance of human capital theory is challenged by himself in the book, because essentially, what he’s arguing is that inherited capital, debt capital is more productive than economic growth and productive capital. So investing in education may not bring you the returns that it might want have brought. So even for the human capital theory, there is a problem at the moment in terms of the nature of capitalist development. So that’s really where his focuses on the returns of education in terms of economic development and economic growth.

Will Brehm:  9:33
In your opinion, what is the relationship between education and capitalism if it’s not human capital?

Mario Novelli:  9:42
Okay, well, I think human capital is part of the story. Let’s be clear about that. I’m not saying that human capital is not important. But I think that if we look at the relationship between education and capitalism, it’s much more complex. I guess, I would start with Roger Dale’s work of the 1970s Education and the Capitalist State, where you need to think about education’s relationship to accumulation ie human capital, social cohesion – the role of education systems in making different population groups get on or not, and also in legitimation, the role of education in making students accept the situation that they’re in, the state of affairs that exists in society. So in a sense, it has a legitimating effect. It has a social cohesion affect, it also has an accumulation effect. And as Roger always pointed out, these three dimensions are not necessarily compatible. So if you focus on accumulation, you may undermine social cohesion, through selectivity etc.

And you may undermine accumulation and social cohesion by focusing too much on the legitimation. So there are range of contradictions in that. So that’s the first area that I think is important to return to. And I think the second area which is a more modern phenomenon is that education is not just human capital, in the terms of self-investment, and the production or the role of education in economic growth.

Education has emerged as an important commodity in the late 20th century, early 21st century whereby it’s one of the fastest growing industries and we can see that the expansion of universities and international chains of schools, so education itself is a factor in economic exchange now and I think that needs to be explored in much more detail and is completely avoided in Piketty’s work, as Susan Robertson’s article in the same special issue focuses on.

The third area, and I think this is, again, really important is the area of inequalities, the role of education in reproducing inequalities. And I’m not just thinking about class and gender, which is a lot of the focus but also about the way education systems reproduce north south inequality, you know.

How is it that Sub Saharan Africa, for example, remains marginalized in terms of the international economy. And I would say that the role of education, education actors, the International architecture of education, delivery, and policy also plays its role in the reproduction of those inequalities. So there are different dimensions. So in a sense, Piketty importantly looks at one area, but I think that if you’re going to take education seriously, you have to look at it much more broadly.

Will Brehm:  13:21
I think it would be very interesting for listeners to hear more about how education can contribute to inequality because I think on the surface that doesn’t sit well with a lot of people, because they would see it as education is the way to achieve equality and to achieve progress.

Mario Novelli:  13:47
Yeah, that’s right. Well, I guess you know, the simplest terms, particularly if you have a Western if we’re thinking about a Western audience, is the way that education privileges some actors and undermines others, the inequality in the provision of education in my own country, in the UK, depending on your postcode, the qualities of schools are often highly differential.

The differentiation in your parents’ salary may determine what type of school you go to whether you go to a private school. So education, in that sense, acts as a filter for social class, whether you can afford a house in a nice area, a wealthy area where there are good schools, or you live in a poor area. So those dimensions, I think, reproduced himself around the world in a sense that education is often highly stratified. But there are also other dimensions of the way education reproduces inequality in terms of, for example, language.

The language issue is a big one whose language gets taught in countries and whose languages get marginalized and what is the effect of that on those that speak that marginalized language? How do they perform in schools? Do they perform less well? If so, what’s the effect of that in the long term? And then in terms of even the content, the curriculum content of schooling, let’s think about you are from a minority community in a particular country, and you’re learning about the heroes of that nation, and none of your communities are ever represented. They’re always representations from other communities, how does that make you feel? What does it lead to? So there’s a lot of ways that education can reproduce alienation. And of course, vice versa, a highly equitable, inclusive open education system may be able to smooth over some of those inequalities that are inherited through generation.

Will Brehm:  16:17
And is part of the inheriting through generations related to imperialism, as you said earlier?

Mario Novelli:  16:24
Yes, certainly, if you’re looking at, let’s take the exploration of the African curriculum, what we see is a legacy of colonial interventions into the national education system. So take a country like Kenya that inherited its education system, from years of colonial rule where there was a highly elitist education system where for the vast majority were excluded and the minority were selected to play roles in the civil service, a small elite, that model of education still carries on to reproduce a highly unequal class structure, often justified by education attainment, but actually pre-ordained through social class.

Will Brehm:  17:27
I’d like to shift gears here to look at some of your work in educational development, particularly in countries like South Sudan or Myanmar and some more of these conflict areas as you said earlier. What have you found how inequalities kind of manifest and function inside education in some of these conflict areas or countries that have experienced conflict?

Mario Novelli:  18:00
Right. Well, maybe I should take a step back. I think that development itself as a field is a highly contradictory field. On the one hand, international development has this idea within it of the rest catching up with the West. This idea that through the study of development, national ex-colonial states, postcolonial states will eventually catch up with the West. But at the same time, international development for other thinkers is a mechanism through which the chains of colonialism were the armies were replaced by new mechanisms, new chains, which with far less visible, not necessarily less powerful than the troops. And so I think that the field itself reproduces some of these dilemma wherever it goes in a sense, the question of, is international development, doing good?

And redressing some of these inequalities or actually, is it there to reproduce them in different modes in different ways. And I think that you see that all around, you know, you see, for example, in Sierra Leone, the role of the international peacekeeping community that came during the war, and after the war in the 1990s, massively increasing the cost of housing and accommodation in the central rise, forcing prices of food up as the international community intervenes in the conflict. And it’s those kinds of things, you know, some would say, the unintentional effects of intervention, which often reproduce or exacerbate inequalities and the same you can go for looking at international intervention in education systems, are they improving the system? Are they reducing inequalities? Or are they actually exacerbating those? And, you know, depending where you’re looking, you have different answers. I mean, Kenya, come back to Kenya, just because I’ve done work in there recently. And the British government DFID has been promoting low cost basic education for poor communities and private schooling for poor communities, which is it seems to be having a demonstrable negative effect on poor communities. And that’s being pushed by an international development agency in the name of doing good, but actually seems to be having devastating effects. So I think that when I teach students of international development, which I do every year, and I always kind of ask them at the beginning of the class, how they feel about entering the field of international development. And they always say, you know, we’re really pleased, we want to, you know, help in Africa, we want to help in Asia. And I say, well, I hope by the end of the course, that you feel a little bit ashamed as well. And that by the end of the course, you actually think that some of the things that have been done in the name of development are actually just as bad as some of the things that have been done in the name of war.

Will Brehm:  22:02
Is that how you feel?

Mario Novelli:  22:06
Ah yes, largely I mean, as I said, it’s a contradictory field. If I thought that it was only doing bad I wouldn’t remain inside the field. But there is a strong sense that like many other terrains, there is a battle going on, it’s the terrain of contestation, and you fight your battles inside that field, to push it in certain directions, and dependent on different social forces at different times, development moves in different directions, so take the 1980s and the global policy of structural adjustment that had an absolutely devastating effect on African and Latin American communities, massively increasing inequalities, and I don’t think anybody can say that that was a positive period.

But the reaction to that was a period of, let’s say, more social democratic approach, a range of different reforms, a range of different challenges to that model. Although I have to say that, you know, a lot of the remnants of that model still remain, particularly within some of the big institutions like the World Bank.

Will Brehm:  23:30
In your article, you say that you have to manage your existential angst when it comes to the contradictions of educational development. Do you have any tips for someone like myself, who does a little bit of work in international development as well and feel similar, conflicting kind of emotions working in that space?

Mario Novelli:  23:58
I think so. I mean, I am uncomfortable. And, you know, I’m happy to say that and I say it to everyone. But on the other hand, what I say to myself as well, in the field I work, which is on the relationship between education and conflict and violent conflict, if I didn’t engage with organizations and in the field, then I wouldn’t be able to make any commentary on it. So I kind of say that you have to, in a sense, get your hands dirty, in order to have some legitimacy in the debates that you’re entering into.

And so in a sense, I wouldn’t advocate for people not to engage, but they would engage cautiously. The second area, I think that’s important is to understand that institutions I’ve been working for UNICEF, I think, for the last seven years, more or less, most of my research time, which is about half of my time, my work time, for the last seven years, has been involved with UNICEF. And I think that what I’ve learned from that experience is that these institutions themselves are not homogenous, there are different actors, different processes going on. And in a sense, often what happens is, you get picked up by certain actors, they kind of know what they’re looking for, and pick people that think that they can deliver that. So in a sense, you get caught up in political battles that are going on in institutions, and you often get picked up and then dropped by these institutions. But I think that you can learn a lot. And I think the good thing about yourself, myself, if we’re academics, and not consultants, we’re not only as good as our last job, we have our own job to go back to, we can select, we can be a bit more selective about what we get involved in. And I think that, you know, the problem with full time consultants is that actually, they’re always looking for their next job. And so they’re always trying to please the people who are paying them. And I think that leads sometime to some complicity in the production of information and evidence. So I would say for people to engage when they engage, within a sense, real world research that they enter into that domain cautiously, and also recognize, you know, some of the constraints.

Will Brehm:  26:48
So part of this work that you’ve done kind of straddling both the researcher and the consultant practitioner in educational development is that you’ve ended up with your team, putting together a framework of trying to understand inequality and education in ways that are probably more robust and complex than those being put forward by others. Can you talk a little bit about your framework and the value that you think it has?

Mario Novelli:  27:22
Yeah, well, as you were saying, I’ve been leading or co-leading a Research Consortium between the University of Amsterdam and the University of Ulster, where we’ve been working in a range of different countries on the relationship between education and peace building. So when we came in, we had a lot of initial meetings around how would we conceptualize peace building in education, and then how would we apply that in the field to start analyzing different countries.

Now, that project began on the back of an earlier one that I did with Professor Alan Smith, between 2010 and 2012. And in that we looked at Lebanon, Nepal, and Sierra Leone, and explored the relationship between education and conflict. And through that analysis, we develop to critique of the international community’s approach to peace building. And the location of education there in which was essentially that the broad approach of the international community to peacebuilding was a kind of security first liberal peace approach. And I’ll just explain those very quickly. And essentially, the argument was that you need to have security before anything else can move forward. So you need to retrain the military, retrain the police, sort the prison system out and then the social development, education, health can come later. And this is also tied with an argument that there was a kind of process of the reconstruction of a conflict affected state that you need to have security, then democracy, then open the country to open the markets up, allow the economy to develop, and then eventually, the rest of this stuff will follow. And basically, our critique of that was that it produced a kind of negative piece, the violence stopped. But the reasons that underpin the violence often remained, and the things that underpinned that violence was often inequalities. So I remember that we went to rural villages in Sierra Leone and ask questions around, you know, 10 years after the peace process, what has peace brought? And often the response was very little. So communities largely saw little benefit from peace in terms of their material lives, their access to education, their access to water, etc. And what we argued was that that approach, while short termly successful in the long term was laying the seeds for another conflict, that they hadn’t addressed the reasons why the conflict broke out in the first place. And we see that reproduced in many parts of the world. So that’s our starting point to say that we need a more social peace building model and more health and education are important.

So from that, with the new research project that we’ve done over the last couple of years, we developed a kind of social justice plus reconciliation approach, which we called the four Rs.

We took the first three Rs from Nancy Fraser’s work on social justice: redistribution, recognition, and representation. So economic inequality, cultural inequality, and political inequality. And we also added the fourth R of reconciliation, which was basically that you needed to address the drivers of conflict, which were often economic inequality, political and cultural inequality. But after a period of war, you also need to bring communities together, you need to have process of reconciliation.

And in a sense, those are often in contradiction. On the one hand, if you want to address those inequalities, you have to upset people, you have to redress, redistribute, reorganize. If you try to reconcile people, you need to deal with the legacies of conflict, which means often bringing them together. So those four different Rs, those four different dimensions working together, provided us in a sense, with the kind of roadmap to explore different countries approaches to education, so allowed us to look at different dimensions of the education system, how much money is spent on the education system? Where does it go? How is it distributed? Who gets what, where? Why don’t others get more? It also allows us to look at recognition which cultures are rarified, which languages which histories which communities are marginalized. It allows us to ask about representation, political issues, who gets to make decisions about issues in the education system that affect them? Who are marginalized and excluded from those decisions? And then finally, what is the education system doing in terms of reconciliation in terms of bringing communities back together after war? Is the school an obstacle to that process of reconciliation or a facilitator for that? So we looked at those different dimensions, and then produced a range of Country Reports around that looking at different aspects of them. And, you know, all kind of heuristic approaches have their limitations. But I think that it’s had some important policy effects. It has been taken up by a range of different national governments, I’m thinking South Sudan and South Africa, in particular. So you know, I’m pretty pleased with that.

Will Brehm:  33:55
One of your critiques about Thomas Piketty earlier was that he focused on empiricism. And in a sense, he wasn’t taking a critical realist approach about trying to realize that there are, there’s a social ontology more than empiricism. So some things we can’t see that that are important, or structures that exist that determine behavior and action that can’t necessarily be seen. How does your framework include a critical realist perspective?

Mario Novelli:  34:34
Well, I mean, I think that that framework, the four R’s is only a beginning, in a sense that all it is this kind of coat hangers to hang different dimensions of injustices and inequalities on what matters then is how you theorize and understand the underpinnings of those inequalities. Yeah, how did they emerge? What are their drivers, and I think that’s why in the sociology paper that you talk about on Piketty, I’ve tried to talk about the interaction between capitalism, imperialism and modernity and the complex and into weaved ways that these three phenomena intersect to reproduce those inequalities.

Will Brehm:  35:29
Well, Mario Novelli, thank you so much for joining Fresh Ed. It was really wonderful to talk on so many different topics.

Mario Novelli:  35:35
Thank you very much for inviting me.

Will Brehm:  1:58
Mario Novelli,欢迎你做客FreshEd

Mario Novelli: 2:01
感谢邀请,乐意之至!

Will Brehm:  2:03
针对法国经济学家托马斯·皮凯蒂(Thomas Piketty)于2013年的著作《21世纪资本论》,《英国教育社会学杂志》出了一期特刊。作为特刊的撰稿人之一,可否总结一下皮凯蒂在《21世纪资本论》中的主要论点,以及它有何特殊之处会使得一本教育期刊专门出特辑讨论呢?

Mario Novelli:  2:33
好的。皮凯蒂的书是一部很重要的著作,他主要研究过去200到220年间不断加剧的不平等现象。
传统经济学认为随着资本主义的发展,国家的繁荣,不平等程度会随之降低。皮凯蒂指出事实上恰恰相反。他强调,除了一战和二战期间曾短暂缩小外,不平等现象正不断加剧,而这种趋势恰恰印证了一条经济学原理,那就是私人财富,即继承财富的增长速度远超生产性投资或整体经济增长。
从长远来看,不平等程度将进一步增加。我认为,这将会对教育产生很大影响,尤其是教育在不平等再生产的问题和消除不平等方面起到了许多作用,甚至在某种意义上扮演了社会平衡的角色。我们觉得有很多维度值得在这本特刊里讨论。而我的重点主要关注教育与冲突之间的关系,因此我深入研究了那一领域。

Will Brehm:  4:11
在讨论您的研究之前,我想先请教一下,你在研究过程中发现皮凯蒂的观点有何不足之处吗?

Mario Novelli:  4:28
我得说这是一本非常出色、非常重要的书。虽然很长,但通俗易懂。而且皮凯蒂提出了很多关于不平等问题的重要观点。多年来,在传统经济学家看来,不平等都不是什么大问题,似乎只是经济发展过程中自然而然的一部分。

但还是有很多值得推敲的地方。首先,皮凯蒂是名经济学家,虽然比大多数新古典经济学家要开放一些,但他的重点仍然放在了经济领域和贫富差距上,在我看来虽然重要,但还不够充分。如果我们回溯过去70年来反抗不平等的民众运动,就会发现,财富上的不平等虽然很关键,但也只是其中一个领域。除此之外,我们还需要探究其他领域上是否存在不平等,例如文化上的、政治上的、民族上的,以及这些不平等对性别、身份、政治权利、人权等方面的影响。因此,我们不能局限于狭隘的经济主义去讨论不平等,还有许多更有深度的角度。

第二点不足之处和皮凯蒂的实证主义主张有关,他很重视可量化的数字和证据。而我认为,并不是所有重要的都可被测量,而可被测量的并不一定都很重要。因此我更相信理论的重要性,因为理论能帮助我们透过现象看本质,深入到无形事物的表面之下,例如不平等的结构、社会阶层、种族主义等等,这些是传统的、可量化的实证主义未必能触及的存在。

我个人认为,皮凯蒂这本书的第三点不足或疏漏是他没有讨论到帝国主义问题、南北关系问题、奴隶制问题,以及资本主义发展进程中的殖民主义的历史。在他看来资本主义发展是遵循经济规律的产物,但实际上我们知道,资本主义同时也是通过征服和殖民的方式发展起来的。

Will Brehm:  7:03
听起来皮凯蒂似乎忽视了社会和文化现象上的、更复杂的不平等问题。那他在书中提到教育问题了吗?是如何提及的呢?

Mario Novelli:  8:07
皮凯蒂将教育视作一种可以带动增长,同时还可以潜移默化地促进公平,缩小贫富差距的引擎。作为一名经济学家,他有这样的想法并不足为奇,这正体现了他对“人力资本假说”的理解,即教育投资不仅能提高个人财富,同时也有利于国家财富的增长。当然,这一观点并不被看好,包括皮凯蒂本人也在书里对人力资本理论的相关性表示质疑。因为,从根本而言,他主张遗产资本和债务资本的生产力要比经济增长和生产资本更高,因此教育投资未必能收获所期望的回报。即使是人力资本理论,目前在资本主义发展的根本属性上也依然存在问题。总而言之,皮凯蒂真正研究视阈是经济发展中的教育回报问题。

Will Brehm:  9:33
如果人力资本理论无法解释,那么还可以用什么来解释教育和资本主义之间的关系呢?

Mario Novelli:  9:42
需要澄清的是,人力资本是一方面,我并不否认其重要性,但教育和资本主义之间的关系要复杂得多。首先,我想引用一下罗杰·戴尔(Roger Dale)的观点,他于上世纪70年代发表的《教育与资本主义国家》一文中反思了教育与资本积累的关系(即人力资本)、教育与社会凝聚力的关系(即教育系统能否起到使不同人群和谐相处的作用),以及教育与合法性的关系(即教育使学生接受他们所处地位与社会现状)。所以,从某种意义上说,教育具有正当合法、凝聚社会和积累资本的作用。罗杰一直表示这三点未必能兼得。比如,如果强调资本积累,那么社会凝聚力可能会因为择优性而受损。如果过分强调合法性,那么资本积累和社会凝聚力也会被削弱。这其中有很多重矛盾。这是我认为第一个值得回顾的重要观点。

第二点是一种比较新的现象,即在自我投资和生产方面,或者说教育在经济增产中的作用不仅是人力资本,而是成为一种重要的商品形式。自20世纪末至21世纪初,教育是发展最快的行业之一,大学和国际学校不断扩张。因此如今,教育本身也变成了经济交换的一种形式。这一点需要更加深入仔细的研究,但正如我们的特刊中苏珊·罗伯森(Susan Robertson)强调的,皮凯蒂的书里完全忽略这一点。

第三点同样非常重要的是不平等领域,即教育在不平等再生产方面的作用。我指的不仅是已有广泛关注的阶级和性别不平等,还有发达国家与发展中国家间的不平等。例如,为什么撒哈拉沙漠以南的非洲地区会在国际经济中处于边缘位置,我认为教育本身、教育从业者、国际教育架构、授课方式和政策等各种不同因素都在不平等再生产中发挥了作用。因而从某种意义上而言,皮凯蒂只观察到其中一个方面。但我认为,要认真对待教育只有从更广泛的角度入手才行。

Will Brehm:  13:21
我觉得大多数人认为教育可以实现平等和进步,所以对于教育反而加剧不平等这一观点,听众朋友们乍一听或许会不太认同,但这是一个很有意思的话题,可否再多解释一下?

Mario Novelli:  13:47
的确如此。假设你是一位来自西方国家的听众,用最简单的话来说,教育会使得某些人享有特权,而其他人的权益则会受到损害。比如,在我自己的国家英国,教育供给是很不均衡的,不同地区的学校在质量上有天壤之别。而父母的收入可能决定了孩子可以就读何种类型的学校,是否能上得起私立学校。如果有能力在高档的富人区买房,那么就能上好的学校,反之在贫穷的地区教育质量也不会太好。因此,在这个层面上,教育充当了社会阶层过滤器的角色。

我认为,现在世界范围内,不论从什么层面,教育都是在高度分化的。另一个教育加剧不平等的层面就是语言。语言是一个很复杂的问题,国家课程里教什么语言,哪些语言被边缘化了,对那些使用边缘化语言的人群有什么影响,他们在学校表现如何,是否表现不太好,长此以往又有何影响?还有例如课程内容也会加剧不平等。试想一个来自少数族群的学生,学习自己国家历史时发现没有一个自己民族的英雄,都是其他民族的人物,这个学生该如何做想,会产生什么后果?总而言之,教育的异化方式有很多。当然,反之,一个高度平等、包容和开放的教育系统也许会缓和这些代代相传的不平等。

Will Brehm:  16:17
这种代代相传的不平等和你之前提到的帝国主义有关吗?

Mario Novelli:  16:24
这是肯定的,研究过非洲国家的课程体系就会知道,很多国家教育系统中都有殖民干涉的痕迹。拿肯尼亚举例,多年被殖民统治的历史使得其发展出一套高度精英化的教育体系,旨在将大多数人排除在外,只有少部分精英被挑选出来进入政府部门。这种教育模式进一步再生产了高度不平等的社会结构,看似公正的学历制度其实早就由社会阶层决定好了。

Will Brehm:  17:27
你之前提到你的研究方向是教育发展与冲突,那接下来可以谈谈你在教育发展方面的成果吗?尤其是在像南苏丹、缅甸这样的冲突地区。你认为在这些冲突不断的国家和地区,不平等是如何在教育中体现和发挥作用的呢?

Mario Novelli:  18:00
首先退一步讲,发展作为一个研究领域本身是一个非常矛盾的。一方面,国际发展中内含的一个思想就是世界上其他国家要向西方看齐。在这种思想指导下的研究认为,前、后殖民地的民族国家最终都能追赶上西方。但同时另一方面,也有人认为国际发展是一种新型的殖民主义,新的机制,新的“食物链”取代了过去军事力量的殖民,虽然不太明显,但威力不减。因此,这一领域本身就陷入囹圄,让人不禁发问,国际发展真的是对的吗?它到底是帮助消灭了国家间的不平等,还是变相地加剧了这些不平等?例如塞拉利昂,1991年爆发内乱后,国际社会的介入,维和部队的驻扎,使得粮食和房屋价格大幅上涨。诸如此类的事情屡见不鲜,这些影响虽说是无意中造成的,却往往复制和加剧了不平等的程度。

同样,国际社会对教育系统的干预是有利还是有弊?不平等到底是缩小了,还是扩大了?关于这一点,不同国家的情况还不尽相同。再拿我最近在研究的肯尼亚举例,自从脱离英国殖民统治后,在国际发展组织出于善意的推动下,肯尼亚致力于推行针对贫困社区的低成本基础教育和私立学校建设,然而这对贫困人口有着显著的负面影响和毁灭性打击。

每年教国际发展课的时候,我都会在课程开始前问学生们一个问题:“你们对于进入国际发展领域有何感想?”有学生说很开心,有人想要帮助非洲,还有人想帮助亚洲。而我告诉他们:“希望在课程结束的时候,你们会一点点惭愧。一些你们以为冠着发展的名头做的事,实际上和战争做的事一样糟糕!”

Will Brehm:  22:02
这是你的感想吗?

Mario Novelli:  22:06
很大程度上我是这么想的。不过就像我前面说过,国际发展是一个矛盾的领域。如果只有不好的一面,我就不会还继续留在这里了。我有种强烈的感觉,和很多其他学科一样,这各领域内正在进行着一场战斗,不同力量间彼此对垒、各自为战。随着不同时期的不同社会力量,发展也朝着不同方向移动。例如上世纪80年代的全球结构性调整政策,对拉丁美洲和非洲国家带来沉重打击,大大增加了不平等,我敢说没有人认为那是一个积极的时期。但也不可否认的是,这一模式也带来更多的社会民主,各种各样的改革,以及不同的反思和挑战。然而,我不得不说,这种模式仍然可以在一些大型组织,例如世界银行的做法中能经常看到。

Will Brehm:  23:30
你在文章中提到,每当遇到教育发展的矛盾时,你都必须要管理自己的焦虑情绪。我自己有时也会做一点关于国际发展的工作,也有这种类似的矛盾情绪。对于像我这样的研究者,你有什么建议吗?

Mario Novelli:  23:58
我同样感觉不是很自在,而且我很乐意告诉别人这一点。但另一方面,我也告诉自己,要想进行教育和暴力冲突之间关系的相关研究,就要不怕“弄脏手”。如果不参加那些组织,不与他们交流,是不能往下评价的。只有真正进入了这一领域,才有资格讨论。所以第一点,我不会劝阻他们,而是希望他们要慎重。

第二点我认为很重要的是要理解你所在的机构。我在过去七年时间里都是在联合国儿童基金会(UNICEF)工作,几乎投入了我全部的研究时间,占所有工作的一半左右。我从这段经历里发现,并不是所有机构都是一样的,不同的机构扮演的角色不同,过程也有所差异。经常发生的是,你可能会被某个组织选中,他们知道自己要的是什么,因而选出他们认为可以实现这一目标的人。从某种意义上而言,你就陷入了机构的政治斗争中去了。他们可能选中你,也可能放弃你。这中间有很多值得学习的地方。

而像我们这些研究者有一点好,那就是我们是学者,不是顾问,所以不用受限于要不断在工作上保持优异的表现,因为我们可以回归自己的本职工作,这就给了我们一些选择的空间,我们能挑选哪些工作是我们想做的。而全职顾问的难处在于,他们永远要寻找下一份工作,因此他们就要努力取悦付给他们薪水的人。这会使信息和证据的可靠性变得复杂起来。总而言之,对于想要踏入真实世界的研究者来说,我建议要小心谨慎、认清局限。

Will Brehm:  26:48
你既以一个研究者的身份,同时也是一名从事教育发展顾问事业的实践者。你和你的团队提出了一个更强大而复杂理论框架,来解释不公平和教育。你可否介绍一下这个框架,以及它的价值吗?

Mario Novelli:  27:22
就像你说的,我率领着一个阿姆斯特丹大学和阿尔斯特大学合作的研究联盟,是共同负责人之一,我们的联盟致力于研究各个国家的教育与和平建设的关系。所以在项目启动时,我们开了很多次初步会议,讨论应该如何构架“教育中的和平建设”这一概念,以及如果将其运用到不同国家的分析中去。

这次的研究联盟是基于我和阿兰·史密斯教授的一个早期项目。2010年到2012年间,我们调查了黎巴嫩、尼泊尔和塞拉利昂,研究教育与冲突的关系。通过那次调研分析,我们对国际社会现有的和平建设方法进行了批判。而与教育相关的研究基本上也遵循了这种以安全优先的自由主义和平的方式。我简单解释一下。这种方式主要是说安全是其他一切的前提,因此需要重新训练军队和警察,梳理监狱体系,在此基础上才开始社会发展,教育和医疗卫生等建设。与其相关的观点是受冲突影响的国家重建有一个过程,首先必须保证安全,其次是民主,然后要有开放的市场环境允许经济发展,最后才到其他方面。

我们认为这种方式有其消极的一面,即虽然暴力冲突停止了,但是造成暴力的原因依然存在,这个原因往往就是不平等。我记得在塞拉利昂农村,我们和当地人交流的时候,问他们十年和平都带来了什么变化,通常得到的答案却是没什么。大部分人并不认为和平在提高生活水平、增加教育机会和获取水资源等方面有积极作用。所以,我们认为短期内这种方式是成功的,但长期来看却会导致另一种冲突,世界各地都有类似的例子证明了这一点。因此,需要一个更加社会化的和平建设模式,更加重视教育和卫生,这是我们的出发点。

我们这个新的研究项目就着眼于此,在过去两年中,我们开辟了一种社会正义与和谐的途径,称之为“4R”。其中,三个R来自南希·弗雷泽对社会正义的研究,即再分配(Redistribution)、认可(Recognition)和代表(Representation),分别对应了财富不平等、文化不平等和政治不平等。第四个R是调和(Reconciliation),这是解决以上三个冲突成因的关键。因为战争结束后,要想把不同人群凝聚在一起,就需要有调和的过程。这中间往往存在着矛盾,一方面,如果要解决不平等问题,就需要重新调整、重新分配、重新组织,会惹恼一部分人;而如果要使人们握手言和,就必须解决冲突的遗留问题。

我们的4R框架首先可以将四个不同方面整合起来,可从多维度探索不同国家的教育体系。例如,财政在教育方面的支出有多少?都用在什么方面?是如何分配的?谁得到了什么?在哪里?为什么其他人没有?其次,这个框架还能帮我们认出已经稀释化的文化,以及被边缘化的语言、历史和人群等。第三,它还涉及政治和代表问题,例如谁掌握了教育系统的决策权?谁被边缘化或隔绝在外?最后,它还能探索教育系统对战后的国家团结的作用,学校会阻碍还是促进这一调和过程?研究了这些不同方面后,我们生成了一系列相应的国家报告。当然,凡是启发式方法都有局限性,但我认为我们的成果还是对政策制定起到了一定的重要作用,有很多国家采纳了我们的报告,尤其是南苏丹和南非。对此我非常高兴!

Will Brehm:  33:55
你之前指出托马斯·皮凯蒂的不足之一就是他的实证主义主张,也就是说他没有采用批判现实主义的方法,未能意识到在实证之下还有社会本体的存在,这产生的问题就是,我们无法观察到一些重要的东西,比如决定人们行为的某些现存结构。那你的4R框架是如何涵盖批判现实主义角度的呢?

Mario Novelli:  34:34
我们的框架仅仅是一个开始,就像是一个衣架,上面挂着各种研究不正义和不公平的方式,然后更重要的是形成相关理论来理解这些不公平背后的基础。例如,不平等是如何出现的?有哪些推动力量?这也是为什么在之前谈到的那篇关于皮凯蒂的社会学论文里,我试图阐释资本主义、帝国主义和现代主义之间的相互作用,以及这三种错综复杂交织在一起的现象是如何再现不平等的。

Will Brehm: 35:29
Mario Novelli,很高兴能聊到这么多的话题,感谢你的分享!

Mario Novelli: 35:35
感谢邀请,也是我的荣幸!

Have any useful resources related to this show? Please send them to info@freshedpodcast.com