Why did I feel it was interesting to interview Carolyn? She is an American economist and public policy scholar who serves as the Patricia and Rodes Hart Professor of Public Policy, Education, and Economics at Vanderbilt University’s Peabody College. Her research focuses on education policy, workforce development, social welfare programs, and the evaluation of public policies and government performance. Carolyn is widely known for her work on program evaluation and evidence-based policymaking, often collaborating directly with federal, state, and local governments as well as international organizations such as the World Bank and UNICEF to improve the design and effectiveness of social policies. Over her career she has held senior academic positions at institutions including the University of Texas at Austin, the University of Wisconsin–Madison, and the University of North Carolina at Chapel Hill. She received her PhD in public policy from the University of Chicago under Nobel laureate James Heckman, and her contributions to the field have been recognized with awards such as the David N. Kershaw Award and election to the National Academy of Public Administration.
This interview is particularly compelling because it connects Carolyn’s personal journey—from a modest upbringing in rural Wisconsin to becoming a leading scholar in public policy—with her broader reflections on how governments evaluate and implement social programs. Throughout the conversation, she explores the tensions between evidence and politics, the limits of traditional policy evaluation methods, and the challenges of designing public systems that truly serve vulnerable populations. At a time when trust in institutions is declining and policy debates are increasingly polarized, Carolyn’s insights highlight the importance of interdisciplinary research, careful evaluation, and humility in public decision-making. The interview therefore offers both an intellectual exploration of modern policy challenges and a personal perspective on the values that shape meaningful public service.
Here’s our exchange:
Where are you originally from, and what aspects of your childhood there most shaped who you are today?
I was born in Milwaukee, Wisconsin (United States). I am one of seven children, the second oldest in a Catholic family of Irish, Polish, and German origins. Before I started kindergarten, we moved to a small town in rural Wisconsin (Waupun), surrounded by dairy farms, cheese factories, and apple orchards. I was what we would call a “free-range” kid. When we weren’t in school and after our chores and homework were done, we were out of the house exploring on our own. With other kids in the neighborhood, we rode our bikes around town, engaged in a lot of creative play, and became very independent.
That independence and self-reliance, combined with high expectations for contributing to the household and doing our best in school, prepared me well for adulthood. I started my first paid job outside the home at age 11, delivering newspapers seven days a week on my bike, and I have never been without a job since.
How would you describe your family environment growing up, and who were the most influential figures in your early life?
My father was a social worker supporting a family of nine on a social worker’s salary, so we lived paycheck to paycheck. My mother tracked the family’s expenditures down to the penny, and my parents did not begin saving money until they were in their sixties.
We lived in a three-bedroom, one-bathroom home, with three or four kids sleeping in each room. Despite these constraints, both of my parents would give the shirts off their backs to anyone in need. I witnessed daily their generosity, kindness, and devotion to serving their community and church.
The values they imparted to me and my siblings are a gift that keeps giving.
Were there particular family or cultural traditions that played a lasting role in shaping your values or worldview?
Because my parents did not have resources for entertainment—such as movies, vacations, or many toys—we created our own. My mom saved the prizes from cereal boxes during the week, and on Sundays she made popcorn while we played games like Rummy Royal and other card games to compete for the prizes.
We collected cardboard boxes from the appliance store and used them to build things. In autumn we filled them with leaves and jumped off the porch railing into them. We spent a lot of time at the public library, which was our main source of books. We also maintained a family garden so that we would have vegetables throughout the winter, and each of us was responsible for maintaining our designated rows.
The beauty of this upbringing is that materialism is anathema to me. What I most appreciate about working in a well-paying job is that it gives me the opportunity to share generously with others and support many important needs and causes in the world.
What initially drew you to the field you chose to study, and was there a moment when you realized it was the right path for you?
I grew into my career path rather than deliberately choosing it from the start. I was fortunate to receive scholarships and to work enough to cover the costs of a liberal arts undergraduate education, where I studied international relations and economics. My undergraduate mentors encouraged me to continue with graduate studies, and I received a full tuition scholarship and stipend to attend the University of Chicago. I could hardly believe that I did not have to pay a penny for such an incredible graduate education.
I fell in love with the interdisciplinary field of public policy, largely because of the opportunities it offered to study the most pressing challenges of the day and the role of institutions and society in addressing them. The city of Chicago was an ideal “laboratory” for this type of study.
At the University of Chicago I acquired both the theoretical background and the sophisticated methodological training necessary to launch a research career, which has continued since the mid-1990s.
At what age did you begin working, and what did your first job teach you about responsibility or independence?
My first job outside the home began at age 11, delivering newspapers seven days a week on my bicycle. Wisconsin was cold for much of the year, but regardless of the weather I had an obligation to my route that I fulfilled daily, including delivering the extra-large Sunday newspaper by 8 a.m. I also became a popular babysitter starting at age 11, because it was well known that I had a great deal of experience helping with babies and young children at home.
I worked to pay for my own haircuts and clothing and to begin saving for college. From a young age I knew I would likely fund my own postsecondary education, which motivated me to work hard in school. During high school I also worked in a grocery store and as a lifeguard.
How would you describe your current professional role, and what aspects of it do you find most meaningful?
I am a professor at a Research-1 university, engaged in both research and teaching, and I have also held numerous administrative roles.
Developing new lines of research and training students to conduct research are the most meaningful aspects of my work. I typically have several research projects underway at any given time, so there is rarely a slow period. A fun evening for me might involve analyzing data. There is often a great deal of groundwork leading up to the moment when the data are ready for analysis, and I genuinely enjoy reaching that point.
How has your interdisciplinary work across public policy, education, and economics reshaped the way we should evaluate government effectiveness beyond traditional cost–benefit analysis?
I strongly believe that we cannot make meaningful progress on society’s greatest challenges if we remain confined within disciplinary boundaries or apply only a narrow economic lens. For example, I worked with colleagues from multiple countries and institutions in South Africa, along with South African government agencies and UNICEF, to evaluate the Child Support Grant (CSG) program—an unconditional cash transfer program.
An economic analysis focusing solely on household spending patterns suggested that some of the grant money was being wasted, particularly when teenage girls purchased personal care products such as beauty supplies. However, by combining qualitative research with quantitative econometric analysis and integrating these findings rigorously, we were able to demonstrate that these purchases actually reduced participation in risky behaviors—such as transactional sex linked to HIV transmission—and improved other outcomes. This example illustrates why interdisciplinary approaches are essential for understanding policy impacts.
In your research on program implementation, where do the greatest gaps emerge between policy design and outcomes, and why do they persist despite decades of evidence?
Policy design is the outcome of an inherently political process, and rigorous research evidence is rarely the primary driver of policy decision-making. Researchers must engage in relationship-building and make intentional efforts to participate in the conversations and activities that shape policy design and program implementation if they want research evidence to influence these processes.
In a world where attention to traditional forms of research communication is increasingly limited, scholars also need to adapt how they present their work. Research findings must compete with many other information sources—including social media—for attention and influence. Even “research briefs” are often too long for contemporary audiences. For this reason, I sometimes use infographics tailored to specific audiences to communicate key findings in ways that policymakers and practitioners are more likely to use.
What do your findings suggest about the limits of evidence-based policymaking in highly politicized environments?
Despite the fact that evidence-based policymaking has been codified into law in the United States, facilitating the objective use of research evidence in policymaking has become increasingly challenging.
The concept of “alternative facts” has blurred the public’s understanding of reliable sources of evidence and truth. At the same time, the credibility of universities and research institutions has been questioned for politically motivated reasons. However, these challenges only reinforce the importance of continuing to produce rigorous research and building public trust. Scholars must remain committed to generating high-quality evidence and ensuring that it remains available as a resource for policymakers and the public.
How should policymakers interpret “what works” when randomized controlled trials produce results that fail to scale or translate across contexts?
Many randomized controlled trials (RCTs) have been designed as “black box” evaluations. They generate estimates of the average impact of a program or intervention without sufficiently examining the implementation processes or underlying mechanisms that produce those results.
Designing more complex experiments—such as multi-arm RCTs or studies that randomize interventions across different subgroups or contexts—is more expensive and complicated. As a result, we often lack sufficient understanding of how implementation affects outcomes.
Mixed-methods evaluations can help address this limitation. Incorporating qualitative components allows researchers to better interpret RCT findings and identify factors that may limit or facilitate scalability across different contexts.
To what extent do performance management systems improve public services, and when do they instead distort incentives and behavior?
A recent meta-analysis confirmed several important lessons about performance management and incentive systems in the public sector: their effectiveness depends heavily on system design and context.
When outcomes are clearly defined, well measured, and aligned with organizational goals, performance management systems can effectively guide improvements in public services. It is also essential that those responsible for meeting performance targets believe they have control over the measured aspects of performance and understand how their actions contribute to improved outcomes.
However, these systems can also create incentives for “gaming” the metrics. This tends to occur when there is misalignment between performance indicators and organizational goals, or when some indicators in a multidimensional system are harder to measure or achieve than others. Gaming is also more likely when individuals are less intrinsically motivated to work toward organizational goals.
Overall, research suggests that outcome-based incentives tend to be more effective than output- or process-based measures in improving public sector performance.
Your work often highlights the role of frontline actors; how much policy failure is actually a problem of governance rather than resources or intent?
Frontline actors have considerable influence over policy and program success. The decisions and actions they take during implementation can reshape how policies function in practice.
Governance structures—the organizational infrastructure, rules, and policies that guide implementation—play a critical role in shaping the discretion and behavior of frontline workers. Effective governance systems can help guide or constrain implementation in ways that align with policy goals.
At the same time, resource constraints are a common challenge in most implementation settings, and governance structures should be designed with those constraints in mind.
How do administrative burdens and bureaucratic complexity disproportionately affect marginalized populations, and why are these costs still undervalued in policy design?
Research on administrative burdens and citizens’ encounters with bureaucratic complexity has expanded significantly over the past decade. Increasingly rigorous evidence shows how administrative burdens can be reduced through changes in policy design and implementation.
One reason this research has gained attention is that reducing administrative burdens can benefit both governments and citizens. Simplifying procedures can lower administrative costs while also improving equitable access to public benefits.
However, these burdens are not always inadvertent. In some cases, policymakers intentionally maintain them. Administrative hurdles—such as long lines or complex applications—may be viewed as tools for screening out individuals who are perceived as less deserving of public benefits.
Recent research challenges this assumption. Evidence increasingly shows that administrative burdens disproportionately exclude those who are most in need and least able to navigate complex systems.
What lessons does your research offer about aligning accountability mechanisms with learning rather than punishment in public institutions?
Performance management is an important mechanism for public sector accountability, but performance information is useful only if it contributes to learning and service improvement.
Punitive uses of performance data—such as sanctions—rarely produce positive outcomes. Instead, they often encourage gaming behaviors, where organizations focus on hitting targets rather than addressing underlying problems.
A more productive approach is something I first observed in the European Union called “benchlearning.” In this model, performance information is shared through forums, workshops, and exchanges that encourage collaborative learning and adaptation.
Effective performance management systems should be dynamic and allow organizations to adapt to changing conditions that may lie beyond the control of public managers and service providers.
In education policy, how do market-based reforms compare to state-led interventions in addressing inequality, based on the evidence you have examined?
In the United States, recent policy trends have shifted away from federal interventions designed to address inequality and toward market-based reforms, particularly school vouchers and expanded school choice.
The research evidence on these reforms is mixed but often negative. Even when voucher programs are designed to prioritize lower-income families, they tend to be used more frequently by families who already have the resources to navigate the system—such as time, transportation, and access to information.
There is also growing momentum for universal voucher programs that are not tied to family income. Early evidence suggests that families with existing advantages are more likely to benefit from these programs.
When access is left primarily to market forces, inequities tend to persist or even worsen. For example, private school providers may choose locations and services that primarily attract families who can already pay, rather than investing in transportation or outreach to underserved communities.
At the same time, the recent downsizing of the U.S. Department of Education’s role in addressing inequality suggests that disparities in educational opportunities and outcomes are likely to grow.
How should public agencies balance the demand for rapid results with the reality that meaningful social change often unfolds over long time horizons?
One of the biggest challenges with evidence-based decision-making and policymaking is that results are often expected within electoral cycles. Policymakers want to demonstrate progress not ten years later—when they may no longer be in office and able to claim credit—but as quickly as possible.
However, when we look at some of the most important policy achievements, such as the Children’s Health Insurance Program (CHIP) in the United States or the long process of dismantling school segregation, meaningful results took many years to emerge. These accomplishments required multiple rounds of policymaking and continuous adjustments to refine implementation.
One way to address this challenge is by electing leaders who are motivated by public service and willing to pursue long-term goals even if they cannot personally claim victory during their time in office.
Another approach is to design performance management systems that track interim milestones along the path to long-term outcomes. Monitoring these intermediate steps allows organizations to adapt strategies over time while also providing evidence of progress that leaders can point to. This is something I am currently working on with a large NGO.
What are the ethical implications of using data analytics and predictive tools in public policy when errors disproportionately harm vulnerable communities?
Data analytics and predictive tools in public policy should be viewed as exactly that—tools to support learning and decision-making, not substitutes for human judgment.
Concerns about the data that feed into AI systems and the biases embedded within those data are entirely legitimate. As we continue to integrate predictive tools into policy design and implementation, we must remain attentive to these risks.
Another concern is ensuring that the advantages of advanced data analytics do not become concentrated among a small group of actors. If access to these tools becomes limited to those with the most resources or influence, they could become yet another mechanism for concentrating power and restricting broader participation in policymaking.
How do you assess the growing influence of private and nonprofit actors in delivering public services, and what risks does this pose to democratic accountability?
The role of private for-profit and nonprofit actors in delivering public services has been expanding for more than a century. However, technological changes have significantly accelerated this trend in certain sectors.
One example from my current research involves for-profit companies that develop and sell online course platforms to public schools in the United States. These platforms are often used for students who are failing courses. Instead of repeating the course in a traditional classroom, students complete modules in computer labs where they can retake or test out of certain parts of the curriculum.
Our research over more than a decade suggests that while these systems may improve course completion rates and graduation statistics, they do not necessarily improve learning outcomes. Answers to many of the assessments are widely available online, allowing students to complete the courses without fully mastering the material.
School systems often have limited oversight over the content provided by these vendors. In many cases, the systems are adopted because they offer a cheaper way to meet accountability targets such as graduation rates. This example illustrates how accountability systems can create unintended consequences. When performance indicators emphasize outcomes like graduation rates without adequately measuring learning, policies may inadvertently undermine the very goals they were designed to achieve.
The role of private vendors in online K–12 education is now firmly established across the United States, especially since the pandemic. However, oversight and accountability for these actors remain weak at federal, state, and local levels.
In your view, what methodological assumptions in policy evaluation deserve the most scrutiny today?
The use of experimental methods has expanded dramatically in the social sciences, including in fields where they were once considered impractical. This is an exciting development in many ways. However, researchers must pay close attention to the assumptions underlying their experimental designs, particularly the nature of the counterfactual. In many real-world contexts, the assumption that a control group represents a true “no-treatment” condition may not hold.
Understanding what is actually happening in the control group can be just as important as understanding the treatment itself. Gathering comparable data from control sites can be challenging and expensive, but failing to do so risks producing inaccurate estimates of an intervention’s effects. For example, in a current K–12 education experiment in which I am involved, we recently discovered that another intervention is being implemented in three of our control sites. We are now collecting information about that program to understand how it may influence outcomes and how it compares to the intervention we are studying.
Ignoring such factors could compromise the validity of the experimental findings.
How can governments better integrate qualitative insights from lived experience with quantitative evidence without undermining rigor?
Together with my colleague Patricia Burch, I wrote a book on mixed-methods research for policy and program evaluation. In it, we advocate for tightly integrating qualitative and quantitative approaches throughout the research process.
My own training is primarily in quantitative methods, but over time I have come to appreciate how essential qualitative insights are for understanding the context of the policies and programs we study.
In the past, qualitative and quantitative findings were often brought together only at the final stage of research during interpretation. I have found that integrating them from the very beginning produces much stronger research. For instance, in one study I initially believed I had an excellent quantitative measure of treatment—an invoiced hour of tutoring. However, qualitative fieldwork revealed that the actual instructional time within that “hour” varied greatly across tutoring formats and implementation models.
Without that qualitative insight, I would have had only a limited understanding of how differences in implementation affected the outcomes we observed.
Looking ahead, how should public policy research evolve to remain relevant in an era of declining trust in institutions and rising political polarization?
Much of my research involves partnerships with public sector organizations and requires collaboration through data-sharing agreements, advisory committees, and other forms of engagement.
In recent years, these partnerships have become more difficult to maintain due to growing political polarization and mistrust between academic institutions and the public—sometimes deliberately fueled by political actors. As a result, researchers must invest more time in relationship-building and trust maintenance while continuing to protect academic independence and the production of nonpartisan evidence.
We also increasingly produce research outputs tailored to different audiences, translating complex findings into formats that are useful for specific stakeholders and decision-makers.
Has there been a book, film, or work of art that significantly influenced the way you see the world or think about your work?
It is difficult for me to identify a single book, film, or work of art that has fundamentally changed how I see the world. In the United States today, there is a strong push by the current presidential administration to deny the legacy and persistence of systemic racism in our society, even as many people increasingly recognize and experience its effects.
For that reason, I gravitate toward works that challenge this narrative and expose these realities, including a number of powerful documentaries, such as The Alabama Solution. If I had to select one work, I would point to Ibram X. Kendi’s book Stamped from the Beginning, which has also been adapted into a Netflix series (although I have not yet watched it).
Looking at younger generations today, what gives you the greatest sense of hope, and what concerns you the most?
I teach public policy to undergraduate students, and I have noticed that a large majority of them receive their news primarily through social media, which we know is curated based on their interactions with various platforms. I see this pattern in my own social media use as well, and I believe it contributes to political and societal polarization.
At the same time, what gives me hope is that many of my students genuinely care about issues that will shape their futures and the well-being of others—such as climate change, economic policy and regulation, and public health. My goal as an educator is to encourage them to become more politically and socially engaged and to consult a broader range of information sources as they form their opinions and perspectives.
If you were asked to teach a class on a subject completely unrelated to your profession, what would it be, and what would you hope students take away from it?
I aspire—perhaps in retirement—not necessarily to teach a completely unrelated subject, but to teach in a very different context: educational programs for people who are incarcerated. Although public policy is central to my profession, I imagine that I would approach the subject differently for students experiencing incarceration, as they would likely have particular topics and concerns that matter most to them.
I would hope to inspire a deeper appreciation for learning and help them recognize its value, while also fostering a greater sense of hope about their futures.
If you could ensure that one human value is never lost in society, which value would you choose, and why?
Humility. We need it now more than ever.
To me, humility means caring for and respecting everyone and striving to understand and respond to the needs of others, regardless of their status, wealth, background, or social position. It means recognizing that no one is inherently “better” or more deserving of compassion, attention, and kindness than anyone else.
There is a saying that sometimes appears on bumper stickers that captures this idea well: “Live simply so that others may simply live.”
Humanity is facing radical changes. To name just ten: geopolitical instability, climate change, economic inequalities, technological risks, public health challenges, political polarization, resource scarcity, humanitarian crises, misinformation, and disparities in global healthcare access. If, in an imaginative exercise, you had the power to solve one of these problems, which one would you choose first and why?
This is a difficult question, but as someone trained as an economist, I would choose economic inequality.
Economic inequality amplifies many of the other challenges we face. It has been worsening over time, and disparities in access to resources are increasingly linked to political power and polarization.
This dynamic makes it even harder to address inequality itself. In the United States, for example, billionaires now enjoy unprecedented access to political institutions and influence. Developments such as the emergence of organizations like DOGE illustrate how concentrated wealth can shape political power.
Reducing economic inequality would therefore help address many of the other global challenges simultaneously.
What do you believe human beings owe one another, both as individuals and as members of a global society?
I would return to the value of humility. As members of a global society, we owe one another respect and recognition of equal human dignity. We should care for and protect the rights of every individual, regardless of their status, background, wealth, or nationality.
Interviews often focus on successes. Could you share something from 2025 that did not unfold as you expected, and what that experience taught you?
The political environment in the United States has affected both my personal and professional life, and I view 2025 as an extremely troubling period. In many ways, events have unfolded far worse than I could have imagined, with many elected officials doing little to prevent the deterioration of key democratic institutions.
This situation has introduced significant uncertainty and instability into institutions across society, including universities and the ways in which we conduct research.
I am learning as events unfold and thinking carefully about how to adapt to circumstances that may not return to anything resembling the pre-2025 status quo—if such a status quo ever truly existed.
Are there any personal or professional goals you feel comfortable sharing for 2026?
My personal goal is to deepen my civic and political engagement and to use my knowledge and skills wherever possible to support more informed public discussions about policy.
For example, I have recently become more active in organizations that aim to help the average U.S. citizen better understand immigration policy—why the system is currently in such turmoil and what more constructive approaches to reform might look like compared with current enforcement-focused strategies.
When you imagine the final moments of your life, what kind of news would you most hope to hear, and why?
I would hope to hear news of genuine and lasting peace emerging in some of the world’s most conflict-affected regions—places such as the Middle East and Gaza, Sudan, Yemen, Haiti, Syria, and many others.
I would also hope to see my country, the United States, playing a greater role in facilitating peace rather than primarily distributing weapons around the world.
Conflict is one of the greatest disruptors of children’s education and the realization of their full human potential. It undermines not only individual futures but also the well-being of humanity as a whole.