1. Introduction
The Fulbright educational exchange program has been called “one of the most enlightened initiatives undertaken” by the United States. On August 1, 1946, President Harry S. Truman signed into law the Fulbright Act, which was intended to promote international goodwill through the exchange of students in the fields of education, culture, and science. Through the development of “mutual understanding,” citizens of the United States and other countries would, ideally, cultivate peaceful relations. The Fulbright program’s promotion of goodwill, mutual understanding, and peace was also strategic. Specifically, the Fulbright Act’s proponents claimed that by developing U.S. citizens who possessed in-depth knowledge of politically and economically important countries and regions, educational exchange would increase the security of the United States.
The tension between policies created for mutual benefit versus mostly for one’s own strategic gain characterizes public relations. Whether in the context of organizations or states, so-called “hemispheric communicators” in the fields of public relations, public affairs, and public diplomacy walk a fine line between mutual- and self-advantage, and as a result, they tend to “express messages that speak to only half the landscape. Like the shining moon, they present only the bright side and leave the dark side hidden”. For Moloney, “Modern PR is competitive communication seeking advantage for its principals and using many promotional techniques, visible and invisible, outside of paid advertising”. Moloney identifies public relations as a form of “weak propaganda,” that is, the “the one-sided presentation of data, belief, an idea, behaviour, policy, a good or service in order to gain attention and advantage for the message sender”. Such propaganda is “weak,” however, in that within pluralistic and democratic societies, it must compete for public attention with other self-advantaging messages.
This article argues that the U.S. State Department’s Bureau of Educational and Cultural Affairs’ (ECA) program evaluations are a form of weak propaganda. Specifically, ECA’s rhetoric evinces the influence of marketization: “market-oriented principles, values, practices, and vocabularies”. Leitch and Davenport explained that marketization “involves the introduction of economic factors as the basis for decision-making as well as deployment of the techniques of business such as marketing and public relations”. Marketization also refers to the “process of penetration of essentially market-type relationships into arenas not previously deemed part of the market”. Marketization bears a family resemblance to other neoliberal discourses such as “enterprise,” “entrepreneurialism,” “market evangelism” and “Total Quality Management”. Inflected in the vernacular of marketization, ECA’s evaluations reflect and reinforce taken-for-granted assumptions about educational exchange that may subtly hinder the development of deeper mutual understanding and peace.
Let me be clear: Educational exchange certainly makes useful contributions to cross- cultural awareness, sensitivity, security, and competitiveness. I am more concerned in this article, however, in marketization’s role in shaping the meanings and practices of educational exchange in the context of U.S. public diplomacy and strategic communication. Specifically, the terrorist attacks of 9/11 ruptured traditional conceptualizations of educational exchange, shifting the emphasis in the United States from mutual benefit toward strategic self- advantage. This shift toward strategic communication involved the intensification of neoliberal policies and the proliferation of marketing-oriented discourses across multiple sectors and institutions, the consequences of which are still not well understood. This article considers some the risks that marketization discourse poses for international educational exchange stakeholders.
The structure of this article is as follows. First, it provides a discourse-oriented theoretical framework. It then uses that framework to describe how 9/11 served as a catalyst that transformed the meanings and practices of educational exchange in the United States. This transformation coincided with broader policy shifts toward strategic communication, marketization, and engagement within the public diplomacy arena. Third, the article explains how marketization discourse influences educational exchange program evaluation at ECA. It concludes with a summary of the risks associated with marketization for the development of mutual understanding, reflexivity, and peace.
2. Discourse
Discourse is a term not easily summarized because different speakers use it in multiple (and at times conflicting) ways. This article focuses on the U.S. State Department’s “organizational discourse,” a term that similarly escapes easy summary but generally refers to talk and text within organizational contexts, rather than smaller interpersonal or group, or larger macro-social contexts. The scholarly focus on discourse can be traced to the “linguistic turn” that shook the foundations of the humanities and social sciences during the latter half of the twentieth century. In response to the idea that language constructs social reality, the practice of “discourse analysis” developed within and across the fields of sociology, social psychology, anthropology, linguistics, philosophy, communication, and literary studies. Discourse analytic methods involve the use of interpretive, critical, or postmodern perspectives. Organizational discourse analysis has thus grown from diverse theoretical roots and methodological approaches. The definition of organizational discourse used in this article is “the structured collections of texts embodied in the practices of talking and writing…that bring organizationally related objects into being as these texts are produced, disseminated and consumed”.
Discourse scholars tend to conceptualize discourse as both reflective and constitutive of social reality. This conceptualization affirms Foucauldian assumptions regarding the way that language “bears down” on individuals, shapes overall societal conditions, and influences what speakers can say or not say about a given phenomenon . To explain how a discourse “works,” however, an analyst generally must demonstrate how people in a particular time and place bring forth, maintain, or transform a construction of social reality through the linguistic resources used in speech and writing. A discourse becomes powerful and influential when its underlying assumptions become taken-for-granted or institutionalized. However, even entrenched discourses can serve as a site of struggle among individuals and groups vying to establish preferred meanings and uses of complex symbols. Thus, the perspective used in this article is similar to previous studies that have examined how institutional members have strategically appropriated various macro-social discourses to advance their more narrow organizational or bureaucratic interests. For Hardy, this perspective helps scholars to explain how macro-social discourses “appear” within organizational discourses “and, in so doing, legitimate them and enhance their performativity, through both unconscious and strategic processes”. This perspective necessarily maintains a constructionist orientation to language,) as well as a focus on texts as the “unit” of discourse analysis. Using this theoretical perspective, the next section explains how 9/11 served as a catalyst for a historical transformation of U.S. educational exchange discourse.
3. 9/11 and the Strategic Value of Educational Exchange
On its website, ECA provides “An Informal History of the Fulbright Program” that summarizes the ways in which the Fulbright Foreign Scholarship Board, the American academic community, and various binational commissions historically have viewed educational exchange in its foreign relations context:
The basic functions of educational exchange from a foreign policy standpoint are to broaden the base of relationships with other countries, reduce tensions, lessen misunderstandings, and demonstrate the possibilities and values of cooperative action. In short, educational exchanges pave the way for closer and more fruitful political relations. Rather than following political diplomacy, educational diplomacy normally precedes or keeps step with it, opening up and nourishing new possibilities for international cooperation.
Despite its outstanding reputation and track record for promoting goodwill, mutual understanding, and peace, educational exchange is not a panacea for political intolerance and violent extremism. All four of the pilots of the hijacked aircraft on 9/11 had international educational experiences. Three of the pilots, Mohamed Atta (Egypt), Marwan al-Shehhi (United Arab Emirates), and Ziad Jarrah (Lebanon), had attended universities in Germany. The fourth pilot, Hani Hanjour (Saudi Arabia), had briefly attended the University of Arizona and had lived off-and-on in the United States over several years. Significantly, the mastermind of the 9/11 attacks, Khalid Sheikh Mohammed (Kuwait) had attended Chowan College in Murfreesboro, North Carolina, later transferring to North Carolina Agricultural and Technical State University, where he earned a Bachelor of Science in mechanical engineering in 1986. A CIA report later claimed that “Khalid Sheikh Mohammed’s limited and negative experiences in the United States — including a short stay in jail — almost certainly helped propel him on his path to become a terrorist”. Despite the 9/11 Commission’s findings concerning the educational backgrounds of the attack’s mastermind and pilots, the Final Report claimed: “The United States should rebuild the scholarship, exchange, and library programs that reach out to young people and offer them knowledge and hope. Where such assistance is provided, it should be identified as coming from the citizens of the United States”.
The theme of educational exchange-as-antidote-to-extremism would soon be codified within official discourse as U.S. lawmakers and officials turned to educational exchange as a resource in the fight against terrorism. Section 7112 of the Intelligence Reform and Terrorism Prevention Act of 2004, the law based on the 9/11 Commission’s recommendations, stated:
(1)Exchange, scholarship, and library programs are effective ways for the United States Government to promote internationally the values and ideals of the United States. (2) Exchange, scholarship, and library programs can expose young people from other countries to United States values and offer them knowledge and
In an influential report on U.S. Strategic Communication, the Defense Science Board (DSB) noted, “From 1993 to 2001, overall funding for the State Department’s educational and cultural exchange programs fell more than 33 percent—and exchanges in societies with significant Muslim populations has declined”The DSB was emphatic, “This must change.
Increased, expanded and targeted exchange programs must be significantly ramped-up under the new strategic communication function”.
Educational exchange gained prominence through numerous post-9/11 reports, laws, and recommendations; however, the tension between mutual benefit and self-advantage could not be reconciled. For example, the WMD Commission (2005), formed in the wake of the 2003 U.S.-led invasion of Iraq, noted in its final report how educational exchange data might directly support U.S. national security interests at the expense of the privacy of international students:
ICE [Immigration and Customs Enforcement] collects reams of data on foreigners entering the United States and manages the Student and Exchange Visitor Information System database, which includes information on foreign students studying in the United States. However, whether agencies like ICE are equipped to make this information available to the Intelligence Community in useable form remains unclear. ICE officials explained that they would not give other agencies unfettered access to their databases (despite those agencies’ wishes) because of unspecified legal constraints. We find this September 10th approach to information sharing troubling…
The WMD Commission’s recommendation is representative of how 9/11 helped to redraw the acceptable limits of self-advantage within the educational exchange domain—a domain ostensibly developed for mutual understanding and benefit. As Campbell lamented, “The mobility of students, scholars and researchers has been severely threatened by the strictures of homeland security, while advocates of educational exchange argue its value in the ideological battle”. In sum, following 9/11, educational exchange was enrolled as a strategic resource in the War on Terrorism and became a key plank of broader U.S. strategic communication efforts.
However, those efforts have suffered from officials’ ill-fated attempts to downplay or deny the self-advantaging and hemispheric tendencies of U.S. strategic communication. Officials have attempted to manage these tensions, in part, through the development of the discourse of “engagement,” that is, an approach to public diplomacy that emphasizes listening and dialogue. Notably, a 2009 White House report, undertaken at the direction of congress, entitled National Framework for Strategic Communication stated: “It is vital that the United States is not focused solely on one-way communication, which is why we have consciously emphasized the importance of ‘engagement’ – connecting with, listening to, and building long-term relationships with key stakeholders”. In referencing “engagement,” the National Framework for Strategic Communication evoked a “cocreational” public relations paradigm. The cocreational paradigm emphasizes “dialogic” activities that foreground the relationship between speaker and audience. Cocreational approaches view publics as “cocreators of meaning” and communication “as what makes it possible to agree to shared meanings, interpretations, and goals”. Cocreational approaches maintain that publics “are not instrumentalized but instead are partners in the meaning-making process”.
The National Framework for Strategic Communication describes engagement as “critical to allow us to convey credible, consistent messages, develop effective plans and to better understand how our actions will be perceived”. However, both the strategy and its theoretical underpinnings cannot adequately account for stakeholders who believe that U.S. influence within their societies is fundamentally illegitimate. When attempting to engage with “extreme” audiences in the Arab world, for example, U.S. strategic communication reverts to largely one-way, asymmetric approaches that are based on a direct “media effects” ontology. The discourse of engagement thus elides the self-advantaging tendencies of actual communication practice. U.S. strategic communication efforts, including those conducted under the friendly moniker of “engagement,” attempt to focus audiences’ attention on America’s values and away from its core strategic interests.
The effort of organizations to dialogically “engage” their stakeholders is not new, nor is its critique. Through the articulation of their “two-way symmetrical” model of public relations in 1984, Grunig and Hunt argued that “excellent” organizations use research and two-way communication to understand and foster dialogue with their stakeholders. Ideally, this dialogue leads to mutual understanding and mutually beneficial outcomes. Grunig and Hunt’s model has served as the dominant theoretical (and normative) paradigm of public relations over the past two decades. U.S. public diplomacy and strategic communication nevertheless reveals consistent ambiguity as officials oscillate between images of communication as fundamentally “two-way” and mutually beneficial versus “one-way” and conduit-like. This oscillation contributes to U.S. officials’ persistent inability to adequately account for the historical and structural inequalities within the regions where they conduct their work. This oscillation also contributes to the contradictions of U.S. “soft power” rhetoric.
Given these conditions, in an article for International Communication Gazette, Comor and Bean critiqued what they termed “America’s ‘Engagement’ Delusion”. The Obama administration initially embraced engagement as the dominant concept informing U.S. public diplomacy. Yet, despite its emphasis on facilitating dialogue with and among Muslims overseas, Comor and Bean demonstrated that, in practice, engagement aimed to employ social media technologies to persuade skeptical audiences to empathize with U.S. policies. Engagement, Comor and Bean argued, actually perpetuated the communication-as-dominance underpinnings of U.S. strategic communication. Perhaps based on similar critiques, at the end of 2013, the word “engagement” was quietly removed from the U.S. State Department’s definition of public diplomacy. However, the marketing-oriented, hemispheric tendencies of engagement live on in other sectors of government, including educational exchange.
4. The Marketization of Educational Exchange at ECA
The mission of ECA is to foster mutual understanding between the people of the United States and the people of other countries to promote friendly and peaceful relations. ECA accomplishes this mission through academic, cultural, sports, and professional exchanges that engage youth, students, educators, artists, athletes, and rising leaders in the United States and more than 160 countries. In 2010, about one quarter of ECA program participants were U.S. citizens; the rest were foreign nationals. ECA is home to the Fulbright Program, “the flagship international educational exchange program sponsored by the U.S. government … designed to increase mutual understanding between the people of the United States and the people of other countries.” Along with the Fulbright Program, featured prominently on ECA’s website is a section titled “Impact.” In this section, readers can learn how ECA “fosters cross-cultural understanding and supports top talent” by viewing visual representations of ECA’s impressive growth and expansion. For example, from 2008 to 2010, ECA exchange participants increased 25 percent, from 46,415 to 57,801. Of 1 million program alumni, 364 are current or former heads of state, 55 are Nobel Prize winners, and eight are current or former United Nations ambassadors. Visitors to ECA’s website thus confront overwhelming evidence of ECA’s success.
That evidence is also prominently featured on the Alliance for International Educational and Cultural Exchange’s website. The Alliance is an association of 86 nongovernmental organizations comprising the international educational and cultural exchange community in the United States. The Alliance claims:
Exchanges are an essential element in our smart power strategy to maintain and strengthen U.S. global leadership. Exchanges enhance U.S. national security and prosperity by building personal connections, mutual understanding, and productive partnerships that help us address critical global issues: managing the world economy, combating terrorism and regional conflicts, and dealing with environmental, public health, and humanitarian challenges.
The Alliance cites several ECA figures to support its claim. Specifically, “98% of Fulbright Visiting Scholar Program respondents reported that their Fulbright experiences gave them a deeper understanding of the United States, while 93% believed their experiences heightened their awareness of social and cultural diversity among different nations”.Additionally, “97% of International Visitor Leadership Program (IVLP) alumni respondents agreed that the program develops friendly and peaceful relations between the United States and other countries”. Such eye-popping figures suggest that ECA’s programs are beyond reproach. However, the nearly universal belief in ECA programs’ effectiveness raises the question of just what, exactly, is being evaluated. ECA’s figures give the impression that educational exchange provides the quintessential remedy to ignorance and intolerance. A critical perspective, however, asks whether mutual understanding can be improved by closely examining the experiences of the handful of educational exchange participants who, apparently, do not agree that ECA programs heighten awareness of social and cultural diversity nor help develop friendly and peaceful relations. Because such critical inquires appear to be off the table, evaluation practices at ECA may miss an opportunity to truly deepen mutual understanding.
Prior to the 1990s, market-oriented principles did not play a prominent role in educational exchange discourse. However, educational exchange’s post-9/11 enrollment as a strategic communication resource brought it further into the realm of marketization. As a result, the discourse of educational exchange has subtly shifted from one of mutual understanding, goodwill, and peace to one of “impact,” “effectiveness,” and “accountability.” The ways that educational exchange contributes to the economic, political, and social goals of its primary funder—the U.S. federal government—have gained currency.
The marketization of educational exchange has been driven, in part, by the wider push across government for “accountability.” In 2009, the U.S. Government Accountability Office (GAO) found that, in return for $10 billion worth of communication initiatives (its estimate of total strategic communications spending since 9/11), “limited data exist on the ultimate effect of U.S. outreach efforts”. The GAO explained that agencies cited three challenges in measuring the effectiveness of their strategic communication efforts:
First, strategic communications may only produce long-term, rather than immediate, effect. Second, it is difficult to isolate the effect of strategic communications from other influences, such as policy. Third, strategic communications often target audiences’ perceptions, which are intangible and complex and thus difficult to measure.
Despite these difficulties, the GAO recommended market-oriented means of assessing public diplomacy, e.g., “private-sector measurement techniques” that included “the use of surveys and polling to develop baseline data, immediate follow-up research, and additional tracking polls to identify long-term changes over time”.
Following Simpson and Cheney, there are several potential outcomes stemming from the influence of GAO’s marketization discourse vis-à-vis educational exchange evaluation. First, educational exchange organizations can simply adopt market-oriented vocabulary to refer to earlier practices. For example, officials may announce a new focus on “accountability” for departments while those departments may simply conduct business as usual. The second level of influence is what Simpson and Cheney call “the cafeteria approach,” whereby organizations adopt or appropriate marketization practices in ways that affirm regional, local, or organization-specific practices. The third level of influence involves the wholesale transformation of an organization. Here, the pretense of non-market concerns is dropped in favor of privatization or market-based regulation. At ECA, developments currently resemble the first and second outcomes.
As within the domains of strategic communication and public diplomacy, at ECA, a risk is that marketization operates as a “universal discourse that permeates everyday discourses but goes largely unquestioned”. Although it is not necessarily antithetical to the development of mutual understanding, peace, and goodwill, marketization tends to naturalize and legitimate a set of business-oriented commitments, practices, and ways of conceptualizing and talking about educational exchange that subordinate intangible outcomes to market-oriented logic.
For example, as the head of ECA, Assistant Secretary, Evan Ryan, recently remarked in several speeches provided on ECA’s website, “Our programs need to be more flexible, responsive, agile, impactful, and innovative…America must do better if we want our young people to be able to compete in a globalized world,” Secretary Ryan declared. Secretary Ryan asked, “[H]ow many vulnerable youth learned that there are alternatives to terrorism because they were exposed to critical thinking skills?” For Secretary Ryan, the discourse of mutual understanding, peace, and goodwill has evolved into a commitment to “building relationships that create resilient communities, democratic societies, and a world where countries are primed to work together to solve our most vexing problems.” Secretary Ryan also recently noted that President Obama “recognizes that it [educational exchange] can no longer be an afterthought, or something we do because it’s nice. It needs to be integrated into our foreign policy strategy at the ground floor.” Invoking the strategic dimension of educational exchange, Secretary Ryan stated, “International exchanges are the secret weapon of foreign policy and we must be on the cutting edge.” Secretary Ryan’s discourse illustrates how ECA’s mission and goals have become inflected in marketization’s vernacular of bottom lines, innovation, and problem-solving.
Marketization discourse increasingly involves an emphasis on measurement and evaluation. For example, the Public Relations Society of America (PRSA) recently launched a campaign that urged communication professionals to make the “business case” for public relations. Seemingly ahead of the trend, evaluation comprises its own division at ECA. This Division aims to enhance the effectiveness of ECA’s educational and cultural programs, and its work consists of two types of initiatives: evaluations and performance measurement. ECA claims that its evaluations are “retrospective and encompass cross-cutting themes” and “incorporate case studies to highlight findings” to “provide data for program planning and goal setting”. Performance measurement initiatives, by contrast, “monitor the Bureau’s programs to track results,” “establish baselines and collect end-of-program and follow- up data from participants,” “compare data across the three points to assess effectiveness,” and “provide data for program planning and goal setting”. In addition to evaluations and performance measurement, ECA also provides visitors to its website “Resources and Tools” to guide evaluation and performance measurement efforts. These resources include performance measurement and evaluation presentations and research papers, external materials, a bibliography of work in the field, and other information.
There are five presentations listed on the Evaluation Division’s website. These include: “Defining Outcomes and Goals;” “ECA Evaluation: Assessing Public Diplomacy;” “Monitoring and Evaluation;” “Performance Measurement for Program Officers,” and “Planning and Monitoring at Program Level.” The presentation, “Defining Outcomes and Goals,” authored in 2009 by ECA’s Chief of Evaluation, provides a five-part model for evaluation. “Planned work” entails a combination of (1) “inputs” and (2) “activities.” These, in turn, lead to “intended results,” i.e., (3) “outputs,” (4) “outcomes,” and (5) a “goal”. The model helps evaluators avoid confusing outcomes and goals with activities, and it aids officials in determining “whether inputs are being used as intended, outputs are occurring, and outcomes and goals are being achieved”. This vocabulary reappears in another presentation, “ECA Evaluation: Assessing Public Diplomacy.” In this presentation, authored in 2010, audiences are told that ECA conducts evaluation and performance measurement for four reasons. First, it “ensures programs are effective in achieving State Department, ECA, and program goals”. Second, it helps ECA meet “Congressional, OMB, other mandates for evaluation, PM, and results reporting”. Third, it “provides data for use by program managers and grantees”. And finally, it “contributes to [the] body of knowledge for practitioners and scholars across sectors”. ECA evaluations are thus conducted primarily to demonstrate to officials and funders that ECA’s programs are effective. However, the stated goal of using evaluations to contribute to the body of knowledge for practitioners and scholars opens a door to more critical and reflexive perspectives.
As of August 2014, 34 completed evaluations are available via ECA’s website. Of these 34 evaluations, none contain in-depth discussion of participants’ negative experiences. Almost no criticism of the United States, its people, or way of life is to be found in any of the evaluation reports. For example, the evaluation for the Youth Exchange and Study Program (YES) provides a typical passage:
Upon completing the program and a year after returning home, a large majority of participants had a ‘more favorable’ view of Americans as a result of their YES experience. The most important thing they felt they learned about Americans is that they are friendly, kind, helpful, open-minded and tolerant. Many commented on how friendly and welcoming Americans are to foreigners, such as YES students.
While some participants’ negative experiences are occasionally alluded to, these cases are not explored in any substantive way. Educational exchange is not evaluated in order to identify the ways in which negative experiences might inadvertently contribute to antipathy toward the United States. It is also possible that participants who report favorable responses nevertheless harbor distrust or skepticism of U.S. foreign policy. In general, ECA’s evaluations decouple program experiences from foreign policy-oriented concerns. Seldom are policy- related questions even asked. Measurement of participants’ perceived “understanding” or “view” of Americans should not be conflated with an embrace of American values nor support for U.S. government policies.
Educational exchange evaluation at ECA, as it is currently conceptualized, aims to prove to funders that programs bolster America’s positive image and reputation. While an implicit objective of educational exchange is for foreign participants to become more accommodating, understanding, or supportive of U.S. economic, political, social, or technological interests, values, and aims, there are clear limits to exchange. Rarely is it suggested that the values of others might inform how Americans view and conduct themselves in a globalized world.
In sum, consideration should be given to how ECA’s evaluation techniques make sense in light of growing anti-U.S. extremism. As Comor and Bean have suggested, stakeholders ought to consider the possibility that uncritical and narrow means of evaluating educational exchange may itself entrench a kind of myopia. If educational exchange is evaluated using limited snapshots that overwhelmingly showcase positive benefits, officials could be hindered in their ability to even recognize the ways that educational exchange might in some cases inadvertently contribute to negative international sentiment or political extremism. More to the point, such evaluations may subtly evoke a causal relationship between educational exchange and support for U.S. foreign policy that is not empirically supported. The marketization of U.S. educational exchange at ECA thus reflects and reinforces a hemispheric approach U.S. strategic communication that impedes the development of more critical, reflexive, and democratic conceptualizations of U.S. public diplomacy.
5. Conclusion
Recently, the United States Advisory Commission on Public Diplomacy (ACDP) released a report, “Data-Driven Public Diplomacy Progress Towards Measuring the Impact of Public Diplomacy and International Broadcasting Activities,” that supports the arguments contained in this essay. In its report, ACDP claimed that State Department officials needed to better recognize the importance of research in public diplomacy, reform risk-averse organizational cultures, develop more consistent strategic approaches to evaluation, increase training, and boost funding.
According to ACDP, evaluation activities at ECA in 2013 totaled $1.3 million, which is less than .25 percent of ECA’s total budget. It is therefore unsurprising that ACDP found considerable room for improvement, despite lauding ECA for its evaluation efforts within existing constraints. Specifically, ACDP recommended that evaluators at ECA: “(1) connect program objectives with research design; (2) separate short-term from long-term goals;(3) avoid reports that rely on self-evaluation data; (4) supply greater context of country, regional and global trends; (5) encourage constructive criticism through evaluations; (6) clarify descriptions of research processes; and (7) distinguish between what’s inferred versus what is directly assessed or observed”. ACDP’s fifth recommendation closely aligns with this essay’s argument. In reviewing ECA’s publicly available evaluations, ACDP similarly concluded that ECA’s reports “provided a strikingly positive view of performance measures, which focused on self-reported changes in participants and included positive quotes from participants who filled out the surveys”Notably, however, ACDP did not explicitly call for ECA to investigate negative cases; rather ACDP urged ECA to conduct “more objective data analysis” in order to detect and understand “the reasons for both the formation of and shifts in attitudes and behavior among foreign publics toward the United States”..ACDP’s recommendation is a helpful and necessary first step; however, in absence of a mandate for more critical and reflexive investigations, ECA officials will likely avoid exploring information from program participants that could challenge taken-for-granted assumptions, policies, and practices. The point of critical and reflexive investigation is to promote self-discovery and self-knowledge; it is not to convince audiences of the overwhelming success of a particular program.
ACDP’s recommendation aside, marketization at ECA is likely to endure due to the entrenchment of the promotional framing of evaluation, the cost and time of evaluation, institutional inertia, and the discomfort that arises when officials confront voices critical of their efforts. This article’s recommendation could certainly spark defensiveness and a counterargument that academics lack awareness of ECA’s day-to-day constraints that delimit what evaluation practices are possible. Overcoming reactionary responses is necessary if officials are to meaningfully reduce foreign audiences’ suspicions of U.S. aims and intentions. Fear of being rhetorically attacked, confronted with conspiracy theories, or forced to account for historical examples of U.S. hypocrisy likely keep officials from engaging in international fora where communication is not carefully scripted or controlled. The development of critical and reflexive evaluation practices might therefore demonstrate goodwill, honesty, and a genuine interest in listening to and responding to the wants, interests, and needs of foreign audiences. In theoretical terms, such evaluation practices would do much to promote dialogic communication’s principles of mutuality, propinquity (shared bonds), empathy, risk, and commitment.
This article has considered how marketization discourse promotes a particular kind of evaluation process that inadvertently hinders the development of deeper mutual understanding, transformation, and peace. Similar to the tensions and contradictions associated with the strategy of “engagement,” commitment to mutual understanding requires the development of critical insight, genuine dialogue, and reflexivity. Analysis of ECA evaluation presentations and reports suggests that a “customer orientation” characterizes ECA’s approach to educational exchange. This orientation necessarily reflects and influences the way that stakeholders conceptualize public diplomacy. ECA’s orientation potentially undermines critical exploration of educational exchange programs that have failed to produce desired outcomes for specific individuals. While negative individual cases may be rare, investigation of those cases could help officials and citizens develop a more comprehensive and nuanced understanding of the benefits, risks, and consequences of educational exchange. Customer- centric discourse encourages officials to downplay or ignore negative cases in favor of evaluation data that satisfies customers’ demands, paints programs in the best light, and promotes expanded funding and operations.
ECA notes that independent evaluation firms conduct its evaluations, but when evaluation is performed principally to showcase success, it loses some of its supposed objectivity. At worse, evaluation instead “functions to reassure, exonerate, and glorify” the organization that has paid for it. Within a marketization paradigm, the products of evaluation risk becoming self-serving: The goal of increased mutual understanding becomes subordinated to the goal of bureaucratic continuance and resource accumulation. While the marketization of relations among government agencies is designed to improve efficiency and effectiveness, marketization discourse discounts a perspective that views public diplomacy as a taxpayer- supported function with a responsibility to critically inform not just other federal agencies, congress, and the executive branch, but also scholars and citizens. ECA’s own evaluation presentations indicate that possibilities for more critical engagement exist and can be cultivated. Asking evaluation questions that promote understanding of the potential risks and consequences of educational exchange should therefore be on the table.
Acknowledgements
The author thanks Dr. Edward Comor for his influence in the development of this essay.