Why tackling gender bias in AI within surveillance capitalism framework is crucial for our digital future – Dr Sunday Ayodabo

Dr. Sunday Joseph Ayodabo is a Fellow of the American Council of Learned Societies (ACLS) and currently a researcher based in the United States.

His research contributions, which include published works, span an array of interdisciplinary fields such as masculinities, children’s literature, gender studies, and literary studies. Presently, his academic interests have expanded to encompass digital culture, artificial intelligence, surveillance studies, and gender studies, reflecting a broad and dynamic engagement with contemporary scholarly discourses. In this interview, he articulates on the complexities of AI and gender within the framework of surveillance capitalism being his present research focus. Excerpts:

The previous Ph.D. research was on masculinity and children’s literature, how is it relevant to your present research?

My previous scholarly endeavors in the realms of masculinities, children’s literature, gender studies, and literary studies have provided me with a robust interdisciplinary foundation that is immensely pertinent to my current research interests in artificial intelligence, surveillance studies, and gender studies. First, myexpertise in conducting qualitative research, analyzing cultural texts, and understanding the broader cultural and social implications of these issues have been valuable assets in mycurrent research. This foundational work is instrumental in navigating the nuanced intersections between gender constructs and technological advancements within the framework of surveillance capitalism. The exploration of masculinity within Nigerian children’s literature, for instance, offered me critical insights into the formation of gender stereotypes, which are now being perpetuated and transformed through digital technologies and AI. This continuum from traditional literary forms to digital expressions allows for a comprehensive analysis of how gender norms are replicated and challenged in new media. Moreover, my engagement with gender studies has enhanced my ability to critically assess the implications of AI and surveillance technologies on societal perceptions of gender, thereby making my previous research not only relevant but also a vital cornerstone for my current research.

What is the new motivation for your research interest in AI and gender stereotypes within the framework of surveillance capitalism?

My shift towards Artificial Intelligence and gender within the framework of surveillance capitalism was motivated by a realization that following COVID-19, there has been an increase in digitization and use of Artificial Intelligence (AI) across all spheres of life, which presents both opportunities and challenges. While it offered enormous opportunities, many AI programmed communicative devices in the US, especially Virtual Personal Assistants, tend to exhibit gender bias within AI algorithm that reinforce gender stereotypes, and potentially perpetuate gender inequities and discrimination against women. For instance, Alexa, Siri, and Cortana are examples of AI virtual assistants that adopt feminine attributes, voices, names, and behaviors that reinforce historical gender biases and roles. In addition, AI virtual entities, endowed with female names and voices, subtly influence users’ interactions, potentially perpetuating stereotypically feminine attributes while encouraging users to share their most intimate data. The consequence of this seemingly innocuous relationship extends far beyond convenience – it plays a central role in the mechanisms of surveillance capitalism. This suggest that these AI objects routinely traffic in normative gender roles of the feminine as caretaker, mother, and wife to obfuscate modes of surveillance, and mediate the relationship users and potential users have with late-capitalist market logics in the platform economy. Gender biases in AI also manifest either during the algorithm’s development, the training of datasets, or via AI-generated decision making. The pressing nature of bias in AI and its disproportionate effect on women as well as on data accumulation, compelled me to concentrate my research efforts on this realm. I believe in the need for stronger normative frameworks, advocate for better auditing frameworks for algorithms, and underscore the need for the adoption of critical approaches that can reimagine technologies and eliminate gendered divisions and biases.

How has living in the US shaped your interest in Gender Bais in AI and Surveillance Capitalism?

Certainly, living and studying in a highly digitalized society, where technology permeates every aspect of life, has heightened my awareness of the pervasive nature of AI and its implications for privacy, security, and social interactions. The US, being at the forefront of technological innovation and home to major tech corporations, provides a unique vantage point from which to observe and analyze the rapid advancements in AI and their integration into daily life. This exposure has been instrumental in shaping my understanding of the complexities surrounding surveillance capitalism—a term coined to describe the monetization of personal data through surveillance by capitalist entities. My firsthand observations of how digital technologies are being gendered to gather, analyze, and exploit user data in the US context have underscored the critical need for examining the intersections of AI, privacy, and gender. It has become increasingly clear that these technologies, while offering remarkable conveniences and efficiencies, also harbor the potential for deepening societal inequities, particularly through the reinforcement of gender stereotypes and biases. This realization has propelled my research interest towards exploring the ethical dimensions of AI and surveillance capitalism, with a focus on advocating for equitable and responsible technology practices.

Also, as a researcher in the US, my encounter with the widespread use of AI-powered surveillance technologies in urban security systems exemplifies the influence of my environment on my research. Observing firsthand the deployment of facial recognition technologies by law enforcement agencies, I noted the profound implications for privacy and the disproportionate impact on marginalized communities, including issues of gender bias and misidentification. This observation sparked a critical inquiry into the ethical use of AI, urging a reevaluation of surveillance practices within the broader framework of surveillance capitalism. Such experiences in the US have been pivotal in shaping my research trajectory towards advocating for more equitable and transparent AI technologies.

As a US-based researcher and scholar but with African root, do you consider collaborative research with US scholars as part of the strategies for addressing issues being raised in your research?

Indeed, I consider collaborative research with US scholars as an integral strategy for addressing the issue of gender bias within AI algorithm and its impact on gender inequities and as well as on data accumulation. Collaboration with scholars from diverse disciplines and cultural backgrounds can enrich the research process, offering a multitude of perspectives that enhance the depth and breadth of the analysis. The multifaceted nature of my research topics necessitates interdisciplinary approaches, where insights from computer science, computer engineering, Feminist science, and technology studies (feminist STS), technology studies, ethics, gender studies, and policy analysis converge to provide holistic understandings and solutions.

Presently, I am working with a group of scholars at UT Dallas to create ethical guidelines and best practices for the design and deployment of AI systems, emphasizing the protection of marginalized and vulnerable groups. Specifically, we are working on Cortana, an artificial intelligence-powered virtual assistant developed by Microsoft. Named after a character in the “Halo” video game series, Cortana was designed to assist users in performing a wide range of tasks through voice commands, typing, or pen input. However, like other AI virtual assistants, Cortana has faced scrutiny regarding issues of privacy, data collection, and the potential reinforcement of gender stereotypes, given its default female voice and persona. These aspects highlight the importance of ethical considerations in the development and deployment of AI technologies, making Cortana a pertinent example of a system that could benefit from interventions aimed at ensuring fairness, privacy protection, and the mitigation of bias. Hence, our focus involves critically evaluating the algorithms driving Cortana, the data it collects and uses, and the ways in which it interacts with users, to foster a more ethical, equitable, and responsible AI ecosystem. The outcome of this research will not only enhance the technology’s integrity and user trust but also contributes to the broader goal of fostering an AI ecosystem that is safe, fair, and beneficial for all segments of society.

I intend to further expand this kind of collaboration with more US scholars. Such kind collaboration will facilitate access to a wide array of resources, including cutting-edge technology and rich academic databases, which are essential for conducting comprehensive research. Second, such partnerships can foster innovative methodologies by integrating diverse theoretical frameworks and research techniques, thereby strengthening the overall research design and findings.

Moreover, collaborative efforts can significantly contribute to bridging the gap between theoretical research and practical implementation. By working together, scholars from the US and those with insights into African contexts can co-develop strategies that are not only theoretically sound but also culturally sensitive and practically applicable. This synergy is crucial for crafting policies and interventions that are effective, equitable, and sustainable.

In sum, collaborative research with US scholars is a strategic approach that enhances the capacity to tackle the pressing issues of digital transformation, ensuring that the research outcomes are robust, relevant, and capable of driving positive change both within and beyond the African continent.

As a research scholar in the U.S. and ACLS Fellow, with African roots, how do you see your work contributing to Africa in the context of AI, Surveillance Capitalism, and Gender Studies?

Absolutely, my work holds profound relevance and potential impact in Africa. Africa is at a crucial juncture, experiencing rapid digital transformation that promises to redefine socio-economic landscapes, enhance access to education, and improve public health outcomes. However, this digital leap also brings with it challenges related to privacy, data security, and the potential exacerbation of existing societal inequities, including gender disparities.

My research into AI and surveillance capitalism, grounded in a gender-sensitive framework, is not only applicable but vital for informing policy and practice in African contexts. By examining the ways in which digital technologies can perpetuate gender biases and stereotypes, my work contributes to a critical discourse on how these technologies can be developed and implemented ethically and equitably. Moreover, understanding the nuances of surveillance capitalism in the U.S. context provides a valuable lens through which to scrutinize and critique the adoption of similar models in Africa, where regulatory frameworks may still be evolving.

The insights garnered from my research are instrumental in advocating for digital policies that prioritize the protection of personal data, promote gender equity in technology access and design, and ensure that the benefits of AI and digitalization are widely distributed. Thus, my work not only bridges continents and cultures but also seeks to influence the trajectory of digital evolution in Africa towards a more inclusive and equitable future.

In what ways do you see AI systems and government policies in the United States intersecting with or differing from those in African contexts?

The intersection and divergence of AI systems and government policies between the United States and African contexts highlight both opportunities and challenges in the global digital landscape. In the United States, AI systems are extensively integrated into various sectors, supported by relatively well-established regulatory frameworks that aim to balance innovation with ethical considerations, privacy, and data protection. U.S. policies increasingly focus on ethical AI development, addressing issues of bias, transparency, and accountability within AI systems. Moreover, the U.S. benefits from robust technological infrastructure and significant investments in AI research and development, fostering a climate of innovation.

In contrast, many African countries are at a different stage in their digital and technological development journey. While there is a burgeoning interest in leveraging AI and technical systems to drive socio-economic development, challenges such as limited technological infrastructure, lower levels of digital literacy, and nascent regulatory frameworks pose significant barriers. A recent instance highlighting the challenges African governments face in policy formulation is Nigeria’s ban on Twitter, aimed at curbing youth activism. This situation underscores the complexities of technology adoption and innovation in African as well as the lack of protection of citizens’ rights and the promotion of equitable access to technology.

However, this difference in stages of technology policy and system development offers African countries the unique advantage of learning from the successes and pitfalls of more advanced economies like the U.S. It presents an opportunity for African nations to develop tailored governance models that are aligned with their socio-cultural contexts and development goals. This involves crafting policies that ensure inclusive growth, address ethical and bias issues from the outset, and prioritize the development of local technological solutions that cater to the specific needs of African societies.