The Institute for the History and Philosophy of Science and Technology

Earlier this year, the U.S.-based National Eating Disorder Association shut down its AI-powered chatbot after it provided unsafe advice to people seeking help.

The chatbot, called “Tessa,” instructed people with eating disorders to greatly reduce their daily calorie intake, according to complaints.

“The chatbot was suggesting callers try things that gave them eating disorders in the first place,” says Rachel Katz, a PhD candidate with the Faculty of Arts & Science’s Institute for the History & Philosophy of Science & Technology.

Her research focuses on bioethics, as well as the philosophy of medicine and psychiatry – including an interest in AI ethics.

Katz is in the early stages of her doctoral research that examines the pros and cons of AI-facilitated psychotherapy, specifically AI-delivered therapy that doesn’t involve a clinician at any point.

Her work received coverage from major news outlets this summer, following her research presentation at the Congress 2023 gathering of the Canadian Society for the History and Philosophy of Science at York University in May.

Rachel Katz believes AI-delivered psychotherapy can be a useful tool in certain situations(photo courtesy of Rachel Katz)

“There are several ways that AI has come to be part of psychotherapy,” Katz says. “I'm focusing on the patient interaction aspect. I’m looking at apps ... that don't require interaction with a human therapist.

“I'm not against the use of AI therapy chatbots – they are a useful tool, but they need to be understood and regulated properly before they spin out of control. Currently, we don't have sufficient rules and guidelines for the kinds of things these chatbots could be useful for.”

Katz believes the difference between an AI chatbot and a human therapist is trust, as opposed to reliance.

“When we have a good relationship with a human therapist, we've formed a trust-based relationship built on goodwill and vulnerability,” she says.

Conversely, Katz describes the reliant relationship with AI therapy as “talking to an affectionate wall.”

“You can have this supportive, helpful experience working with an AI therapist,” Katz says. “There's no vulnerability, but you can rely on it to be there.”

But she notes there is something fundamentally different about human-to-human relationships – and part of that comes from the fact that a therapist can make mistakes.

“You may have a great working relationship with a therapist, and then they suggest something that doesn't work for you,” Katz says. “Or they may say, ‘Here's how I've interpreted what you've told me,’ and you correct them.”

That could become problematic with misdiagnosing or mistreating a mental health concern.

“But part of that ability to mess up represents that ‘special human element’ that I’m exploring – and it’s one of the things that makes [us] trust someone in general,” she says. “That's something you completely lose out on with an AI therapist.”

That element of vulnerability can flow both ways – a human therapist can make themselves vulnerable by offering insights into their personal lives, which can also strengthen a bond with a patient.

Katz plans to further investigate what makes that human relationship special – something she feels she hasn’t fully uncovered yet.

“That’s the big philosophical question underpinning the whole project,” she says.

Katz also questions whether AI chatbots are effective when dealing with crises. For example, chatbots are not considered very effective when assisting someone who is suicidal.

“They will just direct you to call 911 or some other kind of emergency service,” Katz says. “That's not always a good solution for people who may be very distressed.”

Despite the challenges, Katz believes AI has some advantages.

For example, crisis lines are often staffed by volunteers, and such work can take a heavy emotional toll.

“You could argue that turning those call systems into AI saves the emotional burden from volunteers,” Katz says.

Distance and accessibility could also be a factor – if a person living remotely has to drive hours for an appointment, AI might be a more convenient option.

“Or if you're someone who works strange hours – say you work a night shift and need to see a therapist – that's also a difficult situation that might be better suited to AI,” Katz says.

But AI’s biggest appeal may be the fact that it’s impersonal.

Some people – particularly those who have never taken part in therapy before – may feel more at ease chatting to AI rather than a person when it comes to sharing their problems and issues.

“I was teaching a class and asked my students, ‘How would you feel about having a therapist?’ A shocking number of them said they were keen on first talking to an AI therapist,” Katz says.

“They were nervous about the idea of expressing difficult emotions to another human. They preferred having something that could listen but was incapable of human judgment. Ideally, a therapist is non-judgmental, but someone who's seeking out a resource for the first time may not be aware of that.”

As Katz continues her research, she does see AI-based psychotherapy working well in certain situations – with the proper guidelines and disclaimers.

“Ultimately, I want to advocate for patient choice,” she says. “I wouldn't want to deny a patient their ability to make the choice for what intervention they feel will make the most sense for them. If the type of therapy or the method of delivery of therapy doesn't work for the patient, the treatment is not going to be effective.”

As she delves deeper into the subject, Katz sees real-world applications for her work.

“The goal is to do some philosophical investigating and hopefully come up with some answers that are philosophically interesting and can also help inform policy development in this area.”

Brave new tech: Experts say AI tools like ChatGPT – and the ethical questions they raise – are here to stay

siddiq22 — Wed, 05 Apr 2023 18:44:10 +0000

Brave new tech: Experts say AI tools like ChatGPT – and the ethical questions they raise – are here to stay

siddiq22 Wed, 04/05/2023 - 14:44

Cutline

(Clockwise from top left) Catherine Moore, Ashton Anderson, Karina Vold, Paul Bloom, Valérie Kindarji and Paolo Granata (supplied images, photo of Bloom by Greg Martin)

Chris Sasaki

Topic

Our Community

Schwartz Reisman Institute for Technology and Society

The Institute for the History and Philosophy of Science and Technology

School of Cities

Artificial Intelligence

This image was created by directing Dall-e to produce an image of the University of Toronto in the style of painter Vincent van Gogh’s The Starry Night (Image by DALL-E/ directed by Chris Sasaki)

As artificial intelligence (AI) continues to rapidly advance, there has been a surge in the development of AI-powered content creation tools like ChatGPT and Dall-e that offer users a range of personalized experiences. However, with this growth come concerns about the potential dangers and ramifications of such apps, from privacy concerns to the displacement of human workers.

For example, the previous paragraph was written by ChatGPT, illustrating the blurring of lines between AI- and human-generated content. And the image at right was created by directing Dall-e to produce an image of “the University of Toronto in the style of van Gogh’s The Starry Night.”

In recent months, news headlines have outlined the issues relating to generative AI tools and content. Illustrators, graphic designers, photographers, musicians and writers have expressed concerns about losing income to generative AI and having their creations used as source material without permission or compensation.

On the academic front, instructors are having to cope with students submitting work written by ChatGPT and are re-evaluating how best to teach and assess courses as a result. Institutions such as ��˾��ֱ�� are examining the ramifications of this technology and providing guidelines for students and instructors.

Despite the challenges, many experts say that the technology is here to stay, and that our focus should be on establishing guidelines and safeguards for its use, while others look to its positive potential.

Faculty of Arts & Science writer Chris Sasaki spoke with six ��˾��ֱ�� experts about the impact of generative AI tools – and the ethical questions posed by the new technology.

Ashton Anderson

Assistant professor, department of computer science

We are increasingly seeing AI game-playing, text generation and artistic expression tools that are designed to simulate a specific person. For example, it is easy to imagine AI models that play in the style of chess champion Magnus Carlsen, write like a famous author, or interact with students like their favourite teacher’s assistant. My colleagues and I refer to these as mimetic models – they mimic specific individuals – and they raise important social and ethical issues across a variety of applications.

Will they be used to deceive others into thinking they are dealing with a real person – a business colleague, celebrity or political figure? What happens to an individual’s value or worth when a mimetic model performs well enough to replace that person? Conversely, what happens when the model exhibits bad behaviour – how does that affect the reputation of the person being modeled? And in all these scenarios, has consent been given by the person being modelled? It is vital to consider all of these questions as these tools increasingly become part of our everyday lives.

Paul Bloom

Professor, department of psychology

What ChatGPT and other generative AI tools are doing right now is very impressive and also very scary. There are many questions about their capabilities that we don’t know the answers to. We don’t know their limits – whether there will be some things that a text generator is fundamentally incapable of doing. They can write short pieces, or write in the style of a certain person, but could they write a longer book?

Some people don’t think they’ll be capable of a task like that, because these tools use deep-learning statistics – they produce sentences, then predict what comes next. But they lack the fundamentals of human thought. And until they possess those fundamentals, they’ll never come close to writing like we do. We have many things they don’t: we have a model of the world in our minds, mental representations of our homes, our friends. And we have memories. Machines don’t have those and until they do, they won’t be human – and they won’t be able to write, illustrate and create the way we do.

Paolo Granata

Associate professor, Media Ethics Lab; book and media studies, St. Michael’s College

AI literacy is key. Whether something is viewed as a threat or an opportunity, the wisest course of action is to comprehend it. For instance, since there are tasks that AI does more effectively than humans, let’s concentrate on tasks that humans do better than AI. The emergence of widely accessible generative AI technologies should also motivate educators to reconsider pedagogy, assignments and the whole learning process.

AI is an eye-opener. The function of educators in the age of AI has to be re-evaluated – educators should be experience-designers rather than content providers. In education, the context is more important than the content. Now that we have access to such powerful content producers, we can focus primarily on a proactive learning approach.

Valérie Kindarji

PhD candidate, department of political science

While public focus has been on the disruptive AI technologies themselves, we cannot forget about the people behind the screen using these tools. Our democracy requires informed citizens with access to high-quality information, and digital literacy is crucial for us to understand these technologies so we can best leverage them. It is empowering to have access to tools which can help spark our creativity and summarize information in a split second.

But while it is important to know what these tools can do to help us move forward, it is just as important to learn and recognize their limitations. In the age of information overload, digital literacy can provide us with pathways to exercise our critical thinking online, to understand the biases impacting the output of AI tools and to be discerning consumers of information. The meaning of literacy continues to evolve with technology, and we ought to encourage initiatives which help us learn how to navigate the online information ecosystem. Ultimately, we will be better citizens and neighbours for it.

Catherine Moore

Adjunct professor, School of Cities; Faculty of Music

Would seeing a credit at the end of a film, ‘Original score generated by Google Music,’ alter my appreciation of the score? I don't think so. Music in a film is meant to produce an emotional impact. That’s its purpose. And if a score created by AI was successful in doing that, then it’s done its job – regardless of how it was created.

What’s more, generative AI “composers” raise the questions: What is sound; what is music? What is natural sound; what is artificial sound? These questions go back decades, with people capturing mechanical sounds or sounds from nature. You speed them up, slow them down. You do all sorts of things to them. The whole electro-acoustic music movement was created by musicians using technology to manipulate acoustic sounds to create something new.

I see the advent of AI-generated music as part of a natural progression in the long line of music creators using new technologies with which to create and produce – in order to excite, intrigue, surprise, delight and mystify listeners the way they always have.

Karina Vold

Assistant professor, Institute for the History & Philosophy of Science & Technology; Centre for Ethics; Schwartz Reisman Institute for Technology & Society

The progress of these tools is exciting, but there are many risks. For example, there’s bias in these systems that reflects human bias. If you asked a tool like ChatGPT to name ten famous philosophers, it would respond with ten Western male philosophers. And when you then asked for female philosophers, it would still only name Western philosophers. So, GPT-4 is Open AI’s attempt to respond to these concerns, but unfortunately, they haven’t all been addressed.

In his book On Bullshit, [moral philosopher] Harry Frankfurt argues that "bullshitters" are more dangerous than liars, because liars at least keep track of their lies and remember what’s true and what’s a lie. But bullshitters just don't care. Well, ChatGPT is a bullshitter – it doesn’t care about the truth of its statements. It makes up content and it makes up references. And the problem is that it gets some things right some of the time, so users start to trust it – and that’s a major concern.

Lawmakers need to catch up in terms of regulating these generative AI companies. There’s been internal review by some companies, but that’s not enough. My view is there should be ethics review boards and even laws regulating this new technology.

��˾��ֱ�� researchers investigate the hidden history of 'Black androids'

Christopher.Sorensen — Tue, 04 Jan 2022 16:03:37 +0000

��˾��ֱ�� researchers investigate the hidden history of 'Black androids'

Christopher.Sorensen Tue, 01/04/2022 - 11:03

Cutline

Clockwise from top left: Edward Jones-Imhotep, Sarai Rudder, Emily Grenon and Alexandar Offord are exploring the histories of racialized mechanical humans created between the mid-18th and late 20th centuries.

Sarah MacFarlane

Topic

Our Community

The Institute for the History and Philosophy of Science and Technology

Faculty of Arts & Science

History

Humanities

It began as a series of isolated references – the term would appear in a historical article here, a book there. Edward Jones-Imhotep soon began noticing references to “Black androids” everywhere.

They were historically called “automata," automatic machines that, in this case, replicated the actions of human beings.

One example is an 1868 patented design of a mechanical person – a racist depiction of a Black man – wearing a top hat, smoking a pipe and pulling a cart.

“These were references to real physical objects – not science fiction but actual machines that had been built in the form of Black humans,” says Jones-Imhotep, associate professor and director of the Institute for the History & Philosophy of Science & Technology at the Faculty of Arts & Science.

“The androids were part of the racist ideologies of their time. They portrayed Black people in pastoral, leisurely and non-technological roles. But it didn't seem that anybody had looked into what role they might have played in creating racial mythologies – particularly one of the most prominent and harmful mythologies: the idea that technology is opposed to Blackness.”

To help him explore this history, Jones-Imhotep turned to the Jackman Scholars-in-Residence program, a four-week research fellowship for upper-year undergrads in the humanities. In 2017, a year after its launch, the program received 1,000 applications for 50 openings, highlighting the need for additional research opportunities – a call answered by a $1-million gift from Bader Philanthropies, Inc. in 2018.

Jones-Imhotep assembled a team of eight research assistants to undertake the Black Androids project. Their initial goal was to identify and document racialized automata created between the mid-18th and late 20th centuries.

In the first two weeks alone, they discovered more than 100 androids. There are now around 150 androids in the team’s database, which they plan to continue building and refining.

“The most surprising part has been the sheer number of discoveries we have made. It is almost as though we have uncovered a hidden universe that exposes the deep racial roots of societies worldwide,” says Sarai Rudder, a research assistant and third-year undergraduate at Trinity College who is majoring in peace, conflict and justice, with minors in sociology and critical studies in equity and solidarity.

As their research evolved, the team realized that the androids were part of another hidden history.

“We discovered that, if we looked at the machinery beneath the androids’ surface, the same technologies that physically drove their racist depictions were, in other contexts, part of the rich technological experiences of Black peoples at the time – that’s what we want to explore,” Jones-Imhotep explains.

Their current investigation, which forms the basis of a Social Sciences and Humanities Research Council Insight Grant proposal, focuses on New York City between 1830 and 1930 and has two main goals.

“The idea is to first create a digital historical map of the androids’ movements, their histories and the interconnections they have with the social and technological development of New York City over the course of that century,” says Jones-Imhotep. “We then use the androids’ technology as a portal to try to understand the lived technological experiences of Black New Yorkers, and how those experiences shatter the racist depictions of the androids themselves.”

New York is the focus of the project because many of the androids were manufactured and displayed there during this period. But the city’s significance runs deeper.

“There is a kind of cultural spectacle in New York during the late 19th century that surrounds the androids, linking them to the racist vaudeville and minstrel theatre happening at the time,” Jones-Imhotep says. “The androids play a very important part in the construction of race within New York City.”

The team’s interest in New York also stems from a gap in existing scholarship about its history. Researchers have studied the technological development of the city, on one hand, and the history of Black people in New York, “but nobody has written about these two threads as if they’re part of the same history,” he says.

Working together to explore this largely unresearched area has been a meaningful part of the experience for the team.

“The collaborative, creative nature of the work makes every new discovery resonant with possibilities. It’s like discovering a parallel dimension,” says Alexander Offord, a research assistant who earned his honours bachelor of arts in the history and philosophy of science earlier this year as a member of Woodsworth College. “I remain constantly enthralled by how wonderful and strange our discoveries are – from criminal geniuses and haunted dolls to secret societies and underground resistances.”

“Professor Jones-Imhotep encouraged us to follow whatever paths our research took us on. Each of us has added pieces to the whole that we never could have anticipated,” says Emily Grenon, a research assistant and fourth-year undergraduate studying history and material culture as a member of Victoria College. “It’s been a wonderful experience to be part of a project that covers something totally new, and to work with such brilliant people while doing it.”

The team plans to publish their findings widely, including in scholarly articles, conference papers, a book and even a graphic novel to share their research with a broader audience.

“The point of the graphic novel is to highlight this hidden history of Black technological life,” says Jones-Imhotep. “The consequences of this are really important because the myth that sees technology as opposed to Blackness is partly created in the moment we’re investigating. It’s one of the most pernicious, damaging myths we have — and it persists to this day.

“It denies educational opportunities for Black peoples. It justifies exclusion. It supports technologies that target and surveil African-descended peoples. That’s what makes this investigation so critical and urgent. We are working to rewrite the histories of Blackness and technology. By changing those histories, we hope to change the future.”

Adds Rudder: “When we think of technology, it is often names like Thomas Edison, Alexander Graham Bell and Steve Jobs that come to mind. It almost feels as though Black people and other people of colour are missing from historical narratives surrounding technological advancement.”

Jones-Imhotep says the Black Androids project highlights the histories of underrepresented groups and supports the research of Black scholars at ��˾��ֱ��.

“The Black Research Network that was recently launched here at the University of Toronto aims to support and nurture a network of Black researchers and the amazing research they're doing,” he says. “That's crucial given the historical experiences and lack of support Black scholars have had at universities worldwide.

“One of the things this project hopes to demonstrate is the remarkable research that’s possible with focused resources and with the right support.”

Scholars-in-Residence program offers ��˾��ֱ�� undergraduate students immersive research experience

noreen.rasbach — Tue, 13 Aug 2019 17:24:54 +0000

Scholars-in-Residence program offers ��˾��ֱ�� undergraduate students immersive research experience

noreen.rasbach Tue, 08/13/2019 - 13:24

Cutline

��˾��ֱ�� students worked with Hakob Barseghyan, assistant professor in the Institute for the History and Philosophy of Science and Technology, to analyze belief systems throughout history using a diagramming approach (photo by Adriana Leviston)

Jovana Jankovic

Topic

Our Community

The Institute for the History and Philosophy of Science and Technology

English

Faculty of Arts & Science

History

Humanities

Jackman Humanities Institute

Trinity College

Undergraduate Students

Victoria College

It’s a unique, immersive research experience that allows undergraduate students to spend four weeks working on projects with faculty members from across the humanities.

This summer’s Scholars-in-Residence (SiR) program, run by the Jackman Humanities Institute and Victoria College, marked the fourth year that successful applicants took part in the residency in humanities and humanistic social science research.

Students from across the Faculty of Arts & Science, as well as ��˾��ֱ�� Mississauga and ��˾��ֱ�� Scarborough, participated in this year’s program. Participants are granted free accommodation in on-campus housing and a meal plan for the duration of the program, as well as a $1,000 Jackman Scholar Award.

Participants say the opportunities to contribute to original faculty research projects and build new relationships with peers and professors are the biggest rewards.

“SiR is not only an intensive research program, it also allowed me to network and meet an incredible diversity of students outside of my faculty and college,” says Trinity College student Kat Yampolsky, a second-year specialist in peace, conflict and justice studies with a double minor in Italian and Arabic. “I would 100 per cent recommend the program to other students.”

Since its inception, the program has rapidly expanded. What started as a 20-student pilot in 2016 on the St. George campus has now grown into 100 participating students, with some research teams hosted at ��˾��ֱ�� Mississauga and ��˾��ֱ�� Scarborough in the last two years.

Faculty members from across the humanities work with student researchers on a variety of projects. Some students helped transcribe and annotate 18^th-century letters written in French between journalists and publishers, while others worked on an audience research study to examine the representation of minorities in the CBC sitcom Kim’s Convenience.

Students paired with Hakob Barseghyan, assistant professor in the Institute for the History and Philosophy of Science and Technology, analyzed particular belief systems throughout history using a diagramming approach to turn historical data into easily comprehensible visualizations.

Fourth-year Trinity College student Jessica Rapson, who studies psychology and philosophy, diagrammed the Aryan physics worldview, a product of Nazi ideology that existed briefly in the 1930s.

“Few people know about the strange anachronistic scientific beliefs that flourished in the Nazi regime,” says Rapson. “I hope my project will help historians analyze why well-respected scientists –including Nobel Prize-winners – accepted the extremely questionable scientific theories proposed by Aryan science. These include parapsychology – a belief in things like ESP or telepathy – and the notion that the most fundamental particle in the universe is ice.”

Kye Palider, a Victoria College student who is entering his fourth year this fall as a physics and philosophy joint specialist with a history and philosophy of science minor, focused his diagramming on 20^th-centuryscientific methodology in the physical and mathematical sciences.

“The kind of diagramming we’re doing can prove useful in pedagogy, clarifying arguments and finding weak points in essays,” he says of Barseghyan’s project.

Program director Angela Esterhammer, also a professor in the department of English, says SiR has been a “transformative experience” for students and faculty alike.

“Students say the experience gives them new insight into critical thinking, community-engaged research and what it means to be a scholar working with primary sources,” she says.

“The program also opens up career choices by demonstrating how research skills in the humanities can be applied in broader social, economic and cultural contexts. Meanwhile, faculty find that the results produced by their students exceed their expectations. An intense month of working with these talented undergraduates often reveals new approaches to their research.”

Another SiR project is Timothy Sayle’s “Unlocking the Nuclear Vault,” an ongoing, multi-year examination of formerly top secret documents related to Canada and nuclear weapons in the Cold War. Sayle, an assistant professor in the department of history, has led SiR groups in past years and continues to believe in the program’s merits.

“This is really all about our tremendous undergraduates,” says Sayle. “One of the most exciting things as a supervisor is to see how our students work together as a team. It’s incredible.”

One of Sayle’s students, Victoria College’s David de Paiva, is majoring in political science and urban studies, with a minor in Russian literature in translation – a fitting combination for the Cold War project. He was particularly enthusiastic about the groundbreaking nature of the work.

“As we are some of the first scholars outside government to see these files,” says de Paiva, “we’re able to actively participate in the revision and rewriting of history from an accurate, informed perspective. As an undergrad, this is a very unusual and rewarding experience.”

Regardless of their academic accomplishments, SiR students all commented on the lifelong friendships and collaborative relationships they formed during the intensive month-long residency.

“I’m a humanities student,” says Yampolsky, “and one of my closest friends became a math, physics and philosophy student. Where else would I have had the opportunity to work with someone from a polar opposite academic background?”

“SiR is an opportunity to befriend like-minded student researchers and professors and do so in an atmosphere free of the stress of grading or assignment deadlines,” says de Paiva. “It’s how learning should be all the time.”