MONTREAL — Peeps trickle out of a soundproof chamber as its door opens. Female zebra finches are chattering away inside the microphone-lined box. The laboratory room sounds like a chorus of squeaky toys.
“They’re probably talking about us a little bit,” says McGill University postdoctoral fellow Logan James.
It’s unclear, of course, what they are saying. But James believes he is getting closer to deciphering their vocalizations through a partnership with the Earth Species Project. The nonprofit laboratory has drawn some of the technology industry’s wealthiest philanthropists — and they want to see more than just scientific progress. On top of breakthroughs in animal language, they expect improved interspecies understanding will foster greater appreciation for the planet in the face of climate change.
The Earth Species Project hopes to decode other creatures’ communications with its pioneering artificial intelligence tools. The goal is not to build a “translator that will allow us to speak to other species,” Director of Impact Jane Lawton said. However, she added, “rudimentary dictionaries” for other animals are not only possible but could help craft better conservation strategies and reconnect humanity with often forgotten ecosystems.
“We believe that by reminding people of the beauty, the sophistication, the intelligence that is resident in other species and in nature as a whole, we can start to, kind of, almost repair that relationship,” Lawton said.
At McGill University, the technology generates specific calls during simulated conversations with live finches that help researchers isolate each unique noise. The computer processes calls in real time and responds with one of its own. Those recordings are then used to train the Berkeley, California-based research group’s audio language model for animal sounds.
This ad hoc collaboration is only a glimpse into what ESP says will come. By 2030, Lawton said, it expects “really interesting insights into how other animals communicate.” Artificial intelligence advancements are expediting the research. New grants totaling $17 million will help hire engineers and at least double the size of the research team, which currently has roughly seven members. Over the next two years, Lawton said, the nonprofit’s researchers will select species that “might actually shift something” in people’s relationship with nature.
Standing to benefit are animal groups threatened by habitat loss or human activity that could be better protected with better understandings of their languages. Existing collaborations aim to document the vocal repertoires — the distinct calls and their different contexts — of the Hawaiian crow and St. Lawrence River beluga whales.
After spending more than two decades extinct in the wild, the crows have been reintroduced to their home of Maui. But some conservationists fear that critical vocabulary has faded in captivity. Lawton said the birds might need to relearn some “words” before they reenter their natural habitat in droves.
In Canada’s St. Lawrence River, where shipping traffic imperils the marine mammals who feed there, the group’s scientists are exploring whether machine learning can categorize unlabeled calls from the remaining belugas. Perhaps, Lawton suggested, authorities could alert nearby vessels if they understood that certain sounds signaled the whales were about to surface.
Big donors include LinkedIn co-founder Reid Hoffman, the family charity founded by late Microsoft co-founder Paul G. Allen and Laurene Powell Jobs’ Waverley Street Foundation. The latter aims to support “bottom-up” solutions to the “climate emergency.” At the root of that crisis, according to Waverley Street Foundation President Jared Blumenfeld, is the idea that humans deserve “dominion” over the world.
Blumenfeld finds that ESP’s work is an important reminder that we are instead stewards of the planet.
“This is not a silver bullet,” he said. “But it’s certainly part of a suite of things that can help transform how we view ourselves in relation to nature.”
Gail Patricelli — an unaffiliated animal behavior professor at the University of California, Davis — remembers when such tools were just “pie in the sky.” Researchers previously spent months laboring to manually comb through terabytes of recordings and annotate calls.
She said she’s seen an “exponential takeoff” the past few years in bioacoustics’ use of machine learning to accelerate that process. While she finds that ESP has the promise to make finer distinctions in existing “dictionaries,” especially for harder-to-reach species, she cautioned observers against attributing human characteristics to these animals.
Considering this research’s high equipment and labor costs, Patricelli said she’s happy to see big philanthropists backing it. But she said the field shouldn’t rely too much on one funding source. Government support is still necessary, she noted, because ecosystem protection also requires that conservationists examine “unsexy” species that she expects get less attention than more charismatic ones. She also encouraged funders to consult scientists.
“There’s a lot to learn and it’s very expensive,” she said. “That might not be a big deal to some of these donors but it’s very hard to come up with the money to do this.”
The current work largely involves developing baseline technologies to do all this. A separate initiative has recently described the basic elements of how sperm whales might talk. But ESP is trying to be “species agnostic,” AI Research Director Olivier Pietquin said, to provide tools that can sort out many animals’ speech patterns.
ESP introduced NatureLM-audio this fall, touting the system as the first large audio-language model fit for animals. The tool can identify species and distinguish characteristics such as sex or stage of life. When applied to a population — zebra finches — it had not been trained on, NatureLM-audio accurately counted the number of birds at a rate higher than random chance, according to ESP. The results were a positive sign for Pietquin that NatureLM might be able to scale across species.
“That is only possible with a lot of computing, a lot of data and many, many collaborations with ecologists and biologists,” he said. “That, I think, makes us, makes it, quite serious.”
ESP acknowledges that it isn’t sure what will be discovered about animal communications and won’t know when its model gets it absolutely right. But the team likens AI to the microscope: advancements that allowed scientists to see far more than previously considered possible.
Zebra finches are highly social animals with large call repertoires. Whether congregating in pairs or by the hundreds, they produce hours of data — a help to the nonprofit’s AI scientists given that animal sounds aren’t as abundant as the pages of internet text scraped to train chatbots.
James, an affiliated researcher with the Earth Species Project, struggles with the concept of decoding animal communications. Sure, he can clearly distinguish when a chick is screaming for food. But he doesn’t expect to ever translate that call or any others into a human word.
Still, he wonders if he can gather more hints about their interactions from aspects of the call such as its pitch or duration.
“So can we find a link between a form and function is sort of our way of maybe thinking about decoding,” James said. “As she elongates her call, is that because she’s trying harder to elicit a response?”
___
Associated Press coverage of philanthropy and nonprofits receives support through the AP’s collaboration with The Conversation US, with funding from Lilly Endowment Inc. The AP is solely responsible for this content. For all of AP’s philanthropy coverage, visit https://apnews.com/hub/philanthropy.
