AI is helping to ID victims in Holocaust photos

A new facial recognition website is putting names to faces.
Sign up for the Freethink Weekly newsletter!
A collection of our favorite stories straight to your inbox

A Google engineer has built a website that uses facial recognition to identify previously anonymous faces in Holocaust photos — and Holocaust survivors and their descendents are using it to find themselves and their relatives in historical archives.

“It’s so important to identify these photos,” Scott Miller, director of curatorial affairs at the US Holocaust Memorial Museum (USHMM), told BBC News. “You’re restoring some semblance of dignity to them, some comfort to their family, and it’s a form of memorial for the entire Jewish community.”

The atrocity: An estimated six million Jewish people were killed during the Holocaust, and the names of about a million of them are still unknown. Another 3.5 million people were displaced, persecuted, or sent to concentration camps during the Holocaust, but managed to survive. 

“Every person has a name, every person has a face.”

Scott Miller

Thousands of photographs and films of Holocaust victims and survivors taken before and during the war have been preserved and archived online, and in physical collections, but many of the faces in the photos have not yet been identified.

“We all know the figure — six million Jews were killed — but it’s really one person six million times,” said Miller. “Every person has a name, every person has a face.”

The inspiration: Daniel Patt, a software engineer for Google, knows the names of at least three Holocaust survivors because they’re his grandparents. 

When he visited the POLIN Museum of the History of Polish Jews in Poland in 2016, he noted how many of the faces in its photo collection were unidentified — he might have walked right past pictures of his own grandparents or other family members and not even known it. 

“I felt like when I was looking at those pictures, I was looking at myself.”

Daniel Patt

That inspired him to create From Numbers to Names (N2N), a website that uses facial recognition tech to identify people in Holocaust photos and videos preserved by the USHMM, Yad Vashem (Israel’s official Holocaust memorial center), and others.

“I felt like when I was looking at those pictures, I was looking at myself,” Patt told the Jewish Standard. “These weren’t people who lived hundreds of years ago — this was 80 years ago. I felt like there was something wrong with not working to identify them and sharing them with their descendants.”

How it works: Anyone can go to the N2N website and upload a photo of a person who experienced the Holocaust. AI-based facial recognition software then searches faces in a database of 500,000 archived Holocaust photos and videos for the 10 best matches for the person in the original photo.

The idea is that a Holocaust survivor or their descendents could use photos they do have to find ones they’ve never seen before.

“We make no software-based assertions about identifications and leave this judgment to individuals using the site,” Patt told the Times of Israel. “We simply show results, with similarity scores, and let individuals decide whether the results contain a positive identification.”

Holocaust survivors can use photos they do have to find ones they’ve never seen before.

Domino effect: If an N2N user does spot themselves or a loved one in a photo, that discovery can then lead to the identification of others in it.

Holocaust survivor Blanche Fixler, for example, used N2N and an old family photograph to find herself in a group photo taken in France during the war — when she saw the new photo, she recognized a boy in it as well as one of her aunts.

Geddy Lee, lead singer of the band Rush, meanwhile, used the platform to find a photo of his deceased mother, a Holocaust survivor, taken when she was a child living in a displaced person’s camp. That led to the discovery of other photos of his mother’s extended family.

Looking ahead: Patt, who is currently working on N2N in his free time, hopes to add another 700,000 Holocaust photos and videos to its searchable database. Eventually, he’d like to see the site contribute to Holocaust eduction.

“Students can use the software to help identify faces and artifacts in photo and video archives and potentially discover new connections between living Holocaust descendants and their ancestors,” he told the Times of Israel.

We’d love to hear from you! If you have a comment about this article or if you have a tip for a future Freethink story, please email us at [email protected].

Related
LLMs are a dead end to AGI, says François Chollet
AI researcher François Chollet thought we needed a better way to measure progress on the path to AGI — so he made one.
Meet Thresh, the world’s first professional gamer
Was Elon Musk any good at Quake? “He’s a legit gamer,” but…
You’re thinking of the metaverse all wrong, says Matthew Ball
Rumors of the metaverse’s demise have been greatly exaggerated.
Perplexity, Google, and the battle for AI search supremacy
AIs that generate answers to user queries could transform search, but only if someone can get the tech and the business model right.
How AI is rewriting Silicon Valley’s relationship with the Pentagon
Silicon Valley is warming to the Department of Defense as it works to get new AI systems developed and deployed en masse.
Up Next
robot rooms
Subscribe to Freethink for more great stories