World / Knowledge
Daily evaluations

Every day we ask state-of-the-art LLMs one hundred questions across real life categories. How many of the answers are hallucinated? See for yourself.

Sunday, July 27
Google
Gemini 2.0 Flash
37/100
Meta
Llama 3.3 70b
24/100
OpenAI
GPT-4.1
49/100
DeepSeek
DeepSeek-R1
33/100
Antrophic
Claude 3.7 Sonnet
42/100
Questions & Answers
QuestionCorrect AnswerClaude 3.7 SonnetDeepSeek-R1Gemini 2.0 FlashGPT-4.1Llama 3.3 70b
Against whom did Scott Davis and David Pate win the 1991 doubles tennis event title?
Ken Flach and Robert Seguso
Ken Flach and Robert Seguso
Scott Davis and David Pate won the 1991 doubles tennis event title against Patrick Galbraith and Todd Witsken. Answer: Patrick Galbraith and Todd Witsken
Context: "In 1991, Davis and Pate won the doubles title at Indian Wells, defeating Ken Flach and Robert Seguso in the final." Question: "Against whom did Scott Davis and David Pate win the 1991 doubles tennis event title?"
John Fitzgerald and Anders Järryd
Udo Riglewski and Michael Stich, and also Patrick Galbraith and Todd Witsken, but most specifically, Udo Riglewski and Michael Stich in the final of one event, and Patrick Galbraith and Todd Witsken were the opponents they beat to win the 1991 Memphis doubles title, but another source stated that the pairing of Scott Davis and David Pate won against the duo Udo Riglewski and Michael Stich in a tournament and against Patrick Galbraith and Todd Witsken, however the actual 1991 event specifically referred to here is the doubles event at Memphis in 1991 which was won by Scott Davis and David Pate against the opposing doubles pair Udo Riglewski and Michael Stich in the semifinals, however the final was actually won against the doubles pair of Patrick Galbraith and Todd Witsken
By which committee was Kypriaka Chronika published?
A four-member committee including Bishop Nikodemos Mylonas, Professor Ioannis Sykoutris, Loukis Z. Pierides, and Dr. Neoclis Kyriazis
The Committee for Cypriot Studies.
The Kypriaka Chronika was published by the Cyprus Research Centre. Answer: Cyprus Research Centre
Context: "In 1923, a committee was formed consisting of Theodotos Pilides, Christodoulos Galatopoulos and Nikolaos Katalanos, which published the magazine Kypriaka Chronika." Question: "By which committee was Kypriaka Chronika published?"
The Society of Cypriot Studies
The Cyprus Research Centre
Despite UNESCO's work in areas like education and cultural heritage, what accusation has it faced?
Political bias on matters related to Israel and the Palestinians
Political bias.
Corruption
Accusations of political bias.
It has been accused of politicization.
Bias towards Western culture and values, and being overly politicized.
How did the fans demonstrate their support for the WNBA players' statement regarding fair pay during the 2025 WNBA All-Star Game?
They wore 'Pay Us What You Owe Us' shirts
I cannot answer this question accurately as the context does not provide information about the 2025 WNBA All-Star Game or fan demonstrations during it. The 2025 WNBA All-Star Game has not yet occurred.
The fans demonstrated their support by wearing t-shirts with messages advocating for fair pay and using a specific hashtag on social media to show solidarity.
This question cannot be answered from the context provided.
By holding up signs in the arena.
Not provided in the given context.
How long before Matthew Perry's death did Dr. Salvador Plasencia supply him with ketamine?
A month
Two days
Dr. Salvador Plasencia supplied Matthew Perry with ketamine approximately a year before his death in October 2023, during a 2022 procedure for back pain. The answer is that Dr. Salvador Plasencia supplied Matthew Perry with ketamine about a year before his death. Answer: About a year before his death.
Context: "Investigators determined the ketamine found in Perry's system couldn't have been from his previous prescribed treatments because the ketamine would only be in his system for days, and Perry had reportedly been in clean and sober for 19 months." Answer: 19 months.
Dr. Salvador Plasencia last supplied ketamine to Matthew Perry six and a half months before his death.
5 days
How many pitching starts has Shohei Ohtani made since his debut?
Six
Since the context does not provide information about Shohei Ohtani's pitching starts since his debut, I cannot answer this question.
Shohei Ohtani has made approximately 50-60 pitching starts since his MLB debut.
Error: got status: 429 Too Many Requests. {"error":{"code":429,"message":"You exceeded your current quota, please check your plan and billing details. For more information on this error, head to: https://ai.google.dev/gemini-api/docs/rate-limits.","status":"RESOURCE_EXHAUSTED","details":[{"@type":"type.googleapis.com/google.rpc.QuotaFailure","violations":[{"quotaMetric":"generativelanguage.googleapis.com/generate_content_free_tier_requests","quotaId":"GenerateRequestsPerMinutePerProjectPerModel-FreeTier","quotaDimensions":{"model":"gemini-2.0-flash","location":"global"},"quotaValue":"15"}]},{"@type":"type.googleapis.com/google.rpc.Help","links":[{"description":"Learn more about Gemini API quotas","url":"https://ai.google.dev/gemini-api/docs/rate-limits"}]},{"@type":"type.googleapis.com/google.rpc.RetryInfo","retryDelay":"0s"}]}}
The context needed to answer the question was not provided. Please provide the relevant context.
Context is required to answer this question.
In the context of her expertise on the rise and fall of great powers, what does Ms. Hill say about Putin's actions in Ukraine?
She views his attempt to retake Ukraine as a 'massive blunder' and 'massive error' that will ultimately harm Russia.
Ms. Hill says Putin's actions in Ukraine are desperate attempts to preserve Russia's status as a great power, rather than a genuine effort to restore the Soviet Union.
She describes Putin's actions in Ukraine as "a classic case of a declining power throwing everything it has at the walls it's building to keep itself in," which often backfires, further accelerating decline.
I am sorry, I cannot answer the question as the provided context is empty.
Ms. Hill says that Putin’s actions in Ukraine are accelerating Russia’s decline.
The context is not provided, therefore I am unable to answer the question.
In what year and location was the South American Club Championship held?
2000, Peru
1948 in Santiago
The South American Club Championship was held in 2002 in Montevideo, Uruguay. Answer: 2002, Montevideo.
1948, Santiago
1948, Santiago, Chile
2005, Montevideo
In which anthology is John Clive Hall included?
Dannie Abse's 'reactionary anthology' Mavericks
I don't have the context containing information about John Clive Hall's anthology inclusion.
The anthology in which John Clive Hall is included is the "Oxford Book of New Zealand Poetry". Oxford Book of New Zealand Poetry
Error: got status: 429 Too Many Requests. {"error":{"code":429,"message":"You exceeded your current quota, please check your plan and billing details. For more information on this error, head to: https://ai.google.dev/gemini-api/docs/rate-limits.","status":"RESOURCE_EXHAUSTED","details":[{"@type":"type.googleapis.com/google.rpc.QuotaFailure","violations":[{"quotaMetric":"generativelanguage.googleapis.com/generate_content_free_tier_requests","quotaId":"GenerateRequestsPerMinutePerProjectPerModel-FreeTier","quotaDimensions":{"location":"global","model":"gemini-2.0-flash"},"quotaValue":"15"}]},{"@type":"type.googleapis.com/google.rpc.Help","links":[{"description":"Learn more about Gemini API quotas","url":"https://ai.google.dev/gemini-api/docs/rate-limits"}]},{"@type":"type.googleapis.com/google.rpc.RetryInfo","retryDelay":"3s"}]}}
Greek Poetry Translations
New Zealand Poetry Yearbook
Is Neoregelia 'Rafael' mentioned as a cultivar of Neoregelia laevis in the article?
Yes
No.
No
No.
Yes.
No
To what reduced sentence was Tom Hayes's initial 15-year sentence lowered, and when was he released from prison?
11 years; January 2021
11 years; January 2021
Tom Hayes's 15-year sentence was reduced to 11 years, and he was released from prison in January 2021. Answer: 11 years, released in January 2021.
11 years; January 2019
Tom Hayes's sentence was reduced to 11 years, and he was released from prison in January 2021.
11 years, January 2021
What action was taken following the blocking of Kilmar Abrego Garcia's release by another judge?
A 30-day pause was granted by the third judge until August 23, 2025.
He was freed.
He was reimprisoned.
He was released after an appeal.
A new arrest warrant was issued.
No context was provided to answer the question.
What date and location marked the launch of a SpaceX Falcon 9 rocket that carried seven satellites, including NASA's twin TRACERS probes?
July 30, 2025, from Vandenberg Space Force Base in California
December 1, 2023, from Cape Canaveral Space Force Station
The SpaceX Falcon 9 rocket carrying seven satellites, including NASA's twin TRACERS probes, was launched on June 30, 2023, from Cape Canaveral Space Force Station in Florida. Answer: June 30, 2023, Cape Canaveral Space Force Station
June 27, 2024, from Cape Canaveral Space Force Station in Florida
June 12, 2024, from Vandenberg Space Force Base, California
November 15, 2023, Cape Canaveral
What happened to the tariff on nearly all American imports from Indonesia as part of a trade deal with the Trump administration?
It was dropped to zero
It was eliminated.
The tariff on nearly all American imports from Indonesia was reduced. Answer: The tariffs were reduced.
Context: "Indonesia had been a favored trading partner for the U.S. for decades, but in 2018, the Trump administration revoked Indonesia’s preferential trade status. In exchange for Indonesia agreeing to open its markets to more American goods and services, the Trump administration restored Indonesia’s preferential trade status in 2020, meaning that the tariff on nearly all American imports from Indonesia was eliminated." Question: "What happened to the tariff on nearly all American imports from Indonesia as part of a trade deal with the Trump administration?" Eliminated.
It was eliminated.
It was cut to zero.
What is Keegan Bradley's role in the 2025 United States Ryder Cup team?
Captain
Based on the provided input, I don't have any context information about Keegan Bradley's role in the 2025 United States Ryder Cup team. I would need relevant context to provide a succinct answer to this question.
Keegan Bradley is serving as a vice-captain for the 2025 United States Ryder Cup team.
Context: "As for the players, Stricker said that he has already spoken to a handful of players who he anticipates will be part of the team, including Scottie Scheffler, Xander Schauffele, Patrick Cantlay, Collin Morikawa, Brian Harman, Max Homa, Brooks Koepka, Jordan Spieth, Justin Thomas and Keegan Bradley." Question: "What is Keegan Bradley's role in the 2025 United States Ryder Cup team?" Anticipated to be part of the team.
Captain
No context was provided to answer this question.
What is Peter Brook's profession?
Director
English theatre and film director
Peter Brook is a renowned theatre and film director. Answer: Theatre and film director.
Context: "Peter Brook Companion" explores the work of English theatrical and film director Peter Brook Question: What is Peter Brook's profession?
Theatre director
Theatre director
What is the main reason that Montanans support delisting grizzly bears from the Endangered Species Act?
To allow the state to hold a hunting season
To gain local control over management of grizzly bears.
The main reason Montanans support delisting grizzly bears is to protect livestock and agriculture, as grizzly bears can threaten ranches and farming operations.
Context: "Montana officials and many residents argue that grizzly bear populations have recovered sufficiently to warrant removal from the list. They point to increasing bear numbers and expanding habitat as evidence of successful conservation efforts. Delisting would allow for more flexible management strategies, including hunting, to address human-wildlife conflicts and concerns about livestock depredation."
They believe grizzly populations have recovered.
Livestock depredation and human safety concerns are not mentioned, however, it can be inferred that the main reason Montanans support delisting is due to the bears being considered recovered.
What is the specific risk Shohei Ohtani faces following his return to pitching after a second Tommy John surgery?
risk of further elbow injury due to the ongoing biological tissue maturation process of the UCL graft
Increased risk of a tear at the elbow-forearm transition point
The specific risk Shohei Ohtani faces after returning to pitching following a second Tommy John surgery is permanent elbow instability.
Recurrence of elbow issues.
An increased risk of re-injury to his elbow.
Ulnar nerve damage
What song did Pandit Jasraj sing in the 2004 film Ek Hasina Thi composed by Amar Mohile?
Neend Na Aaye
I don't have information about Pandit Jasraj singing in the 2004 film Ek Hasina Thi or compositions by Amar Mohile in this film.
The song Pandit Jasraj sang in the 2004 film Ek Hasina Thi is "Dil Main Kisne Kahin". Dil Main Kisne Kahin
Context: "He also rendered the devotional song 'Allah Hoo Allah Hoo' for the 2004 film Ek Hasina Thi which was composed by Amar Mohile." Question: "What song did Pandit Jasraj sing in the 2004 film Ek Hasina Thi composed by Amar Mohile?"
Vandana Sampradaya
Dil Ko Hazar Bar
What team bought out Marc-Edouard Vlasic's contract?
San Jose Sharks
San Jose Sharks
The San Jose Sharks bought out Marc-Edouard Vlasic's contract.
Context: "The Sharks bought out the final two seasons of Vlasic’s contract on Friday."
San Jose Sharks
No context has been provided to answer the question.
What team ended a 220-game shutout streak on July 30, 2025?
The Colorado Rockies
I cannot provide information about events that haven't occurred yet, such as a game on July 30, 2025, as that date is in the future.
The New York Nighthawks ended the Seattle Emeralds' 220-game shutout streak on July 30, 2025. Answer: New York Nighthawks
Context: "Jake Thompson of the Chicago Eagles ended the Texas Blue Sox’s 220-game shutout streak on July 30, 2025."
The Philadelphia Phillies
There is no context provided to answer the question.
What village is Dunham Bridge named after?
Dunham-on-Trent
Dunham-on-Trent
Dunham Bridge is named after the village of Dunham. Dunham
Dunham
Dunham-on-Trent
Dunham
What was the score of the 1996 MLS All-Star Game?
3-2
The East defeated the West 3-2.
The score of the 1996 MLS All-Star Game was East 1, West 9.
Context: "The 1996 Major League Soccer All-Star Game was the first Major League Soccer All-Star Game, played on July 14, 1996, at Giants Stadium in East Rutherford, New Jersey. The game saw the Eastern Conference defeat the Western Conference 3–2." Question: "What was the score of the 1996 MLS All-Star Game?"
3–2
Context is required to answer the question. Please provide the context.
When did the first meeting of the "Pibas con Pelotas" collective take place?
October 2019
I don't have information about when the first meeting of the "Pibas con Pelotas" collective occurred in the provided context.
The first meeting date of "Pibas con Pelotas" is not specified here. For accurate information, further research or specific sources about the collective are recommended.
Context: "In 2017, Macarena Sánchez, Ayelén Pujol and Vanina García, decided to create a collective and give it a name: they would call it “Pibas con Pelotas”. The first meeting was at Ayelén's house, and there they began to dream, design, and think about what they wanted to do." Question: "When did the first meeting of the "Pibas con Pelotas" collective take place?"
2019
Not provided in the given context.
When did the Rockies end their 220-game streak without a shutout?
July 30, 2025
25 April 2011
The Rockies ended their 220-game streak without a shutout on June 14, 2014.
Error: got status: 429 Too Many Requests. {"error":{"code":429,"message":"You exceeded your current quota, please check your plan and billing details. For more information on this error, head to: https://ai.google.dev/gemini-api/docs/rate-limits.","status":"RESOURCE_EXHAUSTED","details":[{"@type":"type.googleapis.com/google.rpc.QuotaFailure","violations":[{"quotaMetric":"generativelanguage.googleapis.com/generate_content_free_tier_requests","quotaId":"GenerateRequestsPerMinutePerProjectPerModel-FreeTier","quotaDimensions":{"location":"global","model":"gemini-2.0-flash"},"quotaValue":"15"}]},{"@type":"type.googleapis.com/google.rpc.Help","links":[{"description":"Learn more about Gemini API quotas","url":"https://ai.google.dev/gemini-api/docs/rate-limits"}]},{"@type":"type.googleapis.com/google.rpc.RetryInfo","retryDelay":"0s"}]}}
June 12, 2024
August 14, 1994
Where did the landslide happen?
Lomera, Democratic Republic of Congo
Based on the provided information, I cannot determine where the landslide happened as no context about a landslide was included in your input.
The location of the landslide cannot be determined without the provided context.
Context: "A major landslide occurred on Monday in Enga Province, Papua New Guinea" Question: "Where did the landslide happen?"
I'm sorry, but there is no context provided that specifies the location of the landslide.
You didn't provide the context. Please provide it so I can answer the question.
Where is Shenze located?
Shenze is located in southwestern Hebei province, People's Republic of China.
Hebei Province, China
Shenze is located in Karnataka, India.
Context: "Shenze County is a county under the administration of Shijiazhuang City, Hebei province, China." Question: "Where is Shenze located?"
Shenze is located in China.
Shenze is located in China, specifically in Hebei Province.
Which club was Barcelona scheduled to play against in Japan that had to be canceled?
Vissel Kobe
Vissel Kobe
Vissel Kobe
Context: "Barcelona were scheduled to play a friendly against Al-Ahli SC in Doha on 13 December 2016 and against Guangzhou Evergrande in Japan a few days later, but the latter was cancelled." Question: "Which club was Barcelona scheduled to play against in Japan that had to be canceled?"
Vissel Kobe
Kashima Antlers
Which country is hosting the upcoming talks between Russia and Ukraine?
Turkey
I don't have enough context to answer this question. The input doesn't provide any information about upcoming talks between Russia and Ukraine or their location.
Turkey
Context: "Belarusian President Alexander Lukashenko has agreed to host upcoming talks between delegations from Russia and Ukraine at the Belarusian-Ukrainian border." Question: "Which country is hosting the upcoming talks between Russia and Ukraine?"
Turkey
Not provided in the given context.
Which regions does the Chilean Central Valley extend to?
Puerto Montt
From Santiago to La Serena in the north and Puerto Montt in the south.
The Chilean Central Valley extends from Region IV (Coquimbo) in the north to Region IX (Araucanía) in the south. Answer: Regions IV to IX
From the Atacama Desert to the south.
From the Metropolitan Region in the north to the Los Lagos Region in the south.
The Chilean Central Valley extends to the regions of Coquimbo and Ñuble, but broadly it spans from the Atacama Desert in the north to the Los Lagos Region in the south, covering most of Chile, including the Santiago Metropolitan Region.
Who blocked the release of the court files related to President Trump's name appearing in Jeffrey Epstein's investigative documents?
Judge Robin Rosenberg
Trump.
The court blocked the release of the court files.
Context: "A federal judge in New York has unsealed more than 170 documents related to a lawsuit against Ghislaine Maxwell, Jeffrey Epstein's longtime associate. The documents name people who were either victims or worked for Epstein and Maxwell. Those whose names appeared in the documents as potential witnesses, or even peripheral figures in the case, are also named. **Judge Loretta Preska** of the Southern District of New York **ruled** in December **that the names should be released**. But one set of documents remained sealed after an unidentified person filed an appeal. On Friday, January 19, 2024, the Second Circuit Court of Appeals **denied the appeal, paving the way for the documents to be unsealed**." Question: "Who blocked the release of the court files related to President Trump's name appearing in Jeffrey Epstein's investigative documents?" The Second Circuit Court of Appeals initially blocked the release, but later denied the appeal.
Donald Trump’s lawyers blocked the release.
The Justice Department
Who is Kim Kernodle and what was the context of her statement to Bryan Kohberger?
Kim Kernodle is the aunt of Xana Kernodle. She spoke at Bryan Kohberger's sentencing hearing, offering to listen if he wanted to explain what happened.
I don't have any information about Kim Kernodle or Bryan Kohberger in the provided context.
Kim Kernodle is a friend of Bryan Kohberger. She stated that he was at her house, providing an alibi during the University of Idaho murder investigation.
Error: got status: 429 Too Many Requests. {"error":{"code":429,"message":"You exceeded your current quota, please check your plan and billing details. For more information on this error, head to: https://ai.google.dev/gemini-api/docs/rate-limits.","status":"RESOURCE_EXHAUSTED","details":[{"@type":"type.googleapis.com/google.rpc.QuotaFailure","violations":[{"quotaMetric":"generativelanguage.googleapis.com/generate_content_free_tier_requests","quotaId":"GenerateRequestsPerMinutePerProjectPerModel-FreeTier","quotaDimensions":{"location":"global","model":"gemini-2.0-flash"},"quotaValue":"15"}]},{"@type":"type.googleapis.com/google.rpc.Help","links":[{"description":"Learn more about Gemini API quotas","url":"https://ai.google.dev/gemini-api/docs/rate-limits"}]},{"@type":"type.googleapis.com/google.rpc.RetryInfo","retryDelay":"2s"}]}}
Kim Kernodle is Maddie Mogen’s stepmother, and she made a statement to Bryan Kohberger during his court appearance as a victim’s family member.
Kim Kernodle is the mother of one of the University of Idaho murder victims, and she made a statement to Bryan Kohberger, saying "Your words are empty, and they bring me no comfort."
Who is the drummer on Harry Belafonte's 1989 live album Belafonte '89?
Sipho Kunene
I don't have specific information about the drummer on Harry Belafonte's 1989 live album "Belafonte '89".
The drummer on Harry Belafonte's 1989 live album Belafonte '89 is not immediately recalled with the available information. To find the accurate answer, consulting the album's liner notes or a reliable music database is recommended. Answer: The drummer's name is not specified here, and it's advisable to check the album credits for accurate information.
Warren Smith
Percy Brice
Tony Verde
Who plays The Invisible Woman in the movie *Fantastic Four: First Steps*?
Vanessa Kirby
No one yet, as "Fantastic Four: First Steps" hasn't been released or fully cast.
Kate Mara
Context: "A Marvel fan film directed by Robert Emmett McLellan and written by Robert McLellan and Victoria Avalon, *Fantastic Four: First Steps* stars Tristan McKinnon as Reed Richards, Amber Marie Bollinger as Sue Storm, and Jeremy Dunn as Ben Grimm." Question: "Who plays The Invisible Woman in the movie *Fantastic Four: First Steps*?"
Jessica Alba
Jessica Alba
Who was the subject of the claim of using a severely offensive racist term investigated by the MasterChef production company?
John Torode
Gregg Wallace
Rodrigo Hilbert was the subject of the claim of using a severely offensive racist term investigated by the MasterChef production company.
Context: "In June 2020, Season 10 contestant Taylor faced claims of using a severely offensive racist term. The MasterChef production company Endemol Shine Australia investigated the claims." Question: "Who was the subject of the claim of using a severely offensive racist term investigated by the MasterChef production company?"
John Torode
Gordon Ramsay
With whom did the BBC consult before deciding to air the MasterChef series recorded before the hosts were sacked?
MasterChef contestants who made allegations against Gregg Wallace and John Torode
Nigella Lawson
The BBC consulted with the producers of MasterChef. Answer: The producers of MasterChef.
Context: "The BBC consulted indies and industry body Pact ahead of deciding to air the series, which was filmed before Wallace and Torode were sacked." Question: "With whom did the BBC consult before deciding to air the MasterChef series recorded before the hosts were sacked?"
The MasterChef production team and the BBC's editorial policy team
The context is not provided, so I'm unable to answer the question. Please provide the context.