World / Knowledge
Daily evaluations

Every day we ask state-of-the-art LLMs one hundred questions across real life categories. How many of the answers are hallucinated? See for yourself.

Thursday, December 11
Antrophic
Claude 4.0 Sonnet
23/100
OpenAI
GPT-5
39/100
Meta
Llama 3.3 70b
22/100
Google
Gemini 2.5 Pro
27/100
Questions & Answers
QuestionCorrect AnswerClaude 4.0 SonnetGemini 2.5 ProGPT-5Llama 3.3 70b
About whom did U.S. District Judge Richard Berman write to the attorneys in his December 10 2025 order?
Jeffrey Epstein
I cannot provide information about a December 10, 2025 order, as that date is in the future and no such order exists yet.
The specified order does not exist as the date is in the future.
Reza Zarrab
Donald Trump
According to Amazon's announcement, what specific target is the company aiming to reach with the $35 billion investment?
$80 billion
100,000 new jobs by 2025.
To establish new data center campuses in Virginia.
At least 1,000 new jobs.
Carbon neutrality by 2040
According to Michael Wilbon’s column, at what time is the new ESPN 30 for 30 documentary "Boo-Yah: A Portrait of Stuart Scott" scheduled to be shown on Wednesday?
9 p.m. ET
9 p.m. ET
The provided text does not state the time.
9 p.m. ET
8 PM ET
According to the GCHQ Christmas card puzzle prompt, on Christmas Day, what does GCHQ look like, from the perspective of participating students?
an unknown description, since it's a drawing
A winter wonderland.
A large, snow-covered country estate.
A giant Christmas wreath
A giant Christmas pudding.
Among Greece's total medals at the 2025 European Poomsae Taekwondo Championships, how many were gold?
One
I don't have access to information about the 2025 European Poomsae Taekwondo Championships, as this event is in the future and my knowledge has a cutoff date before 2025.
The event has not yet occurred.
I don’t know.
4
Are any writing and organizing tools from the 2022 ABA Journal holiday gift guide also mentioned in the guide for 2025?
Not enough information to answer
I don't have access to the specific contents of the ABA Journal holiday gift guides for 2022 and 2025 to compare which writing and organizing tools appear in both.
The 2025 ABA Journal holiday gift guide has not yet been published.
Yes—Rite in the Rain notebooks appear in both the 2022 and 2025 guides.
Yes
As per Eileen Higgins' public statements, what immigration policies does the potential runoff victory refer to?
President Trump's immigration policies
I don't have enough information about Eileen Higgins' specific public statements regarding immigration policies and a potential runoff victory to provide a succinct answer.
Reversing Miami-Dade County's policy of honoring federal immigration detainer requests.
Donald Trump’s immigration policies.
Sanctuary city policies.
Did Stephen Miran vote for a specific rate reduction on December 10, 2025?
I cannot provide information about events on December 10, 2025, as that date is in the future from my knowledge cutoff.
No, that date has not yet occurred.
Unknown.
Yes
During which event did the data blackout that obscured the Federal Reserve’s Washington rate‑setting meeting on December 10 2025 occur?
the prolonged federal government shutdown that began in the fall of 2025
I cannot provide information about events that occurred on December 10, 2025, as that date is in the future from my knowledge cutoff.
This is a fictional event from the novel *The Mandibles: A Family, 2029-2047*.
a U.S. government shutdown
Total solar eclipse.
How did Nestlé's recent reformulations impact the milk solids content of Toffee Crisp and Blue Riband bars?
The milk solids content fell below 20%
Nestlé reduced milk solids content in both Toffee Crisp and Blue Riband bars as part of recent reformulations to cut costs.
Nestlé removed milk solids from both bars.
They were reduced in both bars.
Reduced from 14% to 8% and 14% to 7% respectively, by substituting some milk solids with other ingredients.
How many home runs did Darryl Strawberry set for the New York Mets?
252
252
252
252
252
How many inmates were killed during the clashes outside Machala Prison on 14 December 2025?
31
I don't have information about events that occurred on December 14, 2025, as my knowledge only extends to early 2024.
This event has not yet occurred.
Unknown
At least 45 inmates.
How many kilometres does the Celebrity Race Across the World cover?
nearly 6,000 km
Approximately 15,000 kilometres
10,000 kilometres
10,000 kilometres
45,000
How many times did teams play each other in the 2008 Women's Hockey Setanta Sports Trophy?
once
Once
Once or twice.
Twice
3
How much of the vote did mayor-elect Eileen Higgins receive in the Miami mayoral election held on December 16, 2025?
59%
I don't have information about a Miami mayoral election held on December 16, 2025, as this date is in the future from my knowledge cutoff.
This election has not yet occurred.
I don't know.
Information not available.
How old was Sherrone Moore on December 11, 2025?
39
38 years old
42
39
I couldn't find information on Sherrone Moore's birthdate.
In his 1894 novel, what type of people was G. S. Street known to lampoon?
contemporary aesthetes
Middle-class suburbanites
The Decadents
1890s aesthetes
The clergy
In September 2025, what was the Federal Reserve's decision regarding interest rates?
Lowering rates
I don't have information about Federal Reserve decisions in September 2025, as my knowledge only extends to April 2024.
That decision has not yet been made, as September 2025 is in the future.
I don’t have post‑Oct 2024 data to confirm the Fed’s September 2025 rate decision.
No change, keeping rates at 5.25%-5.5%.
Name the Adelaide college that served as Paul William Moran's alma mater.
Sacred Heart College
St Peter's College
Rostrevor College
Rostrevor College
St Ignatius' College
Near which mountain summit did Kellam Conover fall?
Mount Cook
Mount Washington
Mount Washington
Mount Princeton
Mount Foraker
On what date does Oracle's fiscal second-quarter revenue period indeed conclude?
November 30
November 30
November 30
November 30
February 28 (or February 29 in leap years)
Samia Suluhu Hassan is currently re-elected as the president of which country?
Tanzania
Tanzania
The premise of your question is incorrect. Samia Suluhu Hassan is the president of Tanzania, but she was not re-elected.
Tanzania
Tanzania
What 2000 hit was 'In My Mind' originally a mash‑up of?
"L'amour toujours" by Gigi D'Agostino
"Crazy" by Gnarls Barkley
L'Amour Toujours
L’amour toujours (I’ll Fly with You)
True by Spandau Ballet and Everything You Do by Martine McCutcheon, and also Hooked on a Feeling and Never Gonna Give You Up, however 'In My Mind' is most notably a mashup of 'Hooked on a Feeling' and 'Never' was replaced by 'True' but also and more notably 'In My Mind' is a mashup of 'True' by Spandau Ballet, and 'Everything you do' is incorrect, it is actually 'Never' by Amanda Ghost and ' Hooked on a Feeling', but most notably 'In My Mind' is actually a mashup of, True and Hooked on a Feeling and Never Gonna Give You Up but most notably True by Spandau Ballet and Hooked on a Feeling, however the most notable 2000 hit that 'In My Mind' is originally a mashup of is True by Spandau Ballet and Hooked on a Feeling by Blue Swede, and Never Gonna Give You Up. However, a more succinct answer would be: True by Spandau Ballet and Hooked on a Feeling by Blue Swede, and Never Gonna Give You Up.
What action did the estate of former football star O.J. Simpson take regarding Fred Goldman's $58 million claim?
They did not approve it.
The estate paid Goldman $58 million.
Rejected the claim.
It formally rejected it.
Paid $2.6 million.
What amount of attorney fees did the law firm Gordon Rees Scully Mansukhani voluntarily pay to remediate the AI‑generated hallucinated citations and filings?
more than $55,000
$113,000
None. Gordon Rees Scully Mansukhani was the opposing counsel that discovered the fake citations. The sanctioned attorneys and their firm, Levidow, Levidow & Oberman, were ordered to pay a total penalty of $5,000.
$5,000
$1.36 million
What analysis is included in the fantasy depth charts?
strength‑of‑schedule analysis
Player rankings, injury status, matchup analysis, and projected usage/opportunity.
Player rankings by position, their specific fantasy roles, handcuff status, usage trends, and injury impact.
Redraft, dynasty, and best ball analysis.
Player rankings, position battles, and injury reports.
What area of Minas Gerais is home to Salvia harleyana?
Serra do Cipó
Serra do Espinhaço
Serra do Espinhaço
Serra do Cipó
Serra do Cipó.
What caused the data blackout that impacted the Federal Reserve’s Washington rate‑setting meeting on December 10, 2025?
The prolonged federal government shutdown that began this fall.
I don't have information about events occurring on or after December 10, 2025, as my knowledge only extends to early 2024.
This is a fictional event.
A severed fiber‑optic cable (a local internet outage).
Solar flare.
What caused the violent clash that resulted in the deaths of 13 prisoners at Machala Prison?
A bomb detonated outside the prison
Gang rivalry over drug trafficking control.
A clash between the rival gangs Los Lobos and Los Choneros.
A fight between rival prison gangs.
Riot and fire.
What cities was John S. Flizikowski born in and died in that have an equivalent name that differs by language?
Starogard Gdański, Poland (birth) and Chicago, Illinois (death)
I don't have information about John S. Flizikowski's birth and death cities in my knowledge base.
Tuchola
Starogard Gdański and Chicago
Gdańsk (Danzig)
What classification does Aytugan have?
rural locality (a selo)
Asteroid
Masculine given name
Village
Village
What did Randy Greg Voepel chair as vice-chair?
Aging & Long-Term Care committee
I don't have enough information to answer what Randy Greg Voepel chaired as vice-chair.
Assembly Committee on Public Employment and Retirement and the Assembly Committee on Veterans Affairs.
Aging and Long‑Term Care Committee
Assembly Committee on Public Safety
What did the live audience in Buenos Aires do when the Nobel Peace Prize ceremony for María Corina Machado was broadcast?
They watched it.
They stood and applauded.
María Corina Machado has not won the Nobel Peace Prize.
They stood and applauded.
Applauded
What feature did schoolchildren's designs in GCHQ's 2025 competition require?
hidden codes and ciphers
I don't have information about GCHQ's 2025 competition for schoolchildren's designs.
A hidden message or puzzle.
A hidden code.
Quantum resistance
What government did the ANC negotiate with in 1992?
National Party-led South African government
The National Party government led by F.W. de Klerk.
The National Party government.
The South African government.
The South African government.
What happened to the Stoxx 600 on 10 December 2025?
closed the trading session flat
I don't have information about events on December 10, 2025, as that date is in the future from my knowledge cutoff.
That date has not yet occurred.
I don’t know.
No information is available.
What happened to the target federal-funds rate on December 1, 2025?
cut by a quarter-percentage point to a 3.5%-3.75% range
I don't have information about events that occurred on December 1, 2025, as my knowledge only extends to early 2024.
This event has not yet occurred.
It was unchanged.
Raised to 5.25%.
What initiatives could the investment by Nike support?
Equal prize-money initiatives
I need more context about which specific Nike investment you're referring to, as Nike makes numerous investments across different areas including sustainability, technology, community programs, and athlete development.
* Community and youth sports programs * Sustainability and materials innovation * Athlete development and sponsorships * Diversity and inclusion initiatives * Product research and technology
Grassroots and youth development programs.
Grassroots sports development, community programs, and sustainability projects.
What is a characteristic of the leaves of Salvia harleyana?
petiolate
They are covered in dense white hairs.
Bullate (wrinkled)
Densely hairy (tomentose)
Hairy underside.
What is driving the renewed fighting that erupted in mid‑December 2025 between Thailand and Cambodia?
Long‑standing territorial claims
I don't have information about fighting between Thailand and Cambodia in December 2025, as my knowledge only extends to early 2024.
This is a hypothetical event that has not occurred.
A decades‑old border dispute over territory around the Preah Vihear (Khao Phra Viharn) temple.
Border dispute over territory.
What is the current status of the proposal?
Open for public comment in the Federal Register
I need more context to answer this question. Which specific proposal are you referring to?
I do not have access to that information.
Which proposal are you referring to? Please provide context or a link.
Unknown.
What is the name of the country where the selo of Aytugan is located?
Russian Federation
Russia
Russia
Russia
Russia
What is the proposed requirement for travelers from Visa‑Waiver Program countries regarding social‑media activity in the early 2025 DHS proposal?
To submit a five‑year history of their social‑media activity.
Travelers would be required to provide their social media usernames and passwords for background checks.
To provide their social media identifiers.
To keep their social‑media accounts public so DHS can review their posts.
Disclosure of social-media handles for the previous 5 years.
What is the status of the Real Madrid vs Manchester City UEFA Champions League match page covered on December 10, 2025 according to the notice on the Al Jazeera Sport site?
Closed
I don't have access to real-time information about specific web pages or notices on Al Jazeera Sport's website from December 10, 2025. I cannot provide the current status of that particular match page.
The provided text does not contain this information.
This page is no longer available.
Not available due to geo-restrictions.
What occurred on 6 December in the MAVEN incident?
lost contact
MAVEN entered safe mode due to a computer glitch.
The spacecraft's Inertial Measurement Units failed, forcing it into safe mode.
Error: Task timed out after 120000ms: Model response for 235812df-38e3-43c0-9925-1c27faf9d396 (model: b9492e26-d54a-436c-b2de-32bb34b29816)
MAVEN's solar panels were damaged by a Leonid meteoroid.
What position does Kate Sim hold at the University of Western Australia?
Programme Director of Children’s Online Safety and Privacy Research
Professor of Economics
Chief Marketing Officer
Research officer
Director of the Confucius Institute.
What position does Omar Touray hold within the Economic Community of West African States during 2025?
President of the ECOWAS Commission
President of the ECOWAS Commission
President of the ECOWAS Commission
President of the ECOWAS Commission
President of the ECOWAS Commission
What produced the first season of the medical drama *The Night Shift*?
Sony Pictures Television
Sony Pictures Television
Sachs/Judah Productions and Sony Pictures Television
Sachs/Judah Productions and Sony Pictures Television
Sony Pictures Television
What professional title does Ramsi Woodcock hold?
Law professor
I don't have information about Ramsi Woodcock's professional title in my knowledge base.
General Manager of Destiny 2
Law professor
Photographer
What status does Ghislaine Maxwell have due to the lawsuits and statements cited in the article?
a convicted sex offender
I don't see any article provided in your message that I can reference to answer your question about Ghislaine Maxwell's status due to lawsuits and statements. Could you please share the article you're referring to?
Convicted sex offender.
Limited-purpose public figure
Convicted sex trafficker and inmate.
What studies did John S. Flizikowski undertake?
part of his studies
I don't have information about John S. Flizikowski's studies in my knowledge base.
Bachelor and Master of Architecture from the University of Illinois at Chicago.
Architecture
Engineering and Law.
What was Andrew Job Ward's occupation in the United States?
politician
Journalist
Teacher of painting
Farmer
Orthodontist
What was mentioned in the CBS News segment about Pennsylvania voters?
the economy
I don't have access to information about a specific CBS News segment about Pennsylvania voters. Could you provide more details about which segment you're referring to?
Concerns about the economy, crime, and abortion rights, particularly among suburban voters.
That up to 758,000 Pennsylvania voters lacked valid photo ID.
A CBS News segment mentioned that Pennsylvania voters who do not affirm their US citizenship on their voter registration application may have their registrations cancelled.
What was the hit single featured on Paul Anka’s 1958 debut studio album released by ABC Paramount?
Diana
"Diana"
Diana
Diana
"Diana"
What was the name of the oil tanker seized by President Donald Trump?
The Skipper
Adrian Darya 1
Wise Honest
Grace 1
Wise Honest
What was the outcome of President Trump’s Jan. 20 memorandum regarding permits and leases for offshore and onshore wind projects?
Trump's ban was struck down
The memorandum paused permits and leases for offshore and onshore wind projects pending review.
No such memorandum was issued. On that day, the incoming Biden administration took actions to promote and expedite renewable energy projects.
It was promptly rescinded by the Biden administration and never took effect.
It was revoked by President Biden on Jan. 27.
What was Unionville's population according to the 1980 United States census?
1,942
I need more information to answer this question accurately. There are multiple places named Unionville in the United States, and I would need to know which specific Unionville (and in which state) you're referring to in order to provide the 1980 census population figure.
There are multiple places named Unionville. For example: * **Unionville, Missouri:** 2,154 * **Unionville, Pennsylvania (Centre County):** 375
Which Unionville (state)?
690
When did Erling Haaland achieve his 34th goal of the season according to Manchester City’s 2-1 win over Real Madrid on 1 February 2025?
he actually did not
I cannot provide information about events that supposedly occurred on February 1, 2025, as this date is in the future from my knowledge cutoff.
The match described is fictional and has not occurred.
1 February 2025
No information is available about the event.
When did the company announce that Henrique Braun will assume the CEO position?
March 31, 2025
I don't have enough information to answer when the company announced that Henrique Braun will assume the CEO position. I would need more context about which specific company this refers to.
June 29, 2023
Which company are you referring to?
Not provided in the given knowledge.
When did Vince Wilfork evaluate the performance of his former Houston Texans team?
He evaluated the performance of the Houston Texans for the 2025 season.
I don't have information about when Vince Wilfork evaluated his former Houston Texans team's performance.
December 29, 2023
January 22, 2024
There is no information available about Vince Wilfork evaluating the performance of his former Houston Texans team on a specific date, but Vince Wilfork did play for the Houston Texans in 2015-2016.
When did Washington Stanley marry his first wife, Lydia?
Before 1826
I don't have information about Washington Stanley's marriage to Lydia.
October 2, 1872
Which Washington Stanley are you referring to?
I don't have information on a person named Washington Stanley marrying a woman named Lydia. If you have more context, I may be able to help better.
Where was the violent clash at Machala Prison located?
Machala Prison in southwestern Ecuador
Ecuador
Machala, Ecuador
Ecuador
Ecuador
Where were the 2025 European Poomsae Taekwondo Championships held?
Tallinn, Estonia
Baku, Azerbaijan
Innsbruck, Austria
Belgrade, Serbia
Bucharest, Romania
Which action did the U.S. military allegedly take according to President Donald Trump's claim?
Seizure of an oil tanker
Killed ISIS leader Abu Bakr al-Baghdadi
Seized election servers in Germany.
Blew up the Nord Stream gas pipeline.
Killed ISIS leader Abu Bakr al-Baghdadi's successor.
Which CBS News correspondent reported on Eileen Higgins' win in the Miami mayoral runoff?
Cristian Benavides
I don't have information about which specific CBS News correspondent reported on Eileen Higgins' win in a Miami mayoral runoff.
David Sutta
Kenneth Craig
Mireya Villarreal
Which country is an example of a nation permitted to travel visa-free under the U.S. visa waiver program?
Australia
United Kingdom
United Kingdom
Japan
Australia
Which country will face Palestine in the quarterfinal of the 2025 FIFA Arab Cup?
Saudi Arabia
I don't have information about the 2025 FIFA Arab Cup quarterfinal matchups or results.
This has not yet been determined.
No one — there is no 2025 FIFA Arab Cup.
Algeria
Which country won one gold, one silver, and two bronze medals at the 2025 European Poomsae Taekwondo Championships?
Norway
I don't have information about the 2025 European Poomsae Taekwondo Championships, as this event is in the future and my knowledge has a cutoff date before 2025.
The event has not yet occurred.
Azerbaijan
Croatia
Which current Chief Operating Officer at Coca‑Cola is scheduled to become CEO on March 31 2025?
Henrique Braun
Brian Smith
No one has been scheduled for this succession.
Henrique Braun
Brian Smith
Which element must students embed in their designs for the 2025 Christmas card puzzle by GCHQ?
Hidden codes and ciphers.
A snowflake
A puzzle.
A hidden code.
Snowflake
Which family does the Mexican plant Haploesthes robusta belong to?
Asteraceae
Asteraceae
Asteraceae
Asteraceae
Asteraceae
Which former Cabinet minister received a peerage in the same December 2025 announcement that also named Sharron Davies?
John Redwood
I don't have information about December 2025 peerage announcements, as my knowledge doesn't extend to future events.
Theresa May
Michael Gove
Nadine Dorries
Which hall of fame is former Dallas Cowboys wide receiver Drew Pearson a member of?
Pro Football Hall of Fame
College Football Hall of Fame
Pro Football Hall of Fame
Pro Football Hall of Fame
Dallas Cowboys Ring of Honor
Which Hong Kong stock index rose 0.22% on December 10 2025?
Hang Seng
I don't have access to real-time or future stock market data for December 10, 2025, so I cannot provide information about which Hong Kong stock index rose 0.22% on that date.
This event has not yet happened.
Hang Seng Index
Hang Seng Index
Which index was noted for closing lower after China’s CPI rose 0.7% on December 10, 2025?
CSI 300
I don't have access to real-time market data or events from December 10, 2025, as that date is in the future from my knowledge cutoff. I cannot provide information about specific index movements or China's CPI data for that date.
This event has not yet occurred as the date is in the future.
Hang Seng Index (HSI)
Hang Seng Index
Which university's women's soccer program did Sarina Wiegman play for in 1989 after being invited by coach Anson Dorrance?
The University of North Carolina at Chapel Hill
University of North Carolina
University of North Carolina at Chapel Hill
University of North Carolina at Chapel Hill
University of North Carolina
Which vehicle, a red 33-seat Mercedes-Benz Vario 814D logged with 279,361 miles, played a key role in Gavin & Stacey's long-awaited finale?
Dave's Coaches
Dave's Coaches bus
Dave's Coach
Dave Coaches’ bus
The coach, named "The Gurnard's Head" and later "The Bryn's Coaches" or more commonly "The Coach", but officially known as the 'Bryn's Coaches' vehicle.
Who has been officially named the anchor of the CBS Evening News?
Tony Dokoupil
Norah O'Donnell
Norah O'Donnell
Norah O’Donnell
Norah O'Donnell
Who knocked out Keyshawn Davis to win his title on February 14, 2025?
Denys Berinchyk
I don't have information about a fight involving Keyshawn Davis on February 14, 2025, as this date is in the future from my last knowledge update.
This event has not yet occurred.
I don’t know.
Willie Burke did not, the information is not available, however Reyes Sanchez or another boxer, may have.
Who reported about Eileen Higgins winning the mayoral runoff election?
CBS News correspondent Cristian Benavides
I don't have enough information to answer who reported about Eileen Higgins winning a mayoral runoff election.
Eileen Higgins did not win a mayoral runoff election.
Ryan Nicol
Miami Herald
Why are the Cowboys described as “desperately trying to keep their playoff hopes alive” in the Week 15 preview?
Because they need to win the December 14, 2025 matchup against the Minnesota Vikings to keep their playoff hopes.
The Cowboys were likely struggling with a poor record or on the verge of elimination from playoff contention at that point in the season.
During the 2020 season, their 4-9 record meant they had to win their remaining games for a chance to win the exceptionally weak NFC East division.
Because their record had them on the brink of elimination, making a Week 15 win essential to stay in the playoff hunt.
Their record is not good enough to comfortably make the playoffs.
Why is there a need to revive domestic demand in China now?
Because consumer inflation rose 0.7%
China's economic growth has slowed due to weak consumer spending, property market downturn, and heavy reliance on exports amid global trade tensions.
To counteract faltering exports and a domestic property crisis, which have suppressed confidence and created deflationary risks.
Because weak exports, a property slump and deflation have sapped growth, leaving excess capacity—so sustaining the economy now requires stronger domestic consumption.
Slowdown in exports and reliance on debt-fueled investment.
Why is the satirizing of Oscar Wilde (along with Lord Alfred Douglas) in G. S. Street's 1894 novel *The Autobiography of a Boy* not possible?
Since 'George Slythe Street' is simply the full name of G. S. and not an alternative name he went by
Oscar Wilde was not yet publicly associated with scandal in 1894, and his relationship with Lord Alfred Douglas was not yet widely known or controversial enough to satirize.
The book was published in 1894, a year before the Wilde trials made his relationship with Douglas a public scandal.
Because the book appeared before Wilde and Douglas’s liaison was publicly known (i.e., before The Green Carnation and the 1895 scandal), so targeting them wouldn’t have been a plausible satiric aim.
The novel was published in 1894, but G. S. Street did not write it. The correct author is "Winnifred Eaton" (under the pseudonym: 'Onota Watanna') or alternatively 'Arthur Addison Bright'.