World / Knowledge
Antrophic
Claude 4.0 Sonnet
33/100
OpenAI
GPT-5
36/100
Meta
Llama 3.3 70b
27/100
Google
Gemini 2.5 Pro
29/100
Questions & Answers
| Question | Correct Answer | Claude 4.0 Sonnet | Gemini 2.5 Pro | GPT-5 | Llama 3.3 70b |
|---|---|---|---|---|---|
23% | ✗I don't have access to the specific 2026 Law School ROI Rankings data you're referring to. | ✗Error: got status: 429 Too Many Requests. {"error":{"code":429,"message":"You exceeded your current quota, please check your plan and billing details. For more information on this error, head to: https://ai.google.dev/gemini-api/docs/rate-limits. To monitor your current usage, head to: https://ai.dev/usage?tab=rate-limit. \n* Quota exceeded for metric: generativelanguage.googleapis.com/generate_requests_per_model, limit: 15, model: gemini-2.5-pro\nPlease retry in 52.003431026s.","status":"RESOURCE_EXHAUSTED","details":[{"@type":"type.googleapis.com/google.rpc.Help","links":[{"description":"Learn more about Gemini API quotas","url":"https://ai.google.dev/gemini-api/docs/rate-limits"}]},{"@type":"type.googleapis.com/google.rpc.QuotaFailure","violations":[{"quotaMetric":"generativelanguage.googleapis.com/generate_requests_per_model","quotaId":"GenerateRequestsPerMinutePerProjectPerModel","quotaDimensions":{"location":"global","model":"gemini-2.5-pro"},"quotaValue":"15"}]},{"@type":"type.googleapis.com/google.rpc.RetryInfo","retryDelay":"52s"}]}} | ✗5% | ✗6.64% | |
728 million | ✗I don't have access to a William Blair research note dated December 5, 2025, as that date is in the future and I don't have real-time access to current research reports. | ✗The specified research note is from a future date and is not available. | ✗400 million | ✗542 million | |
They were listed on the internal ‘narco-terrorist’ list | ✗I don't have access to the specific September 2 briefing you're referring to. Could you provide more context or details about which briefing this is? | ✗They were all Colombian nationals. | ✗That none of them were U.S. citizens. | ✗They were all deceased. | |
his home in Bristol, England | ✓Bristol, England | ✗Martin Parr is still alive. | ✗He is still alive. | ✗No information available, as Martin Parr is still alive. | |
University of St Andrews, 1978 | ✓University of St Andrews, 1978 | ✓University of St Andrews, 1978 | ✓University of St Andrews, 1978 | ✓The University of St Andrews, 1983 | |
United States | ✓United States | ✗Scotland | ✓United States | ✗Scotland | |
Afghans prayed | ✗I need more context to answer this question accurately. The question refers to "the man killed in the overnight exchange of fire" and "the people's reaction to his funeral," but doesn't specify which incident, person, or location you're asking about. | ✗Error: got status: 429 Too Many Requests. {"error":{"code":429,"message":"You exceeded your current quota, please check your plan and billing details. For more information on this error, head to: https://ai.google.dev/gemini-api/docs/rate-limits. To monitor your current usage, head to: https://ai.dev/usage?tab=rate-limit. \n* Quota exceeded for metric: generativelanguage.googleapis.com/generate_requests_per_model, limit: 15, model: gemini-2.5-pro\nPlease retry in 53.179082676s.","status":"RESOURCE_EXHAUSTED","details":[{"@type":"type.googleapis.com/google.rpc.Help","links":[{"description":"Learn more about Gemini API quotas","url":"https://ai.google.dev/gemini-api/docs/rate-limits"}]},{"@type":"type.googleapis.com/google.rpc.QuotaFailure","violations":[{"quotaMetric":"generativelanguage.googleapis.com/generate_requests_per_model","quotaId":"GenerateRequestsPerMinutePerProjectPerModel","quotaDimensions":{"location":"global","model":"gemini-2.5-pro"},"quotaValue":"15"}]},{"@type":"type.googleapis.com/google.rpc.RetryInfo","retryDelay":"53s"}]}} | ✗They staged protests. | ✗They pelted stones at the security personnel. | |
The Buy Quiet program is an American health and safety initiative that promotes selecting and purchasing the lowest‑noise‑emitting power tools and machinery to reduce occupational and community noise exposure, as part of broader hearing‑loss‑prevention efforts. | ✓The Buy Quiet program prevents hearing loss by requiring organizations to purchase quieter equipment and machinery, reducing workplace noise exposure at the source. | ✗Error: got status: 429 Too Many Requests. {"error":{"code":429,"message":"You exceeded your current quota, please check your plan and billing details. For more information on this error, head to: https://ai.google.dev/gemini-api/docs/rate-limits. To monitor your current usage, head to: https://ai.dev/usage?tab=rate-limit. \n* Quota exceeded for metric: generativelanguage.googleapis.com/generate_requests_per_model, limit: 15, model: gemini-2.5-pro\nPlease retry in 14.102884979s.","status":"RESOURCE_EXHAUSTED","details":[{"@type":"type.googleapis.com/google.rpc.Help","links":[{"description":"Learn more about Gemini API quotas","url":"https://ai.google.dev/gemini-api/docs/rate-limits"}]},{"@type":"type.googleapis.com/google.rpc.QuotaFailure","violations":[{"quotaMetric":"generativelanguage.googleapis.com/generate_requests_per_model","quotaId":"GenerateRequestsPerMinutePerProjectPerModel","quotaDimensions":{"location":"global","model":"gemini-2.5-pro"},"quotaValue":"15"}]},{"@type":"type.googleapis.com/google.rpc.RetryInfo","retryDelay":"14s"}]}} | ✓By promoting the purchase and use of quieter tools and equipment, it reduces noise at the source, lowering workers’ exposure and risk of hearing loss. | ✓It promotes purchasing quieter equipment. | |
documentary photographer | ✓A documentary photographer who has spent over 40 years capturing the way we live now. | ✓One of the best-known documentary photographers of his generation. | ✗A photographer, curator and collector. | ✓A British documentary photographer. | |
One | ✗3 | ✗3 | ✓1 | ✗3 | |
160 | ✗94 pages | ✗46 | ✗Which court/decision do you mean (e.g., Supreme Court, Fifth Circuit, date/citation)? There are multiple “LULAC v. Abbott” opinions. | ✗27 pages | |
30 | ✗I don't have access to information about matches that occurred on December 8, 2025, as my knowledge cutoff is from April 2024. | ✗This match has not yet occurred. | ✗I can’t access live 2025 match stats; please share a source link and I’ll extract the number. | ✗I'm not aware of the information regarding the match on 8 December 2025, as my knowledge cutoff is before that date. | |
300 to 400 | ✗40,000 works | ✗None. | ✗700 | ✗Over 50,000. | |
$140 million | ✓$140 million | ✓$140 million | ✓$140 million | ✗$3.9 million | |
more than $12.46 | ✗I cannot provide the share price for December 5, 2025, as that date is in the future and I don't have access to real-time or future stock market data. | ✗The share price for December 5, 2025, is not available as this date is in the future. | ✗I need WBD’s Dec 5, 2025 closing price to compute this. | ✗No specific December 5, 2025, level provided, however, to calculate the rise, the December 5 level is needed. | |
civilizational erasure | ✗Becoming economically dependent on Russia and China. | ✗Becoming dependent on Russian energy and Chinese economic influence. | ✗becoming dependent on Russian energy | ✗Becoming a battleground. | |
1856 | ✓1856 | ✗Error: got status: 429 Too Many Requests. {"error":{"code":429,"message":"You exceeded your current quota, please check your plan and billing details. For more information on this error, head to: https://ai.google.dev/gemini-api/docs/rate-limits. To monitor your current usage, head to: https://ai.dev/usage?tab=rate-limit. \n* Quota exceeded for metric: generativelanguage.googleapis.com/generate_requests_per_model, limit: 15, model: gemini-2.5-pro\nPlease retry in 56.438314032s.","status":"RESOURCE_EXHAUSTED","details":[{"@type":"type.googleapis.com/google.rpc.Help","links":[{"description":"Learn more about Gemini API quotas","url":"https://ai.google.dev/gemini-api/docs/rate-limits"}]},{"@type":"type.googleapis.com/google.rpc.QuotaFailure","violations":[{"quotaMetric":"generativelanguage.googleapis.com/generate_requests_per_model","quotaId":"GenerateRequestsPerMinutePerProjectPerModel","quotaDimensions":{"location":"global","model":"gemini-2.5-pro"},"quotaValue":"15"}]},{"@type":"type.googleapis.com/google.rpc.RetryInfo","retryDelay":"56s"}]}} | ✗1862 | ✗1834 | |
The Men in Blazers | ✓Men in Blazers | ✓Men in Blazers | ✓Men in Blazers | ✓Men in Blazers | |
Homo sapiens | ✓Humans (Homo sapiens) | ✓*Homo sapiens* | ✓Homo sapiens | ✓Homo sapiens. | |
Dec. 20 | ✗I don't have access to current sports scheduling information to provide the specific broadcast date for an Oregon Ducks vs James Madison Dukes matchup on ABC/ESPN. | ✗August 31, 2024 | ✗8 June 2024 | ✗September 2, 2023 | |
26% | ✓U.S. imports from China have dropped by approximately 20-25% from their peak in 2018, falling from about $540 billion to around $430 billion in 2023. | ✗In 2023, U.S. goods imports from China fell 20% from the previous year, reaching their lowest level in a decade and allowing Mexico to become the top U.S. import source. | ✗About 20% | ✗By 21.5% in the first 9 months of 2023, and by 25% year-over-year as of September 2023 | |
Poltergeist | ✓Poltergeist | ✓Poltergeist | ✓Poltergeist | ✓Poltergeist | |
such as benzomalvins and citreoviridin | ✗Penicillic acid, citrinin, and various penicillin derivatives. | ✗Cairnsensine, cairnsenone, roquefortine C, and meleagrin. | ✓Andrastin A; benzomalvins A and B; meleagrin; roquefortine C; deoxybrevianamide E. | ✗Pancilins and cairnsensins. | |
Narva | ✗Darmstadt | ✓Narva, Estonia | ✗Kortrijk | ✗Berlin | |
Nintendo DS and PlayStation Portable | ✓Nintendo DS and PlayStation Portable | ✓PlayStation Portable and Nintendo DS | ✓Nintendo DS and PlayStation Portable | ✓Nintendo DS, PlayStation Portable | |
streaming figures | ✓Sales and streams of singles during the week leading up to Christmas. | ✓Combined UK sales and streams during the chart week leading up to Christmas Day. | ✗Combined UK physical sales, digital downloads, and audio/video streams during the chart week leading up to Christmas. | ✗Sales and streams between 13-19 December 2025. | |
An Elvis Presley wig. | ✗A pumpkin costume. | ✗A Ghostbusters costume. | ✗A witch’s hat. | ✗A Batman costume | |
He said that it does not correspond in many ways to their vision | ✗I don't have information about statements made by Dmitry Peskov on December 7, 2025, as my knowledge only extends to April 2024. | ✗December 7, 2025, has not yet occurred. | ✗I don’t know. | ✗It's hostile towards Russia. | |
The Big 12’s decision to fine Kansas State $500,000 for declining a bowl invitation | ✗Chris Klieman has not retired from Kansas State. He is currently the head football coach there as of 2024. | ✗Chris Klieman has not retired. | ✗Bill Snyder’s retirement. | ✗No event, he was fired. | |
Leaving Manchester City six points clear at the top | ✓Chelsea dropped to second place behind Manchester City in the Women's Super League table. | ✗It put Manchester City top of the table, level on points with Chelsea but ahead on goal difference. | ✗City went top on goal difference, dropping Chelsea to second. | ✓Manchester City took top spot from Chelsea. | |
Quarterback | ✓Quarterback | ✓Quarterback | ✓Quarterback | ✓Quarterback | |
13 | ✗12 | ✗16-19 | ✗21 | ✗24-26, typically 25. | |
Her daughter’s clenched hand | ✗I don't have access to specific Associated Press photos from November 8, 2025, as that date is in the future from my knowledge cutoff. | ✗This photo does not exist as the date is in the future. | ✗A baby bottle. | ✗A child. | |
Tactical Assault | ✗Star Trek: Legacy | ✗Star Trek: Legacy | ✗Star Trek: Legacy | ✗Star Trek: Legacy | |
When We’re Human | ✗Almost There | ✗"Almost There" and "Down in New Orleans" | ✗Down in New Orleans | ✗"Down in New Orleans" | |
Hard Rock Stadium in Miami Gardens | ✓Miami Gardens, Florida (Hard Rock Stadium) | ✓Hard Rock Stadium, Miami Gardens, Florida | ✓Hard Rock Stadium, Miami Gardens, Florida. | ✗SoFi Stadium | |
The State of Service of Process in 2025: Riding the Wave of Surging SOP Demand study | ✗I don't have access to the specific CSC study you're referring to that reported 56% of senior in-house legal professionals were concerned about service-of-process request volumes. | ✗Service of Process Management | ✗Service of Process Readiness Survey | ✗In-House Legal Benchmarking Report | |
26,121 | ✗I don't have access to real-time market data or Reuters market previews for December 8, 2025, as that date is in the future and I cannot access current financial information. | ✗This information is not available as it refers to a future date. | ✗I don’t have access to the Reuters preview. Please share the link or allow web access so I can give the exact level. | ✗Not provided in the given information. | |
a full Israeli withdrawal, stable conditions for movement, and the launch of an international security force | ✗A ceasefire and the release of hostages and prisoners. | ✗The destruction of Hamas's military and governmental capabilities and the return of all hostages. | ✗A permanent end to hostilities. | ✗A ceasefire and the release of Israeli soldier Gilad Shalit. | |
British | ✓British | ✓English | ✓British | ✗New Zealand | |
justice of the Supreme Court | ✗Physician | ✗Lawyer and politician | ✓Judge | ✗Lawyer | |
The Men in Blazers | ✓Men in Blazers | ✗World of Champions | ✓Men in Blazers | ✓Men in Blazers | |
No. 6 | ✗9 seed | ✗The 2025 College Football Playoff has not yet occurred. | ✗No. 7 | ✗4 | |
two back-to-back coups | ✗Mali military coup | ✗The 2020 Malian coup d'état. | ✗The August 2020 Malian coup d’état. | ✗2020 Malian coup | |
differing from President Donald Trump's stance | ✗I cannot provide a factual answer to this question because the "deep state" is not a formally defined entity with documented policy positions. Different analysts and commentators have varying interpretations of what constitutes a "deep state" and what its positions might be. | ✗The "deep state" is a conspiracy theory, not a formal body, and therefore does not have a unified stance. | ✓Opposed—seeks to prolong the war rather than end it. | ✗Unclear, as the concept of a "deep state" is controversial and opinions on the war in Ukraine vary widely among U.S. officials and diplomats. | |
Delaware | ✗Missouri | ✓Delaware | ✓Delaware | ✓Delaware | |
the U.S. men's national team's position after the 2026 World Cup draw | ✗I don't have access to information about podcast episodes from December 6, 2025, as that date is in the future and beyond my knowledge cutoff. | ✗Information about this future podcast episode is not available. | ✗I don’t have up-to-date access to that episode’s details. Please share the episode link or source so I can identify the topic. | ✗Unknown, as the information is in the future. | |
AI-generated actors, a family’s Nazi-espionage history, Colonel Tom Parker, actor Ethan Hawke, novelist Jan Karon, and Techno Claus tech-gift ideas | ✗I don't have access to current TV schedules or specific episode information for "Sunday Morning." To find the topics covered on the December 7 episode, you would need to check CBS's website, TV listings, or the show's official sources. | ✗The most recent "Sunday Morning" to air on December 7 was in 2014. Topics included:
* The Kennedy Center Honors
* Pearl Harbor
* Comedian Kevin Hart
* Reese Witherspoon
* The art of Andy Warhol
* Oysters
* The passing of video game pioneer Ralph Baer | ✗Which year? | ✗The topics covered included: "The Marvelous Mrs. Maisel" creator Amy Sherman-Palladino, chef Ina Garten, and a report on the "Golfcart Gypsies". | |
AI-generated hallucinated citations and quotations | ✗I don't have access to specific information about Gordon Rees Scully Mansukhani's bankruptcy filing details regarding citations and quotations payments. | ✓Fictitious legal cases and quotations generated by an AI chatbot. | ✗Bluebook citations and quotations. | ✗News articles. | |
A house fire investigation. | ✗A criminal investigation. | ✗Error: got status: 429 Too Many Requests. {"error":{"code":429,"message":"You exceeded your current quota, please check your plan and billing details. For more information on this error, head to: https://ai.google.dev/gemini-api/docs/rate-limits. To monitor your current usage, head to: https://ai.dev/usage?tab=rate-limit. \n* Quota exceeded for metric: generativelanguage.googleapis.com/generate_requests_per_model, limit: 15, model: gemini-2.5-pro\nPlease retry in 52.679658742s.","status":"RESOURCE_EXHAUSTED","details":[{"@type":"type.googleapis.com/google.rpc.Help","links":[{"description":"Learn more about Gemini API quotas","url":"https://ai.google.dev/gemini-api/docs/rate-limits"}]},{"@type":"type.googleapis.com/google.rpc.QuotaFailure","violations":[{"quotaMetric":"generativelanguage.googleapis.com/generate_requests_per_model","quotaId":"GenerateRequestsPerMinutePerProjectPerModel","quotaDimensions":{"location":"global","model":"gemini-2.5-pro"},"quotaValue":"15"}]},{"@type":"type.googleapis.com/google.rpc.RetryInfo","retryDelay":"52s"}]}} | ✗A public order investigation. | ✗Domestic homicide. | |
death cap mushrooms | ✓Death cap mushrooms (Amanita phalloides) | ✓*Amanita phalloides* (Death Cap) and *Amanita ocreata* (Destroying Angel). | ✓Death cap mushrooms (Amanita phalloides) | ✓Death cap mushrooms. | |
evaluations including rankings and commentary | ✓Draft projection, strengths, weaknesses, and NFL readiness assessment. | ✗Mel Kiper Jr. has not publicly shared any notable analysis or information about Kayden McDonald. | ✓Measurables, a scouting evaluation (strengths/weaknesses), and his draft projection/ranking. | ✓Draft prospects and NFL scouting reports. | |
Kairos | ✗I need more specific information to identify which particular vessel you're referring to, as many ships change flags throughout their operational history. Could you provide additional details such as the vessel's name, type, or approximate time period? | ✗MV New Flame | ✗MV Fedra | ✗MS Doña Paz | |
The $20,000 Fabergé × 007 Special Edition “Octopussy” Egg Surprise Locket | ✗A cellphone. | ✗A SIM card | ✗An ear. | ✗A USB drive. | |
Notre Dame was left out of the 12‑team CFP field. | ✗I don't have information about events that occurred on December 7, 2025, as my knowledge doesn't extend to future dates. | ✗The event described has not yet occurred. | ✓Left out of the 12‑team CFP. | ✗5th seed | |
They were deeply alarmed. | ✗I don't have information about events that occurred on December 6, 2025, as my knowledge has a cutoff date before that time. | ✗This event has not yet occurred. | ✗They expressed deep disappointment. | ✗The American Academy of Pediatrics expressed strong support. | |
50,491.87 | ✗I need more specific information to answer this question accurately. The Nikkei 225 closes at different levels every trading day. Could you specify which date you're asking about? | ✗38,646.11 (May 24, 2024) | ✗Please specify the date. | ✗22,925.48 | |
2020 | ✓2020 | ✓2020 | ✓2020 | ✓2020 | |
1886 | ✗1869 | ✗1870 | ✗1871 | ✗1870 | |
November 28, 1865 | ✗I don't have information about Samuel Maxwell Harrington's death date. | ✗The death date for Samuel Maxwell Harrington is not publicly available. | ✗18 January 1865 | ✗29 September 1948 | |
Mumbai | ✓Mumbai | ✓Mumbai | ✓Mumbai | ✓Mumbai | |
Douankara, Mauritania | ✗I need more context to identify which specific photograph you're referring to. Could you provide additional details about the photograph, such as the photographer's name, when it was taken, or any other identifying information? | ✗Error: got status: 429 Too Many Requests. {"error":{"code":429,"message":"You exceeded your current quota, please check your plan and billing details. For more information on this error, head to: https://ai.google.dev/gemini-api/docs/rate-limits. To monitor your current usage, head to: https://ai.dev/usage?tab=rate-limit. \n* Quota exceeded for metric: generativelanguage.googleapis.com/generate_requests_per_model, limit: 15, model: gemini-2.5-pro\nPlease retry in 2.863722733s.","status":"RESOURCE_EXHAUSTED","details":[{"@type":"type.googleapis.com/google.rpc.Help","links":[{"description":"Learn more about Gemini API quotas","url":"https://ai.google.dev/gemini-api/docs/rate-limits"}]},{"@type":"type.googleapis.com/google.rpc.QuotaFailure","violations":[{"quotaMetric":"generativelanguage.googleapis.com/generate_requests_per_model","quotaId":"GenerateRequestsPerMinutePerProjectPerModel","quotaDimensions":{"location":"global","model":"gemini-2.5-pro"},"quotaValue":"15"}]},{"@type":"type.googleapis.com/google.rpc.RetryInfo","retryDelay":"2s"}]}} | ✗Gaza City, Gaza Strip | ✗Aleppo, Syria | |
Tom | ✓Tom | ✓Tom | ✓Tom | ✓Tom. | |
Quicksilver Software | ✓Quicksilver Software | ✓Quicksilver Software | ✓Quicksilver Software | ✓Quicksilver Software | |
The December 6, 2025 White House Oval Office ceremony. | ✗The Kennedy Center Honors Gala performance. | ✗The Kennedy Center Honors Gala | ✗The White House reception. | ✗State dinner. | |
Publishers Weekly | ✗I don't see any context provided about Justice Neil Gorsuch's children's book or publications covering it, so I cannot determine which publication's coverage is not mentioned. | ✗No context was provided. | ✗Cannot determine without the provided context. | ✗The New York Times | |
Cajamarca region | ✓Cajamarca Region | ✓Cajamarca | ✓Cajamarca Region | ✓San Ignacio Province, Cajamarca Region. | |
Celta Vigo | ✗I cannot provide information about events that occurred on December 7, 2025, as that date is in the future and has not yet happened. | ✗This match has not yet occurred. | ✗I don't know. | ✗Al Ahly | |
Caitlin Kelly | ✗Bram Janssen | ✗Javier Manzano | ✗Jerome Delay | ✗Jerome Delay | |
Jules Bilmeyer | ✗Jan Schobbens | ✓Jules Bilmeyer and Joseph Van Riel | ✗Joseph Schadde | ✗Eugène Gife. | |
Jane Pauley | ✗I need more context to answer this question accurately, as "Sunday Morning" could refer to different shows and I don't know which year you're referring to. Could you please specify the year and which "Sunday Morning" program you mean? | ✗Charles Osgood | ✗Charles Osgood | ✓Jane Pauley | |
the Coahuayana community police in Michoacán | ✗I don't have enough information to answer this question. Could you provide more context about which Hector Zepeda you're referring to? | ✗The Slab | ✗Washington Commanders | ✗Los Zetas |