World / Knowledge
OpenAI
GPT-4.1
40/100
Google
Gemini 2.0 Flash-Lite
37/100
OpenAI
GPT-4o-mini
42/100
Google
Gemini 2.0 Flash
41/100
Antrophic
Claude 3.7 Sonnet
37/100
Meta
Llama 3.3 70b
23/100
Questions & Answers
| Question | Correct Answer | Claude 3.7 Sonnet | Gemini 2.0 Flash | Gemini 2.0 Flash-Lite | GPT-4.1 | GPT-4o-mini | Llama 3.3 70b |
|---|---|---|---|---|---|---|---|
Yes, three | ✓Yes. | ✓Context: "Diogo Jota and his partner Rute Cardoso have two children."
| ✓Yes.
| ✓Yes. | ✓Yes. | ✗No context is given to determine the answer to the question. | |
four | ✗The question asks about Samuele Ricci's contract with AC Milan, but no context has been provided containing this information. I cannot answer without the relevant context. | ✓This question cannot be answered from the provided context.
| ✓Context: "Samuele Ricci is linked with a move to AC Milan, but the Italian club has not yet made any official offer for the midfielder. According to recent reports, AC Milan is interested in signing the player and could offer him a five-year contract."
Question: For how many years does Samuele Ricci sign a contract with AC Milan?
5
| ✗5 years | ✗Five years | ✗Context is required to answer this question. | |
Two | ✗None. (Luis Severino's contract expired.) | ✗Zero
| ✗Context: "The Yankees acquired right-handed pitcher Luis Severino on a one-year deal."
Question: How many years are left on Luis Severino's contract?
One
| ✗Luis Severino has one year left on his contract. | ✗One year | ✗Context is required to answer this question. | |
2014 | ✗2017 | ✗2015
| ✗2018
| ✗2013 | ✗2018 | ✓2014 | |
2026 | ✗2024 | ✗Context: "In 2023, Shaquille O'Neal will receive a star on the Hollywood Walk of Fame."
| ✗2024
| ✗2024 | ✗2023 | ✗2017 | |
Premier League | ✓Premier League | ✓Premier League
| ✓Premier League
| ✓Premier League | ✓Premier League | ✓Premier League | |
Yes | ✗No. | ✗The provided context doesn't state whether Cal Raleigh is on track to hit 35 home runs before the All-Star break.
| ✗No.
| ✗No, Cal Raleigh is not on track to reach 35 home runs before the All-Star break. | ✓Yes, he is on track to potentially reach 35 home runs before the All-Star break. | ✓Yes | |
Yes | ✓Yes, for the Bailey's Women's Prize for Fiction. | ✓Context: "Riley's fifth novel, First Love, was shortlisted for the 2017 Baileys Women's Prize for Fiction."
| ✗No
| ✓Yes, "First Love" was shortlisted for an award. | ✓Yes. | ✓Yes | |
Yes | ✗No | ✓Yes.
| ✓Yes
| ✓Yes. | ✓Yes. | ✓Yes | |
Seizures and searches | ✓Dismantled the scheme and seized proceeds. | ✓They seized dozens of domain names.
| ✓Seized assets and charged defendants.
| ✓Federal law enforcement seized computers and funds, and arrested several people involved in the scheme. | ✓Federal law enforcement seized over 100 computers and other equipment in connection with the scheme. | ✗Context is required to answer the question. | |
suspended from the Labour Party | ✓She was suspended by Labour. | ✗Context: "In February 2024, Sultana was reprimanded by the Speaker of the House of Commons after falsely accusing a Conservative MP of taking money from a company that sells weapons to Israel."
| ✗A warning.
| ✓The Labour whip was removed from Zarah Sultana. | ✓She was suspended from the Labour Party. | ✗Context is required to answer this question. | |
She lobbied for family medicine and primary care | ✓As executive director of the Utah Academy of Family Physicians, Jennifer Dailey-Provost advocated for family physicians and their patients. | ✗Error: got status: 429 Too Many Requests. {"error":{"code":429,"message":"You exceeded your current quota, please check your plan and billing details. For more information on this error, head to: https://ai.google.dev/gemini-api/docs/rate-limits.","status":"RESOURCE_EXHAUSTED","details":[{"@type":"type.googleapis.com/google.rpc.QuotaFailure","violations":[{"quotaMetric":"generativelanguage.googleapis.com/generate_content_free_tier_requests","quotaId":"GenerateRequestsPerMinutePerProjectPerModel-FreeTier","quotaDimensions":{"location":"global","model":"gemini-2.0-flash"},"quotaValue":"15"}]},{"@type":"type.googleapis.com/google.rpc.Help","links":[{"description":"Learn more about Gemini API quotas","url":"https://ai.google.dev/gemini-api/docs/rate-limits"}]},{"@type":"type.googleapis.com/google.rpc.RetryInfo","retryDelay":"36s"}]}} | ✓Led the organization.
| ✓She advocated for family medicine and primary care. | ✗Jennifer Dailey-Provost improved the organization's operations and communication. | ✗There is no provided context containing the answer to the question. | |
They dismissed it as a coincidence. | ✓They claimed it was "a bogus accusation." | ✗Error: got status: 429 Too Many Requests. {"error":{"code":429,"message":"You exceeded your current quota, please check your plan and billing details. For more information on this error, head to: https://ai.google.dev/gemini-api/docs/rate-limits.","status":"RESOURCE_EXHAUSTED","details":[{"@type":"type.googleapis.com/google.rpc.QuotaFailure","violations":[{"quotaMetric":"generativelanguage.googleapis.com/generate_content_free_tier_requests","quotaId":"GenerateRequestsPerMinutePerProjectPerModel-FreeTier","quotaDimensions":{"location":"global","model":"gemini-2.0-flash"},"quotaValue":"15"}]},{"@type":"type.googleapis.com/google.rpc.Help","links":[{"description":"Learn more about Gemini API quotas","url":"https://ai.google.dev/gemini-api/docs/rate-limits"}]},{"@type":"type.googleapis.com/google.rpc.RetryInfo","retryDelay":"37s"}]}} | ✓They denied it.
| ✓They claimed the report was untrue. | ✓They claimed that the report was false. | ✓They claimed it was false. | |
A solid labor market despite economic uncertainty | ✓Cooling labor market with 206,000 jobs added and unemployment rising to 4.1%. | ✓The labor market remains strong.
| ✓The labor market added 209,000 jobs in June.
| ✓The June jobs report indicated that the labor market remained resilient, with continued job growth. | ✓The June jobs report indicated strong job growth and a decrease in the unemployment rate. | ✗Not provided in the given context. | |
Taking an underground tour | ✗Swim in public fountains. | ✓Context: "Europe is sweltering under a prolonged heat wave...Here are simple tips to help you stay cool: Drink plenty of water; Stay in the shade; Wear loose clothing;"
Question: "What does the article suggest as a way to cool off during Europe's heat wave?"
Answer: Drink plenty of water; Stay in the shade; Wear loose clothing.
| ✗The article does not suggest any ways to cool off during the heat wave.
| ✗The article suggests swimming as a way to cool off during Europe's heat wave. | ✓Taking a dip in a pool or going to the beach. | ✗There is no provided context or article to answer the question. | |
.801 | ✗As there is no context provided about Chandler Simpson's OPS since returning to the Tampa Bay Rays, I cannot provide this specific statistical information. | ✗Context: "Since being returned to the Rays on May 10, Simpson is slashing .190/.292/.238 with a .530 OPS."
| ✗.755
| ✗I'm sorry, but the context needed to provide Chandler Simpson's OPS since returning to the Tampa Bay Rays is missing. Please provide the relevant context. | ✗The context for Chandler Simpson's OPS since returning to the Tampa Bay Rays is not provided. Please provide the relevant context for me to answer your question. | ✗Context is required to answer the question. | |
17.9 | ✗13.3 | ✗13.8
| ✗Context: "In the 2022-2023 season, Chase Forte averaged 2.2 points per game (PPG), 1.7 rebounds per game (RPG) and 0.6 assists per game (APG) for the Tar Heels."
Question: "What is Chase Forte's PPG?"
2.2
| ✗The context needed to answer the question is missing. Please provide the relevant context. | ✗The context needed to answer the question about Chase Forte's PPG is not provided. Please provide the relevant context. | ✗Context is required to answer the question. | |
20% | ✗Based on the provided question, I cannot determine the likelihood of the Cleveland Guardians trading Emmanuel Clase as no context containing this information was provided in your message. | ✓Not stated in context.
| ✓Unlikely
| ✓There is no definitive answer, but current reports indicate the likelihood is low. | ✓The context does not provide information on the likelihood of the Cleveland Guardians trading Emmanuel Clase. | ✗Context is required to answer the question. | |
Declaration of Dissent | ✗There is no title mentioned for the letter signed by 620 employees released on July 7, 2025, in the provided context. | ✗"Standing Up for Gamigo"
| ✗An Open Letter to the Board of Directors
| ✗The Pause Letter | ✗The title of the letter is not provided in the context. | ✗There is no context provided to answer the question. | |
Premature ejaculation is a sexual function concern, which certified sex therapists address. | ✓Certified sex therapists address: sexual function issues, sexual dissatisfaction, intimacy problems, sexual orientation concerns, and sexual trauma healing. | ✓Sexual concerns and relationship issues.
| ✓Sexual dysfunctions and other sexual concerns.
| ✓Certified sex therapists address concerns such as sexual function, sexual feelings, and intimacy for both individuals and couples. | ✓Certified sex therapists address concerns such as sexual dysfunction, intimacy issues, sexual orientation, desire discrepancies, and communication about sexual needs. | ✓Various concerns including erectile dysfunction, orgasmic disorders, low libido, sexual pain, and intimacy issues. | |
They argue that these laws violate the Constitution's Equal Protection Clause and Title IX. | ✓Violation of Title IX and Equal Protection Clause of 14th Amendment. | ✓Discrimination based on sex, violations of equal protection, and Title IX.
| ✓Title IX protects against sex-based discrimination, including gender identity.
| ✓Opponents argue that such bans violate Title IX’s prohibition of sex-based discrimination and the Equal Protection Clause of the Constitution by discriminating against transgender students. | ✓Opponents argue that such bans violate civil rights, are based on flawed science regarding gender identity, and that they discriminate against transgender individuals by denying them equal opportunities in sports. | ✗Context is required to provide an answer. | |
3:00 PM | ✗4:58 p.m. | ✓Context: "The House voted 227-203 to pass the American Health Care Act, which narrowly cleared the chamber at 3:16 p.m. ET"
Question: "What time was the House of Representatives vote on Trump's 'big, beautiful bill'?"
| ✗10:00 a.m.
| ✗2:24 p.m. | ✗10:51 PM | ✗Context is required to provide the answer. | |
Lamborghini | ✗The question asks about the type of car Diogo Jota and André Silva were driving during an accident, but the provided context contains no information about this incident. Without relevant context, I cannot determine what type of car they were driving. | ✗Context: "At the time, the player, who was accompanied by André Silva, was driving a BMW on the A5, in Carcavelos, when he was surprised by an accident."
Question: "What type of car were Diogo Jota and André Silva driving when they were involved in the accident?"
| ✗Porsche
| ✗Audi. | ✗Audi RS7 | ✓There is no context provided to answer the question. | |
high-velocity rounds | ✗He focused on how the weapon was used in the Marjory Stoneman Douglas High School shooting in Parkland, Florida. | ✗The AR-15 style rifle.
| ✗The AR-15's role in mass shootings.
| ✓The lethality of the AR-15 style rifle. | ✗The focus of Scott Pelley's 2018 report on the AR-15 style rifle was on its use in mass shootings and the debate surrounding gun control. | ✗The context is not provided, so I'm unable to answer the question. Please provide the relevant context. | |
to target a key Hamas operative | ✓The Israeli military claimed it struck the school because Hamas militants were operating from within the building. | ✓Context: "The Israeli military said it struck the school-turned-shelter because Hamas militants were using it as a base."
Question: "What was the Israeli military's stated reason for the strike on the school-turned-shelter?"
| ✓The military said the strike targeted Hamas fighters.
| ✓To target Hamas militants allegedly operating from inside the compound. | ✓The Israeli military stated the strike was targeting militants and a command post. | ✗The context is not provided, please provide the context to answer the question. | |
Tied for first in the NL West | ✓First place. | ✓Context: "The Mets, who spent 105 days in first place, are now in third"
Output: First place
| ✓Context: "The Mets were in first place in the NL East before their recent slump."
Question: "What was the Mets' position in the standings before their slump?"
First place in the NL East
| ✓First place | ✗The provided context does not contain the answer to the question. Please provide the relevant context for me to assist you. | ✗No context is provided to answer this question. | |
rough seas with waves taller than six feet | ✗No information is provided about a ferry rescue on July 3, 2025. | ✗Calm.
| ✓Rough
| ✗The context does not provide information about the sea conditions during the rescue of 31 people from the ferry on July 3, 2025. | ✓The sea conditions were rough during the rescue. | ✗There is no context provided to answer the question. | |
After the MMB was formed in 1991 | ✗1970 | ✓Context: "The Mosque Management Board of Masjid Al-Abdul Razak started offering religious classes for women in 1995, and kindergarten classes soon after."
Question: "When did the Mosque Management Board of Masjid Al-Abdul Razak begin offering religious classes for women?"
| ✗2002
| ✗1979 | ✗2002 | ✗That information is not provided in the given context, as there is no context. | |
2025 | ✓The question asks when Wimbledon first took place after Andy Murray's era, but Andy Murray is still active and his era hasn't ended yet. Murray continues to compete at Wimbledon, most recently in 2023. | ✗2017
| ✗2024
| ✗The Wimbledon Championships first took place after Andy Murray's era in 2023. | ✗2022 | ✗The context is not provided, however, I can provide an answer based on general knowledge.
Andy Murray's era can be considered to have started around 2005. The Wimbledon Championships have been held annually since 1877, so they first took place after Andy Murray's era is not applicable, but the first Wimbledon after his retirement is
2019 (as he announced his retirement in 2019, although he has since returned to the sport). | |
July 6, 2025 | ✗The U.S. men's national team is not playing Mexico in the Gold Cup final. | ✗Context: "Jordan Morris and Gyasi Zardes scored late goals to lift the United States to a 2-1 victory over Mexico in the 2017 Gold Cup final on July 26, 2017."
Question: "When will the U.S. men's national team play Mexico in the Gold Cup final?"
| ✗July 2, 2023
| ✗The U.S. men's national team will play Mexico in the Gold Cup final on August 1, 2021. | ✗The match date is not provided in the context. | ✗July 7, however the context was not provided. | |
During her brief interview on 2025-07-04, following her appearance at an East London hospital for the government's NHS plan launch | ✗In the House of Commons. | ✗I am sorry, I cannot answer this question using the provided information. | ✗In an interview.
| ✗A party meeting | ✗Her mother. | ✗The House of Commons | |
The Takeout | ✗CNN's "State of the Union" | ✗This question cannot be answered from the given context.
| ✗Fox News
| ✗CBS News' "Face the Nation" | ✗PBS NewsHour | ✗Face the Nation | |
Because he recently had a lung procedure | ✗Due to high blood pressure. | ✗According to Portuguese media, Diogo Jota was advised not to fly due to a knee problem.
| ✗Due to a hamstring injury.
| ✗He suffered a bruised rib. | ✓Due to a potential health risk. | ✗No context was provided to answer the question. |