World / Knowledge
Google
Gemini 2.0 Flash-Lite
42/100
Google
Gemini 2.0 Flash
39/100
OpenAI
GPT-4.1
47/100
Questions & Answers
| Question | Correct Answer | Gemini 2.0 Flash | Gemini 2.0 Flash-Lite | GPT-4.1 |
|---|---|---|---|---|
Compass argues that Zillow's rule prevents them from advertising homes on other platforms before listing them on Zillow, hindering their ability to market properties effectively. | ✗Context: "Compass said that Zillow's new rule could impact its competitive strategies."
Output:
Could impact its competitive strategies.
| ✓Compass did not provide information about how Zillow's new rule impacts its competitive strategies.
| ✗It limits their options for competitive strategies. | |
their mother Kate's anti-medicine conspiracy theories | ✓According to Gabriel and Sebastian Shemirani, Paloma's decision regarding her cancer treatment was influenced by their opinions.
| ✗Their research.
| ✓Advice from their mother, Kate Shemirani | |
He displays it as one of the guiding principles in his office | ✓As a reminder of the importance of a collaborative environment.
| ✗The article doesn't state how Sam Presti uses the phrase "INFORM THE MUSIC."
| ✓He uses it to describe shaping the direction and culture of the team. | |
The Trump administration, through spokesperson Tricia McLaughlin | ✗The context required to answer the question was not provided.
| ✓The U.S. government.
| ✓A judge | |
Nearly five decades | ✓Context: "Iran has a long record of detaining foreigners and dual nationals on trumped-up charges, using them as bargaining chips with other nations."
Question: "For how long has Iran been using the detention of foreign and dual citizens as a diplomatic tool?"
| ✓Decades
| ✓Over four decades | |
His red card during the FIFA Club World Cup match against Wydad AC for a challenge on Samuel Obeng | ✗Context: "Lewis was initially given a one-match ban for his dismissal against Liverpool at the weekend."
| ✗For accumulating five yellow cards.
| ✗For abusing match officials | |
SCM U Craiova | ✗Context: "Daniel Emil-Luciano Dolenc (born 13 January 2000) is a Romanian professional basketball player who currently plays for CSM Târgu Jiu in the Romanian Liga Națională."
Question: "For which team in the Romanian Liga Națională did Daniel Emil-Luciano Dolenc play during the 2024-25 season?"
| ✗Context: "Daniel Emil-Luciano Dolenc (born 28 August 2003) is a Romanian professional basketball player for CSM Oradea of the Romanian Liga Națională."
Question: "For which team in the Romanian Liga Națională did Daniel Emil-Luciano Dolenc play during the 2024-25 season?"
CSM Oradea
| ✗Steaua București | |
Indirectly | ✗I need context to answer the question. Please provide the context.
| ✓While on the course.
| ✓The golfers were struck by lightning while on the golf course. | |
Los Angeles, California | ✓Context: "The Los Angeles Clippers are an American professional basketball team based in Los Angeles."
Question: "In what city are the Los Angeles Clippers based?"
| ✓Los Angeles
| ✓Los Angeles | |
Israeli strikes in Iran | ✗The attack on the Iranian consulate in Damascus.
| ✗The attack on the Iranian consulate in Damascus.
| ✗The Israeli airstrike on the Iranian consulate in Damascus. | |
Europa League | ✓Champions League
| ✓Champions League
| ✓The Europa League | |
New York City's increased police presence and security measures following the U.S. bombings in Iran | ✗A new program to combat elder fraud and scams.
| ✗The climate.
| ✗Governor Kathy Hochul's statement of June 22, 2025, addressed the attempted assassination of former President Donald Trump. | |
that they had agreed to a 'complete and total ceasefire' | ✗Context: "Asked about the possibility of a ceasefire between Iran and Israel, President Trump said, “We'll see what happens.”"
| ✗He did not say anything about a ceasefire between Iran and Israel.
| ✗The context needed to answer this question was not provided. Please supply the relevant context. | |
President Trump's June 23, 2025, announcement about a cease-fire agreement between Israel and Iran | ✗The timing of the explosion.
| ✗Details of the Hamas attack
| ✓The Israeli military spokesman declined to comment on reports of an Israeli strike. | |
It suggests that Kaiser Permanente is considered a major United States health insurer. | ✗Streamlines prior authorizations for healthcare providers and patients.
| ✓It signifies a broad industry effort to streamline prior authorization processes.
| ✓Kaiser Permanente’s participation signals broad industry commitment to streamlining the prior authorization process, aiming to reduce administrative burdens and improve patient care coordination alongside other major insurers. | |
Nearly half | ✗0.4 percent
| ✓Context: "In Q1, 56% of Compass's sellers used the first phase of its three-step marketing strategy."
Question: "What percentage of Compass's sellers used the first phase of their three-step marketing strategy in the first quarter?"
OUTPUT:
56%
| ✗80% | |
20% | ✓20%
| ✗30%
| ✓About 20% | |
They used their contacts to help New Yorkers seeking to evacuate and get home over the past week. | ✓Context: "As the city grappled with the immediate aftermath, the NYPD's international liaisons played a crucial role. They worked tirelessly to assist New Yorkers stranded abroad, providing guidance and support to navigate complex travel restrictions and return home safely."
| ✓They aided in the evacuation of foreign nationals.
| ✓They coordinated with local authorities abroad to assist New Yorkers in evacuating. | |
British champion | ✓Chief Secretary to the Treasury
| ✗Chief Secretary to the Treasury
| ✗The context needed to answer the question is missing. Please provide the context. | |
Checks for fuel spills and pollution | ✗Safety checks.
| ✗Tension checks.
| ✗Structural and watertight integrity checks were conducted. | |
It was his first wicket in whites since that date | ✓Context: "Archer made his comeback for Sussex's Second XI against Kent on 14 May 2021, taking the wicket of Jordan Cox for 19 in his first over."
| ✓His first wicket since July 2019.
| ✗It was Jofra Archer's 100th first-class wicket. | |
The conflict that began with Israel's airstrikes on June 13, 2025 | ✗I cannot answer in a succinct way, as the context of a broader deal with Iran is vast and complex.
| ✓President Trump pursued a broader deal with Iran after withdrawing from the Iran nuclear deal.
| ✗President Trump pursued a broader deal with Iran after withdrawing from the 2015 nuclear agreement, seeking to address not only Iran's nuclear program but also its ballistic missile activities and regional influence. | |
Stocks climbed | ✗The provided text does not contain the answer.
| ✓The provided context does not contain information about the impact of Iranian missile fire on the stock market.
| ✗There was a sharp decline in the stock market following Iran’s missile attack on Al Udeid Air Base on June 23, 2025. | |
Safety | ✓To determine the circumstances and causes of the sinking.
| ✓To determine the cause of the sinking.
| ✓To determine the causes of the sinking and make safety recommendations. | |
Iranian nuclear and military targets | ✗I am unable to answer as the context required to answer the question was not provided.
| ✓Military targets.
| ✓Iranian military bases and air defense systems | |
June 30, 2025 | ✗Context: "Iran launched a retaliatory missile strike on US military bases in Iraq on January 8."
Question: "When did Iran's retaliatory missile strike take place?"
| ✗January 15, 2024
| ✗April 13, 2024 | |
June 24, 2025 | ✗No information about Jofra Archer appealing loudly for a leg before wicket decision against Durham batsman Gay is provided in the context.
| ✗2018
| ✗During Archer's debut, when Durham batsman Gay had made 8 runs. | |
March 1, 2004 | ✗November 15, 2006
| ✗October 8, 2005
| ✓March 1, 2004 | |
2025-06-22 | ✗December 11, 2023
| ✗December 20, 2023
| ✗17 May 2024 | |
Before the June 24, 2025, attack | ✓Context: "On Friday, October 13, 2023, the U.S. and U.K. governments advised their citizens in Qatar to shelter in place amid heightened regional tensions."
Question: "When did the US and UK advise their citizens in Qatar to shelter in place?"
| ✗March 27, 2023
| ✗October 18, 2023 | |
After Elon Musk's acquisition in 2022 | ✓Context: "In December 2023, Shemirani's account was reinstated on X (formerly Twitter)."
December 2023
| ✓November 2022
| ✗October 2023 | |
1989 | ✗Context: "Turuda was nominally restored as a Latin titular bishopric in 1933."
| ✗1933
| ✗1933 | |
By 1872 | ✗1847
| ✗2004
| ✓1872 | |
This summer | ✓The provided text does not contain the answer to this question.
| ✗Not yet announced.
| ✗September 2024 | |
Al Udeid Air Base | ✓Context: "On May 21, 2017, President Trump visited Saudi Arabia and spoke about military purchases. After this visit, the Saudi government announced deals with the U.S. to purchase $110 billion in military equipment. On July 9, 2017, Qatar's ambassador to the U.S. announced Qatar's intent to purchase American military supplies, after President Trump's visit to Saudi Arabia."
Question: "Where did President Trump visit in Qatar and speak about Qatari purchases of American military supplies?"
| ✓Al Udeid Air Base
| ✓Al Udeid Air Base | |
2021-2025 | ✓All Mustang Mach-E models made between 2021 and 2024 are included in the recall.
| ✓2021-2022
| ✓All trims of the 2021–2022 Ford Mustang Mach-E are included in the recall. | |
Israel | ✗Context: "Israel has carried out airstrikes beginning on June 13 against Iranian nuclear and military targets."
Question: "Who carried out the airstrikes that began on June 13 against Iranian nuclear and military targets?"
| ✓The Israeli Air Force
| ✓Israel carried out the airstrikes. | |
To help increase screening uptake among women who have delayed their cervical screenings | ✓To increase screening rates.
| ✓To increase cervical screening rates.
| ✓To help increase the number of women screened for cervical cancer. | |
He had undergone Tommy John surgery | ✗Context: "Emmet Sheehan's return to the Los Angeles Dodgers earlier this week marked his first major league appearance since last season."
| ✗He was making his first start since April.
| ✓Emmet Sheehan's return was significant because he had missed the entire season due to injury and recently underwent Tommy John surgery, ruling him out until 2025. | |
Damage to the portrait of Ferdinando de' Medici | ✗Due to a climate activist protest.
| ✗Due to the discovery of a crack in the ceiling.
| ✗The exhibition at the Uffizi Gallery was temporarily closed due to overcrowding. |