Skip to main content

SAT Math · Problem-Solving and Data Analysis

SAT Evaluating Statistical Claims

These questions ask which conclusions a study supports. The key distinction is between observational studies and experiments with random assignment.

What to watch for

  • Only random assignment to groups supports a cause-and-effect conclusion.
  • Only random selection lets you generalize to a larger population.
  • Reject choices that claim more than the study design allows.

Worked examples

Example 1

A youth basketball league has 1,200 players. The league's board wanted to know whether players would rather play their games on Sundays instead of Saturdays. The board selected 8 players at random from the league's list of all players and asked each one. All 8 responded, and 6 of them said they would rather play on Sundays.

Which of the following is true about the survey?
  1. A.The sample is likely biased, because the players came only from the league, not from all young players in the region
  2. B.It shows that most of the league's 1,200 players would rather play on Sundays, because the 8 players were selected at random
  3. C.The results can be generalized to all young basketball players in the region, because every player who was selected responded
  4. D.A sample of 8 players is likely too small to give a reliable estimate for the league's 1,200 players, even though it was selected at random
Show the answer and explanation

Answer: D

Random selection prevents bias, but an estimate from very few people is unreliable. With only 8 of 1,200 players, chance alone could easily produce 6 of 8. The answer is A sample of 8 players is likely too small to give a reliable estimate for the league's 1,200 players, even though it was selected at random. Choice A is wrong because the league is the group of interest. Choice B ignores the tiny sample. Choice C reaches players outside the league.

Example 2

An agricultural office in Lowen County selected 150 farms at random from all the dairy farms in the county and asked whether each farm uses solar panels to produce electricity. All 150 farms responded, and 93 of them said they do. Lowen County also has hundreds of fruit farms and grain farms.

Which of the following inferences can appropriately be drawn from these results?
  1. A.Most of the farms in Lowen County, of every type, use solar panels
  2. B.Exactly 93 of the farms in Lowen County, of every type, use solar panels
  3. C.A majority of the dairy farms in Lowen County use solar panels to produce electricity
  4. D.No conclusion can be drawn about Lowen County's dairy farms, because only 150 of them were surveyed
Show the answer and explanation

Answer: C

A random sample of the county's dairy farms supports conclusions about those farms only. Since 93 of 150 is 62%, a majority is a sound estimate. The answer is A majority of the dairy farms in Lowen County use solar panels to produce electricity. Choice A adds fruit and grain farms, which were not sampled. Choice B treats the sample count as a count for every farm in the county. Choice D wrongly rejects a random sample of 150.

Practice evaluating statistical claims

More SAT evaluating statistical claims questions at every difficulty, with explanations in your language.