Quiz (Chapter 8)

Effect Size, Power, CIs, and Bonferroni

The Seven-Step Version of Hypothesis Testing
1. The last step of the 7-step version of hypothesis testing involves determining whether Ho is true.
2.  True False
3. A result that's statistically significant can be completely devoid of any practical significance.
4.  True False
5. The "yardstick" that's used to measure practical significance is called
6.  actual significance credibility effect size importance
7. Look at Excerpts 8.3, 8.4, 8.5, and 8.6. In these excerpts, what 4 letters were used to represent measures of effect size?
8.  e, n, u, and W r, d, f, and V
9. Effect size can be measured numerically.
10.  True False
11. What three words do researchers use to describe the 3 different "sizes" of effect size?
12.  small, medium, large tiny, so-so, gigantic trivial, moderate, impressive worthless, typical, outstanding
13. If a researcher stated that his/her statistical test had a power of .90, this would mean that there is a 90% of what occurring?
14.  Reaching a "reject" decision when the null hypothesis is true. Reaching a "fail-to-reject" decision when the null hypothesis is true. Reaching a "reject" decision when the null hypothesis is false. Reaching a "fail-to-reject" decision when the null hypothesis is false.
15. In a post hoc power analysis, is the effect size is computed by the researcher or is it chosen by him/her?
16.  Computed Chosen
17. If Ho is not rejected but statistical power is quite high, would the chances of a Type II error be high or low?
18.  High Low
The Nine-Step Version of Hypothesis Testing
1. How many steps of the 6-step version of hypothesis testing appear in the 9-step version of hypothesis testing?
2.  3 of them 4 of them 5 of them All 6
3. In the 9-step version of hypothesis testing, the researcher specifies ES after analyzing the sample data.
4.  True False
5. In the 9-step version of hypothesis testing, the sample data are analyzed before a power level is specified.
6.  True False
7. Of the 2 kinds of effect size measures ("standardized" or "raw"), which one is better?
8.  Standardized Raw Either is as good as the other
9. The needed sample size for a study cannot be determined unless both ES & power are specified first.
10.  True False
11. In Excerpt 8.9, if the n had been 50, the power would have been ___ (higher/lower) than .8.
12.  lower higher
13. In Excerpt 8.10, which kind of effect size was used, standardized or raw?
14.  Standardized Raw
15. There is general agreement that power should be no lower than ___ .
16.  .05 .50 .80 .90 .95
17. If a researcher reaches a fail-to-reject decision at the end of the 9-step version of hypothesis testing, a critic cannot legitimately argue that a Type II error was made because the test was too insensitive.
18.  True False
Hypothesis Testing Using Confidence Intervals
1. When hypothesis testing is conducted via one or more confidence intervals, there's no Ho or Ha.
2.  True False
3. If a 95% confidence interval is used when doing hypothesis testing, what is the level of significance?
4.  .05 .95 Any value the researcher wants, but it must be lower than .95. Any value the researcher wants, but it must be higher than .95.
5. If a researcher has a sample with data on two variables, if r = +.40, and if a 95% confidence interval around r extends from +.20 to +.57, should Ho be rejected if Ho: r = 0 (and Ha: r  0)?
6.  Yes No
7. In Excerpt 8.14, is the number .80 indicating statistical power?
8.  Yes No
9. If, in Excerpt 8.15, 40% of the people in the supervised group had improved, the result might have been a nonsignificant difference between the two groups.
10.  True False
Adjusting for an Inflated Type I Error Rate
1. A Type I error is made when a researcher fails-to-reject a null hypothesis that's really false.
2.  True False
3. If you blindly select 1 card from a single well-shuffled deck of cards, the probability that your card will be a "club" is .25 (i.e., 1 out of 4).  Instead of doing that, suppose you blindly select a single card from each of 3 well-shuffled decks of cards.  Here, the probability that you'll end up with at least one club in your set of 3 cards is:
4.  .25 less than .25 more than .25
5. Do the terms "heightened probability of Type I error" & "inflated Type I error risk" mean the same thing?
6.  Yes No
7. Would the Bonferroni adjustment technique ever be used in a study involving a single null hypothesis?
8.  Yes No
9. In Excerpt 8.19, the p-level of .017 would have been ___ if there had been 2 comparisons (rather than 3 comparisons).
10.  .17 .05 .02 .025
11. When the Bonferroni adjustment technique is used, critical values become ____ demanding.
12.  more less
13. Researchers sometimes use the "_____ modification" rather than the Bonferroni adjustment technique.
14.  Cohen-Dunn Cohen-Sidak Dunn-Sidak
A Few Cautions
1. The notion of an "effect size" (in the 7-step version of hypothesis testing) is exactly the same as the notion of an "effect size" (in the 9-step version of hypothesis testing).
2.  True False
3. The numerical criteria for "small," "medium," and "large" effects remain the same regardless of the statistical focus or the kind of ES that's computed.
4.  True False
5. The 6-step version of hypothesis testing fails completely to address the distinction between statistical significance and practical significance.
6.  True False
7. If 21 null hypotheses are tested, each at a=.05, and if Ho is true in each and every one of the 21 cases, would it be smart to bet that one or more Type I errors will be made among the 21 tests.
8.  Yes No
Two Questions that are Supposed to be a Bit Challenging
1. If all bivariate correlations are computed among 5 variables, and if each r is tested to see of it is significantly different from 0, what Bonferroni-corrected alpha level should be used if the researcher desires to have a 5% chance of one or more Type I errors occurring?
2.  .05 .01 .005
3. Suppose 2 researchers (Mary & Larry) each secretly pull a sample from the same giant population.  They both measure their subjects on the same 2 variables (X & Y), they both test Ho: r = 0, they both conduct a 2-tailed test, and they both set a= .05.  If Mary uses 5,000 subjects while Larry uses only 50, will Mary's Type I Error rate be "inflated" as compared to Larry's?
4.  Yes No

 Copyright © 2012 Schuyler W. Huck All rights reserved. | Book Info | Author Info | Site URL: www.readingstats.com Top | Site Map Site Design: John W. Taylor V