Let p1,…, pJ denote the probability of a success for J independent random variables having a binomial distribution and let p(1) ≤ … ≤ p(J) denote these probabilities written in ascending order. The goal is to make a decision about which group has the largest probability of a success, p(J). Let p̂1,…, p̂J denote estimates of p1,…,pJ, respectively. The strategy is to test J − 1 hypotheses comparing the group with the largest estimate to each of the J − 1 remaining groups. For each of these J − 1 hypotheses that are rejected, decide that the group corresponding to the largest estimate has the larger probability of success. This approach has a power advantage over simply performing all pairwise comparisons. However, the more obvious methods for controlling the probability of one more Type I errors perform poorly for the situation at hand. A method for dealing with this is described and illustrated.
Wilcox, R. (2019). Identifying which of J independent binomial distributions has the largest probability of success. Journal of Modern Applied Statistical Methods, 18(2), eP3359. doi: 10.22237/jmasm/1604190960