Cochran's Q test: overview
This page offers structured overviews of one or more selected methods. Add additional methods for comparisons by clicking on the dropdown button in the righthand column. To practice with a specific method click the button at the bottom row of the table
Cochran's Q test 


Independent variable  
One within subject factor ($\geq 2$ related groups)  
Dependent variable  
One categorical with 2 independent groups  
Null hypothesis  
$\pi_1 = \pi_2 = \ldots = \pi_I$
$\pi_1$ is the population proportion of 'successes' in group 1; $\pi_2$ is the population proportion of 'successes' in group 2; $\pi_I$ is the population proportion of 'successes' in group $I$  
Alternative hypothesis  
Not all population proportions are equal  
Assumptions  
Sample of 'blocks' (usually the subjects) is a simple random sample from the population. That is, blocks are independent of one another  
Test statistic  
If a failure is scored as 0 and a success is scored as 1:
$Q = k(k  1) \dfrac{\sum_{groups} \Big (\mbox{group total}  \frac{\mbox{grand total}}{k} \Big)^2}{\sum_{blocks} \mbox{block total} \times (k  \mbox{block total})}$ Here $k$ is the number of related groups (usually the number of repeated measurements), a group total is the sum of the scores in a group, a block total is the sum of the scores in a block (usually a subject), and the grand total is the sum of all the scores. Before computing $Q$, first exclude blocks with equal scores in all $k$ groups  
Sampling distribution of $Q$ if H0 were true  
If the number of blocks (usually the number of subjects) is large, approximately the chisquared distribution with $k  1$ degrees of freedom  
Significant?  
If the number of blocks is large, the table with critical $X^2$ values can be used. If we denote $X^2 = Q$:
 
Equivalent to  
Friedman test, with a categorical dependent variable consisting of two independent groups  
Example context  
Subjects perform three different tasks, which they can either perform correctly or incorrectly. Is there a difference in task performance between the three different tasks?  
SPSS  
Analyze > Nonparametric Tests > Legacy Dialogs > K Related Samples...
 
Jamovi  
Jamovi does not have a specific option for the Cochran's Q test. However, you can do the Friedman test instead. The $p$ value resulting from this Friedman test is equivalent to the $p$ value that would have resulted from the Cochran's Q test. Go to:
ANOVA > Repeated Measures ANOVA  Friedman
 
Practice questions  