This page offers structured overviews of one or more selected methods. Add additional methods for comparisons by clicking on the dropdown button in the righthand column. To practice with a specific method click the button at the bottom row of the table
Logistic regression
Spearman's rho
Chisquared test for the relationship between two categorical variables
$\rho_s = 0$
$\rho_s$ is the unknown Spearman correlation in the population.
In words:
there is no monotonic relationship between the two variables in the population
There is no association between the row and column variable
More precise statement:
If there are $I$ independent random samples of size $n_i$ from each of $I$ populations, defined by the independent variable: The distribution of the dependent variable is the same in each of the $I$ populations
If there is one random sample of size $N$ from the total population: The row and column variables are independent
Alternative hypothesis
Alternative hypothesis
Alternative hypothesis
Model chisquared test for the complete regression model:
not all population regression coefficients are 0
Wald test for individual $\beta_k$:
$\beta_k \neq 0$
or in terms of odds ratio:
$e^{\beta_k} \neq 1$
If defined as Wald $ = \dfrac{b_k}{SE_{b_k}}$ (see 'Test statistic'), also one sided alternatives can be tested:
right sided: $\beta_k > 0$
left sided: $\beta_k < 0$
Likelihood ratio chisquared test for individual $\beta_k$:
$\beta_k \neq 0$
or in terms of odds ratio:
$e^{\beta_k} \neq 1$
Two sided: $\rho_s \neq 0$
Right sided: $\rho_s > 0$
Left sided: $\rho_s < 0$
There is an association between the row and column variable More precise statement:
If there are $I$ independent random samples of size $n_i$ from each of $I$ populations, defined by the independent variable: The distribution of the dependent variable is not the same in all of the $I$ populations
If there is one random sample of size $N$ from the total population: The row and column variables are dependent
Assumptions
Assumptions
Assumptions
In the population, the relationship between the independent variables and the log odds $\ln (\frac{\pi_{y=1}}{1  \pi_{y=1}})$ is linear
The residuals are independent of one another
Often ignored additional assumption:
Variables are measured without error
Also pay attention to:
Multicollinearity
Outliers
Sample of pairs is a simple random sample from the population of pairs. That is, pairs are independent of one another
Note: this assumption is only important for the significance test, not for the correlation coefficient itself. The correlation coefficient itself just measures the strength of the monotonic relationship between two variables.
Sample size is large enough for $X^2$ to be approximately chisquared distributed under the null hypothesis. Rule of thumb:
2 $\times$ 2 table: all four expected cell counts are 5 or more
Larger than 2 $\times$ 2 tables: average of the expected cell counts is 5 or more, smallest expected cell count is 1 or more
There are $I$ independent simple random samples from each of $I$ populations defined by the independent variable, or there is one simple random sample from the total population
Test statistic
Test statistic
Test statistic
Model chisquared test for the complete regression model:
$X^2 = D_{null}  D_K = \mbox{null deviance}  \mbox{model deviance} $
$D_{null}$, the null deviance, is conceptually similar to the total variance of the dependent variable in OLS regression analysis. $D_K$, the model deviance, is conceptually similar to the residual variance in OLS regression analysis.
Wald test for individual $\beta_k$:
The wald statistic can be defined in two ways:
Wald $ = \dfrac{b_k^2}{SE^2_{b_k}}$
Wald $ = \dfrac{b_k}{SE_{b_k}}$
SPSS uses the first definition
Likelihood ratio chisquared test for individual $\beta_k$:
$X^2 = D_{K1}  D_K$
$D_{K1}$ is the model deviance, where independent variable $k$ is excluded from the model. $D_{K}$ is the model deviance, where independent variable $k$ is included in the model.
$t = \dfrac{r_s \times \sqrt{N  2}}{\sqrt{1  r_s^2}} $
where $r_s$ is the sample Spearman correlation and $N$ is the sample size. The sample Spearman correlation $r_s$ is equal to the Pearson correlation applied to the rank scores.
$X^2 = \sum{\frac{(\mbox{observed cell count}  \mbox{expected cell count})^2}{\mbox{expected cell count}}}$
where for each cell, the expected cell count = $\dfrac{\mbox{row total} \times \mbox{column total}}{\mbox{total sample size}}$, the observed cell count is the observed sample count in that same cell, and the sum is over all $I \times J$ cells
Sampling distribution of $X^2$ and of the Wald statistic if H0 were true
Find $p$ value corresponding to observed $X^2$ and check if it is equal to or smaller than $\alpha$
Waldtype approximate $C\%$ confidence interval for $\beta_k$
n.a.
n.a.
$b_k \pm z^* \times SE_{b_k}$
where $z^*$ is the value under the normal curve with the area $C / 100$ between $z^*$ and $z^*$ (e.g. $z^*$ = 1.96 for a 95% confidence interval)


Goodness of fit measure $R^2_L$
n.a.
n.a.
$R^2_L = \dfrac{D_{null}  D_K}{D_{null}}$
There are several other goodness of fit measures in logistic regression. In logistic regression, there is no single agreed upon measure of goodness of fit.


Example context
Example context
Example context
Can body mass index, stress level, and gender predict whether people get diagnosed with diabetes?
Is there a monotonic relationship between physical health and mental health?
Is there an association between economic class and gender? Is the distribution of economic class different between men and women?
SPSS
SPSS
SPSS
Analyze > Regression > Binary Logistic...
Put your dependent variable in the box below Dependent and your independent (predictor) variables in the box below Covariate(s)
Analyze > Correlate > Bivariate...
Put your two variables in the box below Variables
Under Correlation Coefficients, select Spearman
Analyze > Descriptive Statistics > Crosstabs...
Put one of your two categorical variables in the box below Row(s), and the other categorical variable in the box below Column(s)
Click the Statistics... button, and click on the square in front of Chisquare
Continue and click OK
Jamovi
Jamovi
Jamovi
Regression > 2 Outcomes  Binomial
Put your dependent variable in the box below Dependent Variable and your independent variables of interval/ratio level in the box below Covariates
If you also have code (dummy) variables as independent variables, you can put these in the box below Covariates as well
Instead of transforming your categorical independent variable(s) into code variables, you can also put the untransformed categorical independent variables in the box below Factors. Jamovi will then make the code variables for you 'behind the scenes'
Regression > Correlation Matrix
Put your two variables in the white box at the right
Under Correlation Coefficients, select Spearman
Under Hypothesis, select your alternative hypothesis
Frequencies > Independent Samples  $\chi^2$ test of association
Put one of your two categorical variables in the box below Rows, and the other categorical variable in the box below Columns