One Factor Multivariate Repeated Measures

Using Hotelling’s Test

Hotelling’s Test can be used instead of a One Factor Repeated Measures ANOVA, especially when the sphericity assumption doesn’t hold. We illustrate the approach by repeating Example 1 of  One Factor Repeated Measures ANOVA.

Example 1: A program has been developed to reduce the levels of stress for working women. In order to determine whether the program is successful a sample of 15 women was selected and their level of stress was measured (low scores indicate higher levels of stress) before the program, as well as 1, 2 and 3 weeks after the beginning of the program. Based on the data in Figure 1 (range G5:K20) determine whether the program is effective in reducing stress.

Repeated measures data multivariate

Figure 1 – One factor repeated measures data

The approach we use is to test whether the differences between the data in the successive columns of Figure 1 all have a mean of zero. Relabeling Before as W0 and the other timeframes as W1, W2 and W3 we obtain the data in range H3:J18 of Figure 2. E.g. entering the formula =C4-B4 in cell H4 of Figure 2, highlighting range H4:J18 and pressing Ctrl-D and then Ctrl-R fills out the data in range H4:J18.

Repeated measures T-square

Figure 2 – One Factor Repeated Measures test using Hotelling’s Test

We now perform a one-sample T-square test using the formula


The result is shown in range N6:O10. Since p-value = 6.53E-06 < .05 = α, we reject the null hypothesis that Columns H, I and J all have mean zero. But this null hypothesis is equivalent to the mean of W0 is equal to the mean of W1 and the mean of W1 is equal to the mean of W2 and the mean of W2 is equal to the mean of W3, which in turn signifies that W0, W1, W2 and W3 all have the same mean. Our result rejects this hypothesis.

Using Real Statistics Capabilities

We can also use some Real Statistics capabilities to carry out this test directly.

Real Statistics Function: The Real Statistics Resource pack contains the following array function:

T2_RepeatedMeasures(R1, lab) = a 5 × 1 column range with values T-square, df1, df2, F and p-value for Hotelling T-square test for repeated measures design based on the data in R1 (w/o headings) if lab = FALSE (default). If lab = TRUE then the output is instead a 5 × 2 range whose first column contains labels.

If we place the formula =T2RepeatedMeasures(H4:J18,TRUE) in range N6:O10 and press Ctrl-Shft-Enter the output is as shown in Figure 3.

Real Statistics Data Analysis Tool: The Hotelling’s T-square data analysis tool contains an option for carrying out the repeated measures test described above.

For Example 1, press Ctrl-m and double click on Multivariate Analyses option. From the dialog box that appears select the Hotelling’s T-square option and click on the OK button. Now fill in the fields in the dialog box that appears as shown in Figure 3 and click on the OK button.

Hotelling dialog box

Figure 3 – Hotelling’s T-square test dialog box

The output is as range N3:O10 of Figure 2.

Observation: If the data for Example 1 only contained two data columns, then the approaches described in this section will not work properly. In this case you would simply need to use a t-test with paired samples (or the Wilcoxon Signed Rank non-parametric test).

6 Responses to One Factor Multivariate Repeated Measures

  1. Roger says:

    In the above paragraph (Observation:) you mention the Whitney Signed Rank test. But, in the list of non-parametric methods, there is the Mann-Whitney test or the Wilcoxon Signed-Rank test, but no Whitney Signed Rank test. Which do you mean?

    • Charles says:

      Thanks for pointing this out. It should say “Wilcoxon” instead of “Whitney”. I have now changed this.

  2. Jeff says:

    Is this statement correct … “The result is shown in range N6:O10. Since p-value = 6.53E-06 < .05 = α, we conclude that there is no reason to reject the null hypothesis that Columns H, I and J all have mean zero." Give a p-value < 0.001 wouldn't we reject the null hypothesis.

    • Charles says:

      The statement is wrong. It should say that we reject the null hypothesis. I have just corrected this on the webpage.
      Thank you very much for catching this error. I really appreciate your help, especially since this error would really confuse a lot of readers.

  3. Jay says:

    Hi! How do we analyze if we add another dependent variable measured four times also, say, in addition to stress levels, we also measure hours of sleep. Do we have a way to test for significant difference simultaneously? I thought that was the repeated-measures manova whereby there are more than one dependent variable each measured several times. Thank you very much!

Leave a Reply

Your email address will not be published. Required fields are marked *