Cronbach’s Alpha

One problem with the split-half method is that the reliability estimate obtained using any random split of the items is likely to differ from that obtained using another. One solution to this problem is to compute the Spearman-Brown corrected split-half reliability coefficient for every one of the possible split-halves and then find the mean of those coefficients.  This is the motivation for Cronbach’s alpha.

Cronbach’s alpha is superior to Kuder and Richardson Formula 20 since it can be used with continuous and non-dichotomous data. In particular, it can be used for testing with partial credit and for questionnaires using a Likert scale.

Definition 1: Given variable x1, …, xk and x0 = \sum\nolimits_{j=1}^k x_k and  Cronbach’s alpha is defined to be

Cronbachs alpha formula

Property 1: Let xj = tj + ej where each ej is independent of tj and all the ej are independent of each other. Also let x0 = \sum\nolimits_{j=1}^k x_k and t0 = \sum\nolimits_{j=1}^k t_k. Then the reliability of x0α where α is Cronbach’s alpha.

Here we view the xj as the measured values, the tj as the true values and the ej as the measurement error values. Click here for a proof of Property 1.

Observation: Cronbach’s alpha provides a useful lower bound on reliability (as seen in Property 1). Cronbach’s alpha will generally increase when the correlations between the items increase. For this reason the coefficient measures the internal consistency of the test. Its maximum value is 1, and usually its minimum is 0, although it can be negative (see below).

A commonly-accepted rule of thumb is that an alpha of 0.7 (some say 0.6) indicates acceptable reliability and 0.8 or higher indicates good reliability. Very high reliability (0.95 or higher) is not necessarily desirable, as this indicates that the items may be entirely redundant. These are only guidelines and the actual value of Cronbach’s alpha will depend on many things. E.g. as the number of items increases, Cronbach’s alpha tends to increase too even without any increase in internal consistency.

The goal in designing a reliable instrument is for scores on similar items to be related (internally consistent), but for each to contribute some unique information as well.

Observation: There are an number reasons why Cronbach’s alpha could be low or even negative even for a perfectly valid test. Two such reasons are reverse coding and multiple factors.

Reverse coding: Suppose you use a Likert scale of 1 to 7 with 1 meaning strongly disagree and 7 meaning strongly agree. Suppose two of your questions are: Q1: “I like pizza” and Q20: “I dislike pizza”. These questions ask the same thing, but with reverse wording. In order to apply Cronbach’s alpha properly you need to reverse the scoring of any negatively phrased question, Q20 in our example. Thus if a response to Q20 is say 2, it needs to be scored as 6 instead of 2 (i.e. 8 minus the recorded score).

Multiple factors: Cronbach’s alpha is useful where all the questions are testing more or less the same thing, called a “factor”. If there are multiple factors then you need to determine which questions are testing which factors. If say there are 3 factors (e.g. happiness with your job, happiness with your marriage and happiness with yourself), then you need to split the questionnaire/test into three tests, one containing the questions testing factor 1, one with the questions testing factor 2 and the third with questions testing factor 3. You then calculate Cronbach’s alpha for each of the three tests. The process of determining these “hidden” factors and splitting the test by factor is called Factor Analysis (see Factor Analysis).

Example 1: Calculate Cronbach’s alpha for the data in Example 1 of Kuder and Richardson Formula 20 (repeated in Figure 1 below).

Cronbachs alpha Excel

Figure 1 – Cronbach’s Alpha for Example 1

The worksheet in Figure 1 is very similar to the worksheet in Figure 1 of Kuder and Richardson Formula 20. Row 17 contains the variance for each of the questions. E.g. the variance for question 1 (cell B17) is calculated by the formula =VARP(B4:B15). Other key formulas used to calculate Cronbach’s alpha in Figure 1 are described in Figure 2.

Formulas Cronbachs alpha

Figure 2 – Key formulas for the worksheet in Figure 1

Since the questions only have two answers, Cronbach’s alpha .73082 We see that this is the same as the We see that this is the same as the KR20 reliability calculated for Example 1 of Kuder and Richardson Formula 20.

Observation: If the variances of the xj vary widely, the xj can be standardized to obtain a standard deviation of 1 prior to calculating Cronbach’s alpha.

Observation: To determine how each question on a test impacts the reliability, Cronbach’s alpha can be calculated after deleting the ith variable, for each i ≤ k. Thus for a test with k questions, each with score xj, Cronbach’s alpha is calculated for x^*_i for all i where x^*_i = \sum\nolimits_{j \neq i} x_j.

If the reliability coefficient increases after an item is deleted, you can assume that the item is not highly correlated with the other items. Conversely, if the reliability coefficient decreases, you can assume that the item is highly correlated with the other items.

Example 2: Calculate Cronbach’s alpha for the survey in Example 1, where any one question is removed.

The necessary calculations are displayed in Figure 3.

Cronbachs alpha delete one

Figure 3 – Cronbach’s Alpha for Example 2

Each of the columns B through L represents the test with one question removed. Column B corresponds to question #1, column C corresponds to question #2, etc. Figure 4 displays the formulas corresponding to question #1 (i.e. column B); the formulas for the other questions are similar. Some of the references are to cells shown in Figure 2.

Formulas for Cronbachs alphaFigure 4 – Key formulas for worksheet in Figure 3

As can be seen from Figure 3, the omission of any single question doesn’t change the Cronbach’s alpha very much. Removal of Q8 affects the result the most.

Observation: Another way to calculate Cronbach’s alpha is to use the Two Factor ANOVA without Replication data analysis tool on the raw data and note that:

Cronbachs alpha ANOVA

Example 3: Calculate the Cronbach’s alpha for Example 1 using ANOVA.

We begin by running Excel’s Anova: Two Factor without Replication data analysis tool using the data in range B4:L15 of the worksheet shown in Figure 1.

Cronbachs alpha Excel ANOVA

Figure 5 – Calculation of Cronbach’s alpha using ANOVA

As you can see from Figure 5, Cronbach’s alpha is .73802, the same value calculated in Figure 1.

Observation: Alternatively, we could use the Real Statistics Two Factor ANOVA data analysis tool, setting the Number of Rows per Sample to 1. We can also obtain the same result using the following supplemental function.

Real Statistics Function: The following function is provided in the Real Statistics Resource Pack:

 CRONALPHA(R1) = Cronbach’s alpha for the data in range R1

As noted above, for the data in Figure 1, CRONALPHA(B4:L15) = .738019.

Example 4: Calculate Cronbach’s alpha for a 10 question questionnaire with Likert scores between 1 and 7 based on the 15 person sample shown in Figure 6.

Cronbachs alpha Likert Excel

Figure 6 – Calculation of Cronbach’s alpha for Example 4

As you can see from Figure 6, Cronbach’s alpha is 0.59172, a little below the generally acceptable range. We get the same answer by using the supplemental formula in the Real Statistics Resource Pack, namely CRONALPHA(B4:K18) = 0.59172.

81 Responses to Cronbach’s Alpha

  1. jeena says:

    the test contains 18 questions in which 12 mcq’s,5 two marks questions and 1 three marks questions ,how can i calculate alpha coefficient

    • Charles says:

      Hi Jeena,
      I believe that for each question you simply score 1 for a correct answer and 0 for an incorrect answer, whether the multiple choice question has 2,3 or 4 choices. Then follow the procedure described in Example 1 or Example 3 on webpage http://www.real-statistics.com/reliability/cronbachs-alpha/. You can also use the supplemental formula CRONALPHA provided in the Real Statistics Resource Pack.
      Charles

      • Hammad Anjum says:

        Dear Charles,
        as if you have different parts of questionnaire e.g. Yes, No and with 5 scale options.. So would there be two separate evaluations of C Alpha or may i find the one single value as well for both segregated portions of questionnaire ?

        • Charles says:

          Dear Hammad,
          Are you saying that if they answer Yes they have to evaluate something on the scale of 1 to 5, while if they say No they have a separate evaluation also using a scale of 1 to 5?
          Charles

  2. Mary Ann says:

    how can i calculate five point scale survey in excel and get the cronbach alpha??? its quite confusing.

    • Charles says:

      Mary Ann,
      Enter your data as in Example 4 on http://www.real-statistics.com/reliability/cronbachs-alpha/. The example shows what to do for a seven point scale, but a five point scale works exactly the same. Then carry out the calculations as in Figure 6 on the same webpage or simply use CRONALPHA(R1) where R1 is the the range containing your data (without headings). CRONALPHA is a supplemental function which is contained in the Real Statistics Resource Pack.
      Charles

  3. alberto rivas says:

    Thank you, Sir. It´s a great example. it contains all that I have searched. ¿Aren´t you teacher?

  4. Krsna says:

    Hi. I got negative cronbach alpha which made it unacceptable but the questions are just right and fit to my study. What should I do? Thank you for your response. God bless.

    • Charles says:

      Hi Krsna,

      There are an number reasons for getting a low (or even negative) value for cronbach’s alpha for a perfectly valid test. Two reasons are reverse coding and multiple factors.

      Reverse coding: Suppose you use a Likert scale of 1 to 7 with 1 meaning strongly disagree and 7 meaning strongly agree. Suppose two of your questions are: Q1: I like pizza and Q20: I dislike pizza. These questions ask the same thing, but with reverse scoring. In order to apply Cronbach’s alpha properly you need to reverse the scoring of the negatively phrased question, Q20. Thus if a response to Q20 is say 2, it needs to be scored as 6 instead of 2 (i.e. 8 minus the score).

      Multiple factors: Cronbach’s alpha is useful where all the questions are testing more or less the same thing, called a “factor”. If there are multiple factors then you need to determine which questions are testing which factors. If say there are 3 factors, then you need to split the questionnaire/test into three tests, one containing the questions testing factor 1, one with the questions testing factor 2 and the third with questions testing factor 3. You then calculate cronbach’s alpha for each of the three tests. The process of determining these “hidden” factors and splitting the test by factor is called Factor Analysis. See the webpage http://www.real-statistics.com/multivariate-statistics/factor-analysis/ for more details about how to do this in Excel using Real Statistics.

      Charles

  5. sivapriyagirish says:

    this method was very helpful for an average student like me,thank you very much…

  6. Dalia says:

    Hi,
    Thank you for the great explanation.
    My work includes using a 5 point scale by 2 separate groups of raters (trained Vs untrained in that field). Each group will rate 20 different cases.
    My questions are:
    1- Do I need to use Cronbach’s alpha for each case separately (20 cases x 2 groups) (i.e. 40 times)?
    2- How can I assess the consistency within each group for all the cases collectively?
    3- How can I know if there is a significant difference between the 2 groups for all the cases collectively?

    Apologies for the long questions, but I really appreciate your help.

    Best regards,
    Dalia

    • Charles says:

      Hi Dalla,
      From what you have described I have the following suggestions:
      1. to assess the agreement/disagreement between the two raters you probably want to use something like Cohen’s kappa
      2. to assess the consistency within each of the two groups you can use Cronbach’s alpha
      3. to assess whether there is a significant difference between the two groups you can use either a t test or Mann-Whitney
      All of these tests are described on the Real Statistics website and the Real Statistics Resource Pack can be used to carry out each of these tests.
      Charles

  7. Mukesh says:

    Hi,

    I have approximately 200 respondense, could you please let me know how to ho about getting the results of the Cronbach test. Do I have to enter a figure for each respondent to a question?

    Thanks,
    MC.

    • Charles says:

      Mukesh,
      If you have say 200 people taking the test and each test has 20 questions, then you would create a range similar to that in Figure 1 with 200 rows and 20 columns. You need to enter a figure to each question.
      Charles

  8. Jonathan says:

    Great site. Thank you.

    I am looking for simple consistencies within a singular column of measured data, to see how volatile it is. I tried to use your CRONALPHA function to simply analyze one column of data of designated cells, and am getting the “#VALUE” response.

    Am I missing something? Thanks much.

    Jonathan

    • Charles says:

      Jonathan,
      Cronbach’s alpha is not designed to do what you want. There is no internal consistency to measure when only have one response per subject. To use CRONALPHA you need at least two columns.
      Charles

      • Jonathan says:

        Thank you Charles.

        Perhaps I am asking the wrong question. Let’s say I have 120 responses from one subject over time, and what I am trying to do is to look at the consistency and repeatability of the answers from that subject. In other words, I want to see if the data, once I reach a certain point, has a stability to it. While I could do an even-odd correlation from the set, 1st-half / 2nd-half, or something like that, that introduces the limitations you discuss.

        Is there something that considers the stability of a great number of data from one subject alone, to look at stability purposes? Thanks very much for a great site.

  9. Mabel says:

    If I have a 2 group study and want to conduct a cronbach alpha test, do I have to separate it into 2 groups?

    • Charles says:

      Mabel,
      It really depends on what you want to study. E.g. if the groups are just a random split of the sample you could use the split-half method instead of Cronbach’s alpha to measure reliability.
      Charles

  10. Krsna says:

    Thank you Charles. Your response is highly appreciated. My apology for this late reply. God bless.

  11. Vien says:

    Do you have a reference for this”A commonly-accepted rule of thumb is that an alpha of 0.6-0.7 indicates acceptable reliability”? Thank you very much!

    • Charles says:

      Vien,

      I believe that I got this from the following reference (this is also referenced in Wikipedia)

      Ref 1: Kline, P. (2000). The handbook of psychological testing (2nd ed.). London: Routledge, page 13

      I have generally seen that .7 is viewed as the minimum acceptable level. Here is such a reference.

      Ref 2: George, D., & Mallery, P. (2003). SPSS for Windows step by step: A simple guide and
      reference. 11.0 update (4th ed.). Boston: Allyn & Bacon. p. 231

      The rules of thumb there are:
      > .9 – Excellent, _ > .8 – Good, _ > .7 – Acceptable, _ > .6 – Questionable, _ > .5 – Poor, and < .5 – Unacceptable

      Here is yet another example where .6 is used as the minimal acceptable level.

      Ref 3: "Cronbach’s alpha (Cronbach, 1951) which quantifies the degree of internal consistency (reliability) of a set of items, was calculated for each subscale, as well as the overall scale. In general, a Cronbach’s alpha of at least .7 is the criterion used to establish an acceptable level of reliability. However, the recommended minimum Cronbach’s alpha for exploratory studies is .6" (Nunnally, J.C. (1978). Psychometric Theory (2nd ed.). New York: McGraw Hill; Robinson, J. P., Shaver, P. R., & Wrightsman, L. S. (Eds.). (1991). Measures of personality an social psychological attitudes. San Diego: Academic Press).

  12. hadia says:

    I’m not a student of mathematics. I am leading a research in applied linguistics and I need to calculate a result using Cronbach alpha. I asked my students about the extent to which they became autonomous after introducing language learning strategies on a five-graded Likert scale with scores from 1 to 5. However, I didn’t know how to calculate. On the vertical column, I have to mention the respondents (students) and on the horizontal line, I have only one question (so one item??). Could I calculate alpha with only one column?
    I am seeking guidance and I would be very grateful if you could help me.
    Thank you.

    • Charles says:

      Hadia,
      You can’t measure consistency between the items (which is what Cronbach’s alpha does) since you only have one item. You need more than one item to use Cronbach’s alpha. My question to you is why do you want to use Cronbach’s alpha? What are you trying to demonstrate?
      Charles

    • Enriching information.Kudos

  13. Karen says:

    Hi,
    I’m using a sample of 40 and I have 2 sets of questions, one with 9 and the other with 10 questions. I’ve calculated the alpha for both using the formula as you explained and then using the Real Statistics toolpack. I’m getting different alphas when I use the two methods with the toolpack function giving an alpha higher by around 0.08. Why is that?

  14. krisliz says:

    how did you get the var in example 4. i just don’t get it how it can be computed. is there a formula needed?

  15. Colleen Royle says:

    Hello,
    I am using an instrument that has been previously tested for reliability with a Cronbach Alpha of .91 and .93 for overall instrument (there are two variables being tested). The instrument has four subscales and each subscale has a Cronbach Alpha number of >.61 (three subscales are in the .80 range). I used the same instrument and tested Cronbach Alpha and received an overall number of .87 and .86. All of my subscales are substantially lower than the original testing by the instrument author. How do I explain that? We used a similar population. Her study was larger with 64 participants and mine had 40.
    Thank you.
    Colleen

    • Charles says:

      Colleen,
      A few reasons why your alpha values may differ are: population not really the same as that for the original instrument, randomness (you say that your values were substantially lower, but it may turn out that the difference is not statistically significant), differences in the way the test was administrated(e.g. a noisy environment, people under stress, etc.).
      Charles

  16. Dianna says:

    Hello,

    I am having trouble with measures that has items with reverse coding. When I calculate the data with reverse coding, the Cronbach’s Alpha is very low (.2), however when I calculate the Cronbach’s Alpha without using the reverse coding, it is very high (.9). I am wondering if you know why that happens, and what I should do?

    • Charles says:

      Dianna,
      It is hard for me to tell without seeing the data, but I can think of the following possibilities:
      - the questions that you have identified as reverse coded are not really reverse coded
      - there is an error in the coding or calculation
      - reliability is low (not sure why alpha would be high if reverse coding is not done)
      Charles

  17. Zargoon says:

    Regarding example number 3, I have performed Anova: Two Factor without Replication in Excel, but could not see Alpha value as it has been shown in Figure 5 above.

    • Charles says:

      Zargoon,
      I just rechecked and I believe it is correct. Please make sure you analyzed the data from Example 1 (0′s and 1′s only) and not from Example 2.
      Charles

  18. colene says:

    Hi there – hopefully you can answer me :)

    I would like to run a Cronbachs alfa test (or similar if you have an alteriour suggestion) to include it in my reliability part. (using SPSS)

    I have a mixture of variables – Nominal, Ordinal and scale.
    Which have a whole range of diferent ranges in values. Some variables have 0-1, others have 1-5, while others go from 0-14000. None are similiarly kategorized. Like, sex is a 0-1. Work hours range pr week from 0-30. A satisfactory question ranges from 1-5, rent payed ranges from 500- 13000… etc..

    I’ve kategorized rent, and when I lump them all togheter in SPSS – Cronbachs alfa I get a Cronbachs Alfa of around ,500.

    BUT – I have a feeling this is quite pointless? Because of the state of the values – is this so, is Cronbachs Alfa usless – how would I explain that I can’t use Cronbachs Alfa? My corriculum states that it is restricted to indexes – But I can’t quite understand what this means by “indexes”. Certainly we have an index of questions that all aim to answer an underlying question – but it’s not an index where all numbers are grouped simillarilly – so i am unsure what it means… Can’t I use it ? :)

    • Charles says:

      Colene,

      I have read a lot of conflicting information regarding the subject you are raising and so I don’t have a precise answer for you. My understanding is that Cronbach’s alpha is most relevant when the test is evaluating a single “factor”. You can certainly calculate Cronbach’s alpha even if the questionnaire contains a mix of multiple choice, true-false and other types of questions. What I would be especially cautious about is when the test is performing different types of evaluations (e.g. Likert scale to assess your satisfaction with a product plus multiple choice to assess your ability to use the product). You definitely need to calculate separate Cronbach alpha for each concept/factor that you are testing.

      I’m nor sure what your curriculum means by “indexes”. Cronbach’s alpha itself can be used as an index, but it doesn’t sound like this is what is meant.

      The following are a couple of articles on the web that may give you further information (although they may confuse things even more). I suggest that you speak to your professor to get further insights from him/her. Please share with the rest of us any insights you glean.

      http://www.ctbassessments.com/assessment_insights/february_2011/research_insights.html
      http://psychweb.psy.umt.edu/denis/datadecision/front/cortina_alpha.pdf

      Charles

  19. James Selby says:

    Thank you very much for this website!! Absolutely excellent and very useful…!

  20. dee says:

    hi. i gor high Cronbach for my 4 variables but the correlations are zero. Is it somehing wrong wih my calculations or the data? Need help. Tq

  21. noor hafizah hassan says:

    Hye, i would like to run cronbach alpha on each item as my on likert scale..as you show in example 4 that run crunbach alpha on all the items..

    How can i do it on each item?
    Possible?
    Seems it does not clear with me here..
    Thanks

  22. Luke says:

    Hi Charles,
    Thanks so much for this site. Very helpful.
    Reading from one of your observations above, and I quote, “If the variances of the xj vary widely, the xj can be standardized to obtain a standard deviation of 1 prior to calculating Cronbach’s alpha”, end of quote. just wondering how do you do that. Would be grateful for your response.
    Thanks

    • Charles says:

      Hi Luke,
      If you have a column of data in range A1:A10. You calculate the mean of the values (say in cell A12) by =AVERAGE(A1:A10) and the standard deviation (say in cell A13) by =STDEV(A1:A10). Now put the formula =STANDARDIZE(A1,A$12,A$13) in cell B1. B1 now contains the standardized value of the data in cell A1. If you highlight the range B1:B10 and press Ctrl-D then column B will contain the standardized values of all the data in range A1:A10.
      Charles

  23. Luke says:

    Thanks so much indeed Charles. I got it.
    You have a Blessed day.
    Best,

  24. Arin says:

    Hi Charles,

    Thanks so much for the explanation. It’s really easy to follow.
    However, I have a question about example 1. How do you get the value for cell B20?
    In figure 2, you just said its from M17. But how do you calculate it?
    Any explanation on this would be very much appreciated.

    Thx :)

  25. Arin says:

    Hi Charles,

    I think I got it. Is it the sum of all the variance?
    I got 1 different last digit than yours, instead of 3, I got 4.
    I don’t know if it matters or not or if I am mistaken.

    Thx again.

    • Charles says:

      Arin,
      Yes. It is the sum of the variances. I used the formula =SUM(B17:L17) which sums the values in each of the cells B17 through L17. Although the value displayed for each of these cells contains 5 digits, more than this number of digits are actually stored. If you simply add the numbers that are displayed you get a number which ends in 4. If instead you add the complete numbers (as the formula =SUM(B17:L17) does) then the result will end in 3.
      Charles

  26. ricky says:

    Hello Charles,

    I really need your help.
    I am process of Writing my thesis and I need to find Cronbach’s alpha to state the reliability of my research. I tried usingg SPSS but I keep getting -4 as the alpha which I know is not right. It is a likert scale based questioonaire with a scale of 1 to 5 and the number of questions that I selected to find the Cronbach’s alpha is 10.
    I will be glad to send you the questionnaire to see how you can help me.

    regards, ricky

    I would be willing to send you the data that I used.

    I will be very grateful if you can assist me to solve this problem.

    • Charles says:

      Ricky,
      The referenced webpage explains how to calculate Cronbach’s alpha in Excel. If you have downloaded the Real Statistics software you can use the formula =CRONALPHA(R1) where R1 is the range containing your data (formatted as described on the webpage) and the software will do all the calculations for you.
      Charles

  27. Ricky says:

    Hi Charles,

    Thanks for your prompt response and the info that you provided. I’ll download the software and give it a try. The 15-day trial version of the SPSS that I initially used kept outputing -4 as my alpha and it was frustrating.

    Let me try again and if I encounter any problem, I’ll let you know.

    Thanks again.

    Ricky

  28. juliet says:

    Pls can someone send me how to solve cronbach alpha of the example1 above.thanks

  29. Ness says:

    Hello,

    Thank you for the explanation and the answers that you gave, it is very helpful !

    I hope that you can help me with my problem, since it is more or less specific..

    I’m trying to calculate Cronbach’s alpha for a specific purpose: inter-rater reliability (rather than internal consistency reliability) where raters used Liker-scale to judge some behaviors shown in videos. 8 items were used for the Likert-scale. Until now it seems fine, I can measure Cronbach’s alpha coefficient for one behavior (one observed video) while considering 8 rows (for the 8 items) and n columns (for n raters).

    However, there are many videos, and each rater evaluated only 16 videos (among around 600 videos). Each video was rated 24 times. My purpose is to measure the inter-rater reliability for each group of videos (the videos that share a common concept), and later, the overall inter-rater reliability..

    My proposition is to measure the Cronbach’s alpha coefficient for each video, and then to measure the average of those coefficients in order to asses the global Cronbach’s alpha coefficient related to one group of videos. I only need to know whether this approach is reliable, I mean computing the average of n Cronbach’s alpha coefficients (that were computed separately for each video) to get the inter-rater reliability for a group of videos makes a sense !

    Thank you in advance for your help, I really appreciate it since I could not find an answer anywhere..

    Best regards,
    Ness

    • Charles says:

      Ness,

      I am not sure what you mean by measuring Cronbach’s alpha for one video. I would think that you would need more than one video even to use Cronbach’s alpha, unless you are comparing what you call “items”. In your explanation you reference 8 items, but I am not sure what the items represent.

      My key question to you is why you want to use Cronbach’s alpha in this way, when, if I understand what you are trying to accomplish well enough, there are other tests which fit better with your goal? Perhaps you should be using Fleiss’s Kappa instead. See, for example, the webpage http://www.real-statistics.com/reliability/fleiss-kappa/.

      Charles

  30. Ermira says:

    Hi,

    I have 4 questions of type Likert Scale ( each of them contain 4 questions describing the main question).
    As far I saw that cronbach alpha is for internal consistency, or it shows how good items are related to describe the main question.
    I want to measure inter-rater agreement. Is Cronbach Alpha the right metric for doing this?

    Thank you

  31. marzieh says:

    Dear Charles,
    I have made a series of multiple choice questions with 70 items and gave them to a group of ten for piloting but it is really hard to estimate Cronbach’s alpha. I know that it should be more than 0.7 but I don’t know how. Please help me. Thank you so much in advance.
    Sincerely,
    Marzieh

    • Charles says:

      Dear Marzieh,
      If the person answered the question correctly they score 1 for that question. If they answered it incorrectly they score 0 for that question. Then use the approach in Example 1 of the referenced page or the CRONALPHA formula to calculate Cronbach’s alpha.
      Charles

  32. farah says:

    I still dont understand about why should we change into 6 instead of 2…
    N Q20….”Q20 in our example. Thus if a response to Q20 is say 2, it needs to be scored as 6 instead of 2 (i.e. 8 minus the recorded score).”
    And why must be 8?

    Im very confius…
    Hope u can help me…
    Thanks

    • Charles says:

      Farah,

      Suppose you pose the following four questions and ask your respondents to give a rating of 1 to 7 for each, where 1 is the weakest response and 7 is the strongest response:

      “Do you like pie?”, “Do you like steak?”, “Do you like green beans?” and “Do you dislike pizza?”

      The fourth question is reverse phrased: “dislike” instead of “like”. A response of 7 to the first question means that the respondent really likes pie, while a response of 7 to the fourth question means that the respondent really dislikes pizza. This last response is equivalent to a response of 1 to the question “Do you like pizza?”. So in order to “compare apples with apples” (pun intended) you pretend that the last question was “Do you like pizza?” and use a score of 1 instead of 7.

      In a similar way, a response of 6 to the question “Do you dislike pizza?” is equivalent to a score of 2 to the question “Do you like pizza?” Note that with a Likert scale of 1 to 7, the reverse coded score is always 8 minus the actual score (here 8 is 7+1). Similarly, if the Likert scale is 1 to 5, the reverse coded score is 6 minus the actual score (here 6 is 5+1).

      I hope this helps.

      Charles

  33. farah says:

    I have multiple choice question with one correct answer
    How can i get internal consistancy for my questionnaire, should i use similar method in spss to get chronbach alpha vlue for likert scale for my 15 question of MCQ??

    First in coding a b c d with 1.2.3.4
    But now..i coding them 1 for correct answer and 0 for uncorrect answer

    So what should i do next??

    • Charles says:

      Farah,
      When using a Likert scale (such as 1, 2, 3, 4) you should use the appropriate value 1, 2, 3 or 4 for each question, but multiple choice questions are not like questions using a Likert scale. When you are analyzing multiple choice questions you should code 0 (incorrect) and 1 (correct). After the coding just following any of the approaches described on the referenced webpage to obtain Cronbach’s alpha.
      Charles

      • farah says:

        A lot of thank for replied my massage..:)

        By the way, what do you mean by following any approaches described on reference webpage to obtain cronbach alpha?

        I hv difficulties to analyze my data to get alpha value..
        What should i use..anyway..any suggestions?

        • Charles says:

          Farah,

          On the referenced page I showed three ways of computing Cronbach’s alpha:
          1. Directly using the definition of Cronbach’s alpha (as in Example)
          2. Using ANOVA (as in Example 3)
          3. Using the CRONALPHA function found in the Real Statistics Resource Pack (as in Example 4)

          Charles

  34. MJ says:

    Hi,

    for my thesis I conducted CRONBACH alpha on several measures- the core questionnaire is the Five Facet Mindfulness Questionnaire (FFMQ). My sample is 265 Norwegian University students.

    These are the scores I need to explain: FFMQ (0,582) where the individual facets never reach even 0.5, for the Perceived Stress questionnaire (0,345) and for AUDIT (0,396).

    My supervisor thinks these are too low and would like me to explain why, and thinks we cannot be sure what the instruments were actually measuring. He wants me to give reasons for this.

    Also, the CORRELATION between measures was low even though in the past it usually shows to be high. I am not sure what was different now, and what both a low cronbachs alpha and correlation could indicate.

    I have found some reasons that could explain it like Participant Fatique.

    I would truly appreciate any help as my thesis defence is due very soon and I am still stuck at this problem.

    Best,
    MJ

    • Charles says:

      MJ,
      Since this is a standard test, I assume that your supervisor finds that your results are too different from the typical results for the test. You mention that a possible reason is Participant Fatigue, but you need to ask yourself why would students taking this questionnaire have higher levels of fatigue than the typical respondents to this questionnaire? In general, I can only think of two categories of reasons for the discrepancy: (1) the people taking the test are different from the typical people taking the test (different culture, problems with language, etc.) or the environment where the questionnaire is administered is different (too noisy, poor lighting, etc.) or (2) you aren’t measuring the the same thing as is typically measured — e.g. if I remember correctly the FFMQ has 5 different dimensions (factors), in which case you need to calculate Cronbach’s alpha not on the whole questionnaire but for the questions in each of the five dimensions separately.
      Charles

  35. Gabriel says:

    Hi Charles, firstly thank you very much for providing this informative platform for everyone. Your effort is greatly appreciated.

    Anyway, i do have some issues regarding alpha cronbach. Hoping that you can give me some clarification. Issues are stated as follows;
    (i) In one full set of questionnaire, i have 42 items/ questions measuring different and diverse concepts/ factors. In another word, i cannot put all the items together at one go for Cronbach test (as this will lower the cronbach value as they are measuring different things), so i separate them into few groups say 8 groups of factors (consists of 3-5 or 2-3 items). So theoretically, each group i have different value of Cronbach if i executed cronbach for all the items. The question is do i need to execute the cronbach test for ALL items or groups? Is it necessary to ‘cronbach’ all the items? Can i just ‘cronbach’ just one group?

    (ii) In exension of above issue, as you mentioned earlier, in order to use Cronbach, you have at least 2 items right? but we know that the lesser the items, the lower alpha cronbach will be. Say i have low cronbach value for 2 items, but these two items are valid to be in questionnaire just the reported reliability is low, so, do i need to do the cronbach test for that group? or i just ignore it? or there is a better alternative?

    (iii) For your information, another issue is there are some items, like 2-3 items they are unique (maybe i have to say, they are not ordinal data, they are nominal data- yes or no etc, meaning to say, they are representing individual factor, so cronbach cannot be used right? is there alternative to replace the cronbach if this is the case? One more issue is multiple choices questions, i have about 8 of them, so, how can i establish reliability of them, is that possible?

    Thank you very much

    • Charles says:

      Gabriel,

      (i) You only need to calculate Cronbach’s alpha for the group(s) you are interested in.

      (ii) As you know, all other things being equal, in general the more questions you have the higher the value of Cronbach’s alpha will be. For this reason the value of Cronbach’s alpha for two items (i.e. two questions) might seem low compared to a group with more items. There may be better alternatives to Cronbach’s alpha for two items, but I am not aware of them.

      (iii) Cronbach’s alpha handles true/false and multiple choice questions with no problem. You code these with 0 for the wrong answer and 1 for the correct answer (as in Example 1 of the referenced webpage).

      Charles

  36. Chris says:

    Just wanted to say what a fantastic resource you have put together here. I’m an educational researcher from a purely Arts background.

    I put together a Likert survey, made up of 6 root statements (or factors?), and chose to analyse 3 of them using this method. I had 79 respondents and used a 5 point scale. The first factor consisted of 7 items and the second and third of 4 and 3 respectively. The spreadsheet returned scores .88, .84, and .79. I am well pleased!

    I may even have a go at using your site for Factor Analysis and go a step further…

    Much, much appreciated.

    Chris, New Zealand.

    • Charles says:

      Chris,
      I am very pleased that you found the site useful. Interestingly enough the original impetus for creating the site was that I wanted to perform Factor Analysis in Excel. Once I figured out how to do this I decided to share what I had learned with others who might want to do real statistical analysis using Excel.
      Charles

  37. Martin says:

    I´ve just discovered Real Statistics, and so far it looks fantastic!

    I´m looking to automate lots of calculations on a complex data set.

    Is it possible to make the formula only calculate certain questions (for a subscale)?
    How does the formula handle missing items/participants?

    Kind regards,
    Martin

    • Charles says:

      Martin,

      Real Statistics has a lot of useful statistical functions and data analysis tools. I am also adding new features all the time.

      There are various functions for selecting only certain data from a data range. These consist of standard Excel capabilities (Data > Filter, etc.) and Real Statistics capabilities (e.g. Extracting Columns from a Data Range data analysis tool and ExtractCol function).

      Many of the statistical functions ignore any rows with missing data, but the CRONALPHA doesn’t have this capability. You need to first remove any missing data (e,g, by using the Real Statistics function DELROWBLANK or DELROWNonNum or via the Reformatting a Data Range by Rows data analysis tool) and then apply the CRONALPHA function to the reduced data range.

      Charles

  38. Darius says:

    Dear Charles,

    I have followed the chat, however, still did not get how to calculate alpha with multiple choice questions.
    What do you mean by “correct (1)/incorrect(0)”? For instance, my questionnaire contains some questions, beside of Likert scale questions, with 5 sentences and the respondent is asked to mark those sentences which he associate with the particular subject. That means many different combinations could be marked.
    Also there are such questions which require to range 5 sentences from most favourable to least favourable – also the answers could vary alot. How to cope with such questions while calculating alpha?

    Thank you very much

    • Charles says:

      Dear Darius,

      For multiple choice questions of the form “Select one of the following four choices a, b, c or d” the approach that I suggested should work, namely if say (c) is the correct choice then use the value 1 if the person selects choice (c) and use the value 0 if the person selects a, b or d.

      Questions of the form “Select one or more of the following four choice a, b, c or d”, can be viewed as four True/False questions, namely choice (a) is correct (True or False)?, choice (b) is correct (True or False)?, choice (c) is correct (True or False)? and Choice (d) is correct (True or False)? If say the correct choices are (a) and (d), and a person chooses (a) and (b) instead, then score 1 for question (a), 0 for question (b), 1 for question (c) and 0 for question (d).

      I am not sure how best to handle questions of the form “List the following five choices from most favourable to least favourable”. They are similar to having five questions where you rate each on a Likert scale of 1 to 5, but the difference is that you can’t use the same Likert score twice. Perhaps someone else has an idea about how to handle these types of questions

      Charles

  39. Kyan says:

    Hi, I am currently working on my research. I face problem when i generating Cronbach Alpha. My questionnaire contains such question :
    If yes,please answer Section B.
    If no, please answer Section C.
    It’s quite complicated, how to obtain the Cronbach Alpha value after i key in all?

    If answer section B, what i need to fill for section C items? With missing value or without missing value?

    Need a guide to complete it as I running out of time.

    • Charles says:

      Kyan,
      Perhaps the easiest approach is to calculate Cronbach’s alpha for the questions in section B (ignoring the people who didn’t answer the questions in section B) and calculate a separate Cronbach’s alpha for the questions in section C (ignoring the people who didn’t answer the questions in section C).
      Charles

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>