Research & Statistics

Your Research

We receive numerous requests each week from those requesting permission to use VARK for their research. Unfortunately, we do not receive much feedback about their results. Please send us your results so that we can inform others. Results that are part of published papers are particularly important for us and for others.

VARK and Validity

Researchers may want information on the statistical validity of the VARK Questionnaire. Dr. Walter Leite from the Research and Evaluation Methodology program at the University of Florida has conducted a study of VARK. The paper provides evidence of the validity of the VARK for measuring learning preferences and also presents its limitations. The paper is published and the citation is:

Leite, W. L., Svinicki, M. & Shi, Y. (2010). Attempted Validation of the Scores of the VARK: Learning Styles Inventory With Multitrait-Multimethod Confirmatory Factor Analysis Models. Educational and Psychological Measurement. 70, 323-339.

The link for the article is: http://epm.sagepub.com/cgi/content/abstract/70/2/323

The abstract reads:

Validity: The authors examined the dimensionality of the VARK learning styles inventory. The VARK measures four perceptual preferences: visual (V), aural (A), read/write (R), and kinesthetic (K). VARK questions can be viewed as testlets because respondents can select multiple items within a question. The correlations between items within testlets are a type of method effect. Four multitrait-multimethod confirmatory factor analysis models were compared to evaluate the dimensionality of the VARK. The correlated trait-correlated method model had the best fit to the VARK scores. The estimated reliability coefficients were adequate. The study found preliminary support for the validity of the VARK scores. Potential problems related to item wording and the scale’s scoring algorithm were identified, and cautions with respect to using the VARK with research were raised.

Reliability: They also explain that Cronbach’s alpha would underestimate the reliability of the VARK scores, because Cronbach’s alpha assumes that all items are parallel measures of the construct, which is not true with the VARK. Therefore, they provide estimates of reliability based on confirmatory factor analysis. The reliability estimates for the scores of the VARK subscales were .85, .82, .84, and .77 for the visual, aural, read/write, and kinesthetic subscales, respectively, which are considered adequate given that the VARK is not used for high-stakes decisions.

VARK Statistical

Most of the data (below) is from the VARK database July-December, 2013.

NOTE: Where a statistic refers to a question, please use the downloadable VARK Questionnaire from the website. The questions and their options are randomized when presented online on the VARK website so numbers on your sequence may not correspond with items below. These statistics are normally updated annually. Over one million respondents complete the questionnaire each year. One third of those, leave demographic data about themselves. If you need any statistics from the database for your research please contact us.

WHAT DOES VARK INDICATE?

Before we analyze the results from the VARK database it is necessary to examine the shape and structure of the questionnaire so that the correct statistical techniques can be used.

VARK is not a fully-fledged learning style. The words learning style are now used loosely to describe almost any attribute or characteristic of learning but technically the term refers to all the components that might affect a person’s ability to learn. Some inventories report on a number of components in a style (a such as motivation, surface-deep approaches to learning, as well as social, physical and environmental elements) and some personality inventories have learning characteristics as a part of their wider descriptions.

VARK deals with only one dimension of the complex amalgam of preferences that make up a person’s learning style. The VARK questions and their results focus on the ways in which people like information to come to them and the ways in which they like to deliver their communication. The questions are based on situations where there are choices and decisions about how that communication might take place.

It is important to say what VARK is not, so that other components are not perceived as being a part of it. VARK has little to say about personality, motivation, social preferences, physical environments, or intraversion-extraversion. The choice to limit VARK to modal preferences was made because that is where Neil Fleming had most success in assisting students with their learning. Of course, changing the other dimensions affects learning, but it was the modal preferences that had the most direct application for more effective learning.

THE RATIONALE FOR MULTIPLE CHOICES.

Multimodality was the expectation in the questionnaire design. The modal preferences of people are seldom singular and we live in a multimodal world. In the majority of cases people will have preferences for a number of modes and they will use strategies associated with their preferences depending on the context or situation. For example they may choose a Read/write response because the situation is biased towards it. Intuitively this makes sense, as we seldom act on the basis of input or output from only one mode. For that reason, multimodality (bi-, tri- or quad-) is likely to be the “normal” condition and single-preferences are likely to be less common. Those who have a mild, strong or very strong preference for one mode are still multimodal – it is just that one of their preferences is a little stronger than the others. For example a person with VARK scores of 6 3 3 3 is said to have a single preference for Visual but is, in fact, still multimodal, though not categorized as such by the VARK algorithm. Some modes, notably Kinesthetic, is itself, an amalgam of senses and could be said to be multimodal in the broadest sense of that word. For VARK usage it has a specific definition that should be understood if you plan to use VARK.

If multimodality is the expectation in life situations, we should allow for it in the structure of the VARK questionnaire and that is why respondents can choose more than one answer to each question. But clearly if everyone chose every answer for every question then VARK would provide few insights into their strategies for learning. Allowing for multiple choices, however, reduces the discrimination of VARK. So on one hand we say that multimodality is the norm but on the other hand we are really interested in the relative strengths of particular modes within individuals. It is the ability of VARK to allow multiple choices, yet point out a person’s preferences in their profile, that is its strength.

SINGLE PREFERENCES

If the database indicated that respondents’ choices were distributed evenly across all options then it is likely that the questionnaire would provide less discriminatory information for its respondents – most would be all-four – VARK. The options to each question are designed so that those with a particularly strong preference will choose the response that matches their preference even when the situation in the question stem is biased towards another mode. That is how VARK discriminates and for that reason the proportion of respondents choosing each option in a question is unlikely to be close to 25% for each question. It is more likely that one or sometimes two options in each question will be very attractive to most and that only those with a strong preference will choose a different answer, aligned with their modal preference.

Those who have a single-preference may continue to choose the weakest options despite the attraction of the dominant option (see later). An uneven distribution across the options is expected. Table One shows this feature in the proportions (percentages) for each question taken from the September-December 2012 database (n=145538).

Note: The table was calculated using all the choices for all respondents for each question. Many respondents chose more than one option for some questions hence the excess over 100% for the Total column. For 13 of the 16 questions there is at least one mode with more than half the respondents. On 16 occasions that 50% mark is equalled or exceeded. For two questions (Q2 and Q14)there is one weak choice (V) just below an arbitrary 20% (17%,and 19%). Visual and Aural are the lowest choices in seven questions each and Read/write in two. Conversely, Aural and Kinesthetic have four questions where they are the most popular, Read/write has six and Visual has two questions where it leads the others.

TABLE ONE: Percentage choosing each option.

Includes double counting.

Percentage who chose this option as all, or part, of their answer.
Question
V
A
R
K
Total
Most popular option
Least popular Option
1
33
21
41
27
122%
R
A
2
17
22
75
30
144%
R
V
3
41
57
32
45
175%
A
R
4
42
21
50
41
155%
R
A
5
37
33
39
44
153%
K
A
6
32
27
53
59
171%
K
A
7
22
48
26
71
166%
K
V
8
45
62
28
44
179%
A
R
9
38
42
46
42
168%
R
V
10
57
34
41
43
175%
V
A
11
27
55
34
39
155%
A
V
12
55
27
50
36
168%
V
A
13
28
50
34
69
181%
K
V
14
19
56
40
40
155%
A
V
15
26
28
66
48
168%
R
V
16
27
39
54
46
166%
R
A

 

THE VARK PREFERENCES

As in life, VARK allows for multiple approaches and strategies for learning. Most learning takes place in an environment of multiple modes and it is probably impossible to learn or teach using one mode only. Multimodality is certainly the norm. This is similar to saying that everyone has a multimodal profile with some V, some A, some R and some K but within their profile some may have preferences for modes that are stronger than others. There are a number of ways to assemble the VARK preferences. The usual method is to distinguish 23 profiles as shown below.

TABLE TWO: THE VARK PREFERENCES
VARK Profiles Number
Single preferences Visual – Mild, Strong and Very Strong.
Aural – Mild, Strong and Very Strong.
Read/write – Mild, Strong and Very Strong.
Kinesthetic – Mild, Strong and Very Strong.
12
Bi-modal preferences VA VR VK AR AK RK 6
Tri-modal preferences VAR VAK ARK VRK 4
All four modes preferred VARK 1
Total 23

 

Recently we have been subdividing those in the all-four VARK profile (above) into three segments. Those in Type One tend to use their preferences separately. They examine the situation and choose the preference that suits that situation. They could be described as “context specific.” Others need to use all their preferences to get an understanding that suits their learning needs. It could be said that they are “context blind“. Although they take longer to “understand” something new, their understanding is deeper and they have wider perspectives. The graph below shows the proportions who are in Type One and Type Two and a smaller group who lie in the transition area between the two. Note that this distinction between Type One and Type Two would also exist in the Bimodal and the Trimodal profiles but, for clarity, we have not added them into this graph. Using this categorization would mean there are 25 different profiles generated by the VARK algorithm.

varkTypesGraph

TABLE THREE: VARK Database May 2014: Distribution of Preferences

n=20254

Profile
Total %
mild
strong
very strong
Category
Category
%
V
3.4
2.2
0.7
0.4
A
6.8
4.4
1.7
0.8
R
11.6
5.9
3.1
2.5
K
15.2
8.6
4.2
2.4
Single preference
37.0
VA
0.5
VR
1.2
VK
3.3
AR
2.2
AK
5.3
RK
2.9
Bimodal
15.3
VAR
0.7
VAK
4.0
ARK
4.8
VRK
2.7
Trimodal
12.2
VARK Type One
5.5
VARK Type Two
25.7
VARK Transition
4.3
VARK All Four
35.5
Total
100%
100%

 

This means, for example, that there is some Visual in several profiles – it is in the three single Visual preferences Mild, Strong and Very Strong, and in VA, VR, VK, VAR, VAK, VRK and in VARK. Each mode is therefore represented in 10 profiles, seven of which are overlapping with other modes. Note those with a Multimodal set of preferences overall, total 64.8%.

SO WHAT IS NORMAL?

The database samples populations largely dominated by those in education (86%) so it is not representative of a total population.
In the absence of a distinctive distribution, what does it mean if, say, Read/write options are chosen more often? It could be argued that the proportions above, indicate biases towards those with a Read/write preference in our population, or, that the questionnaire measures what it measures, and that is all it does. But this is a circular argument. In questionnaires where only one option can be selected there is a balancing effect. Choosing one option precludes another so if one set of choices is popular, by definition there will be other less popular choices. If the VARK questions and options were rewritten to balance the proportions we would be merely reflecting an hypothesis that modal preferences are balanced within our society. The hypothetical distribution of the 6560 possible and valid sets of four scores (where at least 9 options have been chosen) is shown in the graph below.

varkHypothetical

That statistical nicety may be an interesting phenomena but it is a contestable hypothesis.

The VARK statistics don’t help us decide, as they are a result rather than a cause. In the 2014 May database (n=20254), of the options chosen, 21.7% were for Visual, 24.5% were for Aural, 24.9% were for Read/write and 28.8% were for Kinesthetic.
The content validity of VARK is the best source for resolving the argument about what is normal (see above). The strength of VARK is that its questions and options are drawn from real life learning situations and that people identify with the results that they receive. That is VARK’s strength. If a large proportion of people found that the questionnaire gave them results different from their own perceptions, or the perceptions of those close to them, that would be a reason to re-examine or reject the questionnaire. The strength of VARK is shown by the increasing number of respondents who use it and who comment on its usefulness and the percentage of respondents who indicate that their VARK results match what they perceive as their learning preferences. In July to December 2013 (n=237809) this “Match” statistic was 57.6% of respondents who answered that question and the “No Match” was 6.0%. The remaining respondents (36.4%) chose “Don’t Know” and of that group, 69% were under 25 years of age. It is not surprising that our younger respondents don’t know how they learn?

If we really wanted to balance the results for V, A, R and K we should search for, or create a number of additional questions so that V, K and A are the dominant options more often! In our five-yearly reviews of the questionnaire (last completed in October 2011) we did not do that! As a consequence there is no distinctive distribution of VARK scores – no typical VARK profile for the general population. What we can describe is that the average rounded scores for each mode (V, A, R and K) are 6, 7, 7 and 8. The graph below, for the respondents in July to December 2013, shows the proportions for the major profiles.

varkPreferencesGraph

REDUCING THE COMPLEXITY

It may be useful to identify the dimensions of VARK reduced to only four modes. This can be done in two ways shown in the graph that follows and in Table Four below. For the graph, we have collected all those who have some Visual preference, all those with some Aural preference, some Read/write preference and some Kinesthetic preference. For each of these we have shown those who have a single preference and in the next sections of the bars those who have some of each preference in a bimodal profile and finally all those who have some of that preference in a trimodal profile. Those who have some of each preference in a four-part VARK profile have been omitted as that would only add equal weight to each of the bars.

To interpret the graph, for the 243996 respondents in July-December 2013 we can say that 33% of those respondents had Kinesthetic as part of the description of their profiles i.e. they either had a Kinesthetic single preference from the VARK algorithm or Kinesthetic was part of their bimodal or trimodal profiles viz. AK, RK, VK, VAK, ARK or VRK.

someofgraph

V, A, R and K PROPORTIONS

The database information for Table Four is from the same 62094 responses to the VARK questionnaire during October-December 2011. It uses the VARK profile descriptions (VA, VRK, mild R etc) as above and indicates how many people have some V, some A, some R and/or some K. Unlike the graph above it makes an assumption that preferences are weaker when combined. The table is calculated as follows:

  • Each respondent’s contribution sums to a single unit – 1.0.
  • Each respondent with a Single preference counts as 1.0.
  • Each respondent with two modes has each counted as 0.5.
  • Each respondent with three modes has each counted as 0.33 and
  • Each respondent with four modes has each counted as 0.25.

Using these rules, the table below is formed.

TABLE FOUR Preferences with some proportion of V, A, R and K. January 2010.
V A R K Total
% 16.2 23.6 30.2 30.0 100%

 

TABLE FIVE: Groups and the percentage of V, A, R and K Options Chosen. May 2014.

This table is compiled differently from Table Four. Here we have the percentages for the total number of options chosen for various populations. For example, Females, numbering 12014 chose 21.6% of their options from the Visual choices, 24.1% from the Aural choices etc.

V A R K n=
Total 21.7 24.5 24.9 28.8 20254
Females % 21.6 24.1 26.0 28.3 12014
Males % 21.9 25.2 23.1 29.8 7129
Students 21.6 24.7 24.7 29.0 15954
Teachers 23.2 22.6 26.5 27.7 1810
Applied Science 21.2 24.2 24.4 30.1 468
Architecture 24.4 23.2 22.7 29.8 67
Art 23.7 24.7 21.9 29.7 511
Business 21.7 24.7 25.3 28.3 2634
Computing 22.4 22.5 26.0 29.1 754
Education 21.7 24.7 24.9 28.7 1300
Engineering 23.5 24.3 22.4 29.8 699
Humanities 20.7 25.2 27.1 27.1 499
Languages 21.2 25.0 26.7 27.1 349
Law 20.8 24.4 27.3 27.5 480
Mathematics 22.0 24.8 24.9 28.2 361
Medical 21.7 24.1 25.1 29.1 3991
Performing Arts 20.8 27.4 22.1 29.7 245
Science 22.9 23.8 25.1 28.3 1382
Social Science 20.6 25.0 26.2 28.2 836
Sport 21.1 25.8 21.2 31.9 476
Other 21.2 25.3 24.4 29.1 2786
High School 21.5 25.6 23.7 29.2 3053
Two Year College 21.3 24.5 24.9 29.3 30210
Four Year College 21.7 24.0 25.4 28.9 2271
University 22.3 24.0 25.2 28.5 5453
Other 21.7 24.8 25.0 28.6 2914
In Education 21.8 24.5 24.8 28.9 16417
Not in Education 21.7 24.4 25.4 28.5 2486
Used VARK Before 22.1 24.3 24.9 28.8 1910
First Time User 21.7 24.5 24.9 28.8 17840
Age under 18 21.8 25.7 23.1 29.5 3685
Aged 19 to 25 22.1 25.2 23.2 29.5 6158
Aged 26 to 34 22.0 24.0 25.3 28.7 4090
Aged 35 to 44 21.6 23.4 27.0 28.0 3000
Aged 45 to 54 21.0 23.7 28.1 27.3 2034
Aged 55+ 20.6 23.5 28.9 27.0 887
Matches my perception 22.5 23.6 25.0 28.9 311767
Does not match my perception 19.8 26.3 24.7 29.1 958
Don’t Know How I Learn 20.7 25.9 24.7 28.6 6445
Africa 21.4 24.6 24.8 29.2 250
Asia 22.7 26.0 23.2 28.5 549
Canada 22.3 24.5 24.7 28.5 549
Central America 24.4 24.0 20.5 31.2 120
Europe 20.8 25.5 23.8 29.8 636
Middle East 22.9 25.7 23.5 27.9 141
Oceania 22.8 23.1 25.8 28.2 1318
South America 22.5 24.3 25.0 28.2 151
United Kingdom 21.8 24.9 25.6 27.7 2024
USA 21.6 24.4 24.9 29.0 13370

 

THE MATCH AND NO MATCH STATISTICS

In the tables below are the statistics for a question asked of all respondents after they have completed the questionnaire and seen their results. They are asked if the results match their perception of how they learn. They have three choices: “Match“, “No Match” and “Don’t Know.” The “Match” statistic is currently 57.6% and the “No Match” statistic is 6.0% so a further 36.4% are in the “Don’t Know” category. We use this statistic as a regular check on whether VARK is offering a useful service. If a larger proportion chose “No Match” we would be concerned. Some of the 84288 respondents (July-December, 2013) who claimed that they did not know how they learned are shown in the tables below with the highest group first.

TABLE SIX: “Don’t Know” Statistics
VARK Category Percent of Don’t Know
Database Total
Percent of Total Database
VARK (All modes) 40.7% 38.3%
A Mild 6.0% 4.7%
R Mild 8.0% 7.6%
ARK 7.3% 6.1%
AK 4.9% 4.4%
AR 3.3% 2.9%
RK 3.4% 3.2%
TABLE SEVEN: Age of the “Don’t Know” group

Of the Don’t Know group almost 70% (69.4%) were aged under 25.

Age Percent of Don’t Know Database
Under 18 37.1%
19 – 25 32.3%
26 – 34 13.8%
35 – 44 9.0%
45 – 54 5.4%
Over 54 2.3%

Sixty percent (60%) were females which is similar to the whole database percentage.

TABLE EIGHT: “No Match” Statistics

A total of 13800 respondents chose this category, making up 6.0% of those who answered that question(n=230386). They were mostly in these VARK Profiles.

VARK Category Percent of No Match Database Percent of Total Database
K mild 7.9% 7.2%
R Mild 10.2% 7.6%
A Mild 8.0% 4.7%
ARK 7.8% 6.1%
AR 3.7% 2.9%
A Strong 2.2% 1.6%


THE DISTRIBUTION OF V, A, R AND K SCORES

The VARK website algorithm calculates each respondent’s profile based on their V, A, R and K scores from the questionnaire. The scores for each individual and mode vary from zero (0) to 16. The frequency of each V, A, R and K score for all respondents in September-December 2011 (n=145358) is shown in the graphs below.

graph_VFreq

graph_AFreq

graph_RFreq

graph_KFreq

NUMBER OF OPTIONS CHOSEN

VARK has 16 questions with 64 options spread across those questions. Each of the four modes (V, A, R and K) can be selected 16 times. Because each respondent may choose more than one answer for each of the questions the possible total number of answers for any single respondent is 64 (16 V, 16 A, 16 R and 16 K). For a valid entry in the database the minimum number of questions attempted has been set at 12. The most common number (mode) of options chosen was 16. (Note: not necessarily one per question.
Question Five and 11 were the most difficult for some to decide as they were the ones most often left blank.

graph_noOptions

graph_blankOptions

THE APPROPRIATENESS OF THE OPTIONS.

In testing the latest version it was important to know which options were “working” and which were not. One possibility was to design options so that each would attract significant numbers of respondents as discussed above. This could have led to almost equal proportions of respondents opting for each choice – i.e. for each question there would be equal numbers of respondents choosing each option. Because VARK allows multiple answers to each question and because we wanted the questionnaire to discriminate between preferences, the proportions vary. To test the questions we collected statistics on the percentage of respondents who chose an option that was included in their final profile. For example, if all respondents with a single Read/write preference and all those who had Read/write as a part of their multimodal preference chose the Read/write option for a question, that would provide a 100% statistic. We called this test Loyalty. This also told us who was choosing the weaker options. If the weakest option was still being selected by those who had some preference for the mode represented in their VARK profile, we were confident that the questionnaire and its options were working appropriately. The alternative hypothesis that those who had no preference for that mode were choosing that option would indicate that the option was wrongly worded or poorly selected.
Table Nine indicates the LOYALTY percentages.

TABLE NINE: LOYALTY Percentages

n=62094, October-December 2011

Question Number % with some V in their profile who chose a V option % with some A in their profile who chose an A option % with some R in their profile who chose an R option % with some K in their profile who chose a K option.
1 50 68 51 31
2 28 31 74 60
3 49 68 39 51
4 58 29 60 47
5 52 41 50 52
6 46 36 65 67
7 35 62 36 80
8 61 73 37 54
9 61 73 37 54
10 74 44 52 52
11 40 63 42 46
12 72 37 63 43
13 45 63 46 79
14 29 67 52 47
15 39 37 76 53
16 43 48 62 54
Average 49 52 55 54

To read this table: For Question One, 50% of the respondents who chose the Visual option had some Visual in their final VARK profile i.e. they were categorized as having a single preference Visual (mild, strong or very strong) or had a bimodal, trimodal or four-part preference with Visual as a part of it. (e.g. VA or VRK or VARK etc.) The higher the number the stronger the option was for those with that preference.

TABLE TEN: SINGLE PREFERENCE LOYALTY

N=40228, January 2010

Question Number % of Single Preference Visual respondents who chose a V option % of Single Preference Aural respondents who chose an A option % of Single Preference Read/write respondents who chose an R option % of Single Preference Kinesthetic respondents who chose a K option.
1 63 73 56 40
2 33 32 78 44
3 54 70 44 44
4 69 32 65 52
5 62 46 59 63
6 50 41 71 72
7 47 68 50 84
8 64 74 46 61
9 64 74 46 61
10 79 47 62 55
11 51 66 48 48
12 79 47 73 43
13 55 70 57 83
14 45 76 65 48
15 51 39 80 50
16 55 49 68 54

To read this table: For Question One, 63% of the respondents who had a single (mild, strong or very strong) Visual preference chose the Visual option in their response to this question. The higher the number the stronger the option was for those with that preference.

TABLE ELEVEN: Data for Other Languages and Regions

The May, 2014 online VARK database (n=20254) uses the English questionnaire and is dominated by respondents from the USA and UK as the table below shows.

Region Africa Asia Canada Central America Europe Middle East Oceania South America UK USA
Percentage 1.3% 4.4% 2.8% 0.6% 3.3% 0.7% 6.8% 0.8% 10.4% 68.9%

The VARK database also collects data from respondents other than those who have English as their first language. It uses their own language translations. These databases are small and will be shown when they reach useful numbers.