Does Video Assistant Referee Technology Change The Magnitude and Direction of Home Advantages and Referee Bias? A Proof-Of-Concept Study
Does Video Assistant Referee Technology Change The Magnitude and Direction of Home Advantages and Referee Bias? A Proof-Of-Concept Study
https://doi.org/10.1186/s13102-024-00813-9
and Rehabilitation
Abstract
Background This study analyzed how Video Assistant Referee (VAR), introduced to improve the accuracy of referee
decisions in football, changes the magnitude and direction of home advantage and referee bias in the Turkish Super
League.
Methods We analyzed points, goals, yellow cards and red cards, fouls, penalties, and offside data from 1,838 matches
played in the Turkish Super League with and without VAR. Two-sample t-tests and two one-sided tests analysis were
applied to determine the differences between the home and away team data between the seasons played with and
without VAR.
Results The findings revealed that the only variable that changed significantly after VAR was implemented was fouls,
which decreased for both home (p <.001; d = 0.56, medium effect) and away teams (p <.001; d = 0.69, medium effect).
The results also indicated that, with or without VAR, home teams had an advantage over away teams in points and
goals, and away teams faced more referee bias regarding yellow cards and penalties (against).
Conclusions Although this study shows that VAR does not significantly impact the HA and referee bias of football
matches, nevertheless, teams should be more aware that bias is reduced when playing away. In addition, this study
offers some practical applications that can help football players, coaches, and match officials better understand VAR
technology’s effects on HA and referee bias.
Keywords Referee decision, Video-replay technology, Decision making, Performance analysis, Match analysis
*Correspondence:
Qing Yi
yiqing1771@outlook.com
1
Department of Coaching Education, Faculty of Sport Sciences, Akdeniz
University, Antalya, Turkey
2
College of Physical Education, Dalian University, 116622 Dalian, China
© The Author(s) 2024. Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use,
sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and
the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this
article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included
in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will
need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The
Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available
in this article, unless otherwise stated in a credit line to the data.
Işın and Yi BMC Sports Science, Medicine and Rehabilitation (2024) 16:21 Page 2 of 7
the proportion of points won at home out of the total variables, there was no statistically significant or equiva-
points won at home and away [19].The InStat Scout lent difference between the two groups (p >.05) for both
(InStat®), a database with high inter-observer [28] and the t-test and TOST. The ESs for these variables were
inter-operator reliability [29], was used to collect the very small (0.00 to 0.06), indicating negligible differences
data. This study adhered to the Declaration of Helsinki between the groups. The Bayes factors for these variables
and received ethical approval from the Akdeniz Univer- were very large (7.51 to 19.02), indicating substantial to
sity Social and Humanities Scientific Research and Publi- strong evidence for the null hypothesis.
cation Ethics Committee (2023-14/325). Table 3 compares the data of away teams in the sea-
sons with and without VAR. Fouls were the only variable
Statistical analysis that showed a statistically significant difference between
The data were analyzed with Jamovi version 2.3.18.0 (The the groups (p <.001) for both the t-test and TOST. This
Jamovi project) and each variable’s mean and standard variable had a large ES of 0.69 and a Bayes factor of 0.00,
deviation were reported. The normality of the data was which supported the alternative hypothesis. However,
tested with the Shapiro-Wilk test (p <.05). Two-sample the means of this variable were not statistically equiva-
t-tests and two one-sided tests (TOST) analysis [30] were lent. None of the other variables had a statistically signifi-
used to compare the groups for each variable. A small cant or equivalent difference between the groups (p >.05)
effect size (ES) (Cohen’s d ± 0.20) was set as the bound- for the t-test and TOST. These variables had very small
ary value for this study. The alternative hypothesis H1: ESs (0.00 to 0.07) and large Bayes factors (5.95 to 19.02),
(− 0.20 < d < 0.20) states that the true effect is within the which favored the null hypothesis.
equivalence bounds, meaning that the compared means The introduction of VAR does not significantly impact
are practically similar, and it is tested against the com- HA, as the seasons with (59.8%) and without VAR
posite null hypothesis H0: (d ≤ − 0.20 ∪ d ≥ 0.20) that (59.5%) have comparable HA values.
states that the true effect is large enough to be of inter-
est. If TOST method could reject this null hypothesis, it Discussion
would be said that the difference between home and away The VAR system was introduced to improve the accuracy
teams was statistically equivalent [31]. and consistency of referee decisions and reduce injus-
The ESs were computed with Cohen’s d and the Bayes tice and controversy. It has been gradually introduced in
factors (BF01) were calculated to evaluate the evidence for many leagues since the 2017-18 season and used in the
or against the null hypothesis. The null hypothesis is sup- Turkish Super League since 2018–2019 [10]. Despite the
ported by anecdotal, substantial, strong, very strong and numerous studies on how VAR affects match perfor-
decisive evidence when the Bayes factors (BF01) are 1–3, mance, the impact of VAR on HA remains largely unex-
3–10, 10–30, 30–100, > 100 respectively [32]. plored. This research explored how VAR affected HA and
referee bias in football seasons and found that VAR did
Results not significantly change these phenomena. This study
The results indicated that home team outperformed away also analyzed the differences between home and away
team on average regarding points and goals variables, teams in seasons with and without VAR. The results
which was statistically significant (p <.001). However, the showed that fouls were the only variable significantly
ESs were moderate, and the Bayes factors supported the decreasing for both teams after VAR was introduced. The
alternative hypothesis of difference (BF01 = 0.00). In addi- groups had no significant or equivalent difference for all
tion, away teams faced more yellow cards and penalties other variables, such as goals, shots, cards, etc.
(against) than home teams in both seasons, with or with- The first research to comprehensively focus on HA
out VAR, indicating a possible referee bias. The Table 1 and referee bias in the Turkish Super League pointed to
implied that HA and referee bias were present in both the home advantage in the Super League [26]. Similarly,
groups and that VAR does not have a major impact on Işın and Gómez Ruano (24) emphasized that HA exists
the teams’ selected data. in the Turkish Super League but is reduced in matches
Table 2 compares the home team’s data in the seasons played behind closed doors (ghost matches), thus high-
before and after the introduction of VAR. It was stated lighting the importance of the role of the 12th man. More
that only one variable (fouls) has a statistically significant recently, Işın (15) underlined that HA at different league
difference between the two groups (p <.001) for both the levels in Turkish football continues regardless of the
t-test and TOST. The ES for this variable was 0.56, which league level. These results reveal that HA has existed in
is considered a medium effect. The Bayes factor for this Turkish leagues for many years and playing at home has a
variable was 0.00, indicating strong evidence for the significant advantage.
alternative hypothesis. There was no statistical equiva- The impact of VAR on home-field advantage is hard to
lence between the means of this variable. For all other estimate beforehand. One possibility is that VAR could
Table 1 Comparison of HA and referee bias in matches played with and without VAR
Variables a Descriptive statistics Independent Samples t-test TOST results for statistical equivalence
Home Team Away Team H0: (d ≤ − 0.20 U d ≥ 0.20) vs. H1: (-0.20 < d < 0.20)
M SD M SD t p ES BF01 (H0/H1) b Lower bound Upper bound Statistical equivalence
NO VAR (n: 918) Points 1.65 1.33 1.11 1.28 8.92 < 0.001 0.42 0.00 - t = 5.63 ns t = 12.21 ***
Goals 1.58 1.30 1.21 1.17 6.48 < 0.001 0.30 0.00 - t = 3.01 ns t = 9.951 ***
Işın and Yi BMC Sports Science, Medicine and Rehabilitation
Fouls 15.64 4.24 15.63 4.41 0.05 0.961 0.00 19.04 Strong t = -0.94 ns t = 1.04 ns
Yellow cards 2.18 1.36 2.35 1.40 -2.63 0.009 -0.12 0.62 - t = -5.74 *** t = 0.48 ns
Red cards 0.12 0.34 0.15 0.42 -1.40 0.162 -0.07 7.24 Substantial t = -12.56 *** t = 9.76 *** X
Offsides 2.09 1.61 1.92 1.67 2.29 0.022 0.11 1.41 Anecdotal t = -0.32 ns t = 4.90 ***
Penalties 0.20 0.44 0.14 0.36 3.36 < 0.001 0.16 0.07 - t = -7.27 *** t = 13.98 *** X
VAR (n: 920) Points 1.63 1.31 1.11 1.25 8.70 < 0.001 0.41 0.00 - t = 5.34 ns t = 12.05 ***
(2024) 16:21
Goals 1.58 1.28 1.19 1.12 7.04 < 0.001 0.33 0.00 - t = 3.47 ns t = 10.61 ***
Fouls 13.36 3.81 12.80 3.75 3.21 0.001 0.15 0.12 - t = 2.07 ns t = 4.34 ***
Yellow cards 2.11 1.37 2.25 1.39 -2.13 0.033 -0.10 2.02 Anecdotal t = -5.24 *** t = 0.98 ns
Red cards 0.12 0.36 0.15 0.039 -1.31 0.191 -0.06 8.16 Substantial t = -12.78 *** t = 10.16 *** X
Offsides 1.99 1.62 1.86 1.52 1.81 0.071 0.08 3.78 Substantial t = -0.92 ns t = 4.53 ***
Penalties 0.23 0.49 0.17 0.40 3.14 0.002 0.15 0.14 - t = -6.50 *** t = 12.78 *** X
a
All data presented on a per-match basis
b
Computed considering a one-sided null hypothesis
M: Mean, SD: Standard Deviation, ES: Cohen’s d effect size, BF01: Bayes Factor
P-values legend: *p <.05; **p <.01, ***p <.001; ns: not significant (p >.05)
Page 4 of 7
Işın and Yi BMC Sports Science, Medicine and Rehabilitation (2024) 16:21 Page 5 of 7
Statistical equivalence
in crucial match events and thus make the game fairer.
H0: (d ≤ − 0.20 U d ≥ 0.20) vs. H1: (-0.20 < d < 0.20) Even though referee bias is not explicitly stated, the main
aim of VAR was to “decrease injustice” in referee deci-
sions, implying that bias may be a hidden motive for VAR
TOST results for statistical equivalence
X
X
X
before and after VAR’s introduction. This means that the
HA that existed before VAR was not reduced by it and
Upper bound
t = 12.24 ***
t = 3.72 ***
t = 3.35 ***
t = 4.21 ***
t = 4.02 ***
t = 7.95 *** study also found that home teams got fewer yellow cards
and more penalties than away teams with or without
VAR. This indicates some referee bias in favor of home
teams in the seasons without VAR, which continued in
the seasons with VAR. With the introduction of VAR,
both home and away teams had fewer yellow cards and
Lower bound
t = -10.52***
t = 11.03 ns
t = -1.28 ns
t = -3.31***
same. The main reason for this result is that the referees’
t = -2.79**
t = -2.08*
Strong
Strong
10.86
19.07
7.51
8.41
0.286
0.987
0.170
0.199
-1.28
0.47
0.02
1.07
0.02
1.37
ees’ judgment [18] and make them favor the home team
t
P-values legend: *p <.05; **p <.01, ***p <.001; ns: not significant (p >.05)
1.31
1.28
3.81
1.37
0.36
1.62
0.49
2.11
0.12
1.99
0.23
1.33
1.30
4.24
1.36
0.34
1.61
0.44
2.18
0.12
2.09
0.20
Penalties
Offsides
Statistical equivalence
determine whether it is truly offside.
H0: (d ≤ − 0.20 U d ≥ 0.20) vs. H1: (-0.20 < d < 0.20) Some limitations to this study should be considered. As
a results of studies on the impact of VAR on referee bias
are inconsistent across leagues, this may depend on fac-
TOST results for statistical equivalence
X
X
X
to league. The current study only examined the effects of
VAR on HA and referee bias in the Turkish Super League,
Upper bound
t = 10.71 ***
t = 3.47 ***
t = 4.16 ***
t = 4.61 ***
t = 3.50 ***
t = 9.79 *** ball. Therefore, future research trends should explore
VAR’s HA and referee bias by focusing on data from mul-
tiple tournaments or leagues. Future research could also
investigate the effects of VAR on home advantage and
referee bias, using a different approach such as the mixed
model. Besides that, it would be interesting to analyze
Lower bound
t = -12.69***
t = 13.77 ns
t = -1.54 ns
t = -3.31***
t = -3.33***
Substantial
Strong
Strong
effects on performance.
BF01 (H0/H1) b
-
Independent Samples t-test
Conclusion
Table 3 Comparison of away team’s data in the seasons before and after the introduction of VAR
19.02
17.51
18.91
13.72
0.00
5.95
6.73
0.125
0.895
0.415
0.147
-1.45
0.08
0.42
1.53
0.13
0.81
P-values legend: *p <.05; **p <.01, ***p <.001; ns: not significant (p >.05)
0.039
1.25
1.12
3.75
1.39
1.52
0.40
2.25
0.15
1.86
0.17
1.28
1.17
4.41
1.40
0.42
1.67
0.36
Author contributions
AI: Conceptualization, Data curation, Formal Analysis, Methodology, Writing–
15.63
1.11
1.21
2.35
0.15
1.92
0.14
original draft, Writing– review & editing. QY: Funding acquisition, Supervision,
M
Writing– review & editing. Both authors approve the submitted version.
Funding
Yellow cards
Variables a
Penalties
Offsides
Points
Goals
Fouls
b
a
Işın and Yi BMC Sports Science, Medicine and Rehabilitation (2024) 16:21 Page 7 of 7
Data availability 16. Sors F, Grassi M, Agostini T, Murgia M. The influence of spectators on home
No datasets were generated or analysed during the current study. advantage and referee bias in national teams matches: insights from UEFA
Nations League. Int J Sport Exerc Psychol. 2023;21(2):290–305.
17. McCarrick D, Bilalic M, Neave N, Wolfson S. Home advantage during the
Declarations COVID-19 pandemic: analyses of European football leagues. Psychol Sport
Exerc. 2021;56:102013.
Ethics approval and consent to participate 18. Goumas C. Home advantage and referee bias in European football. Eur J
The study was conducted in accordance with the Helsinki Declaration and Sport Sci. 2014;14(sup1):243–S9.
approved by the Akdeniz University Social and Humanities Scientific Research 19. Matos R, Monteiro D, Antunes R, Mendes D, Botas J, Clemente J, et al. Home-
and Publication Ethics Committee (2023-14/325). advantage during COVID-19: an analysis in Portuguese football league. Int J
Environ Res Public Health. 2021;18(7):3761.
Consent for publication 20. Dellagrana RA, Nunes RF, Silva RL. The importance of crowd support and
Not applicable. team quality to home advantage in Brazilian Soccer League First Division.
Percept Mot Skills. 2023:00315125231169876.
Competing interests 21. Leite W, Pollard R. Comparison of home advantage between level 1 and level
The authors declare that they have no competing interests. 2 in women’s football leagues. J Anthropol Sport Phys Educ. 2020;4(4):9–13.
22. Alonso E, Lorenzo A, Ribas C, Gómez MÁ. Impact of COVID-19 pandemic
Received: 18 November 2023 / Accepted: 8 January 2024 on HOME advantage in different European professional basketball leagues.
Percept Mot Skills. 2022;129(2):328–42.
23. Scoppa V. Social pressure in the stadiums: do agents change behavior with-
out crowd support? J Econ Psychol. 2021;82:102344.
24. Işın A, Gómez Ruano MÁ. How the 12th Man influences Football matches: the
References role of fans and referees in the home advantage phenomenon. Percept Mot
1. Cleland J. A sociology of football in a. global context: Routledge; 2015. Skills. 2023;130(5):2177–88.
2. Frevel N, Beiderbeck D, Schmidt SL. The impact of technology on sports–A 25. Wunderlich F, Weigelt M, Rein R, Memmert D. How does spectator presence
prospective study. Technol Forecast Soc Chang. 2022;182:121838. affect football? Home advantage remains in European top-class football
3. Albanese A, Baert S, Verstraeten O. Twelve eyes see more than eight. Referee matches played without spectators during the COVID-19 pandemic. PLoS
bias and the introduction of additional assistant referees in soccer. PLoS ONE. ONE. 2021;16(3):e0248590.
2020;15(2):e0227758. 26. Seckin A, Pollard R. Home advantage in Turkish professional soccer. Percept
4. Winand M, Fergusson C. More decision-aid technology in sport? An analysis Mot Skills. 2008;107(1):51–4.
of football supporters’ perceptions on goal-line technology. Soccer & Society. 27. Pollard R. Home advantage in soccer: a retrospective analysis. J Sports Sci.
2018;19(7):966–85. 1986;4(3):237–48.
5. Kolbinger O, Link D. The use of vanishing spray reduces the extent of rule 28. Kubayi A, Larkin P. Technical performance of soccer teams according to
violations in soccer. SpringerPlus. 2016;5:1–7. match outcome at the 2019 FIFA women’s World Cup. Int J Perform Anal
6. Psiuk R, Seidl T, Strauß W, Bernhard J. Analysis of goal line technology from Sport. 2020;20(5):908–16.
the perspective of an electromagnetic field based approach. Procedia Eng. 29. Silva H, Marcelino R. Inter-operator reliability of InStat Scout in female football
2014;72:279–84. games. Sci Sports. 2023;38(1):42–6.
7. IFAB. Laws of the game 2018/19 2018 [16-12-2022]. Avail- 30. Lakens D. Equivalence tests: a practical primer for t tests, correlations, and
able from: https://downloads.theifab.com/downloads/ meta-analyses. Social Psychol Personality Sci. 2017;8(4):355–62.
laws-of-the-game-2018-19-single-pages?l=en. 31. Sors F, Grassi M, Agostini T, Murgia M. A complete season with attendance
8. IFAB. Video assistant referee (VAR) protocol 2023 [16-12- restrictions confirms the relevant contribution of spectators to home advan-
2022]. Available from: https://www.theifab.com/laws/latest/ tage and referee bias in association football. PeerJ. 2022;10:e13681.
video-assistant-referee-var-protocol/#principles. 32. Jarosz AF, Wiley J. What are the odds? A practical guide to computing and
9. Spitz J, Wagemans J, Memmert D, Williams AM, Helsen WF. Video assistant reporting Bayes factors. J Problem Solving. 2014;7(1):2.
referees (VAR): the impact of technology on decision making in association 33. Abbate C, Cross J, Uhrig R. Video Assistant Referee and Home Field Advan-
football referees. J Sports Sci. 2021;39(2):147–53. tage: Implications for Referee Bias. Available at SSRN 4295203. 2022.
10. Işın A. Video Yardımcı Hakem Uygulamasının Hakem Kararları Üzerine 34. Han B, Chen Q, Lago-Peñas C, Wang C, Liu T. The influence of the video
Etkileri: Tanımlayıcı Araştırma. Türkiye Klinikleri Spor Bilimleri Dergisi. assistant referee on the Chinese Super League. Int J Sports Sci Coaching.
2023;15(2):237–42. 2020;15(5–6):662–8.
11. Lago-Peñas C, Ezequiel R, Anton K. How does Video Assistant Referee (VAR) 35. Boyko RH, Boyko AR, Boyko MG. Referee bias contributes to home advantage
modify the game in elite soccer? Int J Perform Anal Sport. 2019;19(4):646–53. in English Premiership football. J Sports Sci. 2007;25(11):1185–94.
12. Lago-Peñas C, Gómez M, Pollard R. The effect of the Video Assistant Referee 36. Nevill AM, Balmer NJ, Williams AM. The influence of crowd noise and
on referee’s decisions in the Spanish LaLiga. Int J Sports Sci Coaching. experience upon refereeing decisions in football. Psychol Sport Exerc.
2021;16(3):824–9. 2002;3(4):261–72.
13. Kubayi A, Larkin P, Toriola A. The impact of video assistant referee (VAR) on
match performance variables at men’s FIFA World Cup tournaments. Proc
Institution Mech Eng Part P: J Sports Eng Technol. 2022;236(3):187–91.
14. Dufner A-L, Schütz L-M, Hill Y. The introduction of the Video Assistant Referee Publisher’s Note
supports the fairness of the game–An analysis of the home advantage in the Springer Nature remains neutral with regard to jurisdictional claims in
German Bundesliga. Psychol Sport Exerc. 2023:102386. published maps and institutional affiliations.
15. Işın A. Home advantage and Referee Bias: a comparative analysis of League
Level differences. Percept Mot Skills. 2023;130(6):2621–31.