A novel approach to assessing validity in sports performance research: integrating expert practitioner opinion into the statistical analysis: A novel approach for interpreting GPS validity

Efthymios Kyprianou, Lorenzo Lolli, Hani Al Haddad, Valter Di Salvo, Matthew Varley, Alberto Mendez-Villanueva, Warren Gregson, Matthew Weston

Research output: Contribution to journalArticle

Abstract

Abstract
Purpose: Using elite youth soccer players’ maximal sprinting speeds collected from a criterion and non-criterion measure, we demonstrate how expert practitioner opinion can be used to determine measurement validity.
Methods: Expert soccer practitioners (n=50) from around the world were surveyed on issues relating to the measurement of maximal sprinting speed and twelve elite youth soccer players performed two maximal 40 m sprints, measured by 10-Hz GPS units (non-ctierion) and a 100-Hz Laser (criterion). Setting statistical equivalence bounds as practitioner opinion of the practically acceptable amount of measurement error for maximal sprinting speed, we assessed agreement between GPS and Laser.
Results: Survey respondents reported a combination of methods for deriving maximal sprinting speed (tests, training, match) but most did not assess system validity. Median value of the practically acceptable amount of measurement error for maximal sprinting speed was 0.20 m/s. Maximal sprinting speed was 8.79 ± 0.33 m/s (Laser) and 8.75 ± 0.32 m/s (GPS) and the mean difference was 0.04 (90% confidence interval -0.03 to 0.11) m/s. Using the median acceptable amount of measurement error, we set our lower and upper equivalence bounds to -0.10 m/s and +0.10 m/s, respectively. Equivalence testing showed Laser and GPS as likely equivalent measures (probability 93.7%).
Conclusion: Using expert-informed equivalence thresholds represents a novel way to assess validity in sports performance research.
Original languageEnglish
JournalScience and Medicine in Football
Publication statusAccepted/In press - 5 May 2019

Fingerprint

Athletic Performance
Expert Testimony
Soccer
Lasers
Research
Confidence Intervals
Surveys and Questionnaires

Cite this

@article{50b92035489142e9b7b6919d8d4a24dd,
title = "A novel approach to assessing validity in sports performance research: integrating expert practitioner opinion into the statistical analysis: A novel approach for interpreting GPS validity",
abstract = "AbstractPurpose: Using elite youth soccer players’ maximal sprinting speeds collected from a criterion and non-criterion measure, we demonstrate how expert practitioner opinion can be used to determine measurement validity. Methods: Expert soccer practitioners (n=50) from around the world were surveyed on issues relating to the measurement of maximal sprinting speed and twelve elite youth soccer players performed two maximal 40 m sprints, measured by 10-Hz GPS units (non-ctierion) and a 100-Hz Laser (criterion). Setting statistical equivalence bounds as practitioner opinion of the practically acceptable amount of measurement error for maximal sprinting speed, we assessed agreement between GPS and Laser. Results: Survey respondents reported a combination of methods for deriving maximal sprinting speed (tests, training, match) but most did not assess system validity. Median value of the practically acceptable amount of measurement error for maximal sprinting speed was 0.20 m/s. Maximal sprinting speed was 8.79 ± 0.33 m/s (Laser) and 8.75 ± 0.32 m/s (GPS) and the mean difference was 0.04 (90{\%} confidence interval -0.03 to 0.11) m/s. Using the median acceptable amount of measurement error, we set our lower and upper equivalence bounds to -0.10 m/s and +0.10 m/s, respectively. Equivalence testing showed Laser and GPS as likely equivalent measures (probability 93.7{\%}). Conclusion: Using expert-informed equivalence thresholds represents a novel way to assess validity in sports performance research.",
author = "Efthymios Kyprianou and Lorenzo Lolli and {Al Haddad}, Hani and {Di Salvo}, Valter and Matthew Varley and Alberto Mendez-Villanueva and Warren Gregson and Matthew Weston",
year = "2019",
month = "5",
day = "5",
language = "English",
journal = "Science and Medicine in Football",
issn = "2473-3938",
publisher = "Taylor and Francis Ltd.",

}

A novel approach to assessing validity in sports performance research: integrating expert practitioner opinion into the statistical analysis : A novel approach for interpreting GPS validity. / Kyprianou, Efthymios; Lolli, Lorenzo; Al Haddad, Hani; Di Salvo, Valter; Varley, Matthew; Mendez-Villanueva, Alberto; Gregson, Warren; Weston, Matthew.

In: Science and Medicine in Football, 05.05.2019.

Research output: Contribution to journalArticle

TY - JOUR

T1 - A novel approach to assessing validity in sports performance research: integrating expert practitioner opinion into the statistical analysis

T2 - A novel approach for interpreting GPS validity

AU - Kyprianou, Efthymios

AU - Lolli, Lorenzo

AU - Al Haddad, Hani

AU - Di Salvo, Valter

AU - Varley, Matthew

AU - Mendez-Villanueva, Alberto

AU - Gregson, Warren

AU - Weston, Matthew

PY - 2019/5/5

Y1 - 2019/5/5

N2 - AbstractPurpose: Using elite youth soccer players’ maximal sprinting speeds collected from a criterion and non-criterion measure, we demonstrate how expert practitioner opinion can be used to determine measurement validity. Methods: Expert soccer practitioners (n=50) from around the world were surveyed on issues relating to the measurement of maximal sprinting speed and twelve elite youth soccer players performed two maximal 40 m sprints, measured by 10-Hz GPS units (non-ctierion) and a 100-Hz Laser (criterion). Setting statistical equivalence bounds as practitioner opinion of the practically acceptable amount of measurement error for maximal sprinting speed, we assessed agreement between GPS and Laser. Results: Survey respondents reported a combination of methods for deriving maximal sprinting speed (tests, training, match) but most did not assess system validity. Median value of the practically acceptable amount of measurement error for maximal sprinting speed was 0.20 m/s. Maximal sprinting speed was 8.79 ± 0.33 m/s (Laser) and 8.75 ± 0.32 m/s (GPS) and the mean difference was 0.04 (90% confidence interval -0.03 to 0.11) m/s. Using the median acceptable amount of measurement error, we set our lower and upper equivalence bounds to -0.10 m/s and +0.10 m/s, respectively. Equivalence testing showed Laser and GPS as likely equivalent measures (probability 93.7%). Conclusion: Using expert-informed equivalence thresholds represents a novel way to assess validity in sports performance research.

AB - AbstractPurpose: Using elite youth soccer players’ maximal sprinting speeds collected from a criterion and non-criterion measure, we demonstrate how expert practitioner opinion can be used to determine measurement validity. Methods: Expert soccer practitioners (n=50) from around the world were surveyed on issues relating to the measurement of maximal sprinting speed and twelve elite youth soccer players performed two maximal 40 m sprints, measured by 10-Hz GPS units (non-ctierion) and a 100-Hz Laser (criterion). Setting statistical equivalence bounds as practitioner opinion of the practically acceptable amount of measurement error for maximal sprinting speed, we assessed agreement between GPS and Laser. Results: Survey respondents reported a combination of methods for deriving maximal sprinting speed (tests, training, match) but most did not assess system validity. Median value of the practically acceptable amount of measurement error for maximal sprinting speed was 0.20 m/s. Maximal sprinting speed was 8.79 ± 0.33 m/s (Laser) and 8.75 ± 0.32 m/s (GPS) and the mean difference was 0.04 (90% confidence interval -0.03 to 0.11) m/s. Using the median acceptable amount of measurement error, we set our lower and upper equivalence bounds to -0.10 m/s and +0.10 m/s, respectively. Equivalence testing showed Laser and GPS as likely equivalent measures (probability 93.7%). Conclusion: Using expert-informed equivalence thresholds represents a novel way to assess validity in sports performance research.

M3 - Article

JO - Science and Medicine in Football

JF - Science and Medicine in Football

SN - 2473-3938

ER -