Validation of a Football Competence Observation System (FOCOS), Linked to Procedural Tactical Knowledge
Round 1
Reviewer 1 Report
The paper “Validation of a Football Competence Observation System 2 (FOCOS), linked to Procedural Tactical Knowledge” presents a novel observational tool for assessing quality of play in football. Overall, this is a solid study that I consider very appropriate for the intended Special Issue. Although the manuscript as a whole is relatively convincing, a few questions remain open for me with regard to the tests conducted, which ultimately also has consequences for the interpretation of the data.
It is unclear to me to what extent the items combined into a scale (Offensive Average, Defensive Average) actually fit together. There is a lack of analyses of correlations and reliability at item level (not with regard to coder reliability, which the authors carry out, but with regard to item reliability, calculated by Cronbach's alpha, for example).
I then also see a difficulty in the justification of construct validity: the authors check here whether the instrument is able to measure with sufficient sensitivity to different player levels. In my understanding, however, this tests the prognostic quality, but not the construct validity (convergent and discriminant). This would require other procedures, especially confirmatory factor analyses. The authors would at least have to give good reasons for not using these methods. If one reason is the small sample size, it seems necessary to expand it first.
Author Response
see attached
Author Response File: 
Author Response.pdf
Reviewer 2 Report
Dear authors,
I would like to congratulate the authors on the effort to carry out this study, carefully design in a clear attempt to define and assess the player’s football competence. In my opinion the overall appreciation of the current investigation is positive, as the present work proposes a new instrument that it is intended to overcome some shortcoming identified in previous methods. Also, it can provide an interesting tool for talent identification, selection, and development programs, for competitive purposes, or for pedagogical means. However, I have some concerns or comments for your consideration, particularly regarding the consistency in some raised aspects of the rationale, and the potential benefits and limitations, as following:
Abstract
Please be consistent when referring to the sport as soccer or as football. This should be consistent throughout the text.
- Introduction
In this section, the authors use a set of references that, in general, were published 10 years ago (or more), which naturally does not allow inferring about the current and pertinent use of the proposed instrument. Furthermore, it was exactly in the last decade that there was a significant proliferation of this type of studies, with an exponential increase in investigations focused on this specific domain, which propose different approaches, instruments and techniques of analysis, which should be contextualized in order to better fit understand the relevance of using these instruments under analysis. I suggest the inclusion of the following references, for example:
- Sarmento H, Marcelino R, Anguera M, Campaniço J, Matos N, Leitão J. Match analysis in football: a systematic review. Journal of Sports Sciences. 2014(32):1831-43. doi:10.1080/02640414.2014.898852.
- Agras H, Ferragut C, Abraldes JA. Match analysis in futsal: a systematic review. International Journal of Performance Analysis in Sport. 2016;16(2):652-86.
- Silva M, Marcelino R, Lacerda D, Joao PV. Match Analysis in Volleyball: a systematic review. Montenegrin Journal of Sports Science and Medicine. 2016;5(1):35-46.
- Medeiros A, Palao J, Marcelino R, Mesquita I. Systematic review on sports performance in beach volleyball from match analysis. Revista Brasileira de Cineantropometria e Desempenho Humano. 2014;16(16):698-708.
- Courel-Ibáñez J, McRobert AP, Toro EO, Vélez DC. Collective behaviour in basketball: a systematic review. International Journal of Performance Analysis in Sport. 2017;17(1-2):44-64. doi:10.1080/24748668.2017.1303982.
It should be noted that the growth in development of instruments for the observation and analysis of games in team sports has evolved from instruments of a general nature (of application to different sports) to had-hoc instruments, more appropriate to the different realities and contexts of interest to the scientific and / or technical community.
- Material and Methods
The description of behavioral variables and technical-tactical indicators is a clear need for coaches and technical staff, of utmost importance. It is noticeable the careful approach followed by the authors, during the several stages (Lines 135–145, and from then on). The introduction of graphical elements would be advised in order to provide a clearer view about what was done.
- Results
Line 284: Please include effect size estimation.
It would be of interest to include the effectiveness indices obtained for each category, besides the offensive and defensive effectiveness. I wonder that maybe this could provide a clearer overview about the application of the FOCOS instrument in an applied context.
- Discussion
I have serious concerns regarding the general discussion and interpretation of the observed results as this section is limited to a comparative superficiality. The advantages and beneficial use of FOCOS should be clearly addressed, not only over other instruments, but also highlighting what does this new tool adds and possible applications. For example, it would be interesting to discuss the observed results on tactical behaviors in accordance to other methods, such as positional data.
- Olthof, S. B., Frencken, W. G., & Lemmink, K. A. (2019). A match-derived relative pitch area facilitates the tactical representativeness of small-sided games for the official soccer match. Journal of strength and conditioning research, 33(2), 523.
Although the present work provides a methodological investigation of a new observational tool, limitations must include a critical examination of the analysis and observation of the game, referring to the volume of information, the amount of financial, temporal and human resources that often entails, its evaluation and application in real time, the limitations of the FOCOS, among others.
- Conclusions
Are generally in line with the main findings.
References
It is strongly recommended that authors include more updated references.
The manuscript is displayed in a confusing-written English, with a baffling flow throughout the text, and it must be improved.
Author Response
see attached
Author Response File: Author Response.pdf
Round 2
Reviewer 1 Report
The revisions and justifications seem sufficient to me.
Author Response
Thank you for the feedback.
Reviewer 2 Report
Dear authors,
I would like to congratulate the authors on the changes to carry out in this new version of the manuscript. I understand that this study focused on the development and validation of a new observational tool, this was methodological accomplished by the authors.
- Introduction
I recognize that the suggested references include several study areas related no performance analysis. However, it should be noted that these references include a review of the application of several instruments in team sports – most of them were mentioned in the introduction. It should also be noted that some of the cited instruments (GPAI, TSAP or GPET) were developed in team sports (basketball, handball, football, or volleyball, for instance). In addition, some of these instruments were developed mainly in training contexts for young athletes, preferably recommended for young people aged 6-14 years old (GPAI) and +12/13 years old (TSAP), or even as an assessment tool for using in physical education programs.
By suggesting more updated references, it was intended to reinforce and highlight the relevance of the current study.
- Material and Methods
I find the inclusion of Figure 1 quite useful, providing a clearer view about what was done in the current study.
- Results
No effect size estimation was included when comparing semi-professional and amateur football players.
Although the current study aim was not to describe the football competence, I was hoping to see explored not only the total average, the offensive average and defensive average. In fact, it was expected to observe the sensitivity of the instrument in each category, according to player status.
- Discussion
No major changes were performed.
Author Response
see attached
Author Response File: Author Response.pdf
