Validation of Cybertest 2022
Publish date: 2022-09-27
Report number: FOI-R--5335--SE
Pages: 25
Written in: Swedish
Abstract
The Swedish Defence Research Agency has developed and assessed tests for selection of conscript cyber soldiers and specialist officers in the cyber area on behalf of the Swedish Armed Forces. Cyber Test Future Soldiers (CTFS) is used to support the Swedish Defence Conscription and Assessment Agency during selection of conscripts. Cyber Test Future Officers (CTFO) is used to support the Swedish Armed Forces with selection to the education of specialist officers (SOU), tactical officers and civil personnel within the Armed Forces. Both tests consist of one subtest measuring aspects of general cognitive ability and one subtest measuring knowledge specific for the cyber area. CTFS has been under development for three years and this evaluation shows that it works well in its current format. The test results from the selection phase has been shown to predict grade levels during the cyber soldier training. The test quality will assessed continually until 2024 to ensure high test quality over time. The test is now administrated with pen and paper but will be digitized and further research will be conducted to investigate the possibilities of adding additional parts to the subtest for cognitive ability in order to increase the quality further. Continuous assessment is important to keep assessing to what degree the test predicts suitability of candidates for the role of cyber soldier. The evaluation of CTFO shows a need for revision of several questions. Since the CTFO test has been in development for less than a year and only been given once, it is not surprising that it displays a need for adjustments. The work with CTFO will continue for several years with the goal of achieving the same standard that has been reached with the more mature CTFS. In general, the evaluations of the tests show that both tests can continue to be used for the selection of cyber soldiers and officers.