Evaluation of Model-based Capability Development in the projects, FMLS TS Infrastructure, NBG 11 and MARKUS
Publish date: 2009-12-17
Report number: FOI-R--2922--SE
Pages: 54
Written in: Swedish
Abstract
This report describes the evaluation of Model-based Capability Development (MbFU) as regards impact on the understanding, knowledge and ways of working of the personnel, which was performed in 2009. Three projects, FMLS TS, NBG 11 and MARKUS, were studied, mainly by means of interviews performed with respondents related to respective project. The evaluation study showed that the implementation of MbFU in the Swedish Armed Forces still is in a very initial phase; with few practical experiences or effects to report. On the other hand, the respondents describe goals, strategies, success factors and hypothetical effects of MbFU which, by large, replicate research results from the domain of model based development. This includes aspects such as, for instance, a common view, common frameworks and ways of working, a uniform terminology, collaboration and project integration, traceability, increased efficiency and a more distinct organisation with visible and clear processes, roles and responsibilities. One project, MARKUS, reports practical experiences, of which the most important relates to difficulties in collecting correct information data (capability requirements) for the models. The evaluation of the three projects further showed that many of the common difficulties and mistakes done in relation to model based development, also can be found in the Swedish Armed Forces initial work with MbFU. Examples include lack of overview and insufficient connections between overall goals and strategies and concrete projects, insufficient collaboration among projects, an unbalanced focus on "is now" versus "to-be" views, insufficient management of change, difficulties in identifying what is to be modelled (focus) and difficulties related to the process of collecting data to the models. In addition, it is possible to discern more general problems in terms of insufficient or inadequate time, resources, training and information. At the same time, MbFU is a unique and pioneering application of mode based development. Therefore, the approach taken by the Swedish Armed Forces, to start with small-scale experiments via pilot projects, is judged to be perfectly adequate. The evaluation study suggests that this experimental approach is continued and performed more in-depth, taking into consideration the lessons learned described in this report. This in order to build accumulative experience as basis for a decision on more comprehensive implementation of MbFU in the armed forces. The evaluation study also suggests continued and continuous evaluation, for instance in the forms of surveys, observation and work shops. It is further suggested that the Swedish Armed Forces takes care of other MbFU related needs which have been identified during the evaluation. These include training packages for MbFU, MODAF and MooD, need analyses and the development of a lessons learned database.