Design Science Evaluation – Example of Experimental Design

Evaluation plays a major part in Design Science Research; however, researchers provide very little examples of how one could actually conduct this part at the operational research level. To address this need, we present an example of utility evaluation of design science artifact using an experimental design. We investigate whether an artifact as a treatment of for process development in design science research methodology improved the representational information quality of design science artifacts. The control condition is that each practitioner was presented with two artifacts in a basic two-condition repeated measures design. The improvement was measured after examining each artifact using paper-questionnaire. The paper presents DS researchers to numerous benefits that a simple experiment can provide.