Pattern discovery and validation using scientific research methods [TPLOP Journal]

Abstract

Pattern discovery, the process of discovering previously unrecognized patterns, is often performed as an ad-hoc process with little resulting certainty in the quality of the proposed patterns. Pattern validation, the process of validating the accuracy of proposed patterns, remains dominated by the simple heuristic of “the rule of three”. This article shows how to use established scientific research methods for the purpose of pattern discovery and validation. We present a specific approach, called the handbook method, that uses the qualitative survey, action research, and case study research for pattern discovery and evaluation, and we discuss the underlying principle of using scientific methods in general. We evaluate the handbook method using three exploratory studies and demonstrate its usefulness.

Keywords

Pattern discovery, pattern mining, pattern validation, the-rule-of-three, handbook method, theory presentation

Reference

Riehle, D., Harutyunyan, N., & Barcomb, A. (2025). Pattern Discovery and Validation Using Scientific Research Methods. In Transactions on Pattern Languages of Programming V (TPLOP), Lecture Notes in Computer Science (LNCS 14630), Springer Verlag, pp. 226-253.

(Yes, this paper was accepted in 2021 and published in 2025.)

Download

The paper is available online (local copy).

An earlier version was published as: Technical Report CS-2020-01. Friedrich-Alexander-Universität Erlangen-Nürnberg, Dept. of Computer Science, Erlangen, Germany. Also available as a preprint.