Pattern discovery and validation using scientific research methods [TPLoP Journal]

Abstract: Pattern discovery, the process of discovering previously unrecognized patterns, is often performed as an ad-hoc process with little resulting certainty in the quality of the proposed patterns. Pattern validation, the process of validating the accuracy of proposed patterns, remains dominated by the simple heuristic of “the rule of three”. This article shows how to use established scientific research methods for the purpose of pattern discovery and validation. We present a specific approach, called the handbook method, that uses the qualitative survey, action research, and case study research for pattern discovery and evaluation, and we discuss the underlying principle of using scientific methods in general. We evaluate the handbook method using three exploratory studies and demonstrate its usefulness.

Keywords: Pattern discovery, pattern mining, pattern validation, the-rule-of-three, handbook method, theory presentation

Reference:  Riehle, D., Harutyunyan, N., & Barcomb, A. (2021). Pattern Discovery and Validation Using Scientific Research Methods. In Transactions on Pattern Languages of Programming V (TPLoP), Lecture Notes in Computer Science, Springer Verlag. Forthcoming.

The paper is available as a preprint (local copy).

An earlier version was published as: Technical Report CS-2020-01. Friedrich-Alexander-Universität Erlangen-Nürnberg, Dept. of Computer Science, Erlangen, Germany.

Posted on


  1. […] to make your theory practical, I recommend our handbook method. There is an explanatory video and a journal article […]

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Share the Joy

Share on LinkedIn

Share by email

Share on Twitter / X

Share on WhatsApp

Featured Startups

QDAcity makes qualitative research and qualitative data analysis fun and easy.
EDITIVE makes inter- and intra-company document collaboration more effective.

Featured Projects

Making free and open data easy, safe, and reliable to use
Bringing business intelligence to engineering management
Making open source in products easy, safe, and fun to use