Double-loop bench marking methods in the era of data deluge: An empirical scientometric study and assessment of Japan's Galapagos syndrome in scientific research activities

This paper addresses the need for reliable measurement guidelines for organizations or entities in the turbulent environment of our era of data deluge. Based upon conceptual and empirical research in bibliometrics, we suggest an analytical approach to benchmarking the technology management of surprising and potentially damaging phenomena. In order to do so, we propose a method called 'double-loop benchmarking,' which consists of two steps: (1) structural benchmarking, based upon social relationships between actors and actants, and (2) projecting transaction data accumulated through daily business processes as benchmark indicators based upon the social relationships empirically measured in the first step. This paper can be seen as part of a broader agenda for how to manage during continuous but unpredictable change in circumstances of open ignorance. As an empirical study in bibliometrics, we propose a methodological improvement in scientometrics using data repurposing and triangulations. An international comparative analysis reveals empirical evidence that Japan's dynamic technology portfolio on research activities in the fields of electrics, electronics, information, and communications has consistently deviated from that in global trends since the 1990s. This phenomenon, which may be described as the 'Galapagos Syndrome,' is a strategic pitfall under the dynamic technology paradigm change.