Abstract
Zusammenfassung.Hintergrund: Das Publikationsaufkommen in Zeitschriften mit hohem Impact Factor ist ein Indiz für die Teilhabe einer Disziplin am internationalen Diskurs. Ein Suchfilter ermöglicht es, definierte Publikationen zuverlässig und reproduzierbar zu recherchieren. Ziel: Entwicklung und Validierung eines geografischen Suchfilters für Publikationen in pflegewissenschaftlichen Zeitschriften mit hohem Impact Factor mit Beteiligung von Pflegewissenschaftlerinnen / -wissenschaftlern aus dem deutschsprachigen Raum. Methode: Der Suchfilter wurde objektiv in mehreren Stufen entwickelt und geprüft: (i) Bildung eines Entwicklungs- und eines Validierungssets, jeweils bestehend aus relevanten und nicht relevanten Publikationen, (ii) Generierung des Suchfilters mittels Textanalyse des Entwicklungssets, (iii) interne Validierung anhand des Entwicklungssets und (iv) externe Validierung anhand des Validierungssets. Die Validität wurde anhand mehrerer Genauigkeitsparameter geprüft, z. B. Sensitivität, Spezifität, positiver prädiktiver Wert (PPW) und Number needed to read (NNR). Ergebnisse: Der Suchfilter identifizierte 22 von 30 relevanten und 16 von 21 nicht relevanten Publikationen korrekt im Entwicklungsset: Sensitivität 80 % (95 % KI 66 − 94), Spezifität 76 % (95 % KI 58 − 94), PPW 83 % (95 % KI 69 − 97). Die externe Validierung ergab ähnliche oder bessere Ergebnisse: Sensitivität 81 % (95 % KI 67 − 96), Spezifität 88 % (95 % KI 71 − 100), PPW 88 % (95 % KI 75 − 100). Die NNR betrug 1,2 bzw. 1,1. Schlussfolgerungen: Der Suchfilter hat das Potenzial, die intendierten Publikationen zu identifizieren.
Abstract.Background: The number of publications in journals with a high impact factor is an indication of a discipline’s participation in international discourse. A search filter allows reliable and reproducible searches for specific publications. Aim: Development and validation of a geographic search filter for publications by nursing scientists affiliated to German-speaking countries in nursing journals with a high impact factor. Methods: The search filter was objectively developed following several steps: (i) creation of a development and a validation set, each consisting of relevant and non-relevant publications, (ii) generation of the search filter by means of text analysis of the development set, (iii) internal validation based on the development set and (iv) external validation using the validation set. The validity was examined regarding several accuracy parameters, e. g. sensitivity, specificity, positive predictive value (PPV) and number needed to read (NNR). Results: The search filter correctly identified 22 of 30 relevant and 16 of 21 non-relevant publications in the development set: sensitivity 80 % (95 % CI 66 − 94), specificity 76 % (95 % CI 58 − 94), PPV 83 % (95 % CI 69 − 97). External validation yielded similar or better results: sensitivity 81 % (95 % CI 67 − 96), specificity 88 % (95 % CI 71 − 100), PPV 88 % (95 % CI 75 − 100). The NNR was 1.2 and 1.1, respectively. Conclusions: The search filter has the potential to identify the intended publications.
Literatur
(2017). The medline UK filter. Development and validation of a geographic search filter to retrieve research about the UK from OVID medline. Health Information and Libraries Journal, Article in Press. doi: 10.1111/hir.12187
(2002). Identifying Diagnostic Studies in MEDLINE: Reducing the Number Needed to Read. JAMA, 9 (6), 653 – 658.
(2014). Choosing and using methodological search filters: searchers’ views. Health Information & Libraries Journal, 31 (2), 133 – 147.
(2007). Was ist ein Konfidenzintervall? Deutsche Medizinische Wochenschrift, 132 (Supplement 1), e17 – e18.
(2005). Development of two search strategies for literature in MEDLINE-PubMed: nursing diagnoses in the context of evidence-based nursing. International Journal of Nursing Terminologies and Classifications, 16 (2), 26 – 32.
(2009). A principal component analysis of 39 scientific impact measures. PLOS One, 4 (6), e6022.
(2015). Growth rates of modern science. A bibliometric analysis based on the number of publications and cited references. Journal of the Association for Information Science and Technology, 66 (11), 2215 – 2222.
(1996). Statistical Methodology. I. Incorporating the Prevalence of Disease into the Sample Size Calculation for Sensitivity and Specificity. Academic Emergency Medicine, 3 (9), 895 – 900.
(2014). Creating Provincial and Territorial Search Filters to Retrieve Studies Related to Canadian Indigenous Peoples from Ovid MEDLINE. Journal of the Canadian Health Libraries Association, 35 (1), 5.
Clarivate Analytics . (2017a). 2017 Journal Citation Reports® Science Edition. Clarivate Analytics. https://jcr.incites.thomson reuters.com [19.06.2017].Clarivate Analytics . (2017b). Journal Citation Reports® Science Edition. International Journal of Nursing Studies (Citing Journal Data). https://jcr.incites.thomsonreuters.com [02.07.2017].The Cochrane Collaboration . (2012). LMIC Filters. http://epoc.cochrane.org/lmic-filters. [26.11.2018].(2018). Systematic review identifies six metrics and one method for assessing literature search effectiveness but no consensus on appropriate use. Journal of Clinical Epidemiology, 99, 53 – 63.
(2017). random: True Random Numbers using RANDOM.ORG (Version 0.2.6.) [Computer Software]. https://CRAN.R-project.org/package=random. [26.11.2018].
(2014). Sample size estimation in diagnostic test studies of biomedical informatics. Journal of Biomedical Informatics, 48, 193 – 204.
(2012). Routine development of objectively derived search strategies. Systematic Reviews, 1, 19.
(1994). Developing Optimal Search Strategies for Detecting Clinically Sound Studies in MEDLINE. Journal of the American Medical Informatics Association, 1 (6), 447 – 458.
(2014). Evaluation of medical research performance – position paper of the Association of the Scientific Medical Societies in Germany (AWMF). German Medical Science, 12.
(2018). Repräsentanz von Pflegewissenschaftlerinnen und Pflegewissenschaftlern aus dem deutschsprachigen Raum in Zeitschriften mit hohem Impact Factor. Eine bibliometrische Publikationsanalyse. Pflege, 31 (1), 31 – 39.
InterTASC Information Specialists’ Sub-Group . (2017). ISSG Search Filters Resource. https://sites.google.com/a/york.ac.uk/issg-search-filters-resource/home [26.10.2017].(2004). Evaluation of methodological search filters − a review. Health Information and Libraries Journal, 21 (3), 148 – 163.
(2005). Development and evaluation of evidence-based nursing (EBN) filters and related databases. Journal of the Medical Library Association, 93 (1), 104 – 115.
(2015). Retrieval of overviews of systematic reviews in MEDLINE was improved by the development an objectively derived and validated search strategy. Journal of Clinical Epidemiology, 74, 107 – 118.
(2013). Searching for research findings and KT literature. In: Straus, S. E.Tetroe, J.Graham, I. D. (Hrsg.),
Knowledge Translation in Health Care . Chichester: John Wiley & Sons, 63 – 74.(2009). Retrieving randomized controlled trials from medline: a comparison of 38 published search filters. Health Information and Libraries Journal, 26 (3), 187 – 202.
(2009). Der Impact Factor. Pflege, 22 (1), 3 – 5.
NLinks . (2013). NLINKS. About NLINKS. http://nlinks.org/about -nlinks.html [02.07.2017].(2011). Developing a geographic search filter to identify randomised controlled trials in Africa. Finding the optimal balance between sensitivity and precision. Health Information and Libraries Journal, 28 (3), 210 – 215.
R Core T eam . (2017) R: A language and environment for statistical [Computer Software]. Wien: R Foundation for Statistical Computing. www.R-project.org/. [26.11.2018].(2010). Developing and testing of search filters for the new European Union Member States’ research. Health Information and Libraries Journal, 27 (3), 227 – 234.
(2002). Nutzen eines diagnostischen Tests in der Praxis: prädiktive Werte. Deutsche Zahnärztliche Zeitschrift, 57 (10), 573 – 575.
(2001). Taking advantage of the explosion of systematic reviews: an efficient MEDLINE search strategy. Effective Clinical Practice, 4 (4), 157 – 162.
(2010). Identifying nurse staffing research in Medline: development and testing of empirically derived search strategies with the PubMed interface. BMC Medical Research Methodology, 10, 76.
(2007). Improving search filter development: a study of palliative care literature. BMC Medical Informatics and Decision Making, 7, 18.
. (2017). InCites Journal Citation Reports [15.06.2017].
(2005). The number needed to read-a new measure of journal value. Health Information and Libraries Journal, 22 (2), 81 – 82.
(2010). Development of search filters for retrieval of literature on the molecular epidemiology of cancer. Mutation Research, 701 (2), 107 – 110.
(2012). Search filters to identify geriatric medicine in Medline. Journal of the American Medical Informatics Association, 19 (3), 468 – 472.
(2016). Limits of search filter development. Journal of the Medical Library Association, 104 (1), 42 – 46.
(o. J.). POOQ. http://www.pooq.org/wortzahl/index.php [02.07.2017].
