Jan.

11, 2010

Becker Medical Library Model for Assessment of Research Impact

RESEARCH OUTPUT: Research outputs are the products created or generated from basic or clinical research (research data) and products disseminated by the research study investigators that discuss or interpret the findings of the research study (journal publications). INDICATORS OF RESEARCH OUTPUT EVIDENCE OF RESEARCH OUTPUT
Biological Materials Conference Materials Databases/Software/Algorithms Biological material or application identified or developed as a result of the research study. Conference abstracts (papers or posters) resulting from the research study. Panel discussions resulting from the research study. Database resulting from the research study. Software resulting from the research study. Algorithm resulting from the research study. License agreement executed for intellectual property generated by the research study. Measurement instrument developed by the research study. News releases issued by the research study or affiliate organization. Medical device or prototype developed by the research study. Outreach visits by research investigators. Attendees at outreach visits. Patent executed as a result of the research study. Potential new drug identified as a result of the research study. Publications resulting from the research study. Supplemental materials such as specimens, images, slides, etc., that supplement a publication (published or unpublished). Research data generated by the research study. Website developed for the research study.

License Agreements Measurement Instruments Media Releases Medical Devices Outreach Visits Patents Pharmaceutical Preparations Publications

Research Data (public or restricted) Website of Research Study

2010

Becker Medical Library St. Louis, Missouri

Jan. 11, 2010

KNOWLEDGE TRANSFER: Knowledge transfer represents awareness and/or use of research outputs. Subsequent use of the research output can be by the same study investigators or by another group. INDICATORS OF KNOWLEDGE EVIDENCE OF KNOWLEDGE TRANSFER TRANSFER
Alternative/Informal Dissemination Biological Materials Research study is referred to or cited in a blog, tweet, wiki, or other alternative mode of dissemination. Research study is cited in a presentation, speech or teaching materials. Subsequent use of a particular biological material or application of the material generated by the research study in a bench study (basic science) or clinical trial study. Clinical data generated in support of marketing a biological material (BLA) generated by the research study. Publication generated by the research study is cited in a subsequent reference including journal articles, books, book chapters, gray literature, patents, web sources, and NCBI resources. Publication generated by the research study is cited or noted as being a classical article in a field of study. Research study cited in Consensus Development Conference. Curriculum guideline refers to the research study as being significant or for use as recommended or background readings for more information. License agreement granted for use of intellectual property generated by the research study. Mass media publication refers to the research study. MTA executed for transfer of tangible property generated by the research study. Clinical trial study testing of a medical device generated by the research study. Clinical data generated in support of marketing a medical device (510(k); Investigational Device Exemption, IDE; or Premarket Approval, PMA) generated by the research study. Research study cited in a meta-analysis. Subsequent use of a drug generated by the research study in a bench study (basic science) or clinical trial study. Clinical data generated in support of marketing a drug (Investigational New Drug Application, IND; New Drug Application, NDA; Abbreviated New Drug Application, ANDA; or 505(b)(2)) generated by the research study. Publication generated by the research study accessed online. Supplemental material generated by the research study accessed online or requested. Journal article generated by the research study assigned a ranking factor by a reviewer based on significance of the research study. Requests for reprints of journal articles generated by the research study. Ancillary research study generated as a result of the research study. New research study generated as a result of the research study. Research study cited in a review. New subject heading or thesauri term or phrase resulting or related to the research study is applied. Research study cited in a systematic review. Number of page views Number of unique visitors Origin of site visitors by country Visitor length

Cited References Classical Articles Consensus Development Conferences Curriculum Guidelines License Agreements Mass Media Material Transfer Agreements (MTA) Medical Devices

Meta-Analyses Pharmaceutical Preparations

Publication Use Statistics Ranking Factors Requests for Reprints Research Studies/Ancillary Research Studies/New Reviews Subject Headings/Thesauri Systematic Reviews Website of Research Study

2010

Becker Medical Library St. Louis, Missouri

Jan. 11, 2010

Requests from the public for more information Requests from health care providers and/or researchers for more information

CLINICAL IMPLEMETATION: Clinical implementation is the application or adoption of research outputs in clinical practice. INDICATORS OF CLINICAL IMPLEMENTATION
Biological Materials

EVIDENCE OF CLINICAL IMPLEMENTATION

Biological material application generated by the research study shows benefit during clinical trials. Biological material application generated by the research study registered/licensed with FDA. Biological material application generated by the research study used by health care providers and/or consumers. Clinical/Practice GuidelinesGovernment Agency Research study cited in a guideline issued by a government agency. Clinical/Practice GuidelinesSpecialty Organizations Research study cited in a guideline issued by a specialty organization related to the field of study. Clinical/Practice GuidelinesOther Research study cited in a guideline issued by a non-government organization. HCPCS code implemented as a result of the research study. ICD-9-CM code implemented as a result of the research study. CPT code implemented as a result of the research study. Research study cited in continuing education materials. Measurement instrument generated by the research study used by health care providers and/or consumers. Medical device generated by the research study shows benefit during clinical trials. Medical device generated by the research study registered/licensed with FDA. Medical device generated by the research study used by health care providers and/or consumers. Drug generated by the research study shows benefit during clinical trials. Drug generated by the research study registered/licensed with FDA. Drug generated by the research study used by health care providers and/or consumers. Drug generated by the research study is listed on a drug formulary list. Drug generated by the research study listed on the WHO Model List of Essential Medicines. Research study cited in private insurance benefit plan in support of coverage. Research study cited in a public insurance benefit plan in support of coverage. Quality Measure Guidelines Government Agency Research study cited in a guideline issued by a government agency. Quality Measure Guidelines Specialty Organizations Research study cited in a guideline issued by a specialty organization related to the field of study. Quality Measure Guidelines Other Research study cited in a guideline issued by a non-government organization.

Clinical/Practice Guidelines

Coding

Continuing Education Materials Measurement Instruments Medical Devices

Pharmaceutical Preparations

Private Healthcare Benefit Plans Public Healthcare Benefit Plans Quality Measure Guidelines

2010

Becker Medical Library St. Louis, Missouri

Jan. 11, 2010

COMMUNITY BENEFIT: Community benefit is the enhancement of community health outcomes as a result of research outputs. INDICATORS OF COMMUNITY BENEFIT
Economic Outcomes

EVIDENCE OF COMMUNITY BENEFIT

Research study findings result in a cost-effective intervention for a disease, condition or disorder. Research study findings result in enhancement of existing resources and expertise. Research study findings result in increased performance, quality, and consistency in the delivery of health care services. Research study findings result in clinically effective approach in the management and treatment of a disease, disorder or condition. Research study findings leads to enhancement of well-being among community members.

Health Care Outcomes Quality of Life

2010

Becker Medical Library St. Louis, Missouri

Jan. 11, 2010

LEGISLATION AND POLICY ENACTMENT: Legislation and Policy Enactment represents codification of research outputs into public law, guidelines, standards or policy. INDICATORS OF LEGISLATION AND POLICY ENACTMENT
Legislation/Regulations

EVIDENCE OF LEGISLATION AND POLICY ENACTMENT

Research study cited in enactment of federal legislation or regulation. Research study cited in enactment of state legislation or regulation. Research study cited in enactment of local legislation or regulation. Research study cited in enactment of federal policy. Testimony based on research outputs is presented before a legislative body. Research study cited in enactment of standards such as American National Standards Institute (ANSI) or the International Standard Organization (ISO). Research study cited in development of non-clinical guidelines such as American Institute of Architecture Guidelines on Construction of Hospital Facilities.

Policy Testimony/Witness Standards Guidelines

2010

Becker Medical Library St. Louis, Missouri