<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Archiving and Interchange DTD v1.0 20120330//EN" "JATS-archivearticle1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" article-type="research-article"><?properties manuscript?><front><journal-meta><journal-id journal-id-type="nlm-journal-id">9815831</journal-id><journal-id journal-id-type="pubmed-jr-id">22061</journal-id><journal-id journal-id-type="nlm-ta">Genet Med</journal-id><journal-id journal-id-type="iso-abbrev">Genet. Med.</journal-id><journal-title-group><journal-title>Genetics in medicine : official journal of the American College of Medical Genetics</journal-title></journal-title-group><issn pub-type="ppub">1098-3600</issn><issn pub-type="epub">1530-0366</issn></journal-meta><article-meta><article-id pub-id-type="pmid">22555656</article-id><article-id pub-id-type="pmc">4681509</article-id><article-id pub-id-type="doi">10.1038/gim.2012.43</article-id><article-id pub-id-type="manuscript">HHSPA742734</article-id><article-categories><subj-group subj-group-type="heading"><subject>Article</subject></subj-group></article-categories><title-group><article-title>Knowledge integration at the center of genomic medicine</article-title></title-group><contrib-group><contrib contrib-type="author"><name><surname>Khoury</surname><given-names>Muin J.</given-names></name><degrees>MD, PhD</degrees><xref ref-type="aff" rid="A1">1</xref><xref ref-type="aff" rid="A2">2</xref></contrib><contrib contrib-type="author"><name><surname>Gwinn</surname><given-names>Marta</given-names></name><degrees>MD, MPH</degrees><xref ref-type="aff" rid="A1">1</xref><xref ref-type="aff" rid="A3">3</xref></contrib><contrib contrib-type="author"><name><surname>Dotson</surname><given-names>W. David</given-names></name><degrees>PhD</degrees><xref ref-type="aff" rid="A1">1</xref></contrib><contrib contrib-type="author"><name><surname>Schully</surname><given-names>Sheri D.</given-names></name><degrees>PhD</degrees><xref ref-type="aff" rid="A2">2</xref></contrib></contrib-group><aff id="A1"><label>1</label>Office of Public Health Genomics, Centers for Disease Control and Prevention, Atlanta, Georgia, USA</aff><aff id="A2"><label>2</label>Epidemiology and Genomics Research Program, Division of Cancer Control and Population Sciences, National Cancer Institute, Bethesda, Maryland, USA</aff><aff id="A3"><label>3</label>McKing Consulting Corp, Atlanta, Georgia, USA</aff><author-notes><corresp id="FN1">Correspondence: Muin J. Khoury (<email>muk1@cdc.gov</email>)</corresp></author-notes><pub-date pub-type="nihms-submitted"><day>8</day><month>12</month><year>2015</year></pub-date><pub-date pub-type="ppub"><month>7</month><year>2012</year></pub-date><pub-date pub-type="pmc-release"><day>16</day><month>12</month><year>2015</year></pub-date><volume>14</volume><issue>7</issue><fpage>643</fpage><lpage>647</lpage><!--elocation-id from pubmed: 10.1038/gim.2012.43--><abstract><p id="P1">Three articles in this issue of <italic>Genetics in Medicine</italic> describe examples of &#x0201c;knowledge integration,&#x0201d; involving methods for generating and synthesizing rapidly emerging information on health-related genomic technologies and engaging stakeholders around the evidence. Knowledge integration, the central process in translating genomic research, involves three closely related, iterative components: knowledge management, knowledge synthesis, and knowledge translation. Knowledge management is the ongoing process of obtaining, organizing, and displaying evolving evidence. For example, horizon scanning and &#x0201c;infoveillance&#x0201d; use emerging technologies to scan databases, registries, publications, and cyberspace for information on genomic applications. Knowledge synthesis is the process of conducting systematic reviews using <italic>a priori</italic> rules of evidence. For example, methods including meta-analysis, decision analysis, and modeling can be used to combine information from basic, clinical, and population research. Knowledge translation refers to stakeholder engagement and brokering to influence policy, guidelines and recommendations, as well as the research agenda to close knowledge gaps. The ultrarapid production of information requires adequate public and private resources for knowledge integration to support the evidence-based development of genomic medicine.</p></abstract><kwd-group><kwd>evidence-based medicine</kwd><kwd>genomic medicine</kwd><kwd>knowledge integration</kwd><kwd>management</kwd><kwd>synthesis</kwd><kwd>translation</kwd></kwd-group></article-meta></front><body><p id="P2">Rapid discoveries in genomics and other &#x0201c;omic&#x0201d; fields are creating expectations that new tests and interventions will be developed for use in clinical practice and disease prevention.<sup><xref rid="R1" ref-type="bibr">1</xref></sup> Cancer has been at the forefront of clinical applications of these technologies, which offer the potential to use germ-line and tumor genomic data to develop personalized interventions.<sup><xref rid="R2" ref-type="bibr">2</xref></sup> Despite this promise, the information needed to move applications into clinical practice is often scarce and stakeholders sometimes disagree on how much evidence is needed.<sup><xref rid="R3" ref-type="bibr">3</xref></sup></p><p id="P3">In this issue of <italic>Genetics in Medicine</italic>, three articles tackle the complexities of gathering, evaluating, and disseminating the evidence on genomic tests. Two articles stem from a National Cancer Institute initiative on comparative effective research in cancer genomics and personalized medicine.<sup><xref rid="R4" ref-type="bibr">4</xref></sup> Comparative effective research arose as a result of increased interest in measuring patient-centered health outcomes and comparing alternative approaches to disease prevention and treatment.<sup><xref rid="R5" ref-type="bibr">5</xref></sup> Genomic medicine provides an ideal opportunity to apply comparative effective research methods to compare genomic tools and applications with usual care in real-world settings.<sup><xref rid="R6" ref-type="bibr">6</xref></sup></p><p id="P4">In the first article, Goddard et al.<sup><xref rid="R7" ref-type="bibr">7</xref></sup> identify approaches to assessing genomic applications through literature reviews and demonstrate lessons learned from the National Cancer Institute initiative. Using case studies, they identify significant challenges in the conduct and evaluation of comparative effective research, including the rapid pace of innovation and data acquisition, lack of oversight, and variable evidentiary thresholds for clinical and personal utility. They conclude that a variety of methodological approaches are needed to develop and synthesize the knowledge needed to ensure an effective translation of genomic discoveries in cancer. These approaches include a combination of comparative observational studies and randomized trials, as well as decision modeling and economic analysis of patient-centered outcomes.</p><p id="P5">In the second article, Deverka et al.<sup><xref rid="R8" ref-type="bibr">8</xref></sup> explore how stakeholders view knowledge about genomic applications in cancer. Stakeholders include clinicians, insurers, test developers, advocates, policy makers, and others whose views can influence translation from research to practice. Using case studies, the authors present results of evidence synthesis to 22 diverse stakeholders who participated in a workshop to explore the evidence of cancer genomic tests for clinical practice and coverage decision-making. Describing how the stakeholders&#x02019; opinions on evidentiary thresholds diverged and changed during the workshop, the authors highlight the need for ongoing stakeholder engagement in unbiased settings. A common understanding of the existing evidence base should guide the development of evidentiary thresholds in genomic medicine.</p><p id="P6">In the third article, Wallace et al.<sup><xref rid="R9" ref-type="bibr">9</xref></sup> explore a new way to rapidly update the evidence base on genomic applications in practice. Systematic reviews and meta-analyses, the principal tools for evidence synthesis, are labor intensive and time consuming; thus, the volume and rapid evolution of information in genomic medicine presents a substantial challenge. The authors demonstrate an approach to mining curated, online knowledge bases that can reduce the burden of updating systematic reviews. Their findings provide important impetus for the development and deployment of modern approaches based on text or data mining and other technologies to reduce the labor necessary to produce and maintain systematic reviews in the rapidly developing field of genomic medicine.</p><sec id="S1"><title>KNOWLEDGE INTEGRATION AT THE CENTER OF GENOMIC MEDICINE</title><p id="P7">Each of these three articles addresses a different component of the &#x0201c;knowledge integration&#x0201d; (KI) process, a term that has been used to mean different things in different contexts.<sup><xref rid="R10" ref-type="bibr">10</xref>,<xref rid="R11" ref-type="bibr">11</xref></sup> Burke et al.<sup><xref rid="R12" ref-type="bibr">12</xref></sup> viewed KI within and across disciplines as the engine for the effective use of genomic information to improve health. They defined KI as &#x0201c;the process of selecting, storing, collating, analyzing, integrating and disseminating information both within and across disciplines for the benefit of population health. It includes methodological development, and is the means by which information is transformed into useful knowledge.&#x0201d;<sup><xref rid="R12" ref-type="bibr">12</xref></sup></p><p id="P8">Because genomic discoveries result from basic, clinical, and population research, KI is at the center of translational activities in genomic medicine as illustrated in the T1&#x02013;T4 translational pathway discussed elsewhere<sup><xref rid="R13" ref-type="bibr">13</xref></sup> and elaborated here in <xref rid="F1" ref-type="fig">Figure 1</xref>. Translational research proceeds in phases, using basic genome-based discoveries to develop promising applications such as tests and drugs (T1), evaluating efficacy of such applications and developing evidence-based recommendations (T2), implementing and disseminating evidence-based recommendations into clinical and public health programs (T3), and measuring effectiveness and cost-effectiveness of genomic applications at the population level (T4). Most funded and published genomic research, even in cancer, remains either in the discovery or early translation phases<sup><xref rid="R14" ref-type="bibr">14</xref></sup> and the evidence base for genomics in practice remains limited. The sheer volume and variety of information accumulating from primary research creates tremendous potential noise.<sup><xref rid="R15" ref-type="bibr">15</xref></sup></p><p id="P9">A robust KI process is needed to digest this information and transform it into knowledge that drives policy, practice, and further research. Three essential components constitute the essence of KI: knowledge management (KM), knowledge synthesis (KS), and knowledge translation (KT; <xref rid="T1" ref-type="table">Table 1</xref> and <xref rid="F1" ref-type="fig">Figure 1</xref>). These are common to all areas of biomedical research and genomics is no exception; however, the volume of new genomic information and the speed with which it is developing has the potential to affect all areas of medicine and public health.</p></sec><sec id="S2"><title>KM: HORIZON SCANNING AND INFOVEILLANCE</title><p id="P10">The first component of KI is KM, which is a continuous process of horizon scanning to select, store, curate, and track relevant information from multiple disciplines and phases of translation. Bioinformatics tools can help automate the process of mining for information on genomic discoveries and their potential functional significance, as well as raise hypotheses about potential therapeutic or preventive interventions. The National Center for Biotechnology Information of the National Library of Medicine has organized a wealth of diverse information in open-access, online databases focused primarily on basic research; these include genomic sequencing databases, functional databases, and locus-specific databases.<sup><xref rid="R16" ref-type="bibr">16</xref></sup></p><p id="P11">Developing methods for horizon scanning and surveillance of relevant information is part of the new field of &#x0201c;infoveillance&#x0201d;.<sup><xref rid="R17" ref-type="bibr">17</xref></sup> An example of this approach is the Human Genome Epidemiology Navigator (HuGE Navigator<sup><xref rid="R18" ref-type="bibr">18</xref></sup>), a continuously updated, curated knowledge base of published genetic association studies maintained by the Centers for Disease Control and Prevention. The number of such publications has quadrupled over the past 10 years, with &#x0003e;9,500 articles published in 2011 alone.<sup><xref rid="R19" ref-type="bibr">19</xref></sup> The HuGE Navigator uses a combination of text-mining algorithms and human curation,<sup><xref rid="R20" ref-type="bibr">20</xref></sup> which is also the approach taken by Wallace et al.<sup><xref rid="R9" ref-type="bibr">9</xref></sup> By placing a wealth of genetic association information at the fingertips of researchers and other users, such online applications can improve the efficiency and reduce the time required for KS.</p><p id="P12">The infoveillance approach can be applied to subsequent stages of translation. For example, the evaluation of genomic tests requires information on analytic performance, clinical validity, clinical utility, and ethical and legal issues.<sup><xref rid="R21" ref-type="bibr">21</xref></sup> The Genomic Applications in Practice and Prevention Knowledge Base of the Centers for Disease Control and Prevention is a continuously updated database of emerging genomic tests proposed for use in clinical or public health practice.<sup><xref rid="R22" ref-type="bibr">22</xref></sup> Between October 2009 and January 2012, &#x0003e;400 newly introduced tests were added to the database; approximately two-thirds of these tests were related to cancer.<sup><xref rid="R22" ref-type="bibr">22</xref></sup> We have combined cancer- related information from the HuGE Navigator and the Genomic Applications in Practice and Prevention Knowledge Base into a trial version of CancerGEM KB,<sup><xref rid="R23" ref-type="bibr">23</xref></sup> which will be developed further in the next few years. This year, the National Institutes of Health plans to release the Genetic Testing Registry, which will provide public access to information submitted voluntarily by test developers.<sup><xref rid="R24" ref-type="bibr">24</xref></sup></p></sec><sec id="S3"><title>KS: SYSTEMATIC REVIEWS, META-ANALYSES, AND MODELING</title><p id="P13">While KM is an essential first step in the KI process, a crucial second step is KS, which &#x0201c;makes sense&#x0201d; of the incoming information and transforms it into information that answers specific questions both within and across different scientific disciplines (<xref rid="T1" ref-type="table">Table 1</xref> and <xref rid="F1" ref-type="fig">Figure 1</xref>). For example, within the realm of genetic associations, it is important to know whether or not a reported genetic association has been replicated across multiple populations and the magnitude of disease risks conferred by specific genetic variants in different populations. In the pre&#x02013;genome-wide association studies era, candidate gene analyses often led to nonreplicable results.<sup><xref rid="R25" ref-type="bibr">25</xref></sup> The problem has been partially alleviated by the use of large-scale consortia and networks with sufficient sample size to conduct rigorous replication and meta-analysis. The National Human Genome Research Institute curates an online knowledge base of genome-wide association studies results, integrated with other information from the National Center for Biotechnology Information.<sup><xref rid="R26" ref-type="bibr">26</xref></sup></p><p id="P14">KS applies technical methods for systematic review of published and unpublished data using <italic>a priori</italic> rules of evidence. KS may include meta-analysis, decision analysis, and modeling to combine information from different study designs and different domains in basic, clinical and population research (e.g., Cochrane collaboration reviews;<sup><xref rid="R27" ref-type="bibr">27</xref></sup> Agency for Healthcare Research and Quality funded evidence-practice centers<sup><xref rid="R28" ref-type="bibr">28</xref></sup>). The independent, multidisciplinary Evaluation of Genomic Applications in Practice and Prevention working group<sup><xref rid="R29" ref-type="bibr">29</xref></sup> has developed evidentiary rules for conducting comprehensive systematic reviews of the analytic validity, clinical validity, and clinical utility of genomic tests in specific clinical scenarios.</p><p id="P15">In the arena of pharmacogenomics, the Pharmacogenomics Knowledge base (PharmGKB, <ext-link ext-link-type="uri" xlink:href="http://www.pharmgkb.org/">http://www.pharmgkb.org/</ext-link>) has for &#x0003e;10 years created a repository of primary data as well as tools to track associations between genes and drugs, and to catalog the location and frequency of genetic variations related to drug response.<sup><xref rid="R30" ref-type="bibr">30</xref></sup> With the explosion of new data over the past 10 years, PharmGKB now focuses on curating and synthesizing knowledge, and captures more complex relationships between genes, variants, drugs, diseases, and pathways.</p><p id="P16">In general, KS can be slow and tedious and is often criticized for this reason. As suggested by Goddard et al.<sup><xref rid="R7" ref-type="bibr">7</xref></sup> and Veenstra et al.,<sup><xref rid="R31" ref-type="bibr">31</xref></sup> additional tools could be used in the rapidly developing landscape of genomic medicine, including value of information analysis, decision analysis, and modeling. All these tools can supplement but not replace synthesis of empirical data from observational studies and clinical trials. Methods for rapid review and display of existing information are in development. To accelerate KS for genomic tests, the Centers for Disease Control and Prevention recently launched an online publication through the open-access Public Library of Science. The collection, entitled Public Library of Science Currents: Evidence on Genomic Tests, Public Library of Science<sup><xref rid="R32" ref-type="bibr">32</xref></sup> is intended as a rapid publication channel for synopses of knowledge on genomic tests. KS is often used by independent panels to develop evidence-based recommendations and practice guidelines.<sup><xref rid="R29" ref-type="bibr">29</xref>,<xref rid="R33" ref-type="bibr">33</xref>&#x02013;<xref rid="R35" ref-type="bibr">35</xref></sup> Much more methodological work is needed to accelerate the pace of KS.</p></sec><sec id="S4"><title>KT: BROKERING INFORMATION TO INFLUENCE RESEARCH, POLICY, AND PRACTICE</title><p id="P17">The third component of KI is KT. Deverka et al.<sup><xref rid="R8" ref-type="bibr">8</xref></sup> clearly illustrate that synthesized knowledge tends to be viewed differently by various stakeholders. If genomic medicine is to succeed, a strong KT process is crucial. KT is the active process of disseminating synthesized information to influence policy, guideline development, practice, and research across the translation continuum. This is the most &#x0201c;messy&#x0201d; component of KI because using information to influence research and practice requires &#x0201c;buy-in&#x0201d; from stakeholders with different perspective and can be an iterative process.</p><p id="P18">Evidence-based recommendations are necessary but not sufficient to move genomic medicine applications into practice. Many forces can affect their diffusion, adoption, and implementation. These forces often operate independently of knowledge synthesis and span a wide spectrum, including private investments in research and development, policy and legal frameworks, oversight and regulation, product marketing, coverage and reimbursements, consumer advocacy, provider awareness, access, and health services development and implementation. Deverka et al.<sup><xref rid="R8" ref-type="bibr">8</xref></sup> demonstrate once again that payers generally require a higher level of evidence of clinical utility than genomic researchers or test developers. Issues around differential access and implementation lead to the phenomenon of &#x0201c;lost in translation&#x0201d; in clinical practice.<sup><xref rid="R36" ref-type="bibr">36</xref></sup> Furthermore, translation requires implementation sciences, health services, and outcomes research agendas (T3 and T4 research) that are currently underrepresented in funding and publications of genomics research.<sup><xref rid="R37" ref-type="bibr">37</xref></sup></p><p id="P19">An important component of KT is the convening of stakeholders around KS to address differences in evidentiary thresholds that can drive decision making.<sup><xref rid="R38" ref-type="bibr">38</xref></sup> Such collaborations link researchers and policy makers, facilitate interactions, understand goals and professional culture, and forge new partnerships to use evidence from existing knowledge and define areas for future research. This process, sometimes called &#x0201c;knowledge brokering,&#x0201d; is ultimately about developing and using evidence-based decision-making to deliver genomic medicine in clinical and public health settings. To be successful, KT needs to lead to evidentiary standards and empower independent, transparent appraisal of the evidence. Examples of such collaborations include the Institute of Medicine round-table on translating genomics into health<sup><xref rid="R39" ref-type="bibr">39</xref></sup> and the Genomic Applications in Practice and Prevention,<sup><xref rid="R40" ref-type="bibr">40</xref></sup> a collaboration of multiple groups including government agencies, the private sector, academia, consumers, and clinical and public health practice.<sup><xref rid="R5" ref-type="bibr">5</xref></sup></p><p id="P20">In the arena of pharmacogenomics, the Clinical Pharmacogenetics Implementation Consortium was formed in late 2009 to develop and publish peer-reviewed guidelines with simultaneous posting to PharmGKB with supplemental information.<sup><xref rid="R41" ref-type="bibr">41</xref></sup>. The goal of Clinical Pharmacogenetics Implementation Consortium is to address some of the barriers to implementation of pharmacogenetic tests into clinical practice. Clinical Pharmacogenetics Implementation Consortium guidelines are designed to help clinicians understand how available genetic test results should be used to optimize drug therapy, rather than if such tests should be ordered, thus informing the stakeholder dialogue on evidence-based implementation of pharmacogenomics testing in clinical practice.</p></sec><sec sec-type="conclusions" id="S5"><title>CONCLUSION</title><p id="P21">The three papers in this issue<sup><xref rid="R7" ref-type="bibr">7</xref>&#x02013;<xref rid="R9" ref-type="bibr">9</xref></sup> illustrate why a robust KI process is needed to drive the growth and development of genomic medicine for years to come. Here, we have elaborated on the three components of KI: management, synthesis, and translation. Because of the rapid emergence of complex &#x0201c;omic&#x0201d; data from basic, clinical, and population research, we believe an adequately resourced KI process with as much automation as possible is needed to keep up with the avalanche of information. A multistakeholder KI enterprise should involve both the public and private sectors to ensure a rapid, transparent and credible process than can drive policy and practice.</p></sec></body><back><ack id="S6"><p>We thank Andrew Freedman and Deborah Winn for their comments on an earlier version of the manuscript.</p></ack><fn-group><fn id="FN2" fn-type="conflict"><p>DISCLOSURE</p><p>The authors declare no conflict of interest.</p></fn></fn-group><ref-list><ref id="R1"><label>1</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Green</surname><given-names>ED</given-names></name><name><surname>Guyer</surname><given-names>MS</given-names></name><collab>National Human Genome Research Institute</collab></person-group><article-title>Charting a course for genomic medicine from base pairs to bedside</article-title><source>Nature</source><year>2011</year><volume>470</volume><fpage>204</fpage><lpage>213</lpage><pub-id pub-id-type="pmid">21307933</pub-id></element-citation></ref><ref id="R2"><label>2</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>McDermott</surname><given-names>U</given-names></name><name><surname>Downing</surname><given-names>JR</given-names></name><name><surname>Stratton</surname><given-names>MR</given-names></name></person-group><article-title>Genomics and the continuum of cancer care</article-title><source>N Engl J Med</source><year>2011</year><volume>364</volume><fpage>340</fpage><lpage>350</lpage><pub-id pub-id-type="pmid">21268726</pub-id></element-citation></ref><ref id="R3"><label>3</label><element-citation publication-type="book"><collab>Institute of Medicine Roundtable on Translating Genome-based Research for Health</collab><source>Generating Evidence for Genomic Diagnostic Test Development: A Workshop Summary</source><publisher-name>National Academies Press</publisher-name><publisher-loc>Washington, DC</publisher-loc><year>2011</year></element-citation></ref><ref id="R4"><label>4</label><element-citation publication-type="web"><collab>National Cancer Institute</collab><source>Comparative effectiveness research in genomics and personalized medicine</source><comment><ext-link ext-link-type="uri" xlink:href="http://cancercontrol.cancer.gov/od/phg/research.asp?type=CER">http://cancercontrol.cancer.gov/od/phg/research.asp?type=CER</ext-link>. Accessed 1 February 2011</comment></element-citation></ref><ref id="R5"><label>5</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Sox</surname><given-names>HC</given-names></name><name><surname>Greenfield</surname><given-names>S</given-names></name></person-group><article-title>Comparative effectiveness research: a report from the Institute of Medicine</article-title><source>Ann Intern Med</source><year>2009</year><volume>151</volume><fpage>203</fpage><lpage>205</lpage><pub-id pub-id-type="pmid">19567618</pub-id></element-citation></ref><ref id="R6"><label>6</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Khoury</surname><given-names>MJ</given-names></name><name><surname>Rich</surname><given-names>EC</given-names></name><name><surname>Randhawa</surname><given-names>G</given-names></name><name><surname>Teutsch</surname><given-names>SM</given-names></name><name><surname>Niederhuber</surname><given-names>J</given-names></name></person-group><article-title>Comparative effectiveness research and genomic medicine: an evolving partnership for 21st century medicine</article-title><source>Genet Med</source><year>2009</year><volume>11</volume><fpage>707</fpage><lpage>711</lpage><pub-id pub-id-type="pmid">19752739</pub-id></element-citation></ref><ref id="R7"><label>7</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Goddard</surname><given-names>KAB</given-names></name><name><surname>Knaus</surname><given-names>WA</given-names></name><name><surname>Whitlock</surname><given-names>E</given-names></name><etal/></person-group><article-title>Building the evidence base for decision making in cancer genomic medicine using comparative effectiveness research</article-title><source>Genet Med</source><comment>this issue</comment></element-citation></ref><ref id="R8"><label>8</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Deverka</surname><given-names>PA</given-names></name><name><surname>Schully</surname><given-names>SD</given-names></name><name><surname>Ishibe</surname><given-names>N</given-names></name><etal/></person-group><article-title>Stakeholder assessment of the evidence for cancer genomic tests: insights from three case studies</article-title><source>Genet Med</source><comment>this issue</comment></element-citation></ref><ref id="R9"><label>9</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Wallace</surname><given-names>BC</given-names></name><name><surname>Small</surname><given-names>K</given-names></name><name><surname>Brodley</surname><given-names>CE</given-names></name><etal/></person-group><article-title>Towards modernizing the systematic review pipeline in genetics: efficient updating via data mining</article-title><source>Genet Med</source><comment>this issue</comment></element-citation></ref><ref id="R10"><label>10</label><element-citation publication-type="web"><collab>Wikipedia</collab><source>Knowledge integration</source><comment><ext-link ext-link-type="uri" xlink:href="http://en.wikipedia.org/wiki/Knowledge_integration#mw-head">http://en.wikipedia.org/wiki/Knowledge_integration#mw-head</ext-link>. Accessed February 2, 2012</comment></element-citation></ref><ref id="R11"><label>11</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Kerner</surname><given-names>JF</given-names></name></person-group><article-title>Knowledge translation versus knowledge integration: a &#x02018;funder&#x02019;s&#x02019; perspective</article-title><source>J Contin Educ Health Prof</source><year>2006</year><volume>26</volume><fpage>72</fpage><lpage>80</lpage><pub-id pub-id-type="pmid">16557513</pub-id></element-citation></ref><ref id="R12"><label>12</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Burke</surname><given-names>W</given-names></name><name><surname>Khoury</surname><given-names>MJ</given-names></name><name><surname>Stewart</surname><given-names>A</given-names></name><name><surname>Zimmern</surname><given-names>RL</given-names></name><collab>Bellagio Group</collab></person-group><article-title>The path from genome-based research to population health: development of an international public health genomics network</article-title><source>Genet Med</source><year>2006</year><volume>8</volume><fpage>451</fpage><lpage>458</lpage><pub-id pub-id-type="pmid">16845279</pub-id></element-citation></ref><ref id="R13"><label>13</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Khoury</surname><given-names>MJ</given-names></name><name><surname>Gwinn</surname><given-names>M</given-names></name><name><surname>Yoon</surname><given-names>PW</given-names></name><name><surname>Dowling</surname><given-names>N</given-names></name><name><surname>Moore</surname><given-names>CA</given-names></name><name><surname>Bradley</surname><given-names>L</given-names></name></person-group><article-title>The continuum of translation research in genomic medicine: how can we accelerate the appropriate integration of human genome discoveries into health care and disease prevention?</article-title><source>Genet Med</source><year>2007</year><volume>9</volume><fpage>665</fpage><lpage>674</lpage><pub-id pub-id-type="pmid">18073579</pub-id></element-citation></ref><ref id="R14"><label>14</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Schully</surname><given-names>SD</given-names></name><name><surname>Benedicto</surname><given-names>CB</given-names></name><name><surname>Khoury</surname><given-names>MJ</given-names></name></person-group><article-title>How can we stimulate translational research in cancer genomics beyond bench to bedside?</article-title><source>Genet Med</source><year>2012</year><volume>14</volume><fpage>169</fpage><lpage>170</lpage><pub-id pub-id-type="pmid">22237448</pub-id></element-citation></ref><ref id="R15"><label>15</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Ioannidis</surname><given-names>JP</given-names></name><name><surname>Khoury</surname><given-names>MJ</given-names></name></person-group><article-title>Improving validation practices in &#x0201c;omics&#x0201d; research</article-title><source>Science</source><year>2011</year><volume>334</volume><fpage>1230</fpage><lpage>1232</lpage><pub-id pub-id-type="pmid">22144616</pub-id></element-citation></ref><ref id="R16"><label>16</label><element-citation publication-type="web"><collab>National Center for Biotechnology Information, National Library of Medicine</collab><comment><ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/">http://www.ncbi.nlm.nih.gov/</ext-link>. Accessed 1 February 2012</comment></element-citation></ref><ref id="R17"><label>17</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Eysenbach</surname><given-names>G</given-names></name></person-group><article-title>Infodemiology and infoveillance tracking online health information and cyberbehavior for public health</article-title><source>Am J Prev Med</source><year>2011</year><volume>40</volume><issue>5 suppl 2</issue><fpage>S154</fpage><lpage>S158</lpage><pub-id pub-id-type="pmid">21521589</pub-id></element-citation></ref><ref id="R18"><label>18</label><element-citation publication-type="web"><collab>Human Genome Epidemiology Navigator (HuGE Navigator)</collab><comment><ext-link ext-link-type="uri" xlink:href="http://www.hugenavigator.net/HuGENavigator/home.do">http://www.hugenavigator.net/HuGENavigator/home.do</ext-link>. Accessed 1 February 2012</comment></element-citation></ref><ref id="R19"><label>19</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Khoury</surname><given-names>MJ</given-names></name><name><surname>Gwinn</surname><given-names>M</given-names></name><name><surname>Clyne</surname><given-names>M</given-names></name><name><surname>Yu</surname><given-names>W</given-names></name></person-group><article-title>Genetic epidemiology with a capital E, ten years after</article-title><source>Genet Epidemiol</source><year>2011</year><volume>35</volume><fpage>845</fpage><lpage>852</lpage><pub-id pub-id-type="pmid">22125223</pub-id></element-citation></ref><ref id="R20"><label>20</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Yu</surname><given-names>W</given-names></name><name><surname>Gwinn</surname><given-names>M</given-names></name><name><surname>Clyne</surname><given-names>M</given-names></name><name><surname>Yesupriya</surname><given-names>A</given-names></name><name><surname>Khoury</surname><given-names>MJ</given-names></name></person-group><article-title>A navigator for human genome epidemiology</article-title><source>Nat Genet</source><year>2008</year><volume>40</volume><fpage>124</fpage><lpage>125</lpage><pub-id pub-id-type="pmid">18227866</pub-id></element-citation></ref><ref id="R21"><label>21</label><element-citation publication-type="book"><person-group person-group-type="author"><name><surname>Haddow</surname><given-names>JE</given-names></name><name><surname>Palomaki</surname><given-names>GE</given-names></name></person-group><article-title>ACCE: a model process for the evaluation of genetic tests</article-title><person-group person-group-type="editor"><name><surname>Khoury</surname><given-names>MJ</given-names></name><name><surname>Little</surname><given-names>J</given-names></name><name><surname>Burke</surname><given-names>W</given-names></name></person-group><source>Human Genome Epidemiology</source><publisher-name>Oxford University Press</publisher-name><publisher-loc>New York</publisher-loc><volume>2004</volume><fpage>217</fpage><lpage>233</lpage></element-citation></ref><ref id="R22"><label>22</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Gwinn</surname><given-names>M</given-names></name><name><surname>Grossniklaus</surname><given-names>DA</given-names></name><name><surname>Yu</surname><given-names>W</given-names></name><etal/></person-group><article-title>Horizon scanning for new genomic tests</article-title><source>Genet Med</source><year>2011</year><volume>13</volume><fpage>161</fpage><lpage>165</lpage><pub-id pub-id-type="pmid">21233720</pub-id></element-citation></ref><ref id="R23"><label>23</label><element-citation publication-type="web"><source>Cancer Genomics Evidence based Medicine Knowledge Base CancerGEM KB</source><comment><ext-link ext-link-type="uri" xlink:href="http://www.hugenavigator.net/CancerGEMKB/home.do">http://www.hugenavigator.net/CancerGEMKB/home.do</ext-link>. Accessed 1 February 2012</comment></element-citation></ref><ref id="R24"><label>24</label><element-citation publication-type="web"><collab>National Center for Biotechnology Information: Genetic Testing Registry</collab><comment><ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/gtr/">http://www.ncbi.nlm.nih.gov/gtr/</ext-link>. Accessed 1 February 2012</comment></element-citation></ref><ref id="R25"><label>25</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Siontis</surname><given-names>KC</given-names></name><name><surname>Patsopoulos</surname><given-names>NA</given-names></name><name><surname>Ioannidis</surname><given-names>JP</given-names></name></person-group><article-title>Replication of past candidate loci for common diseases and phenotypes in 100 genome-wide association studies</article-title><source>Eur J Hum Genet</source><year>2010</year><volume>18</volume><fpage>832</fpage><lpage>837</lpage><pub-id pub-id-type="pmid">20234392</pub-id></element-citation></ref><ref id="R26"><label>26</label><element-citation publication-type="web"><collab>National Human Genome Research Institute</collab><source>GWAS catalog</source><comment><ext-link ext-link-type="uri" xlink:href="http://www.genome.gov/gwastudies/">http://www.genome.gov/gwastudies/</ext-link>. Accessed 1 February 2012</comment></element-citation></ref><ref id="R27"><label>27</label><element-citation publication-type="web"><collab>The Cochrane collaboration</collab><comment><ext-link ext-link-type="uri" xlink:href="http://www.cochrane.org/">http://www.cochrane.org/</ext-link>. Accessed 1 February 2012</comment></element-citation></ref><ref id="R28"><label>28</label><element-citation publication-type="web"><collab>Agency for Healthcare Research and Quality evidence practice centers</collab><comment><ext-link ext-link-type="uri" xlink:href="http://www.ahrq.gov/clinic/epc/">http://www.ahrq.gov/clinic/epc/</ext-link>. Accessed 1 February 2012</comment></element-citation></ref><ref id="R29"><label>29</label><element-citation publication-type="web"><collab>Evaluation of Genomic Applications in Practice and Prevention (EGAPP)</collab><comment><ext-link ext-link-type="uri" xlink:href="http://www.egappreviews.org/">http://www.egappreviews.org/</ext-link>. Accessed 1 February 2012</comment></element-citation></ref><ref id="R30"><label>30</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Thorn</surname><given-names>CF</given-names></name><name><surname>Klein</surname><given-names>TE</given-names></name><name><surname>Altman</surname><given-names>RB</given-names></name></person-group><article-title>Pharmacogenomics and bioinformatics: PharmGKB</article-title><source>Pharmacogenomics</source><year>2010</year><volume>11</volume><fpage>501</fpage><lpage>505</lpage><pub-id pub-id-type="pmid">20350130</pub-id></element-citation></ref><ref id="R31"><label>31</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Veenstra</surname><given-names>DL</given-names></name><name><surname>Roth</surname><given-names>JA</given-names></name><name><surname>Garrison</surname><given-names>LP</given-names><suffix>Jr</suffix></name><name><surname>Ramsey</surname><given-names>SD</given-names></name><name><surname>Burke</surname><given-names>W</given-names></name></person-group><article-title>A formal risk-benefit framework for genomic tests: facilitating the appropriate translation of genomics into clinical practice</article-title><source>Genet Med</source><year>2010</year><volume>12</volume><fpage>686</fpage><lpage>693</lpage><pub-id pub-id-type="pmid">20808229</pub-id></element-citation></ref><ref id="R32"><label>32</label><element-citation publication-type="web"><source>PLoS Currents: evidence on genomic tests</source><comment><ext-link ext-link-type="uri" xlink:href="http://knol.google.com/k/plos/plos-currents-evidence-on-genomic-tests/28qm4w0q65e4w/50#">http://knol.google.com/k/plos/plos-currents-evidence-on-genomic-tests/28qm4w0q65e4w/50#</ext-link>. Accessed 1 February 2012</comment></element-citation></ref><ref id="R33"><label>33</label><element-citation publication-type="web"><collab>NIH consensus development program</collab><comment><ext-link ext-link-type="uri" xlink:href="http://consensus.nih.gov/">http://consensus.nih.gov/</ext-link>. Accessed 1 February 2012</comment></element-citation></ref><ref id="R34"><label>34</label><element-citation publication-type="web"><collab>Agency for Healthcare Research and Quality</collab><source>US Preventive Services Task Force</source><comment><ext-link ext-link-type="uri" xlink:href="http://www.ahrq.gov/clinic/uspstfix.htm">http://www.ahrq.gov/clinic/uspstfix.htm</ext-link>. Accessed 1 February 2012</comment></element-citation></ref><ref id="R35"><label>35</label><element-citation publication-type="web"><collab>National Institute for Health and Clinical Excellence</collab><comment><ext-link ext-link-type="uri" xlink:href="http://www.nice.org.uk/">http://www.nice.org.uk/</ext-link>. Accessed 1 February 2012</comment></element-citation></ref><ref id="R36"><label>36</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Burke</surname><given-names>W</given-names></name><name><surname>Burton</surname><given-names>H</given-names></name><name><surname>Hall</surname><given-names>AE</given-names></name><etal/><collab>Ickworth Group</collab></person-group><article-title>Extending the reach of public health genomics: what should be the agenda for public health in an era of genome-based and &#x0201c;personalized&#x0201d; medicine?</article-title><source>Genet Med</source><year>2010</year><volume>12</volume><fpage>785</fpage><lpage>791</lpage><pub-id pub-id-type="pmid">21189494</pub-id></element-citation></ref><ref id="R37"><label>37</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Khoury</surname><given-names>MJ</given-names></name><name><surname>Clauser</surname><given-names>SB</given-names></name><name><surname>Freedman</surname><given-names>AN</given-names></name><etal/></person-group><article-title>Population sciences, translational research, and the opportunities and challenges for genomics to reduce the burden of cancer in the 21<sup>st</sup> century</article-title><source>Cancer Epidemiol Biomarkers Prev</source><year>2011</year><volume>20</volume><fpage>2105</fpage><lpage>2114</lpage><pub-id pub-id-type="pmid">21795499</pub-id></element-citation></ref><ref id="R38"><label>38</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Khoury</surname><given-names>MJ</given-names></name></person-group><article-title>Dealing with the evidence dilemma in genomics and personalized medicine</article-title><source>Clin Pharmacol Ther</source><year>2010</year><volume>87</volume><fpage>635</fpage><lpage>638</lpage><pub-id pub-id-type="pmid">20485318</pub-id></element-citation></ref><ref id="R39"><label>39</label><element-citation publication-type="web"><source>Institute of Medicine roundtable on translating genome-based research for health</source><comment><ext-link ext-link-type="uri" xlink:href="http://iom.edu/Activities/Research/GenomicBasedResearch.aspx">http://iom.edu/Activities/Research/GenomicBasedResearch.aspx</ext-link>. Accessed 1 February 2012</comment></element-citation></ref><ref id="R40"><label>40</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Khoury</surname><given-names>MJ</given-names></name><name><surname>Feero</surname><given-names>WG</given-names></name><name><surname>Reyes</surname><given-names>M</given-names></name><etal/><collab>GAPPNet Planning Group</collab></person-group><article-title>The genomic applications in practice and prevention network</article-title><source>Genet Med</source><year>2009</year><volume>11</volume><fpage>488</fpage><lpage>494</lpage><pub-id pub-id-type="pmid">19471162</pub-id></element-citation></ref><ref id="R41"><label>41</label><element-citation publication-type="journal"><person-group person-group-type="author"><name><surname>Relling</surname><given-names>MV</given-names></name><name><surname>Klein</surname><given-names>TE</given-names></name></person-group><article-title>CPIC: The Clinical Pharmacogenetics Implementation Consortium of the Pharmacogenomics Research Network</article-title><source>Clin Pharmacol Ther</source><year>2011</year><volume>89</volume><fpage>461</fpage><lpage>464</lpage></element-citation></ref></ref-list></back><floats-group><fig id="F1" orientation="portrait" position="float"><label>Figure 1</label><caption><p>Components of knowledge integration in genomic medicine. Modified from Khoury et al.<sup><xref rid="R13" ref-type="bibr">13</xref></sup></p></caption><graphic xlink:href="nihms742734f1"/></fig><table-wrap id="T1" position="float" orientation="portrait"><label>Table 1</label><caption><p>Components of knowledge integration in genomic medicine: definitions and examples</p></caption><table frame="below" rules="rows"><thead><tr><th valign="top" align="left" rowspan="1" colspan="1">Component</th><th valign="top" align="left" rowspan="1" colspan="1">Definition</th><th valign="top" align="left" rowspan="1" colspan="1">Examples</th></tr></thead><tbody><tr><td align="left" valign="top" rowspan="1" colspan="1">Knowledge management</td><td align="left" valign="top" rowspan="1" colspan="1">Process of scanning, selecting, storing, curating, and tracking genomic research information from multiple disciplines and phases of translation</td><td align="left" valign="top" rowspan="1" colspan="1">Curated literature and Web-based databases, e.g., HuGE Navigator for genetic-epidemiology studies;<sup><xref rid="R18" ref-type="bibr">18</xref></sup> GAPPKB to find new genomic tests and link with available studies;<sup><xref rid="R22" ref-type="bibr">22</xref>,<xref rid="R23" ref-type="bibr">23</xref></sup> Genetic Testing Registry<sup><xref rid="R24" ref-type="bibr">24</xref></sup></td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Knowledge synthesis</td><td align="left" valign="top" rowspan="1" colspan="1">Systematic review of information from multiple disciplines to assess validity and utility of information; process usually employs methods of meta-analysis and can use modeling of value of information, using direct and indirect evidence</td><td align="left" valign="top" rowspan="1" colspan="1">AHRQ evidence-based reviews;<sup><xref rid="R28" ref-type="bibr">28</xref></sup> Cochrane reviews;<sup><xref rid="R27" ref-type="bibr">27</xref></sup> CancerGEMKB;<sup><xref rid="R23" ref-type="bibr">23</xref></sup> EGAPP reviews and recommendations;<sup><xref rid="R29" ref-type="bibr">29</xref></sup> PharmGKB;<sup><xref rid="R30" ref-type="bibr">30</xref></sup> PLoS Currents: evidence on genomic tests;<sup><xref rid="R32" ref-type="bibr">32</xref></sup> NIH consensus conferences;<sup><xref rid="R33" ref-type="bibr">33</xref></sup> US Preventive Services Task Force;<sup><xref rid="R34" ref-type="bibr">34</xref></sup> National Institute for Clinical Excellence<sup><xref rid="R35" ref-type="bibr">35</xref></sup></td></tr><tr><td align="left" valign="top" rowspan="1" colspan="1">Knowledge translation</td><td align="left" valign="top" rowspan="1" colspan="1">Process of actively disseminating synthesized information to influence policy, guideline development, and research across the translation continuum, as well as clinical and public health practice. The process uses stakeholder engagement and knowledge brokering</td><td align="left" valign="top" rowspan="1" colspan="1">IOM roundtable on translating genome-based research for health;<sup><xref rid="R39" ref-type="bibr">39</xref></sup> the Genomic Applications in Practice and Prevention Network;<sup><xref rid="R40" ref-type="bibr">40</xref></sup> Clinical Pharmacogenetic Implementation Consortium<sup><xref rid="R41" ref-type="bibr">41</xref></sup></td></tr></tbody></table><table-wrap-foot><fn id="TFN1"><p>AHRQ, Agency for HealthCare Research and Quality; CancerGEM KB, Cancer Genomic Evidence-based Medicine Knowledge Base; EGAPP, Evaluation of Genomic Applications in Practice and Prevention; GAPPKB, Genomic Applications in Practice and Prevention Knowledge Base; HuGE Navigator, Human Genome Epidemiology Navigator; IOM, Institute of Medicine; PharmGKB, Pharmacogenomics Knowledge Base.</p></fn></table-wrap-foot></table-wrap></floats-group></article>