Center For Open Science

DARPA SCORE PROGRAM - TO ESTABLISH AN INFRASTRUCTURE TO SUPPORT RAPID, SCALABLE ASSESSMENT OF CLAIMS IN RESEARCH, BEST PRACTICES FOR CONDUCTING REPLICATIONS AND REPRODUCTIONS FOR VALIDATION OF CONFIDENCE IN CLAIMS, AND A METHODOLOGY FOR DRAMATICALLY ACCELERATING THE VALUE, CREDIBILITY ASSESSMENT, AND APPLICATION OF SCIENTIFIC EVIDENCE FOR DECISION-MAKING.

DARPA-BAA-16-32 NEXT GENERATION SOCIAL SCIENCE (NGS2)

THE PURPOSE OF THIS AGREEMENT IS TO FUND RESEARCH IN FURTHERANCE OF THE MISSION OF THE DEFENSE ADVANCED RESEARCH PROJECTS AGENCY DARPA DEFENSE SCIENCES OFFICE SYSTEMATIZING CONFIDENCE IN OPEN RESEARCH AND EVIDENCE SCORE PROGRAM. TERM: A THE TERM OF THE BASE PERIOD FOR THIS AGREEMENT COMMENCES ON DECEMBER 01, 2019 AND CONTINUES THROUGH DECEMBER 31, 2020. OPTION 1, IF EXERCISED, COMMENCES ON THE EFFECTIVE DATE OF EXERCISE AND CONTINUES FOR A PERIOD OF 18 MONTHS.

POSE: PHASE II: OPEN-SOURCE ECOSYSTEM TO ENABLE OPEN SCHOLARSHIP -OPEN SCIENCE, ALSO CALLED OPEN RESEARCH OR OPEN SCHOLARSHIP, IS A MOVEMENT THAT ADVANCES THE FREE AND OPEN SHARING OF RESEARCH. THE GOAL OF OPEN SCIENCE IS TO MAKE THE RESEARCH PROCESS OPEN FOR REVIEW BY EVERYONE WITH THE GOAL OF IMPROVING THE QUALITY OF SCIENTIFIC RESULTS AND USEFULNESS OF SCIENTIFIC DISCOVERIES. TOOLS ARE NEEDED TO ENCOURAGE AND SUPPORT RESEARCHERS TO WORK TOGETHER, SHARE DATA AND ANALYSES, AND DISCOVER AND REUSE RESEARCH. THE CENTER FOR OPEN SCIENCE (COS) HAS BUILT AND MAINTAINS THE OPEN SCIENCE FRAMEWORK (OSF), WHICH IS A FREE, OPEN-SOURCE PLATFORM THAT PROVIDES THESE TOOLS. RESEARCHERS USE THIS PLATFORM TO MANAGE AND CONDUCT THEIR RESEARCH WHILE FOLLOWING OPEN SCIENCE PRACTICES. THE INVOLVEMENT OF RESEARCH COMMUNITIES IN THE CO-DEVELOPMENT OF THE TOOLS THAT SUPPORT THEM IN PRACTICING OPEN SCIENCE IS IMPORTANT TO SECURE ROBUST AND LONG-STANDING SCIENTIFIC KNOWLEDGE. THIS NSF POSE PHASE II AWARD CREATES A DISTRIBUTED OPEN SOURCE ECOSYSTEM (OSE) AROUND THE OSF: THE OPEN SCHOLARSHIP OSE. THIS PROJECT PERMITS THE EXPANSION OF COMMUNITY-DRIVEN OPEN SCHOLARSHIP BY (1) CREATING A GOVERNANCE STRUCTURE THAT GUIDES THE TRAJECTORY OF THE OPEN SCHOLARSHIP OSE BY DEVELOPING A COMMUNITY OF USER-CONTRIBUTORS TO THE ECOSYSTEM, (2) CONNECTING NEW DIGITAL STORAGE LOCATIONS, TOOLS, AND OTHER SERVICES, EXPANDING THE RANGE OF APPLICATIONS OF AND DISCIPLINES USING THE OSF, AND (3) DEVELOPING IMPROVED WORKFLOWS THAT ENABLE OPEN SCHOLARSHIP ACROSS A WIDER RANGE OF RESEARCH GOALS, METHODS, PROCESSES, AND OUTPUTS. THE OPEN SCHOLARSHIP OSE DEVELOPS COMMUNICATION PATHWAYS FOR RESEARCHERS TO BECOME PART OF THE DEVELOPMENT PROCESS AND TO IMPLEMENT OPEN SCHOLARSHIP PRACTICES WHILE MAKING THE BARRIERS TO PARTICIPATION AS LOW AS POSSIBLE. THIS AWARD REFLECTS NSF'S STATUTORY MISSION AND HAS BEEN DEEMED WORTHY OF SUPPORT THROUGH EVALUATION USING THE FOUNDATION'S INTELLECTUAL MERIT AND BROADER IMPACTS REVIEW CRITERIA.- SUBAWARDS ARE NOT PLANNED FOR THIS AWARD.

COMMUNITY DEVELOPING AND SUPPORTING PRACTICES TO INCREASE REPLICABILITY OF SCIENT

AN EHR CORE RESEARCH (ECR) DATA RESOURCE HUB TO CATALYZE CULTURE CHANGE AND COMMUNITY BUILDING FOR IMPROVING RIGOR AND REPRODUCIBILITY IN STEM EDUCATION RESEARCH

NSF PD 19-125Y - SCIENCE OF SCIENCE: DISCOVERY, COMMUNICATION, AND IMPACT (SOS:DCI) -RANDOMIZED CONTROL TRIAL OF THE REGISTERED REPORTS PUBLISHING FORMAT -THE REGISTERED REPORTS (RR) PUBLISHING MODEL COULD BE TRANSFORMATIVE TO HOW RESEARCH IS CONDUCTED, PEER REVIEWED, AND PUBLISHED. RRS COULD ALTER INCENTIVES FOR RESEARCHERS TOWARD FOCUSING ON ASKING IMPORTANT QUESTIONS AND USING STRONG METHODOLOGY TO TEST THOSE QUESTIONS, AND AWAY FROM THE DEMAND FOR EXCITING, PROVOCATIVE RESULTS WHATEVER THEIR CREDIBILITY. ULTIMATELY, RRS CAN IMPROVE THE QUALITY OF PEER REVIEW AND SCHOLARLY COMMUNICATION, THUS IMPROVING THE RIGOR, TRANSPARENCY, AND REPRODUCIBILITY OF RESEARCH. LARGE-SCALE ADOPTION OF RRS COULD FUNDAMENTALLY CHANGE HOW RESEARCH IS EVALUATED AND COMMUNICATED. IN A RR, AUTHORS SUBMIT A PAPER DETAILING THE RESEARCH QUESTION AND PROPOSED METHODOLOGY TO TEST THE QUESTION PRIOR TO OBSERVING THE STUDY OUTCOMES. IN THE FIRST STAGE OF PEER REVIEW, REVIEWERS ASSESS THE IMPORTANCE OF THE QUESTION AND THE QUALITY OF THE METHODOLOGY PROPOSED TO INVESTIGATE IT. IF THE PAPER PASSES THIS STAGE OF PEER REVIEW, THE AUTHORS RECEIVE ?IN-PRINCIPLE ACCEPTANCE? MEANING THAT THE JOURNAL COMMITS TO PUBLISHING THE PAPER REGARDLESS OF OUTCOMES AS LONG AS THE AUTHORS FOLLOW THROUGH WITH COMPETENT EXECUTION AND REPORTING OF THE RESEARCH. THE SECOND STAGE OF PEER REVIEW, AFTER THE RESULTS ARE KNOWN AND ADDED TO THE PAPER, ASSESSES ADHERENCE TO THE ORIGINAL COMMITMENTS, CLARITY OF THE DISTINCTION BETWEEN PLANNED AND UNPLANNED ANALYSES, AND ACCURACY OF INTERPRETATION OF FINDINGS, AND NOT WHETHER THE RESULTS ARE POSITIVE, INTERESTING, OR CONSISTENT WITH HYPOTHESES. GIVEN THE POTENTIALLY TRANSFORMATIVE IMPACT OF RRS ON THE RESEARCH PROCESS, IT IS ESSENTIAL TO CONDUCT A RANDOMIZED TRIAL TO EVALUATE THE MODEL?S QUALITIES. BY COLLABORATING WITH JOURNALS, WE WILL CONDUCT A RANDOMIZED TRIAL OF RRS IN AN ECOLOGICALLY VALID CONTEXT. THIS AWARD REFLECTS NSF'S STATUTORY MISSION AND HAS BEEN DEEMED WORTHY OF SUPPORT THROUGH EVALUATION USING THE FOUNDATION'S INTELLECTUAL MERIT AND BROADER IMPACTS REVIEW CRITERIA.

ETHICAL AND RESPONSIBLE RESEARCH (ER2) RIGOR AND TRANSPARENCY INITIATIVES (RTI)

EAGER: COMMUNITY BUILDING AND WORKFLOWS FOR DATA SHARING WITH PUBLICLY ACCESSIBLE AND CONSUMABLE METADATA

COLLABORATIVE RESEARCH: CCRI: ENS: BOA 2.0: ENHANCING INFRASTRUCTURE FOR STUDYING SOFTWARE AND ITS EVOLUTION AT A LARGE SCALE

EO14042 YEAR OF OPEN SCIENCE WORKSHOPS AND CULMINATING CONFERENCE