RIO Journal 5 years on: over 300 published outcomes from all around the research cycle

Five years on, the Open Science-driven journal Research Ideas and Outcomes (RIO) published an editorial that looks back on the 300 research ideas and research outcomes it has published so far.

Since its early days, RIO has enjoyed quite positive reactions from the open-minded academic community for its innovative approach to Open Science in practice: it provides a niche that had long been missing, namely the publication of early, intermediate and generally unconventional research outcomes from all around the research cycle (e.g. grant proposals, data management plans, project deliverables, reports, policy briefs, conference materials) in a cross-disciplinary scientific journal. In fact, several months after its launch, in 2016, the journal was acknowledged with the SPARC Innovator Award.

‘Alternative’ research publications

In times when posting a preprint was seen as a novel and rather bold practice across many fields, RIO facilitated much deeper dives into the research process, in order to unveil scientific knowledge and the process by which it is gathered, well before any final conclusions have been drawn. Long story short, to date, RIO has published 33 Research Ideas78 Grant Proposals16 Data Management Plans33 Workshop Reports and 5 PhD Project Plans, in addition to plenty of other early, interim and final non-traditional research outcomes, as well as conventional articles. Over time, RIO has kept adding additional article types to its list of publication types, with a few more expected in the near future.

What’s more, over the years, we’ve already observed how papers published in RIO successfully followed up on the continuity of the research process. For example, the Grant Proposal for the “Exploring the opportunities and challenges of implementing open research strategies within development institutions” project, funded by the International Development Research Centre (IDRC), was followed by the project’s Data Management Plan a year later.

Five years later, the figures reflecting the usage and engagement with the content published in RIO are evidently supportive of the value of having non-final and unconventional academic publications. For instance, the Grant Proposal for the COST Action DNAqua-Net, a still ongoing project dedicated to the development of novel genetic tools for bioassessment and monitoring of aquatic ecosystems, is the article with the most total views in RIO’s publication record to date. In the category of sub-article elements, whose usage is also tracked at the journal, the most viewed figure belongs to a Project Report and illustrates a sample code meant to be used in future neuroimaging studies. Similarly, the most viewed table ever published in RIO is part of a Workshop Report that summarises ASAPbio‘s third workshop, dedicated to the technical aspects of services related to the promotion of preprints in the biomedical and other life science communities.

Response to societal challenges

A unique and defining staple for RIO since the very beginning has also been the pronounced engagement with the Sustainable Development Goals (SDGs), as formulated by the United Nations right around the time of RIO’s launch. In order to highlight the societal impact of published research, RIO lets authors map their articles to the SDGs relevant to their paper. Once published, the article displays the associated badge(s) next to its title. Readers of the journal can even search RIO’s content by SDG, in the same way they would filter articles by subject, publication types, date or funding agency. Next on the list for RIO is to add another level of granularity to the SDGs mapping. The practice has already been piloted by mapping relevant RIO articles to the ten targets under SDG14 (Life below water).

Taking transparency, responsibility and collaboration in academia and scholarly publishing up another notch, RIO requires for reviews to be publicly available. In addition, the journal supports post-publication reviews, where peers are free to post their review anytime. In turn, RIO registers each review with its own DOI via CrossRef, in order to recognise the valuable input and let the reviewers easily refer to their contributions. A fine example is a Review Article exploring the biodiversity-related issues and challenges across Southeast Asia, which currently has a total of three public peer reviews, one of which is provided two years after the publication of the paper.

Public, transparent and perpetual peer review, pre- and/or post-publication

What’s more striking about peer review at RIO, however, is that it is not always mandatory. Given that the journal publishes many article types that have already been scrutinised by a legitimate authority – for instance, Grant Proposals that have previously been evaluated by a funder or defended PhD Theses – it only makes sense to avoid withholding these publications and duplicating associated evaluation efforts. On such occasions, all an author needs to do is provide a statement about the review status of their paper, which will be made public alongside the article.

On the other hand, where the article type of a manuscript requires pre-publication review, to avoid potential delays caused by the review process and editorial decisions, RIO encourages the authors to post their pre-review manuscript as a preprint on the recently launched ARPHA Preprints platform, subject to a quick editorial screening, which would only take a few days.

Further, RIO has now abandoned the practice of burdening the journal’s editors with the time-consuming task of finding reviewers, and instead requiring the submitting author to invite suitable reviewers upon submission, who are then immediately and automatically invited by the system. While significantly expediting the editorial work on a manuscript, this practice doesn’t compromise the quality of peer review in the slightest, since the reviews go public, while the final decision about the acceptance of the paper lies with the editor, who is also overlooking the process and able to intervene and invite additional reviewers anytime, if necessary.

Project-driven knowledge hub

The most significant novelty at RIO, however, is perhaps the newly assumed role of the journal as “a project-driven knowledge hub“, targeting specifically the needs of research projects, conference organisers and institutions. For them, RIO provides a one-stop source for the outputs of their scientists, in order to comply with the requirements of their funders or management, or simply to facilitate the discoverability, reusability and citability of their academic outputs and to highlight their interconnectedness.

Unlike typical permanent article collections, already widely used in scholarly publishing, with RIO, collection owners can take advantage of the unique opportunity to add a wide range of research outputs, including such published elsewhere, in order to provide even greater context to the assembled research outputs in their project- or institution-branded article collection (see the Horizon 2020 Project Path2Integrity‘s project collection as an example).

A permanent topical collection in RIO Journal may include a diverse range of both traditional and unconventional research outputs, as well as links to publications from outside the journal (see What can I publish on the journal’s website). 

For example, a project coordinator could open a collection under the brand of the project, and start by publishing the Grant Proposal, followed shortly by Data and Software Management Plans and Workshop Reports. Thus, even at this early point in the project’s development, the funder – and with them everyone else – would already have strong evidence of the project’s dedication to transparency and active science communication. Later on, the project’s participants would all be able to easily add to the project’s collection by either submitting their diverse research outputs straight to RIO and having it accepted by the collection lead editor, or providing metadata and link to their publication from elsewhere, even preprints. If the document is published outside of RIO, its metadata, i.e. author names and affiliations, article title and publication date, show up in the collection, while a click on the item will lead to the original publication. As the project progresses, the team behind it could add more and more outputs (e.g. Project Reports, Guidelines and Policy Briefs), continuously updating the public and the relevant stakeholders about the development of their work. Eventually, the collection will be able to provide a comprehensive and fully transparent report of the project from start to finish.

###

Follow RIO Journal on TwitterFacebook and LinkedIn.

Subscribe to RIO Journal’s blog for news updates.

Pilot Project provides findings and advice on data sharing in development research

Launched just ahead of last year’s FORCE11 conference devoted to the utilisation of technological and open science advancements to communication of scholarship, the data sharing pilot project of Prof. Cameron Neylon, Centre for Culture and TechnologyCurtin University, Australia, and his collaborators has published its final outcomes days before FORCE2017.

The project made use of the innovative open science RIO Journal, which allows for the publication of various research outcomes and sorting them into dedicated collections. The collection, “Exploring the opportunities and challenges of implementing open research strategies within development institutions: A project of the International Development Research Center” now features the project’s grant proposal as approved by the IDRC, a review article, several data management plans and case studies, and the final report as a research article.

The pilot project looked into the current state and challenges of data management and sharing policies and practices, as shown by case studies of seven IDRC-funded development research projects.

Having worked with the projects selected from across a range of geographies, scales and subjects over the course of 16 months, the data sharing initiative began with an introduction to data management and sharing concepts, as well as helping the projects to develop their own data management plans. Then, they carefully monitored and observed the implementation of those plans.

Over the course of the project, it became apparent that simply developing and implementing funder policies is not enough to change research culture. The question of how funder policy and implementation could support culture change both within research communities and within the funder itself became the focus of the initiative.

Data management plans have become a mandatory part of grant submission for many funders. However, they are often not utilised by researchers or funders later in the project, becoming “at best neutral and likely counter productive in supporting change in research culture.”

While the pilot project managed to identify a number of significant bottlenecks within both research institutions and for grantees that impede efficient data sharing practices, including, expectedly, lack of resources and expertise, the researchers specifically point out issues related to structural issues at the funder level.

“The single most productive act to enhance policy implementation may be to empower and support Program Officers,” says the author.

“This could be achieved through training and support of individual POs, through the creation of a group of internal experts who can support others, or via provision of external support, for instance, by expanding the services provided by the pilot project into an ongoing support mechanism for both internal staff and grantees.”

Amongst the findings of the pilot project are also the importance of language barriers and the need for better suited data management platforms and tools.

Furthermore, the study identified a gap between the understanding of “data” amongst cultures, pointing out that the concept of data is “part of a western scientific discourse which may be both incompatible with other cultures, particularly indigenous knowledge systems.”

In conclusion, the research article outlines a set of recommendations for funders, particularly those with a focus on development, as well as recommendations specific to the IDRC.

Original source:

Neylon C (2017) Building a Culture of Data Sharing: Policy Design and Implementation for Research Data Management in Development Research. Research Ideas and Outcomes 3: e21773. https://doi.org/10.3897/rio.3.e21773

Data sharing pilot to report and reflect on data policy challenges via 8 case studies

This week, FORCE2016 is taking place in Portland, USA. The FORCE11 yearly conference is devoted to the utilisation of technological and open science advancements towards a new-age scholarship founded on easily accessible, organised and reproducible research data.

As a practical contribution to the scholarly discourse on new modes of communicating knowledge, Prof. Cameron Neylon, Centre for Culture and Technology, Curtin University, Australia, and collaborators are to publish a series of outputs and outcomes resulting from their ongoing data sharing pilot project in the open access journal Research Ideas and Outcomes (RIO).

Starting with their Grant Proposal, submitted and accepted for funding by the Canadian International Development Research Centre (IDRC), over the course of sixteen months, ending in December 2016, they are to openly publish the project outputs starting with the grant proposal.

The project will collaborate with 8 volunteering IDRC grantees to develop Data Management Plans, and then support and track their development. The project expects to submit literature reviews, Data Management Plans, case studies and a final research article with RIO. These will report and reflect on the lessons they will have learnt concerning open data policies in the specific context of development research. Thus, the project is to provide advice on refining the open research data policy guidelines.

“The general objective of this project is to develop a model open research data policy and implementation guidelines for development research funders to enable greater access to development research data,” sum up the authors.

“Very little work has been done examining open data policies in the context of development research specifically,” they elaborate. “This project will serve to inform open access to research data policies of development research funders through pilot testing open data management plan guidelines with a set of IDRC grantees.”

The researchers agree that data constitutes a primary form of research output and that it is necessary for research funders to address the issue of open research data in their open access policies. They note that not only should data be publicly accessible and free for re-use, but they need to be “technically open”, which means “available for no more than the cost of reproduction, and in machine-readable and bulk form.” At the same time, research in a development context raises complex issues of what data can be shared, how, and by whom.

“The significance of primary data gathered in research projects across domains is its high potential for not only academic re-use, but its value beyond academic purposes, particularly for governments, SME, and civil society,” they add. “More importantly, the availability of these data provides an ideal opportunity to test the key premise underlying open research data — that when it is made publicly accessible in easily reusable formats, it can foster new knowledge and discovery, and encourage collaboration among researchers and organizations.”

However, such openness is also calling for extra diligence and responsibility while sharing, handling and re-using the research data. This is particularly the case in development research, where challenging ethical issues come to the fore. The authors point out the issues, raised by such practice, to be, among others, realistic and cost-effective strategies for funded researchers to collect, manage, and store the various types of data resulting from their research, as well as ethical issues such as privacy and rights over the collected data.

###

Original source:

Neylon C, Chan L (2016) Exploring the opportunities and challenges of implementing open research strategies within development institutions. Research Ideas and Outcomes 2: e8880. doi: 10.3897/rio.2.e8880

Roadmap: Global research data management advisory platform combines DMPTool and DMPonline

Roadmap, a global data management advisory platform that links data management plans (DMPs) to other components of the research lifecycle is a new open science initiative from partners at the University of California Curation Center (UC3) of the California Digital Library (CDL), USA, and the Digital Curation Centre (DCC), United Kingdom.

Both organizations sponsor and maintain such platforms, the DMPTool and DMPonline respectively. They allow researchers from around the world to create their data management plans in less time by employing ready-to-use templates with specific guidance tailored to address the requirements of specific funding agencies in the USA and the UK.

Recently, the proliferation of data sharing policies throughout the world has produced increasing demand for data management planning support from both organizations. Therefore, it makes sense for the CDL and DCC to consolidate efforts and move beyond a focus on national researchers and funders to extend their global outreach through Roadmap, a new open-source platform for data management planning. Their proposal was submitted to the Open Science Prize contest and is now published in the open access journal Research Ideas and Outcomes (RIO).

While the two teams have been working together unofficially and engaging in international initiatives, a formal partnership would signal to the global research community that there is one place to create DMPs and find advisory information.

“Research data management (RDM) that enables open science is now acknowledged as a global challenge: research is global, policies are becoming global, and thus the need is global,” explain the authors. “Open science has a global agenda, and by making DMPs true infrastructure in a global open access community we will elevate research and open data for reuse.”

roadmap still

In their joint project, the two organizations will combine their experience along with all existing functionality from their tools regarding the DMP use case into a single technical platform.

“New work on our respective systems is already underway to enable internationalization, integrate with other organizations and technical platforms, and encourage greater openness with DMPs,” they explain. “By joining forces, the Roadmap system will consolidate these efforts and move beyond a narrow focus on specific funders in specific countries, and even beyond institutional boundaries, to create a framework for engaging with disciplinary communities directly.”

To facilitate data sharing, reuse, and discoverability, Roadmap will be integrated with a number of platforms such as the Open Science Framework, SHARE, the Crossref/Datacite DOI Event Tracking system and Zenodo, among others. “Linking systems and research outputs across the web increases the chances that data will be discovered, accessed, and (re)used,” note the authors.

The team’s plan for enhanced openness includes encouraging authors to share their newly created data management plans by setting their privacy on “public” by default. They also intend to assign digital object identifiers (DOIs) to all plans, thus making them citable and motivating their authors to make them openly accessible. As part of this initiative, five researchers have just published their DMPs, created with the DMPTool, in Research Ideas and Outcomes (RIO).

“We see greater potential for the DMP as a dynamic checklist for pre- and post-award reporting; a manifest of research products that can be linked with published outputs; and a record of data, from primary through processing stages, that could be passed to repositories,” state the authors. “The DMP will therefore not only support the management of the data but boost its discoverability and reuse.”

###

Original source:

Simms S, Jones S, Ashley K, Ribeiro M, Chodacki J, Abrams S, Strong M (2016) Roadmap: A Research Data Management Advisory Platform. Research Ideas and Outcomes 2: e8649. doi: 10.3897/rio.2.e8649