RIO Journal 5 years on: over 300 published outcomes from all around the research cycle

Five years on, the Open Science-driven journal Research Ideas and Outcomes (RIO) published an editorial that looks back on the 300 research ideas and research outcomes it has published so far.

Since its early days, RIO has enjoyed quite positive reactions from the open-minded academic community for its innovative approach to Open Science in practice: it provides a niche that had long been missing, namely the publication of early, intermediate and generally unconventional research outcomes from all around the research cycle (e.g. grant proposals, data management plans, project deliverables, reports, policy briefs, conference materials) in a cross-disciplinary scientific journal. In fact, several months after its launch, in 2016, the journal was acknowledged with the SPARC Innovator Award.

‘Alternative’ research publications

In times when posting a preprint was seen as a novel and rather bold practice across many fields, RIO facilitated much deeper dives into the research process, in order to unveil scientific knowledge and the process by which it is gathered, well before any final conclusions have been drawn. Long story short, to date, RIO has published 33 Research Ideas78 Grant Proposals16 Data Management Plans33 Workshop Reports and 5 PhD Project Plans, in addition to plenty of other early, interim and final non-traditional research outcomes, as well as conventional articles. Over time, RIO has kept adding additional article types to its list of publication types, with a few more expected in the near future.

What’s more, over the years, we’ve already observed how papers published in RIO successfully followed up on the continuity of the research process. For example, the Grant Proposal for the “Exploring the opportunities and challenges of implementing open research strategies within development institutions” project, funded by the International Development Research Centre (IDRC), was followed by the project’s Data Management Plan a year later.

Five years later, the figures reflecting the usage and engagement with the content published in RIO are evidently supportive of the value of having non-final and unconventional academic publications. For instance, the Grant Proposal for the COST Action DNAqua-Net, a still ongoing project dedicated to the development of novel genetic tools for bioassessment and monitoring of aquatic ecosystems, is the article with the most total views in RIO’s publication record to date. In the category of sub-article elements, whose usage is also tracked at the journal, the most viewed figure belongs to a Project Report and illustrates a sample code meant to be used in future neuroimaging studies. Similarly, the most viewed table ever published in RIO is part of a Workshop Report that summarises ASAPbio‘s third workshop, dedicated to the technical aspects of services related to the promotion of preprints in the biomedical and other life science communities.

Response to societal challenges

A unique and defining staple for RIO since the very beginning has also been the pronounced engagement with the Sustainable Development Goals (SDGs), as formulated by the United Nations right around the time of RIO’s launch. In order to highlight the societal impact of published research, RIO lets authors map their articles to the SDGs relevant to their paper. Once published, the article displays the associated badge(s) next to its title. Readers of the journal can even search RIO’s content by SDG, in the same way they would filter articles by subject, publication types, date or funding agency. Next on the list for RIO is to add another level of granularity to the SDGs mapping. The practice has already been piloted by mapping relevant RIO articles to the ten targets under SDG14 (Life below water).

Taking transparency, responsibility and collaboration in academia and scholarly publishing up another notch, RIO requires for reviews to be publicly available. In addition, the journal supports post-publication reviews, where peers are free to post their review anytime. In turn, RIO registers each review with its own DOI via CrossRef, in order to recognise the valuable input and let the reviewers easily refer to their contributions. A fine example is a Review Article exploring the biodiversity-related issues and challenges across Southeast Asia, which currently has a total of three public peer reviews, one of which is provided two years after the publication of the paper.

Public, transparent and perpetual peer review, pre- and/or post-publication

What’s more striking about peer review at RIO, however, is that it is not always mandatory. Given that the journal publishes many article types that have already been scrutinised by a legitimate authority – for instance, Grant Proposals that have previously been evaluated by a funder or defended PhD Theses – it only makes sense to avoid withholding these publications and duplicating associated evaluation efforts. On such occasions, all an author needs to do is provide a statement about the review status of their paper, which will be made public alongside the article.

On the other hand, where the article type of a manuscript requires pre-publication review, to avoid potential delays caused by the review process and editorial decisions, RIO encourages the authors to post their pre-review manuscript as a preprint on the recently launched ARPHA Preprints platform, subject to a quick editorial screening, which would only take a few days.

Further, RIO has now abandoned the practice of burdening the journal’s editors with the time-consuming task of finding reviewers, and instead requiring the submitting author to invite suitable reviewers upon submission, who are then immediately and automatically invited by the system. While significantly expediting the editorial work on a manuscript, this practice doesn’t compromise the quality of peer review in the slightest, since the reviews go public, while the final decision about the acceptance of the paper lies with the editor, who is also overlooking the process and able to intervene and invite additional reviewers anytime, if necessary.

Project-driven knowledge hub

The most significant novelty at RIO, however, is perhaps the newly assumed role of the journal as “a project-driven knowledge hub“, targeting specifically the needs of research projects, conference organisers and institutions. For them, RIO provides a one-stop source for the outputs of their scientists, in order to comply with the requirements of their funders or management, or simply to facilitate the discoverability, reusability and citability of their academic outputs and to highlight their interconnectedness.

Unlike typical permanent article collections, already widely used in scholarly publishing, with RIO, collection owners can take advantage of the unique opportunity to add a wide range of research outputs, including such published elsewhere, in order to provide even greater context to the assembled research outputs in their project- or institution-branded article collection (see the Horizon 2020 Project Path2Integrity‘s project collection as an example).

A permanent topical collection in RIO Journal may include a diverse range of both traditional and unconventional research outputs, as well as links to publications from outside the journal (see What can I publish on the journal’s website). 

For example, a project coordinator could open a collection under the brand of the project, and start by publishing the Grant Proposal, followed shortly by Data and Software Management Plans and Workshop Reports. Thus, even at this early point in the project’s development, the funder – and with them everyone else – would already have strong evidence of the project’s dedication to transparency and active science communication. Later on, the project’s participants would all be able to easily add to the project’s collection by either submitting their diverse research outputs straight to RIO and having it accepted by the collection lead editor, or providing metadata and link to their publication from elsewhere, even preprints. If the document is published outside of RIO, its metadata, i.e. author names and affiliations, article title and publication date, show up in the collection, while a click on the item will lead to the original publication. As the project progresses, the team behind it could add more and more outputs (e.g. Project Reports, Guidelines and Policy Briefs), continuously updating the public and the relevant stakeholders about the development of their work. Eventually, the collection will be able to provide a comprehensive and fully transparent report of the project from start to finish.

###

Follow RIO Journal on TwitterFacebook and LinkedIn.

Subscribe to RIO Journal’s blog for news updates.

RIO shifts gears to serve as project-driven knowledge hub

Research Ideas and Outcomes (RIO Journal) upgrades its unique concept to appeal to scientific projects, conference organisers and research institutions

Over the last few years, we’ve been increasingly observing how major funders of research around the world, including the likes of the European Commission, Wellcome, U.S. National Institutes of Health (NIH), Deutsche Forschungsgemeinschaft (DFG) and the Japan Society for the Promotion of Science (JSPS) recognise the research cycle as a continuum, rather than scattered standalone conclusions and reports. 

Hence, as a forward-looking, open science-driven journal Research Ideas and Outcomes (RIO) took it as its own responsibility to encourage scientific project teams, conference organisers and research institutions to bring together unconventional research outputs (e.g. grant proposals, data management plans, project deliverables, policy briefs, conference materials) as well as traditional (e.g. research or review papers, monographs, etc.), including such published elsewhere. To do so, RIO now provides the platform ready to be used as a research knowledge hub, where published outcomes are preserved permanently and easier to share, disseminate, reference and reuse.

Hence, RIO stepped up its game by turning permanent article collections into a one-stop source of diverse research items, where project coordinators, conference organisers or research institutions can not only publish early, interim and conclusive research items as they emerge within a research project, a series of events or the continuous scientific efforts at their lab, but also link relevant publications (i.e. preprints, articles or other documents, published elsewhere) available elsewhere through their metadata. As a result, they will receive a one-stop source under their own branding for every piece of scientific contribution ready to present to funding bodies or prospective collaborators and future research teams.

A permanent topical collection in RIO Journal may include a diverse range of both traditional and unconventional research outputs, as well as links to publications from outside the journal (see What can I publish on the journal’s website). 

Apart from bringing contextually linked research outcomes together, thus prompting findability, readership and citability en masse, RIO’s approach to collections ensures further accessibility by not only having RIO-published articles available in traditional PDF, semantically enriched HTML and minable XML format. The open-science journal has now made it possible for users to add to their collections preprints from ARPHA Preprints, as well as author-formatted PDFs (e.g. project deliverables, reports, policy briefs, etc.) and linked metadata to documents published elsewhere. Thanks to the integration of the journal with the general-purpose open-access repository Zenodo, all items in a collection are archived, and additionally indexed, disseminated and cited.

By focusing on article and preprint collections coming out from a research project, institution or conference, RIO provides a quite specific and unique combination of benefits to all actors of the research process: scientists, project coordinators, funders and institutions: 

  1. Project, institution or conference branding and promotion.
  2. One-stop point for outputs of a research project, institution or conference.
  3. Free publication of author-formatted project outputs (i.e. grant proposals, deliverables, reports, policy briefs, conference materials and others).
  4. Inclusivity through adding articles, preprints and other documents published elsewhere as easy as entering the DOI number of the document.
  5. Credit and recognition for the Collection and Guest editors, who take care to organise and manage the article collection.
  6. Easier discoverability and usability of topically related studies to benefit both authors and readers.
  7. Increased visibility of related papers in a collection, even when these might otherwise not have much exposure.
  8. Simultaneous citation of multiple articles related to a certain subject.
  9. Citation and referencing of the whole collection as a complete entity.
  10.  DOI and citation details for collections and individual articles.

Furthermore, RIO Journal maps all publications to the Sustainable Development Goals  (SDGs), in order to emphasise the real-world impact of each published contribution, by displaying the corresponding badge within the article list. 

Last, but not least, both collections and individual publications in RIO enjoy the variety of default and on-demand science communication services, provided by Pensoft.  

How do project coordinators, funders and institutions benefit from a collection in RIO?

At the time a grant proposal is submitted to a research funder for evaluation, the team behind the proposed project has already put in considerable efforts, resulting in a unique idea with the potential to make a great stride towards the resolution of an outstanding problem in science, if only given the chance. However, too many of these ideas are bound to remain locked away in the archives of those funders, not because they are lacking in scientific value, but due to limited funds.

So, with its launch back in 2015, RIO Journal made it possible to publish and shed light on grant proposals and research ideas in general, similar early research outputs regardless of whether they are eventually funded or not, a novelty in scholarly publishing which earned RIO the SPARC Innovator Award Winner in 2016. To date, the journal has already published 75 grant proposals

Then, imagine what a contribution to science it would make to bring together the whole continuum of knowledge and scientific work all the way from the grant proposal to data  and software management plans, workshop reports, policy briefs and all interim and final deliverables produced within the span of the project!

On the other hand, funders are increasingly evaluating a prospective project’s impact based on its communication strategy. So, why not publish a grant proposal at the time of the submission of your proposal, in order to prove to the funding body that your project is serious about optimising its outreach to both the public and academia? Furthermore, by having an academic journal host any subsequent project deliverable, as a coordinator, you can rest assured that the communication activities of your project remain consistent and efficient.

In an excellent example of a project collection, the EU-funded ICEDIG (Innovation and Consolidation for Large Scale Digitisation of Natural Heritage), led by several major natural history institutions, including the Natural History Museum of London, Naturalis Biodiversity Center (the Netherlands), the French National Museum of Natural History and Helsinki University, brought together policy briefs, project reports, research articles and review papers, in order to provide a fantastic overview of their own research continuum. As a result, future researchers and various stakeholders can easily piece together the key components within the project, in order to learn from, recreate or even build on the experience of ICEDIG.

Explore the ICEDIG Project Outcomes collection on RIO’s website.

Similarly, conference organisers can make use of their own branded collections to overcome the ephemerality of presented research by collating virtually all valuable conference outputs, including abstracts, posters, presentations, datasets and full-text conference talks. For further convenience, a collection can be divided into subcollections, in order to organise the contribution by type or symposium. What particularly appeals to conference participants is the ARPHA Writing Tool, an intuitive collaborative online environment, which practically guides the user through each step: authoring, submission and pre-submission review, within a set of pre-designed, yet flexible templates available for each type of a conference output, thus sparing them the hassle to familiarise themselves with specific and perplexing formatting requirements

For institutions, RIO offers the opportunity to continuously provide evidence of the scholarly impact of their organisation. To better serve the needs of different labs or research teams, an institution can easily organise their outputs into various subcollections, and also customise their own article types, as well as the available usage tracking systems. Furthermore, by making use of the available pre-paid plans, institutions can support their researchers by covering fully or partially the publication charges at a discounted rate.

***

Find more information regarding the submission and review process, policies and pricing, visit RIO Journal’s website.

Follow RIO Journal on Twitter and Facebook.

New DFG grant proposal for a software quality control able to stand the test of time

For a software to be maintained in an optimal condition, as well as in track of any necessary updates and innovations, it needs to be kept in check constantly. This appears to be the only way for any potential quality problems that may arise to be detected and handled momentarily well before a user can encounter them.

A new grant proposal, addressed to the German Research Foundation (DFG), authored by Prof. Dr. Stefan Wagner, University of Stuttgart, and published in the open-access journal Research Ideas & Outcomes (RIO), suggests a new persistent set of quality control approaches meant to start analysing a software both manually and automatically during its creation and well before it has even been introduced.

The proposed methods, which Prof. Dr. Stefan Wagner envisions as a solution to software quality decay, provide thorough, contextual and focused feedback to the developers, who in their turn need less time and efforts to make sense of the new information. To achieve this, novel tools are to initiate regular analyses even before the implementation of the software changes and go on during the changes.

Previous knowledge and experience from similar problem-detection tools and practices are to be utilised as well. “Contemporary quality models, dynamic slicing and online discussions could even provide rationales for the feedback to support its acceptance and understandability,” explains the German researcher.

A particular issue addressed by the Professor of Software Engineering in his present publication are the so-called ‘co-changes’, which are changes to source code files that need to occur together. For example, if developers introduce a new feature it will cause changes in the functional part of the source code as well as the user interface. Such co-changes can lead to a defect when the change to the user interface is omitted. Giving such information on co-changes is especially useful to give the developers directly while the perform the change.

“Advances in static analysis, test generation and repository mining allow us to give further feedback to developers, potentially just-in-time while performing changes,” Prof. Dr. Stefan Wagner points out. “These analyses have not been incorporated into a joint feedback system that gives focused hints.”

###

Original source:

Wagner S (2015) Continuous and Focused Developer Feedback on Software Quality (CoFoDeF). Research Ideas and Outcomes 1: e7576. doi: 10.3897/rio.1.e7576

###

Additional information:

The DFG is the largest independent research funding organisation in Germany. It promotes the advancement of science and the humanities by funding research projects, research centres and networks, and facilitating cooperation among researchers.

The mission of RIO is to catalyse change in research communication by publishing ideas, proposals and outcomes in order to increase transparency, trust and efficiency of the whole research ecosystem. Its scope encompasses all areas of academic research, including science, technology, the humanities and the social sciences.

The journal harnesses the full value of investment in the academic system by registering, reviewing, publishing and permanently archiving a wider variety of research outputs than those traditionally made public: project proposals, data, methods, workflows, software, project reports and research articles together on a single collaborative platform offering one of the most transparent, open and public peer-review processes.

RIO pricing: affordable, flexible, sustainable

Today, we are happy to announce our initial pricing scheme and launch promotions.

Many people have asked us what we are going to charge for our novel services – we welcome such questions. In an age when some are charging in excess of $5000 for publishing a single open-access article, we are proud to keep our prices low, but sustainable.

You may notice the pricing structure is more complicated than usual. Don’t Panic. In this blog post, we’ll break it down into easy pieces. We think this flexibility of pricing is a positive feature: it reflects that some outputs are less costly to publish, and others are more expensive. We also offer à la carte pricing with respect to optional services such as linguistic editing, PR services and paper-printed copies.

Try RIO for free

RIO is already open for submissions. To encourage you to give it a try, we’re making idea-stage submissions completely free from now on until the end of April 2016. This promotional offer applies to the following output types if submitted through the ARPHA writing tool: Small Grant Proposals, Research Ideas, PhD Project Plans, PostDoc Project Plans, Data Management Plans and Software Management Plans.

pricing-1

Very small outcomes have very small prices. We think producing a professional, machine-readable version of your work, assigning it a DOI, and enabling optional community peer review is something worth paying for. At € 50, single-figure publications (see Do and Mobley, 2015) are particularly appealingly priced, so as to encourage the community to explore this new format.  

pricing-2

For those who like to compare rates between different open-access journals, you’ll find our research article price very competitive at only €550. Unlike many open access journals, we accept review articles, too, as well as a wide variety of other research outputs.

pricing-3

Finally, you might be worried that charging for each and every single output could get quite expensive over time for an individual or an institution. We’ve got that covered with our package plans. For individuals, if you commit to buying a package upfront, we’re happy to reduce the overall price per output published to an average price between EUR 140 and 330 per article (see table below). For funders, institutions, conference organisers and others, we’re happy to make even more competitive deals; just contact us to discuss your needs at: rio@riojournal.com.

pricing-4

For further details, please see the Article Processing Charges and Promotions entries on the RIO website.

 

Would you like some experience of basic editorial work at RIO Journal?

Warming up for its first set of research ideas, proposals, articles, software suggestions and a lot more types of scientific work to be submitted in November, RIO Journal is on the lookout for early career researchers to lay the basis of the one-of-a-kind project that Research Ideas and Outcomes (RIO) Journal is.

What is an Editorial Apprentice?

At RIO Journal, we want to help researchers gain an understanding of editorial roles, by experience, from an early stage in their careers. Editorial Apprentices perform basic technical checks and execute the validation of a manuscript right before it is submitted to RIO.

RIO uses a unique platform – ARPHA, along with its associated authoring tool, the ARPHA Writing Tool (AWT). The platform is the first end-to-end, narrative- and data-integrated publishing solution that supports the full life cycle of a manuscript, from authoring to reviewing, publication and dissemination.

arphahub

To ensure high quality of content, manuscripts on ARPHA go through a two-step validation process. First, the system provides an automated technical check, but a human “fine tuning” on a manuscript is often still needed. The editorial assistant keeps an eye on the text consistency, whether the references and the language are in compliance with the high standards of RIO, and if data underlying a manuscript are published according to the journal’s policy.

Why should I apply for an Editorial Apprentice at RIO?

If you are a PhD student or a Postdoc, you should be looking for some first-hand experience of more senior academic roles. It’s good to improve your own understanding of the academic system, as well as good for your CV. As an Editorial Apprentice at RIO you’ll gain experience of paper reviewing and publishing processes, and you will also be given the right atmosphere to advance your editorial skills and improve your knowledge of the publishing process.

What else do I want to know about RIO?

RIO is the first open-access peer-reviewed journal that makes it possible to publish research across all stages of the research cycle in disciplines ranging from humanities to science.  RIO uses a novel, entirely public process of quality assurance checks, technical validation and formal peer-review, including options for pre-submission and post-publication peer-reviews.

apprenticeship

How to apply?

If you are a PhD student or a Postdoc and wish to continue your career in academia or in the academic publishing industry, you are more than welcome to apply for an Editorial Apprenticeship via our online application form (Also available as PDF).

Please, note you will need to spend a few hours per week for a period of one year or more. We are looking for candidates who have published or submitted at least two scientific articles. High-level proficiency with written English is a must.

We look forward to working with you!

Counting days and tweets: What’s happened to RIO Journal so far?

So, here we are, counting days and Twitter impressions since Research Ideas & Outcomes (or, RIO for short) our new open access journal was officially announced on 1st September 2015. As much as we were excited to take this long-prepared and anticipated stand in the spotlight, we are still holding our breath ahead of the big event – the launch itself, scheduled for November 2015.

In the meantime, when not busy welcoming our very first subject editors, we have our ear to the ground, so that we can make sure to provide everyone with the best services and insight. The truth is, we don’t only value attention, we deeply appreciate your opinion and respect your needs and concerns.

So, here below we provide a short summary of the eventful first week of RIO Journal:

It all started on 1st September on Twitter. Among the constantly growing list of our first followers, there were a lot of welcoming retweets, sounding just as excited as we were:

Then, the time came for the world media to give its verdict:

This week sees the birth of a new type of scientific journal, one that will publish not only study results and data, but also research ideas and proposals. It’s called Research Ideas and Outcomes (RIO).
/The Scientist, 3rd September/

With so many science journals already in existence, it is rare for a new title to draw attention. But researchers and publishing experts are taking notice of Research Ideas and Outcomes, or RIO, an open-access journal that launched on 1 September.
/Nature, 3rd September/

Understandably, the hottest discussion points were RIO’s initiatives:

> To present openly the whole process of the research cycle especially including research proposals
> To publish such ideas regardless of them being eventually approved or rejected for funding
> To apply a transparent, public, and open peer-review policy

Stephen Curry, a structural biologist at Imperial College London shared on Twitter that in his opinion RIO is “bringing a new sense of transparency and collaboration to research”, while he voiced his strong support for preprint publications and open feedback in his Guardian blog. “Preprints can help to refocus attention where it matters – on the work itself, not where it is published. In so doing, they have the potential to revitalize the scientific enterprise”, his column reads.

“I like the idea of getting “publishing-credit” for my research proposals and other research output. Roughly speaking for every proposal I write, I write one paper less”, points out computational chemist at the University of Copenhagen Jan Jansen on explaining why he accepted the invitation to become one of RIO’s subject editors.

At the end of the day, some of RIO’s innovations couldn’t escape being challenged by some criticisms. A librarian and known extreme critic of open access journals, Jeffrey Beall questioned the freedom given to RIO’s authors to make their own choice of reviewers.

One of the RIO’s own subject editors, Ivo Grigorov, a marine scientist at the Technical University of Denmark also raised his concerns on the matter. Yet, he and our ever growing list of editors and advisory board are sticking with us:

In his turn, Ross Mounce, a postdoc at the Natural History Museum, London and a founding editor of RIO, explained how the new open access journal seeks to improve the “immensely wasteful” traditional research process in his piece on the popular LSE Impact blog.

Ross also gave a podcast interview for Beta Pleated Chic, he spoke in detail about the whole list of innovative tools and strategies.

If you know of any other press mentions or blogs about RIO Journal, please don’t hesitate to forward them to us on Twitter @RIOJournal.