Fostering Diffusion of Scientific Contents of National Societies Cardiovascular Journals: The New ESC Search Engine

Download PDF

Fernando Alfonso1,2, Lino Gonçalves3, Fausto Pinto1, Adam Timmis1, Hugo Ector1, Giuseppe Ambrosio1, Panos Vardas1, On behalf of the Editors’ Network European Society of Cardiology Task Force
Author Affiliations

1 Nucleus Members Editors’ Network of the European Society of Cardio­logy
2 ESC Editors’ Network Task Force Chair
3 ESC Search Engine Task Force Chair

Contact address:
Fernando Alfonso MD ESC Editors´ Network Task Force Chair. Interventional Cardiology. Cardiovascular Institute. Clínico San Carlos University Hospital. IdISSC. Plaza Cristo Rey. Madrid. 28040. Spain.
E-mail: [email protected]

Editors´ Network Members (Editors-in-Chiefs of National Society Cardiovascular Journals):

Eduard Apetrei (Editor-in-Chief, Romanian Journal of Cardiology),
Michael Aschermann (Editor-in-Chief, Cor et Vasa),
Leonardo Bolognese (Editor-in-Chief, Giornale Italiano Di Cardiologia),
Mirza Dilic (Editor-in-Chief, Medical Journal),
Istvan Edes (Editor-in-Chief, Cardiologia Hungarica),
Krzysztof J. Filipiak (Editor-in-Chief, Kardiologia Polska),
Faig Guliyev (Editor-in-Chief, Azerbaijan Cardiology Journal),
Habib Haouala (Editor-in-Chief, Cardiologie Tunisienne),
Magda Heras (Editor-in-Chief, Revista Española de Cardiología).
Mahmoud Mohamed Hassanein (Editor-in-Chief, Egyptian Heart Journal),
Kurt Huber (Editor-in-Chief, Journal für Kardiologie),
Mario Ivanusa (Editor-in-Chief, Cardiologia Croatica),
Germanas Marinskis (Editor-in-Chief, Seminars in Cardiovascular Medicine),
Izet Masic (Editor-in-Chief, Medical Archives),
Miodrag Ostojic (Editor-in-Chief, Heart and Blood Vessels),
Dimitar Raev (Editor-in-Chief, Bulgarian Cardiology),
Mamanti Rogava (Editor-in-Chief, Cardiology and Internal Medicine XXI),
Olaf Rødevand (Editor-in-Chief, Hjerteforum),
Vedat Sansoy (Editor-in-Chief, Archives of the Turkish Society of Cardiology),
Valentin A. Shumakov (Editor-in-Chief, Ukrainian Journal of Cardiology),
and Thomas F. Lüscher (Editor-in-Chief, Kardiovaskuläre Medizin)

Abstract: European Society of Cardiology (ESC) National Society Cardiovascular Journals (NSCJ) are high-quality biomedical journals focused on cardiovascular diseases. The Editors´ Network of the ESC devises editorial initiatives aimed at improving the scientific quality and diffusion of NSCJ. In this article we will discuss on the importance of the Internet, electronic editions and open access strategies on scientific publishing. Finally, we will propose a new editorial initiative based on a novel electronic tool on the ESC web-page that may further help to increase the dissemination of contents and visibility of NSCJ.
Keywords: biomedical journal, editors network, open access, Internet, electronic editions

European Society of Cardiology (ESC) National Society Cardiovascular Journals (NSCJ) are high-quality biomedical journals devoted to publish original research and also educative material on cardiovascular diseases1-3. These journals officially belong to the corresponding ESC national societies. However, many of them have achieved major international recognition, are included in most important bibliometric databases and have gained major scientific impact1-5. Some NSCJ offer full-text English content and are freely available from ele­ctronic editions. NSCJ, however, are largely heterogeneous and some of them are only published in local languages with a limited visibility1-3.
The main goal of biomedical journals is to publish high quality scientific information. To achieve this goal, journals should compete for the best research generated in their field being the “prestige” of the journal the main driver to attract original contributions1-3. In turn, journals prestige is based upon credibility, diffusion and scientific impact6. To ensure that the scientific process is fully respected journals relay in the “peer review” system. This process not only allows the Editors to select the best possible material for publication but also ensure the readers that the quality of the information follows the highest scientific standards. Actually, the process significantly improves the final quality of manuscripts eventually published. Once the article is definitively accepted for publication the Journal should guarantee its expedited publication and widespread diffusion among the scientific community1-3.
The Editors´ Network of the ESC provides a unique platform to devise editorial initiatives aimed to improve the scientific quality and to facilitate diffusion of con­tents from NSCJ1-5. Herein we will discuss on the importance of the Internet and electronic editions on scientific publishing. We will also review the growing relevance of open access strategies. Last but not least, we will propose a new initiative based on a novel electronic tool that may further help to increase the diffusion, dissemination and overall visibility of NSCJ. This tool, located at the ESC web site, should foster collaboration among the different NSCJ and also broaden exposure from diverse scientific sites and ESC official journals. Hopefully, this will help to further expand the scientific impact of European cardiovascular research.

Electronic Editions and the Internet: A paradigm shift in Scientific Publishing:

Sharing the results of late breaking research through peer-reviewed journals remains the mainstay of the sci­entific process and the progress in science1-3. The success of research requires articles to be read, spread, discussed and cited among interested investigators. Therefore, in the fast moving and globalized world of science, journals should ensure the maximal accessibility and diffusion of their articles1-3. Indeed, most publications have already moved into a new “online era” where the emphasis is placed on the Internet and in electronic editions1-3. Just a few years ago scholars did all their reading from paper journal issues obtained as personal copies circulating inside their organizations, or by retrieving the issues from library archives7. Today the predominating reading mode is to download a digital copy and either read it directly off the screen or as a printout7. Currently, readers and investigators readily retrieve articles with just a click on their home or office computers7.
Interestingly, the Internet not only impacts research but also clinical practice. Nowadays, physicians are freq­uently approached and challenged by patients who had downloaded medical information from the internet. Often they face either unnecessarily worried patients or patients with unrealistic expectations. Although some patients are confused others are over-informed and demand in-depth explanations regarding their diag­nosis, management and prognosis. Patient-oriented information should be provided from the scientific societies to address these demands. Therefore, even everyday clinical practice should accommodate the socio-cultural change induced by the Internet.
Access to medical information has been revolutio­ni­zed by electronic editions. Likewise, bibliometric data­bases are also evolving. MEDLINE, the ISI Web of Sci­ence and more recently Scopus offer comprehensive online information on medical literature8-11. In addition, Google Scholar is increasingly used by many investigators8-11. Scopus and specially Google Scholar obtain data from a larger data sources including widely diverse scientific items (not only ISI publications) and therefore offer a slightly different perspective of the field. Interestingly, Google scholar is free and different studies suggest that it provides accurate search and data analyses that differ little from those obtained from classical bibliometric sources8-11.
Traditionally, the most commonly used source of bibliometric data is the Thomson ISI Web of Knowledge, in particular the Science Citation Index and the Journal Citation Reports, which provide the yearly Journal Impact Factors. Recently, other indicators such as SCImago SJR or the Eigenfactor are emerging as alternative indices of a journal’s quality8-11. These consider not only the number but also the “quality” or relevance of the citations received by a given paper. Quantitative publication metrics (research output) and citations analyses (scientific influence) are key determinants of the scientific success of individual investigators and institutions because the “publish or perish” dictum still prevails in most academic settings8-11. In this scenario, the electronic editions and accessibility on the Internet certainly play a critical role. Nowadays, once a paper is electronically published on a journal website, the information can propagate rapidly in the community and extremely high downloads could be the results of mechanisms such as the “Matthew effect” (richer get richer)12. Indeed, the relationship between the number of citations acquired by an article has been explored in relation to the number of downloads13. Hit counts on a journal website for an article during the week after the online publication predict the number of citations of that article in subsequent years14. Of note, Uniform Resource Locators (URLs), are being increasingly used in scientific publications15. Citation of URLs provide the possibility of calculating an objective electronic impact factor (eIF) to measure their impact on scientific research15. However, the stability of URLs remains a matter of concern and this should be guaranteed by the responsible organization because URLs are vulnerable to technical problems and may become inaccessible in a time-dependant manner15.
Notably, the Internet offers a new window to science and provides new insights on access and use of research16. Currently web-usage-data may be analyzed in depth to outline a “map of knowledge”. According to Butler et al16 when readers click from one page to another while looking through online scientific journals, they generate a chain of connections between links they think belong together. These ‚clickstream eve­nts’ may be analyzed to map such connections and to provide a snapshot of interconnections between dis­ci­plines.
Usage maps reveal how often users looking at an article in journal A moved on to an article in journal B during a browser session. By aggregating all these complex relationships using network-visualization algorithms, maps can be generated based on the ‚distances’ between journals and disciplines16. The structure of these maps is quite similar to those created using citation data: a network of clusters in different fields within which journals have strong connections with one another but fewer links to other clusters. Interestingly, journals in the humanities and social sciences figure much more prominently in these maps than in citation-based maps16. Another key difference between citation- and usage-based maps is that the former only reflect citations by researchers who publish, but ignore the impact of papers on the medical community who read and apply the literature in medical practice but who rarely publish. Citation data may undervalue papers written in practitioner-based fields that are widely read but not cited proportionally16. Moreover, usage maps are more up-to-date than citation ones because of the inherent delay in publication therefore providing a different time-slice of the scientific process. Accordingly, both usage and citation data each provide complementary information on the impact of papers and journals on the scientific community16.
Electronic editions provide unique publishing possibilities and open new venues in scientific communication1-3. For instance, they offer a flexible layout and structure for articles, new formats and the possibility of including additional documentation attached to the paper as media enhancements (videos, etc). Important sections as methods and additional data can be now presented as supplementary material without additional costs. Electronic managing systems facilitate both the processes of peer-review and publishing1-3. Open peer-review and even post-publication readers´ comments may be uploaded on the journal website facilitating interactivity and a more transparent and dynamic scientific process. Finally, statistics on electronic papers (downloads and citation metrics) are offered to the interest of readers and researchers17.
Publicly available data is advocated as a means to further promote transparency in research and a more open science18-20. Online editions allow the publication of longer papers free from the economic burden of print charges. Posting the complete anonymized “raw data set” has been advocated
in this regard18-20. The raw data can be used to confirm original results by independent analyses but also to explore related or new hypotheses, particularly when combined with other publicly available data sets. From an ethical perspective it appears unacceptable that while patients are willing to share data about themselves with investigators and sponsors these may be unwilling to share the trial data with others. Data sharing has been already successful among genomic investigators. However, this strategy may cause concerns including inappropriate analyses, “data dredging” and drawing inappropriate conclusions18-20. The International Committee of Medical Journals Editors has developed guidelines for the preparation of raw clinical data for Publication18. Interestingly, this practice has been associated with a 69% increase in citations, independently of journal impact factor, date of publication, and author country of origin20. The correlation between publicly available data and increased literature impact may further motivate investigators to share their detailed research data.
On the other hand, the Web 2.0 is also been increasingly used in the medical field21-25. RSS feeds, podcasts, personal publishing platforms (blogs), social networks (like Twitter and Facebook), and social media are proposed as innovative tools for the education and update of clinicians. They allow physicians to distribute, share and comment medical information21-25. However, the scientific community is less than eager to regard them as equivalent to the traditional models of information dissemination on peer-reviewed medical journals. In this regard, some have proposed that platforms of post-publication peer-review may provide the required safe guard in this new setting22. In addition, intuitive browsing of Journals´ content on smartphones and the iPad, is being provided by a growing number of publications (including the European Heart Journal)24 to enhance diffusion of contents21. Furthermore, some Web 2.0 technologies facilitate collaborative data collection for clinical trials23. Google Docs, for instance, is freely available and allows multiple users to enter patient data into electronic case report forms of multicenter trials through mobile devices23.
Finally, we should keep in mind that English represents the “lingua franca” of science. This is important and efforts should be made within the ESC to prevent tower-of-Babel phenomena in the digital era1-3. However, this may create major problems and unique challenges for non-English-speaking investigators and countries26. Actually, some NSCJ only publish in their mother tongue and therefore they are not readily accessible to the international scientific community. Some NSCJ have decided to publish their articles in both native language and English, to address healthcare professionals and international scholars, respectively. Difficult concepts are easier to remember in the mother tongue. Interestingly, Public Library of Science journals encourage non-English-speaking authors to provide a version of their article in its original language as supporting material27. Science should not be considered an “ivory tower” separated from the rest of society but rather imbedded on it to facilitate its cultural assimilation27.

Some Editorial Perspectives on “Open Access” Initiatives:

The Internet and the electronic editions set the bases for Open Access (OA) initiatives28,29. The two main cha­racteristics of OA publications are: 1) all published con­tents are freely accessible through the Internet, and 2) readers are given copyright permission as long as authors and publishers receive the adequate attribution28. In turn, this model requires two major changes from the traditional –subscription based- model. First, OA shifts the financing of publication from readers (subscriptions fees by individuals or universities) to authors and investigators (through the corresponding funding organization or academic institutions) by mean of articles processing fees28. Second, the copyright is not longer used to prevent but rather to stimulate re-publication. Subscription-based journals usually require authors to transfer the copyright to the journal to be empowered to restrict access to paying customers and threat with infringement lawsuits to competing publications. Major subscription-based journals are financed by individuals or medical societies but mainly by bundled e-license agreements between publishers and universities or librarians28,29. Electronic individual articles can also be accessed on a pay-per-view basis. Readers are charged one way or the other in the traditional way whereas authors and investigators are charged in the OA model28,29. Some commercial publishers charge authors a publication fee to substitute for subscription revenue while significantly limiting reuse. This initiatives, however, should not be considered real OA. Some traditional publishers have recently open to “hybrid” initiatives where authors are allowed (after paying a fee) to make individual articles OA28,29.
In the early 90´s, pioneer OA journals were founded by individual investigators based on voluntary work and usually were hosted in individual or university servers29. Thereafter, many established journals made their articles OA when they implemented their digital editions in parallel with print editions. This was especially the case for official journals from medical societies and in non-English speaking countries in an attempt to increase their readership and impact30. In the last decade, new, formal, OA journals flourished using article processing charges to finance publications29. Interestingly, some major publishers (BioMed Central, Public Library of Science) became specialized in OA29. OA has to major pathways: 1) “Gold” OA (via direct publishing) and 2) “Green” OA (traditional publication in subscription-based journals with parallel openly posting on the Web the final manuscript). Green open access is delivered by repositories whereas gold open access is delivered by journals (31). Licences range from any kind of reuse providing proper attribution is made (CC-BY) to those that limit commercial use (CC-BY-NC)31.
The health of the free-access author-pay model may be demonstrated by data showing the steady growing of papers published in OA journals (20% per year) and also in the number of OA journals (15% per year), either as new journals or traditional journals switching to this model32. Currently 30% of all peer-review journals in the world are open access31.
OA benefits science by accelerating dissemination and uptake of research findings. A major advantage of OA is that readers can use any Web-based research tool to access and review the literature28. These articles are quickly recognized and their results are readily picked up and discussed by peers33. As already mentioned, there are two main modalities of open access: open access journals and self-archiving. Interestingly, some studies suggest33 that articles immediately published as OA on the journal site (gold route) have higher impact than self-archived or otherwise openly accessible OA articles (green route).
Overall OA initiatives increase diffusion of contents, citations and eventually the impact factor of the corresponding journals33-35. Early studies 10 on MEDLINE as “full text on the net” also boosts their impact factor37. This bias is explained by the tendency to peruse what is more readily available37. OA initiatives also appear to increase the impact factor33-35. However, some argue that this effect may confound between open and electronic access. Nevertheless, recent reports, suggest that in most developed countries journals articles receive an increase in citations when they come online freely but experience an additional jump when they first come online through commercial sources35. This effect appears to be reversed in poor countries where freeaccess articles are much more likely to be cited35. All together these findings suggest that free Internet access widens the circle of those who read and make use of scientific research. In addition, this “OA impact advantage” does not appear to be a “quality bias” from authors self-selecting what to make OA, because some studies suggest that this advance persists after adjusting for many other potential confounders related to the editorial and research quality38.
Interestingly, a randomized trial on OA publishing analyzed the effects of free access on article downloads and citations39. Articles placed in the OA received significantly more downloads and reached a broader audience within the first year. However, in this particular study, OA were cited no more frequently, nor earlier, than subscription-access articles within 3 years. It was suggested that the process of “social stratification”, acc­ounting for a concentration of scientific authors at as mall number of elite research universities with excellent access to the scientific literature, might help to explain this apparent paradox39. Moreover, this controlled study suggests that real beneficiaries of OA publishing may notbe the research community but rather communities of medical practice that consume, but rarely contribute to, the corpus of literature39.
As discussed, currently, embargoes are imposed by publishers for economic reasons. This may be a significant barrier to access in biomedical sciences. As previously emphasized, it has been suggested that users favor electronic access and often eschew articles that are not available electronically40. In a shy attempt to tackle these problems many journals offer now free access to all articles 6 months after publication and welcome the publication of articles as OA after a fee is paid by the authors.
However, research funding bodies are becoming in­creasingly sensible to this ethical issue. Many would argue that it is unethical to use the research grants from government (people’s money) and not allow the sci­entific community to have free access to the results of the study. To address such issues, the Berlin declara­tion suggested the establishment of OA repositories. Every investigator who has received public grants should submit the full text of the paper published from his study to PubMed Central and also ensure self archiving at the corresponding university or research institution. Obviously, OA journals provide an attractive solution to the problem of restricted access to results of publicly funded research41.
Most countries and founding bodies are currently taking further actions to ensure OA for publicly funded research41-43. Researches are compelled to make their work publicly available in repositories (green road) within 12 month of publication. Others bodies even suggest that authors should make their work free by the publisher upfront (gold road). Clearly, research budgets should be re-allocated with this aim although the logistics required and the implications of this change remain a matter of ongoing debate. On July 2012, a new OA policy was announced from the European Union that recommended OA policies for all the member states31,41-43. Hopefully, this will represent a paradigm shift in scientific publishing and will herald a new era of academic discovery.

The ESC Search Engine:

In the last decade the amount of documents and educational materials available inside the ESC websites family increased exponentially. This situation was naturally associated with increasing difficulties for the user to find the information they need. It became quite obvious that a more comprehensive search solution was necessary. This is the reason why the ESC decided to provide a better search experience for the ESC site visitors44. The ESC search engine uses semantic analysis to provide the best results from the typed keywords45. This search engine project has four goals. First, to provide a single entry point to multiple data sources. In fact, from a single entry point, the user will be able to explore ESC rich database of slides, scientific reports, guidelines, abstracts, clinical cases, news, and articles from the ESC Journals. Second, to propose a tool which can treat requests expressed in natural language, in a very user-friendly way. Third, to locate content that would be difficult to find or access otherwise, therefore saving a lot of precious time. Finally, to allow visitors to find contents by topic or person in an intuitive way.
In 2008, the ESC Board chaired by Roberto Ferrari, decided to support the development of a semantic search engine that would be able to search for information inside the ESC Central website and all the six Associations websites, as well (EHRA, EAE, EAPCI, HFA, EACPR, ACCA). This idea was based on the previously reported need of providing to the user a quick and easy way of getting the information needed from hundreds of thousands of documents available in all these websites. Moreover, this engine is also looking into the ESC journals’ family were it is possible to get results from more than 30 000 papers! Not surprisingly, this tool was a major success, being already the second most visited page of the ESC website, with 49,853 page views, in October and November of 201246. With the help of this search engine it is now extremely easy to get the information you need by just typing the key words on the top right hand side of the screen, inside the landing page (Figure 1). The result is a list of documents addressing that specific topic, and it is up to the user to select the ones they want (Figure 2).

Figure 1. ESC website landing page. The search engine box is located on the top right hand side of the screen (arrow).

Figure 1. ESC website landing page. The search engine box is located on the top right hand side of the screen (arrow).

Figure 2. Results page with relevant information about the documents found. On the right, there is a toolbar with a filtering system to refine the search.

Figure 2. Results page with relevant information about the documents found. On the right, there is a toolbar with a filtering system to refine the search.

Inside this results page you can get a lot of information and functionalities. Within the document preview you can see how the document looks like (Figure 2). The relevance score assigned to this document is also displayed by the search engine. The type of document is also presented (guideline, abstract, slide presentation, scientific report, news, clinical case, or a web document). The document origin can also be easily identified at a glance through a small institutional logo which can also be found inside the results page, just below the icon showing the type of document. Also important to know is the document availability. A padlock symbol is displayed when a document is behind a login so that you can still see that the resource exists, meaning that its access is for members only. This tool also allows to refine the search by using filters located on the toolbar located on the left. With this toolbar you can filter the type of document you are looking for (only slides for example). It is also possible to filter only results from a given time period. During a congress, when a lot of content is published daily, you may filter for what’s new since yesterday, or you can filter only the results where a person is cited. Related terms are proposed by the engine from the keywords entered in your request to propose other related topics which could be of interest. If you search the same term on a regular basis, you could be interested in using the RSS feed functionality. We may show any search result page as an RSS feed which you may subscribe to, and get regular updates about what’s new in this field.

Time has come to involve the National Societies’ Journals!

This project is already in its adulthood and time has come now to enter into a second phase of development and involve also the NSCJ. The ESC Board chaired by Michel Komajda decided to support the development of this project. The ESC Editor’s club gave also an enthusiastic response and decided to contact those NSCJ that are already published in an electronic format and that are published in English. Some of them have already a significant Impact Factor. The goal of this second phase of the project is to increase the visibility of the NSCJ and as a consequence to increase their reading and their level of reference in other international journals. Moreover, the excellent research that is performed at the National level in many countries in Europe will become more visible worldwide.
This new tool is already available and you will be able to get, after typing the keywords you can get two results: one from the ESC documents, and a second one from the NSCJ. It will be possible for the user to see both in parallel and easily move from one result to the other with a simple click.
The first NSCJ have been added to the search results and can now be easily identified and selected. The first five journals are: Revista Española de Cardiología, Heart and Blood Vessels, Journal of the Cardiology Society of Serbia, Hellenic Journal of Cardiology, Egyptian Heart Journal, and Romanian Journal of Cardiology. An arrangement has been made with the Brazilian Society of Cardiology and its website should soon include our Search Engine. This is an interesting way to raise awareness about this very useful tool and allow the Brazilian cardiologists to have better access to our scientific resources.
There is no doubt in our mind that by providing this tool the bonds between the ESC central and the National Societies will be strengthen even further and that European Cardiovascular Science will become more visible and easily accessible from any place in the world.

Acknowledgements: We are grateful for the support and assistance of Iris Chapuis, Isabelle Collin and Muriel Mioulet from the ESC National Cardiac Societies Relations Department at the Heart House.

Conflict of Interest: No conflicts of interest in relation to this work were disclosed


1. Alfonso F, Ambrosio G, Pinto FJ, Van der Wall EE; Task Force of the European Society of Cardiology, Kondili A, Nibouche D, Adamyan K, Huber K, Ector H, Masic I, Tarnovska R, Ivanusa M, Stanek V, Videbaek J, Hamed M, Laucevicius A, Mustonen P, Cohen JY, Rogava M, Böhm M, Fleck E, Heusch G, Klawki R, Vardas P, Stefanadis C, Tenczer J, Chiariello M, Elias J, Benjelloun H, Rødevand O, Kułakowski P, Apetrei E, Lusov VA, Oganov RG, Obradovic V, Kamensky G, Kenda MF, Höglund C, Lüscher TF, Lerch R, Jokhadar M, Haouala H, Sansoy V, Shumakov V, Timmis A. European National Society cardiovascular journals. Background, rationale and mission statement of the „Editors’ Club” (Task Force of the European Society of Cardiology). Heart. 2008 Jun;94(6):e19.
2. Alfonso F, Ambrosio G, Pinto FJ, Ector H, Vardas P, Kulakowski P, Timmis A; Editors’ Network ESC Task Force. European Society of Cardiology national cardiovascular journals: the ‚editors’ network’. Eur Heart J. 2010 Jan;31(1):26-8.
3. Alfonso F, Timmis A, Pinto FJ, Ambrosio G, Ector H, Kulakowski P, Vardas P; Editors’ Network European Society of Cardiology Task Force. Conflict of interest policies and disclosure requirements among European Society of Cardiology National Cardiovascular Journals. Eur Heart J. 2012 Mar;33(5):587-94
4. Mills P, Timmis A, Huber K, Ector H, Lancellotti P, Masic I, Ivanusa M, Antoniades L, Aschermann M, Laucevicius A, Mustonen P, Artigou JY, Vardas P, Stefanadis C, Chiarello M, Bolognese L, Ambrosio G, van der Wall EE, Kułakowski P, Pinto FJ, Apetrei E, Oganov RG, Kamensky G, Lüscher TF, Lerch R, Haouala H, Sansoy V, Shumakov V, Tajer CD, Lau CP, Márquez M, Krittayaphong R, Arai K, Alfonso F. The role of European national journals in education. Heart J. 2009 Dec;95(24):e3.
5. Timmis AD, Alfonso F, Ambrosio G, Ector H, Kulakowski P, Pinto FJ, Vardas P; Editors’ Network. National society cardiovascular journals of Europe: Almanac 2011. Heart. 2011 Nov;97(22):1819
6. Alfonso F, Bermejo J, Segovia J. Impactology, impactitis, impactotherapy. Rev Esp Cardiol. 2005 Oct;58(10):1239-45.
7. Bjork B-C, Welling P, Laakso M, Majlender P, Hedlund T, et al. Open Access to the Scientific Journal Literature: Situation 2009. PLoS ONE 2010;5(6):e11273.
8. Van Aalst, J. Using Google Scholar to estimate the impact of journal articles in education. Educational Researcher 2010;39:387-400.
9. Falagas ME, Pitsouni EI, Malietzis GA, Pappas G. Comparison of PubMed, Scopus, Web of Science, and Google Scholar: Strengths and weaknesses. FASEB J 2008;22:338-42.
10. Kulkarni AV, Aziz B, Shams I, Busse JW. Comparisons of citations in Web of Science, Scopus, and Google Scholar for articles published in general medical journals. JAMA 2009;302:1092-6.
11. Alfonso F. The long pilgrimage of Spanish biomedical journals toward excellence. Who helps? Quality, impact and research merit. Endocrinol Nutr. 2010 Mar;57(3):110-20.
12. Merton RK. The Matthew effect in science. The reward and communication systems of science are considered. Science 1968;159:56–63.
13. Brody T, Harnad S, Carr L. Earlier Web usage statistics as predictors of later citation impact. Journal of the American Society for Information Science and Technology 2006;57:1060–1072.
14. Perneger TV. Relation between online “hit counts” and subsequent citations: prospective study of research papers in the BMJ. BMJ 2004;329:546-7.
15. Wren JD. URL decay in MEDLINE: a 4-year follow-up study. Bioinformatics. 2008 Jun 1;24(11):1381-5.
16. Butler D. Web usage data outline map of knowledge. Nature. 2009; 458(7235):135.
17. Citrome L, Moss SV, Graf C. How to search and harvest the medical literature: let the citations come to you, and how to proceed when they do. Int J Clin Pract. 2009 Nov;63(11):1565-70.
18. Hrynaszkiewicz I, Norton ML, Vickers AJ, Altman DB. Preparing raw clinical data for publication: Guidance for journal editors, authors and peer reviwers. BMJ;2010:340:c181.
19. Ross JS, Lehman R, Gross CP. The importance of clinical trial data sharing. Towards more open science. Circ Cardiovasc Qual Outcomes 2012;5:238-40.
20. Piwowar HA, Day RS, Fridsma DB. Sharing Detailed Research Data Is Associated with Increased Citation Rate. PLoS ONE 2007;2(3):e308.
21. Santoro E, Caldarola P, Villella A. Using Web 2.0 technologies and social media for the cardiologist’s education and update. G Ital Cardiol (Rome). 2011;12:174-81.
22. Chatterjee P, Biswas T. S Afr Med J. Blogs and Twitter in medical publications: too unreliable to quote, or a change waiting to happen? 2011 Sep 27;101(10):712, 714.
23. Chan XH, Wynn-Jones W. Time for open access secure online data collection tool. BMJ 2012;11:49.
24. Masic I, Sivic S, Pandza H. Social Networks in medical education in Bosnia and Herzegovina. Nat Soc Med 2012;24(3):162-164.
25. Nallamothu BK, Lüscher TF. Moving from impact to influence: measurement and the changing role of medical journals. Eur Heart J. 2012 Dec;33(23):2892-6.
26. Heras M, Avanzas P, Bayes-Genis A, Pérez de Isla L, Sanchis J. 2011 Annual summary. Another meeting with our readers. Rev Esp Cardiol. 2011 Dec;64(12):1207-14.
27. Meneghini R, Packer AL. Is there science beyond English? Initiatives to increase the quality and visibility of non-English publications might help to break down language barriers in scientific communication. EMBO Rep. 2007 Feb;8(2):112-6.
28. Carroll MW. Why full open access matters. PLoS Biol 2011;9:e101210.
29. Bjork BC. A study of innovative features in scholarly open access journals. J Med internet Res 2011;13:e115.
30. Alfonso F, Almonte K, Arai K, Bacal F, Drago Silva JM, Galeano Figueredo J, Guarda E, Gutiérrez Sotelo O, Guzmán L, León Galindo J, Mario Lombana B, Márquez MF, Moreno Martínez FL, Navarro Robles J, Pinto F, Romero C, Tajer CD, Villarroel H, Wyss Quintana FS. Ibero-American cardiovascular journals. Proposals for a much-needed cooperation. Rev Esp Cardiol. 2009 Sep;62(9):1060-7.
31. Suber P. Ensuring open access for publicly funded research. BMJ 2012;345:e5184.
32. Whitfield J. Open access comes of age. Nature. 2011 Jun 21;474(7352): 428
33. Eysenbach G. Citation advantage of open access articles. PLoS Biol 2006;4(5): e157.
34. Norris M, Oppenheim C, Rowland F. The Citation Advantage of Open-Access Articles. Journal of the American Society for Information Science and Technology 2008;59: 1963–1972.
35. Evans JE, Reimer J. Open access and global participation in science. Science 2009 Feb 20;323(5917):1025.
36. Mueller PS, Murali NS, Cha SS, Erwin PJ, Ghosh AK. The effect of online status on the impact factors of general internal medicine journals. Neth J Med. 2006 Feb;64(2):39-44.
37. Murali NS, Murali HR, Auethavekiat P, Erwin PJ, Mandrekar JN, Manek NJ, Ghosh AKImpact of FUTON and NAA bias on Mayo Clin Proc. 2004 Aug;79(8):1001-6.visibilityof research.
38. Gargouri Y, Hajjem C, Larivière V, Gingras Y, Carr L, et al. Self-Selected or Mandated, Open Access Increases Citation Impact for Higher Quality Research. PLoS ONE (2010);5(10): e13636.
39. Davis PM. Open access, readership, citations: a randomized controlled trial of scientific journal publishing. FASEB J. 2011 Jul;25(7):2129-34.
40. Crum JA. An availability study of electronic articles in an academic health sciences library. J Med Libr Assoc. 2011 Oct;99(4):290-6.
41. Manikandan S, Vani NI. Restricting access to publications from funded research: ethical issues and solutions. J Postgrad Med. 2010 Apr-Jun;56(2):154-6.
42. Hawkes N. UK government comes down in favor of making all publicly funded research “open access”. BMJ 2012;345:e4878.
43. Noorden RV. Europe joins UK open-access bid. Britain plans to dip in to research funding to pay for results to be freely available. Nature 2012;487:285.
46. ESC Web activity report Oct 2012 to Nov 2012.

ISSN – online: 2734 – 6382
ISSN-L 1220-658X
ISSN – print: 1220-658X
The Romanian Journal of Cardiology is indexed by:
ESC search engine
CODE: 379
CME Credits: 10 (Romanian College of Physicians)
This work is licensed under a Creative Commons Attribution 4.0 International License.