Original Paper
Abstract
Background: Tissue engineering (TE) constitutes a multidisciplinary field aiming to construct artificial tissues to regenerate end-stage organs. Its development has taken place since the last decade of the 20th century, entailing a clinical revolution. TE research groups have worked and shared relevant information in the mass media era. Thus, it would be interesting to study the online dimension of TE research and to compare it with traditional measures of scientific impact.
Objective: The objective of this study was to evaluate the online dimension of TE documents from 2012 to 2018 using metadata obtained from the Web of Science (WoS) and Altmetric and to develop a prediction equation for the impact of TE documents from altmetric scores.
Methods: We analyzed 10,112 TE documents through descriptive and statistical methods. First, the TE temporal evolution was exposed for WoS and 15 online platforms (news, blogs, policy, Twitter, patents, peer review, Weibo, Facebook, Wikipedia, Google, Reddit, F1000, Q&A, video, and Mendeley Readers). The 10 most cited TE original articles were ranked according to the normalized WoS citations and the normalized Altmetric Attention Score. Second, to better comprehend the TE online framework, correlation and factor analyses were performed based on the suitable results previously obtained for the Bartlett sphericity and Kaiser–Meyer–Olkin tests. Finally, the linear regression model was applied to elucidate the relation between academics and online media and to construct a prediction equation for TE from altmetrics data.
Results: TE dynamic shows an upward trend in WoS citations, Twitter, Mendeley Readers, and Altmetric Scores. However, WoS and Altmetric rankings for the most cited documents clearly differ. When compared, the best correlation results were obtained for Mendeley Readers and WoS (ρ=0.71). In addition, the factor analysis identified 6 factors that could explain the previously observed differences between academic institutions and the online platforms evaluated. At this point, the mathematical model constructed is able to predict and explain more than 40% of TE WoS citations from Altmetric scores.
Conclusions: Scientific information related to the construction of bioartificial tissues increasingly reaches society through different online media. Because the focus of TE research importantly differs when the academic institutions and online platforms are compared, basic and clinical research groups, academic institutions, and health politicians should make a coordinated effort toward the design and implementation of adequate strategies for information diffusion and population health education.
doi:10.2196/25394
Keywords
Introduction
Tissue engineering (TE) is a multidisciplinary field aiming to develop biological substitutes that can restore, maintain, or even improve the structure or functionality of damaged tissues [
]. Since its appearance in 1988 [ ], TE has globally spread to improve current therapeutic approaches, entailing a revolution in health sciences [ ]. In this sense, several TE devices have been employed in the treatment of damaged blood vessels [ ], peripheral nerve injuries [ ], chronic skin ulcerations [ ], oral mucosal replacement [ , ] and corneal lesions [ ].The crescent interest and the fast development of TE have been demonstrated from a quantitative perspective by showing the incremental number of TE publications during the last decade [
]. Moreover, its cognitive and social frameworks have been described by means of science mapping analysis techniques [ ]. These bibliometric-based studies can serve as a guide to help administrative authorities to better plan funding allocations and to promote synergies among research groups, as previously exhibited in other scientific areas [ , ].In this sense, traditional bibliometric analysis employs the information extracted from academic documents (ie, citations or keywords) to comprehend the evolution of a scientific discipline, such as TE [
, , ]. However, classical bibliometric methods have been largely reviewed because of their fewer adequacy to assess the real dimension of scientific enterprise and due to a relative inattention to the societal dimension of scientific endeavor [ ]. Consequently, a new kind of metrics, called alternative metrics or altmetrics, has been proposed to obtain, evaluate, and characterize scientific information through data content in social media [ ].Altmetrics describes a web-based metrics used to understand the impact of publications and other scholarly materials by using data from social media platforms (ie, Twitter, Facebook, Google+, blogs, Mendeley Readers, CiteULike, Reddit, and Wikipedia, among others) [
]. The emergence and development of these metrics are related to the social media revolution: there are now different groups of the population, nonauthor professionals, which read research articles and also share them; furthermore, new types of academic outputs have appeared [ ]. Hence, the traditional acceptance that scientific output is disseminated solely through academic media, such as journals, conferences, or specialized books, has now changed.In addition, the online public nature of these metrics allows to track mentions of scholarly articles across the online landscape faster and broader than traditional citation metrics [
]. The validity and potential of altmetrics and its necessary collaborative relation with classical metrics have been demonstrated in several disciplines [ ]. Motivations on the impact that these metrics could offer on professional research careers have been also scrutinized [ ].Then, within the context of a global science where information is shared and consumed in the web, even before its general validation for the scientific community, it would be interesting to explore the online dimension of a multidisciplinary and dynamic science such as TE. Among the recent advances in health sciences, the construction of biosimilar tissues constitutes one of the most powerful approaches to achieve the successful treatment of previously untreated conditions. To the best of our knowledge, there are no documents available that evaluate the online dimension of TE research since its appearance at the end of the 20th century. Thus, the primary aim of this study was to determine the characters of TE behavior online and to compare it with traditional metrics of scientific impact.
Methods
Sample
The metadata used in this study were obtained from the Web of Science (WoS) Core Collection bibliographic database. WoS is considered one of the most relevant scientific information sources, as it contains reliable evidence about citations, and is widely used in research evaluations [
].The search strategy used in this study was “TISSUE ENGINEER*” or “TISSUE-ENGINEER*”, and it was applied on the Science Citation Index-Expanded Collection for a period between 2012 and 2018. We performed this search strategy to accurately discriminate between genuine TE documents and documents belonging to other related areas such as regenerative medicine or cellular therapy [
]. As originally described by Langer and Vacanti [ ], TE is defined by the use of cell sources, matrices, and growing factors to construct biomimetic tissues with a therapeutic impact on human health [ ], which differs from other emerging biomedical approaches based on the sole use of cultured stem cells or biomaterials without giving rise to a human bioartificial tissue. In this sense, our aim was to capture this precise notion of TE research.Once the metadata were extracted, we excluded reviews, book chapters, meeting abstracts, and proceeding articles. Then, original articles obtained from this research were matched with the information available on Altmetric online [
], which holds important social information since 2012 from a much broader spectrum of sources than traditional metrics (eg, web-based references, news media mentions, Twitter mentions, or patents, among others) [ ].Descriptive Analysis
To comprehend the behavior of TE in the social web and to compare it with traditional metrics, we carried out 2 different analyses. First, we evaluated the presence of original articles regarding TE in 7 different platforms (WoS, Altmetric Attention Score, Twitter, patents, Facebook, Mendeley Readers, and news) as the percentage of documents with at least one mention or a citation from 2012 to 2018. Following Eysenbach [
], in the case of Twitter, we called each mention a tweetation, which includes the mention of a TE journal article URL, retweet of the same tweet, or sending a modified tweet by other users [ ]. In addition, we obtained the top 10 most cited TE original articles from 2012 to 2018 and ranked them according to 2 parameters: the normalized WoS citations and the normalized Altmetric Attention Score. Those measures were calculated using the rationale of the normalized citation impact. It was calculated by dividing the count of citing items by the average of citations for documents with the same year of publication in our corpus of documents. The Altmetric Attention Score has been previously employed as a bibliometric measure of online attention [ ].Statistical Analysis
To better characterize TE structure online, we performed 3 different statistical tests: Spearman correlation test [
], factor analysis [ ], and linear regression model [ ]. The collection of cites using traditional metrics requires several years, while the data provided by Altmetric before 2015 were not extensive, as the platform was only founded in 2012. For this reason, correlation and factor analyses were performed on publications retrieved from 2015 to 2018. This strategy has been used previously in other altmetrics studies [ ]. Furthermore, all citation and mention counts were transformed with the formula Ln(1+x) before processing to reduce skewing [ ].To verify that the data set does not follow a normal distribution, the Kolmogorov–Smirnov test was performed for the next 16 variables that were evaluated, overall, to characterize the field: (1) WoS citations, (2) news, (3) blogs, (4) policy, (5) Twitter, (6) patents, (7) peer review, (8) Weibo, (9) Facebook, (10) Wikipedia, (11) Google, (12) Reddit, (13) F1000, (14) Q&A, (15) video, and (16) Mendeley Readers. The Spearman correlation was then obtained for the variables previously described, and the statistical significance was defined as P<.05.
Once the correlation data were obtained, factor analysis was performed. Factor analysis allowed us to identify the common variables or factors that could explain the previously observed correlation data. In this sense, Bartlett sphericity and Kaiser–Meyer–Olkin tests were performed prior to assessing the suitability of factor analysis [
]. Finally, the linear regression model was applied to obtain a mathematical expression of the influence of alternative metrics on a traditional measure of scientific impact such as the citation counts. The equation constructed contains a group of variables identified in the correlation and factor analyses, which allows us to predict the number of WoS citations in 2018 from 2015 TE Altmetric scores. Finally, the equation was used to calculate the predicted citation(s) of the documents published in 2015. A t-test analysis was employed to determine the significance (95% CI and significance at P<.05). JASP (freeware; University of Amsterdam, Amsterdam, The Netherlands) was employed to perform all the statistical analyses [ ].Results
Sample
After performing the search strategy described, a total of 23,179 documents pertaining to TE were retrieved from WoS for the period from 2012 to 2018. A process of matching between the DOIs available in the WoS and the Altmetric data was then performed. Finally, a total of 10,112 documents (43.63%) with an Altmetric score of 1 or higher were obtained.
Descriptive Analysis
Evolution of TE Documents in WoS and the Online Web
The presence of TE documents in WoS and online is shown in
. The trend lines indicate the evolution of the percentage of documents with at least one citation or mention during the period 2012-2018. In WoS, the percentage of documents exceeds 85.00% from 2012 to 2017. However, the nearness of 2018 to the time of data acquisition explains the result of WoS citations in that year (40.93%) when these metadata were not already collected. The evolution of TE documents in Twitter, Mendeley Readers, and the Altmetric Attention Score shows an upward trend from the beginning of the period studied. In this sense, documents with at least one mention in the reference manager Mendeley Readers were close to the 50% in 2017. By contrast, the presence of TE documents in platforms such as Facebook, patents, and news was less than 10% for the whole period studied.Ranking of TE Documents According to WoS Citations and Altmetric Attention Score
The top 10 TE documents ranked by their normalized WoS citations and normalized Altmetric Attention Score are presented in
and .WoS rank | Altimetric rank | Normalized WoS citations | Normalized Altmetric Attention Score | Reference |
1 | 5 | 38.32 | 140.76 | [ | ]
2 | 21 | 35.19 | 54.11 | [ | ]
3 | 43 | 22.19 | 33.31 | [ | ]
4 | 602 | 21.49 | 2.16 | [ | ]
5 | 291 | 19.78 | 5.73 | [ | ]
6 | 6022 | 18.10 | 0.11 | [ | ]
7 | 8060 | 18.10 | 0 | [ | ]
8 | 2259 | 18.03 | 0.59 | [ | ]
9 | 3738 | 16.97 | 0.22 | [ | ]
10 | 8 | 14.91 | 68.29 | [ | ]
aWoS: Web of Science.
WoSa rank | Altimetric rank | Normalized WoS citations | Normalized Altmetric Attention Score | Reference |
365 | 1 | 3.46 | 204.96 | [ | ]
16 | 2 | 12.97 | 199.36 | [ | ]
83 | 3 | 6.83 | 149.21 | [ | ]
39 | 4 | 9.60 | 141.62 | [ | ]
1 | 5 | 38.32 | 140.76 | [ | ]
8853 | 6 | 0 | 115.27 | [ | ]
1584 | 7 | 1.73 | 85.10 | [ | ]
10 | 8 | 14.91 | 68.29 | [ | ]
307 | 9 | 3.80 | 67.04 | [ | ]
252 | 10 | 4.37 | 65.81 | [ | ]
aWoS: Web of Science.
and show a remarkable discrepancy between classical (normalized WoS citations) and alternative (normalized Altmetric Attention Score) metrics among the most valued documents.
On the one hand, the original article by Deng et al [
], reporting multifunctional stimuli-responsive hydrogels with self-healing, high conductivity, and rapid recovery through host–guest interactions, has a remarkable scholarly impact, being the 7th top-cited document when analyzing normalized WoS citations. However, the Altmetric Attention Score was null for this paper, suggesting that in vitro research could not attract as much societal attention as translational research. On the other hand, the research study by Nichols et al [ ], regarding the transplantation of bioengineered lung into a large-animal model, employs a very translational approach to TE, and thus its social impact is reflected by the high Altmetric Attention Score, although its scholar relevance was not yet evident.Statistical Analysis
Correlation Analysis
The results of the correlation analysis between traditional and alternative metrics of all retrieved publications from 2015 to 2018 are presented in
.WoSb | News | Blogs | Policy | Patents | Peer review | Wikipedia | F1000 | Q&A | Video | ||||||
WoS | |||||||||||||||
News | 0.144 | ||||||||||||||
Blogs | 0.137 | 0.387 | |||||||||||||
Policy | 0.049 | 0.065 | 0.064 | ||||||||||||
0.176 | 0.149 | 0.158 | 0.009 | ||||||||||||
Patents | 0.114 | 0.093 | 0.09 | –0.009 | –0.068 | ||||||||||
Peer review | –0.006 | –0.01 | 0.136 | –0.001 | –0.006 | –0.009 | |||||||||
0.04 | 0.108 | 0.108 | –0.002 | 0.063 | –0.011 | –0.002 | |||||||||
0.064 | 0.2 | 0.213 | 0.046 | 0.213 | 0.047 | –0.014 | 0.081 | ||||||||
Wikipedia | 0.076 | 0.072 | 0.073 | –0.004 | 0.073 | 0.032 | –0.004 | 0.14 | 0.039 | ||||||
0.071 | 0.109 | 0.184 | 0.138 | 0.073 | 0.013 | –0.005 | 0.11 | 0.184 | 0.086 | ||||||
–0.012 | 0.008 | 0.028 | –0.005 | –0.015 | –0.03 | –0.005 | 0.118 | 0.016 | –0.013 | 0.025 | |||||
F1000 | 0.054 | 0.036 | 0.063 | –0.003 | 0.05 | 0.013 | –0.003 | 0.164 | 0.015 | 0.063 | 0.046 | –0.011 | |||
Q&A | 0.003 | –0.007 | –0.007 | –0.001 | –0.004 | –0.006 | –0.001 | –0.001 | –0.01 | –0.003 | –0.003 | –0.003 | –0.002 | ||
Video | –0.033 | 0.008 | 0.036 | –0.003 | 0.006 | –0.02 | –0.003 | –0.004 | 0.061 | –0.009 | –0.011 | –0.011 | –0.008 | –0.002 | |
Mendeley Readers | 0.716 | 0.198 | 0.197 | 0.021 | 0.243 | 0.104 | –0.025 | 0.049 | 0.107 | 0.077 | 0.098 | 0.012 | 0.067 | 0.008 | 0.03 |
aItalicized values mean P<.05.
bWoS: Web of Science.
Overall, the number of citations on Mendeley Readers and WoS shows the best correlation results (ρ=0.71) and platforms such as Twitter (ρ=0.17) and news (ρ=0.14) have a suitable correlation. However, the correlation results obtained for Wikipedia, Facebook, F1000 mentions, and Q&A mentions were weak, and an inverse correlation was observed for TE documents appearing in 3 online platforms: peer review mentions (ρ=−0.006), Reddit mentions (ρ=−0.01), and video mentions (ρ=−0.03).
Factor Analysis
First, a value of 5629.85 (P<.001) for a chi-square approximation of the Bartlett sphericity test and a value of 0.700 for the Kaiser–Meyer–Olkin test confirmed the suitability of factor analysis. Then, factor analysis identified 6 different components or factors that could explain the correlation results. These factors are shown in
and labeled as F1, F2, F3, F4, F5, and F6. Positive and negative results are indicated with green and red lines, respectively.F1 exposes the relation between WoS citations and Mendeley Readers. However, the remaining factors (F2-F6) most likely account for a different type of scientific impact not directly associated with TE professional researchers and readers. Regarding this, F3 acts as a common factor for Google and policy mentions, and, interestingly, 3 social platforms (blogs, news, and Facebook) appear together within F5. Finally, the mentions of TE documents in Twitter (tweetations) were strongly tied with a unique factor (F4), suggesting a particular behavior and structure for TE information shared in Twitter.
Linear Regression Analysis
The correlation coefficient (r) and the determination coefficient (R2) obtained were equal to 0.645 and 0.414, respectively. In addition, the statistical test for the analysis of variance was significant (P<.001). Consequently, the mathematical model constructed explains more than the 40% of the variation in the number of WoS citations obtained for TE documents in 2018 from 2015 Altmetric scores.
The variable Mendeley Readers constitutes the best citation predictor for TE documents as it holds the higher result for r (r=0.599). The rest of the Altmetric scores also had a positive correlation but the strength of the observed association was weaker.
The prediction equation for 2018 TE WoS citation counts from 2015 Altmetric scores can be expressed as follows:
Ln (1 + WoS)=–27.25 + 5.37 x Ln (1 + blog) + 0.82 × Ln (1 + news) + 12.78 × Ln (1 + Mendeley Readers) + 5.83 × Ln (1 + patent) + 0.75 × Ln (1 + Twitter).
Finally, no significant differences were found (P=.12) for the predicted citations versus the real citations rates for the documents published in 2015.
Discussion
Principal Findings
The seminal article published by Langer and Vacanti [
] laid the foundations for TE. Since then, TE has evolved and given rise to an interdisciplinary field that applies the principles of engineering and life sciences toward the development of biological substitutes that can restore, maintain, or even improve tissue functions. Within contemporary medicine, TE is considered one of the most promising advanced therapies, as it has the potential to overcome traditional problems associated with organ failure and to treat previously untreated conditions [ ]. Its onset and application to the clinical practice have led to a revolution in surgery and transplantation procedures, as new bioartificial tissue devices are now available for therapy with a considerably less risk of infection transmission and immune-mediated organ rejection [ ].As a consequence, a crescent interest has appeared, aiming to elucidate global trends in TE and its cognitive and social framework [
, ]. These bibliometrics-based approaches utilize, in common, the traditional measures of scientific impact, such as citations and publications. Moreover, the social maps and conceptual diagrams proposed suffer from the same bias, as both the relations among institutions and the key notions identified are based on the number of citations and co-occurrence of keywords [ ]. Thus, new approaches are needed to better characterize and comprehend the real impact of TE in our society. In this sense, the association of traditional bibliometrics with alternative metrics (altmetrics) could render a more sensible and realistic view of TE behavior nowadays [ ].Hence, in this study, we have carried out an altmetrics-based analysis of the core documents of TE retrieved from WoS between 2012 and 2018. We have previously employed this query term to analyze the global trends of TE [
], the cognitive and social framework of TE [ ], and the structure and evolution of TE reviews [ ], in an attempt to replicate the same search strategy highlighting the value of the reproducibility and comparability of our results. To our best knowledge, there is no previous literature that defines TE structure and its major characters online or its essential divergence with other widespread platforms in clinical medicine such as scientific journals.In this regard, we first performed a descriptive analysis of evolution of TE documents in WoS and 6 different web-based platforms (ie, Facebook, patents, Twitter, news, Mendeley Readers, and Altmetric Attention Score). The presence of TE documents in WoS is significant over the rest, suggesting the existence of a well-established research dynamic where academic and professional health practitioners collect and consult applicable clinical information in renowned databases. Besides, TE diffusion in Twitter stood out within the group of social networks consulted; it is interesting to note a growing trend for the whole period evaluated, and a particular pattern of scientific information diffusion in Twitter could explain these results.
On the one hand, the own structure of Twitter, a micro-blogging platform that enables the users to “tweet” short messages with their virtual colleagues, has developed a singular model of scientific communication and a special information flow [
, ]. Kwak et al [ ] demonstrated that retweets constitute the nucleus of this original model. Hence, retweets of TE documents could spread their information beyond the limits of their original authors, expanding them to the broad space of the followers’ networks [ , ]. In addition, relevant information about new TE devices may reach primary care physicians and groups of patients through this network, optimizing the communication between different health care levels and the education of society [ ]. Eysenbach [ ] reported that highly tweeted articles are 11 times more likely to end up as being highly cited and that Tweets correlate with traditional metrics of scientific impact [ ]. Consequently, the upward trend of TE documents in Twitter could also be explained in terms of this higher academic impact.To better comprehend the similarities and differences between the focus of TE documents online and in traditional scholar media, we identified the 10 most cited TE documents from 2012 to 2018. We then ranked and compared them according to the number of normalized WoS citations and the normalized Altmetric Attention Score. The results obtained demonstrated a clear discrepancy between the rankings of TE documents, suggesting that citations in WoS and interests of online users do not follow the same path. Differences between metrics tend to be more remarkable when comparing the top-ranked documents for each metric. This comparison, although cannot be used for validation purposes, is useful to elucidate this differential pattern. This kind of dissimilar relation, where scholar- and web-based attention clearly differs, has never been demonstrated for TE as a discipline, although it is not exclusive of it. In this sense, similar results have been shown in other research fields, revealing that social and academic assumptions of scientific advances are not guided by identical principia [
, ].This finding is not a negative result but rather a consequence of the varying nature of traditional and alternative metrics, as well as the social and dynamic context in which research takes place. It has been reported that, in medical and applied sciences, an important share of information targets is found outside the research and scholar community and that traditional citations are only partial measures of impact and use of information [
]. In accordance with Bornmann [ ], citations only assess the impact of scholarly literature on those who cite, and this neglects many audiences of scholarly literature who may read the paper, but do not cite it as “pure” readers [ ]. Furthermore, the task of assessing the impact of science has to take into account some policy and society demands. These societal, policy-driven, and technical demands have led to the emergence of altmetrics as an evolved methodology to broaden the impact of research on both researchers and policy demands as promoters of research and society as final users of developed technology through advances in research.As TE is devoted to the construction of biomimetic tissues that can restore, maintain, or even improve the structure or functionality of damaged tissues [
], and to treat previously untreated conditions [ , ], its social demands are particularly important [ ]. In this sense, the use of altmetrics, combined with classical measures of scientific impact, could provide a wider context on the real influence of TE research in society.In addition to the descriptive analysis, we applied 3 different statistical tests: Spearman correlation, factor analysis, and the linear regression model. The correlation study showed that TE citations in WoS and the number of readers in Mendeley Readers have the highest value (ρ=0.71). This finding can be explained by attending to the own nature of Mendeley Readers, as it is a citation manager tool essentially used to store and share references by a community of bibliographic users. The use of Mendeley Readers has been previously correlated with future citation counts in several biomedical sciences fields [
]. In this way, citations of TE documents in WoS are equally well-correlated with the number of Mendeley Readers. Because TE researchers could use the previously stored documents as cited documents for their own future publications, the correlation results are, to some extent, explainable. However, Mendeley Readers users do not have to be publishing academics exclusively, and may also be practitioners or students, as previously demonstrated [ , ]. Therefore, the correlation observed in TE research should be related to a broader spectrum of scientific activity and not just restricted to experts and research groups that publish in specialized journals.A positive but weaker correlation was obtained for online platforms such as Twitter, news, and blogs. However, the mention of TE documents in video and Reddit is lesser, because of an inverse correlation. These results are most likely influenced by the structure and the type of readers on these platforms. For example, in Reddit, virality constitutes a crucial factor [
]. As stated by Berger and Milkman [ ], those contents that evoke emotions of activation (eg, anger, awe, anxiety) are more suitable to become viral, in contrast to deactivating emotions (eg, softness) [ ]. Hence, documents referring to the construction of bioartificial tissues could be mentioned in Reddit to be criticized or report findings that are surprising and shocking for common readers, but not so relevant for a specialized audience.For instance, correlation studies could obscure the genuine relationships existing between a set of variables. This potential bias is particularly important when a predominant or strong association exists [
]. In this sense, factor analysis could serve to identify the common factors or components that explain the previously observed correlation. In this regard, factor analysis of TE production showed the existence of 6 differentiated factors (F1-F6).F1 is tied to readers in Mendeley Readers, citations in WoS, and patents. Interestingly, the final goal that guides TE research is the clinical application of bioengineered tissue devices in the daily practice of the medical specialties. For this achievement, 2 previous requirements must be guaranteed: the communication of the scientific results in a peer-reviewed journal and the acquisition of a patent license. As this process is causally related to the employment of citation manager and paper collection in well-known databases, factor analysis reveals consistent results. F2 (Weibo, F100, Reddit, and Wikipedia) probably accounts for a different kind of TE information consumption. A more informal communication of results with less scientific rigor mostly presided over the components that integrate this factor.
The relation between policy and Goggle in F3 is not clear, as the latter can be used to filter and obtain a heterogeneous and vast amount of information related to TE, and not just the legal requirements for TE application in clinics. It is interesting to note that Twitter acquires an individual dimension in F4, constituting a social network distinguished from the rest. Nevertheless, news and Facebook appear together in F5 and blogs constitute a component of F6. A plausible explanation for this leading role of Twitter in the diffusion of TE information is that the development of TE has taken place in parallel with the burst of social media. Probably, as previously stated for other scientific disciplines, TE researchers have substituted the idea of academic community for the virtual department [
, ]. Moreover, the structural multidisciplinary nature of TE and the relationships between the biomaterials industry, research groups, and clinicians can be ideally displayed using a social network such as Twitter [ , , ].Finally, we aimed to develop a mathematical model for TE documents to predict the influence of Altmetric scores on future citation counts with relative accuracy. However, in accordance with Thelwall and Nevill [
], it is reasonable to consider alternative metrics in conjunction with journal impact to get an idea about which articles are more likely to attract longer-term citations [ ]. Applying this logic to TE production, we established a linear regression equation to derive 2018 TE citation counts from 2015 Altmetric indexes. The model is able to explain more than the 40% of variation in the number of WoS citations for TE documents that Altmetric tracked (R2=49.6%); regression results were statistically significant, and so the association between measures such as publications or citations and the impact of scientific work online could serve to better characterize the movement of information in biomedical disciplines, such as TE.We hope this article serves to stimulate the adequate use of web-based platforms in the communication and diffusion of scientific information in TE. We are firmly convinced that, as wisely stated by Weigold [
], the sharing of well-constructed information online contributes to informing society about real possibilities of scientific progress.Limitations
Although the findings provided in this study are interesting, several limitations must be addressed. First, only a percentage of the publications indexed in WoS are available on Altmetric, and consequently, the conclusions of the study are influenced by the core of documents obtained. Second, the factor analysis is performed for only 1 year; although the behavior of the research area could be similar, it could be influenced by the published topics or other factors. Finally, the intentional tweeting by the publisher or the editor of the journal was not analyzed.
Furthermore, the use of altmetrics lead to some potential disadvantages, especially when they are used as the only indicator for impact assessment. There is also the difficulty with field normalization, which makes it difficult to compare the impact of different disciplines [
]. Besides, altmetrics could be affected by an incomplete and biased coverage of impact areas (eg, most Chinese regions do not use Twitter), which makes it difficult to compare the impact of different regions [ ]. Importantly, altmetrics present a lack of quality control, and as such they are susceptible to deliberate or accidental manipulation, which may promote sensational outcomes, and the subsequent loss of credibility, if they are used as a sole indicator for impact assessment [ ]. However, some of these drawbacks can be controlled when analyzing a large set of documents, and in this sense alternative metrics seem to be more prevalent and useful in health sciences when compared with other fields [ , ]. Thus, we consider that new alternative metrics are not replacing the classical ones. Indeed, these are 2 different approaches with a common goal: traditional metrics attempt to assess the scholarly impact among researchers, whereas alternative metrics try to evaluate policy and societal demands on a specific scientific issue. Although these approaches are different, they are positively correlated [ ]. A randomized controlled trial [ ] reported a causal relationship between the dissemination of research results through a web-based platform and subsequent citations.Another limitation of this study is that we have restricted our search strategy to WoS, without exploring the presence of TE in other databases such as Scopus or Medline or employing a broader search strategy as reported in other studies [
]. However, WoS covers more than 250 scientific disciplines and its total number of records is over 90 million [ ]. When performing bibliometric analysis, citation data provided by WoS are considered one of its main advantages in comparison with other databases. Furthermore, the coverage of TE documents is not limited by the date of WoS construction (1960s), as the seminal paper on TE was published in 1993 [ ].Comparison With Prior Work
Previous studies of our group have described the global trends [
] and identified the cognitive and social framework of TE [ ]. However, to our knowledge, this is the first study analyzing the online social dimension of TE as a research field in the age of mass media.Summary of Findings
- Online social media play a key role in the dissemination of information about advanced therapies and TE from academics to patients and health consumers.
- The focus of TE research groups at the academic level and the most shared articles in the online mass media are not the same, as the ranking of the top 10 most cited TE documents in terms of normalized WoS citations and normalized Altmetric Attention Score were not homogeneous.
- Mathematical models established based on information retrieved from alternative metrics (altmetrics) can be used to predict the impact of TE documents on citation counts.
- Different actors (academics, groups of basic and translational researchers, health clinicians, data managers, and health information workers) should implement knowledge diffusion models about advanced therapies and TE in the online mass media.
Conclusions
TE has supposed a revolution in daily medical practice as tissue constructs are now available to treat severe conditions that previously remained untreated. Therefore, these new medical approaches have an impact on the population that can now be measured by altmetrics. These metrics differ from the classical academic metrics, but the knowledge of their influence on the final citation count could form the basis of different institutional or personal decision processes. The different actors involved in the scientific diffusion of the TE can use the results of this study to increase their interest in the use of social media and other online platforms as a window to the world, with the intention of reaching not only the scientific community, but also the general society.
Acknowledgments
This study was supported by CTS-115 (Tissue Engineering Research Group, University of Granada) from Junta de Andalucia, Spain, the Spanish State Research Agency through the project PID2019-105381GA-I00/AEI/10.13039/501100011033 (iScience), a postdoctoral grant (RH-0145-2020) from the Andalusia Health System, and the European Union Fondo Europeo de Desarrollo Regional para la Inversion Territorial Integrada Grant for Cadiz Province (PI‑0032‑2017). The authors thank Altmetric LLP (London, UK) for granting access to Altmetric Explorer for research purposes.
Authors' Contributions
MAM-P and JAM-M were responsible for conceptualization of this work. AS-E and JAM-M took care of the implemented methodology. MJC performed software analysis. AS-E, MAM-P, and JAM-M. validated the content. AS-E managed the formal analysis, performed the investigation, and managed resources. JM-S, MJC, and AIP-S performed data curation. JM-S and AIP-S were responsible for writing—original draft, while AS-E, MAM-P, and JAM-M were responsible for writing—review and editing. JAM-M took care of visualization. MAM-P, JAM-M, and AC supervised the work. AC was responsible for project administration. AC and MJC handled funding acquisition. All authors have read and agreed to the published version of the manuscript.
Conflicts of Interest
None declared.
References
- Langer R, Vacanti JP. Tissue engineering. Science 1993 May 14;260(5110):920-926. [CrossRef] [Medline]
- Viola J, Bal B, Grad O. The Emergence of Tissue Engineering as a Research Field. URL: https://www.nsf.gov/pubs/2004/nsf0450/start.htm [accessed 2021-11-02]
- Kaul H, Ventikos Y. On the genealogy of tissue engineering and regenerative medicine. Tissue Eng Part B Rev 2015 Apr;21(2):203-217 [FREE Full text] [CrossRef] [Medline]
- Kumar VA, Brewster LP, Caves JM, Chaikof EL. Tissue Engineering of Blood Vessels: Functional Requirements, Progress, and Future Challenges. Cardiovasc Eng Technol 2011 Sep 01;2(3):137-148 [FREE Full text] [CrossRef] [Medline]
- Carriel V, Alaminos M, Garzón I, Campos A, Cornelissen M. Tissue engineering of the peripheral nervous system. Expert Rev Neurother 2014 Mar;14(3):301-318. [CrossRef] [Medline]
- Debels H, Hamdi M, Abberton K, Morrison W. Dermal matrices and bioengineered skin substitutes: a critical review of current options. Plast Reconstr Surg Glob Open 2015 Jan;3(1):e284 [FREE Full text] [CrossRef] [Medline]
- Sanchez-Quevedo MC, Alaminos M, Capitan LM, Moreu G, Garzon I, Crespo PV, et al. Histological and histochemical evaluation of human oral mucosa constructs developed by tissue engineering. Histol Histopathol 2007 Jun;22(6):631-640. [CrossRef] [Medline]
- Martín-Piedra MA, Alaminos M, Fernández-Valadés-Gámez R, España-López A, Liceras-Liceras E, Sánchez-Montesinos I, et al. Development of a multilayered palate substitute in rabbits: a histochemical ex vivo and in vivo analysis. Histochem Cell Biol 2017 Mar;147(3):377-388. [CrossRef] [Medline]
- Rico-Sánchez L, Garzón I, González-Andrades M, Ruíz-García A, Punzano M, Lizana-Moreno A, et al. Successful development and clinical translation of a novel anterior lamellar artificial cornea. J Tissue Eng Regen Med 2019 Dec;13(12):2142-2154 [FREE Full text] [CrossRef] [Medline]
- Santisteban-Espejo A, Campos F, Martin-Piedra L, Durand-Herrera D, Moral-Munoz JA, Campos A, et al. Global Tissue Engineering Trends: A Scientometric and Evolutive Study. Tissue Eng Part A 2018 Oct;24(19-20):1504-1517. [CrossRef] [Medline]
- Santisteban-Espejo A, Campos F, Chato-Astrain J, Durand-Herrera D, García-García O, Campos A, et al. Identification of Cognitive and Social Framework of Tissue Engineering by Science Mapping Analysis. Tissue Eng Part C Methods 2019 Jan;25(1):37-48. [CrossRef] [Medline]
- Abramo G, D’Angelo CA, Caprasecca A. Allocative efficiency in public research funding: Can bibliometrics help? Research Policy 2009 Feb;38(1):206-215. [CrossRef]
- Gheisari Y, Baharvand H, Nayernia K, Vasei M. Stem cell and tissue engineering research in the Islamic republic of Iran. Stem Cell Rev Rep 2012 Sep;8(3):629-639. [CrossRef] [Medline]
- Dai G, Yang KH, Li QH. [Bibliometric analysis on tissue engineering research literatures]. Zhongguo Xiu Fu Chong Jian Wai Ke Za Zhi 2000 Sep;14(5):308-310. [Medline]
- Powell AGMT, Bevan V, Brown C, Lewis WG. Altmetric Versus Bibliometric Perspective Regarding Publication Impact and Force. World J Surg 2018 Sep;42(9):2745-2756 [FREE Full text] [CrossRef] [Medline]
- Priem J, Piwowar H, Hemminger B. Altmetrics in the wild: an exploratory study of impact based on social media. arXiv Preprint posted online on March 20, 2012. [FREE Full text]
- Veeranjaneyulu K. Altmetrics: new tools to measure research impact in the digitally networked environment. 2018 Jun 21 Presented at: National Conference of Agricultural Librarians and User Community (NCALUC-2017); 2018; Hisar, Haryana p. 495-505 URL: https://www.researchgate.net/publication/325619882_ALTMETRICS_NEW_TOOLS_TO_MEASURE_RESEARCH_IMPACT_IN_THE_DIGITALLY_NETWORKED_ENVIRONMENT
- Moral-Munoz J, Cobo M. Measuring the online attention of the Rehabilitation Web of Science category : an Altmetrics-based analysis. 2018 Sep 14 Presented at: 23rd International Conference on Science and Technology Indicators; September 12-14, 2018; Leiden, The Netherlands p. 2018 URL: https://www.researchgate.net/publication/327594583_Measuring_the_online_attention_of_the_Rehabilitation_Web_of_Science_category_an_Altmetrics-based_analysis
- Verma S, Margam M, Abu K. Altmetrics: A new way of assessing research impact beyond citations. 2018 Presented at: Changing Digital Landscape in Smart Environment; February 11, 2018; Delhi, India URL: https://www.researchgate.net/publication/325465926_Altmetrics_A_new_way_of_assessing_research_impact_beyond_citations
- Haustein S, Bowman T, Costas R. Interpreting 'altmetrics': viewing acts on social media through the lens of citation and social theories. In: Theories of Informetrics and Scholarly Communication. Munich, Germany: De Gruyter Saur; 2016:372.
- Jacob KJ, Longstaff H, Scott CT, Illes J. Focus on People and the Science Will Follow: Motivating Forces for Professional Movement in Stem Cell Research. Stem Cell Rev Rep 2015 Aug;11(4):533-539. [CrossRef] [Medline]
- Bakkalbasi N, Bauer K, Glover J, Wang L. Three options for citation tracking: Google Scholar, Scopus and Web of Science. Biomed Digit Libr 2006 Jun 29;3(1):7 [FREE Full text] [CrossRef] [Medline]
- Katari R, Peloso A, Orlando G. Tissue engineering and regenerative medicine: semantic considerations for an evolving paradigm. Front Bioeng Biotechnol 2014;2:57 [FREE Full text] [CrossRef] [Medline]
- Altmetric. URL: https://www.altmetric.com/ [accessed 2021-11-02]
- Trueger NS, Thoma B, Hsu CH, Sullivan D, Peters L, Lin M. The Altmetric Score: A New Measure for Article-Level Dissemination and Impact. Ann Emerg Med 2015 Nov;66(5):549-553. [CrossRef] [Medline]
- Eysenbach G. Can tweets predict citations? Metrics of social impact based on Twitter and correlation with traditional metrics of scientific impact. J Med Internet Res 2011 Dec 19;13(4):e123 [FREE Full text] [CrossRef] [Medline]
- Asuero AG, Sayago A, González AG. The Correlation Coefficient: An Overview. Critical Reviews in Analytical Chemistry 2007 Jan 12;36(1):41-59. [CrossRef]
- Taherdoost H, Sahibuddin S, Jalaliyoon N. Exploratory factor analysis: concepts and theory. In: Advances in Applied and Pure Mathematics. Athens, Greece: WSEAS Press; 2014:375-382.
- Thelwall M, Wilson P. Regression for citation data: An evaluation of different methods. Journal of Informetrics 2014 Oct;8(4):963-971. [CrossRef]
- Thelwall M, Nevill T. Could scientists use Altmetric.com scores to predict longer term citation counts? Journal of Informetrics 2018 Feb;12(1):237-248. [CrossRef]
- Chan LL, Idris N. Validity and Reliability of The Instrument Using Exploratory Factor Analysis and Cronbach’s alpha. IJARBSS 2017 Oct 31;7(10):400-410. [CrossRef]
- Love J, Selker R, Marsman M, Jamil T, Dropmann D, Verhagen J, et al. : Graphical Statistical Software for Common Statistical Designs. J. Stat. Soft 2019;88(2):1-17. [CrossRef]
- Kang HW, Lee SJ, Ko IK, Kengla C, Yoo JJ, Atala A. A 3D bioprinting system to produce human-scale tissue constructs with structural integrity. Nat Biotechnol 2016 Mar;34(3):312-319. [CrossRef] [Medline]
- Sun JY, Zhao X, Illeperuma WRK, Chaudhuri O, Oh KH, Mooney DJ, et al. Highly stretchable and tough hydrogels. Nature 2012 Sep 06;489(7414):133-136 [FREE Full text] [CrossRef] [Medline]
- Kolesky DB, Truby RL, Gladman AS, Busbee TA, Homan KA, Lewis JA. 3D bioprinting of vascularized, heterogeneous cell-laden tissue constructs. Adv Mater 2014 May 21;26(19):3124-3130. [CrossRef] [Medline]
- Menasché P, Vanneaux V, Hagège A, Bel A, Cholley B, Parouchev A, et al. Transplantation of Human Embryonic Stem Cell-Derived Cardiovascular Progenitors for Severe Ischemic Left Ventricular Dysfunction. J Am Coll Cardiol 2018 Jan 30;71(4):429-438 [FREE Full text] [CrossRef] [Medline]
- Gross BC, Erkal JL, Lockwood SY, Chen C, Spence DM. Evaluation of 3D printing and its potential impact on biotechnology and the chemical sciences. Anal Chem 2014 Apr 01;86(7):3240-3253. [CrossRef] [Medline]
- Lai Y, Cao H, Wang X, Chen S, Zhang M, Wang N, et al. Porous composite scaffold incorporating osteogenic phytomolecule icariin for promoting skeletal regeneration in challenging osteonecrotic bone in rabbits. Biomaterials 2018 Jan;153:1-13. [CrossRef] [Medline]
- Deng Z, Guo Y, Zhao X, Ma PX, Guo B. Multifunctional Stimuli-Responsive Hydrogels with Self-Healing, High Conductivity, and Rapid Recovery through Host–Guest Interactions. Chem. Mater 2018 Feb 10;30(5):1729-1742. [CrossRef]
- Croisier F, Jérôme C. Chitosan-based biomaterials for tissue engineering. European Polymer Journal 2013 Apr 10;49(4):780-792. [CrossRef]
- Ribeiro C, Costa CM, Correia DM, Nunes-Pereira J, Oliveira J, Martins P, et al. Electroactive poly(vinylidene fluoride)-based structures for advanced applications. Nat Protoc 2018 Apr;13(4):681-704. [CrossRef] [Medline]
- Workman MJ, Mahe MM, Trisno S, Poling HM, Watson CL, Sundaram N, et al. Engineered human pluripotent-stem-cell-derived intestinal tissues with a functional enteric nervous system. Nat Med 2017 Jan;23(1):49-59 [FREE Full text] [CrossRef] [Medline]
- Gershlak JR, Hernandez S, Fontana G, Perreault LR, Hansen KJ, Larson SA, et al. Crossing kingdoms: Using decellularized plants as perfusable tissue engineering scaffolds. Biomaterials 2017 May;125:13-22 [FREE Full text] [CrossRef] [Medline]
- Laronda MM, Rutz AL, Xiao S, Whelan KA, Duncan FE, Roth EW, et al. A bioprosthetic ovary created using 3D printed microporous scaffolds restores ovarian function in sterilized mice. Nat Commun 2017 May 16;8:15261 [FREE Full text] [CrossRef] [Medline]
- Nawroth JC, Lee H, Feinberg AW, Ripplinger CM, McCain ML, Grosberg A, et al. A tissue-engineered jellyfish with biomimetic propulsion. Nat Biotechnol 2012 Aug;30(8):792-797 [FREE Full text] [CrossRef] [Medline]
- Park SJ, Gazzola M, Park KS, Park S, Di Santo V, Blevins EL, et al. Phototactic guidance of a tissue-engineered soft-robotic ray. Science 2016 Jul 08;353(6295):158-162 [FREE Full text] [CrossRef] [Medline]
- Nichols JE, La Francesca S, Niles JA, Vega SP, Argueta LB, Frank L, et al. Production and transplantation of bioengineered lung into a large-animal model. Sci Transl Med 2018 Aug 01;10(452):eaao3926. [CrossRef] [Medline]
- Moutos FT, Glass KA, Compton SA, Ross AK, Gersbach CA, Guilak F, et al. Anatomically shaped tissue-engineered cartilage with tunable and inducible anticytokine delivery for biological joint resurfacing. Proc Natl Acad Sci U S A 2016 Aug 02;113(31):E4513-E4522 [FREE Full text] [CrossRef] [Medline]
- Workman MJ, Mahe MM, Trisno S, Poling HM, Watson CL, Sundaram N, et al. Engineered human pluripotent-stem-cell-derived intestinal tissues with a functional enteric nervous system. Nat Med 2017 Jan;23(1):49-59 [FREE Full text] [CrossRef] [Medline]
- Johnson BN, Lancaster KZ, Zhen G, He J, Gupta MK, Kong YL, et al. 3D Printed Anatomical Nerve Regeneration Pathways. Adv Funct Mater 2015 Oct 21;25(39):6205-6217 [FREE Full text] [CrossRef] [Medline]
- Lu TY, Lin B, Kim J, Sullivan M, Tobita K, Salama G, et al. Repopulation of decellularized mouse heart with human induced pluripotent stem cell-derived cardiovascular progenitor cells. Nat Commun 2013;4:2307 [FREE Full text] [CrossRef] [Medline]
- Vacanti CA. The history of tissue engineering. J Cell Mol Med 2006;10(3):569-576 [FREE Full text] [CrossRef] [Medline]
- Crupi A, Costa A, Tarnok A, Melzer S, Teodori L. Inflammation in tissue engineering: The Janus between engraftment and rejection. Eur J Immunol 2015 Dec;45(12):3222-3236 [FREE Full text] [CrossRef] [Medline]
- Weed LL. Medical records that guide and teach. N Engl J Med 1968 Mar 21;278(12):652-7 concl. [CrossRef] [Medline]
- Grant J, Cottrell R, Cluzeau F, Fawcett G. Evaluating "payback" on biomedical research from papers cited in clinical guidelines: applied bibliometric study. BMJ 2000 Apr 22;320(7242):1107-1111 [FREE Full text] [CrossRef] [Medline]
- Martin-Piedra MA, Santisteban-Espejo A, Moral-Munoz JA, Campos F, Chato-Astrain J, Garcia-Garcia OD, et al. An Evolutive and Scientometric Research on Tissue Engineering Reviews. Tissue Eng Part A 2020 May;26(9-10):569-577. [CrossRef] [Medline]
- Finin T, Tseng B, Akshay J, Xiaodan S. Why We Twitter: Understanding Microblogging Usage and Communities. 2007. URL: https://ebiquity.umbc.edu/_file_directory_/papers/369.pdf [accessed 2021-11-02]
- Kwak H, Lee C, Park H, Moon S. What is Twitter, a social network or a news media? In: Proceedings of the 19th International Conference on World Wide Web. 2010 Apr 23 Presented at: 19th International Conference on World Wide Web; April 26-30, 2010; Raleigh, NC. [CrossRef]
- Darling E, Shiffman D, Côté I, Drew J. The role of Twitter in the life cycle of a scientific publication. IEE 2013;6:32-43 [FREE Full text] [CrossRef]
- Huberman B, Romero DM, Wu F. Social networks that matter: Twitter under the microscope. FM 2008 Dec 20:1-9. [CrossRef]
- Sola M, Sanchez-Quevedo C, Martin-Piedra MA, Carriel V, Garzon I, Chato-Astrain J, et al. Evaluation of the awareness of novel advanced therapies among family medicine residents in Spain. PLoS One 2019;14(4):e0214950 [FREE Full text] [CrossRef] [Medline]
- Choo EK, Ranney ML, Chan TM, Trueger NS, Walsh AE, Tegtmeyer K, et al. Twitter as a tool for communication and knowledge exchange in academic medicine: A guide for skeptics and novices. Med Teach 2015 May;37(5):411-416. [CrossRef] [Medline]
- Gunn W. Social Signals Reflect Academic Impact. 2013. URL: https://www.niso.org/sites/default/files/stories/2017-08/IP_Gunn_Mendeley_isqv25no2.pdf [accessed 2021-11-02]
- Glänzel W, Chi P. The big challenge of Scientometrics 2.0: exploring the broader impact of scientific research in public health. Scientometrics 2020 Apr 26;125(2):1011-1031. [CrossRef]
- Bornmann L. Alternative metrics in scientometrics: a meta-analysis of research into three altmetrics. Scientometrics 2015 Mar 15;103(3):1123-1144. [CrossRef]
- O'Rourke C, Day AGE, Murray-Dunning C, Thanabalasundaram L, Cowan J, Stevanato L, et al. An allogeneic 'off the shelf' therapeutic strategy for peripheral nerve tissue engineering using clinical grade human neural stem cells. Sci Rep 2018 Feb 13;8(1):2951 [FREE Full text] [CrossRef] [Medline]
- Das S, Browne KD, Laimo FA, Maggiore JC, Hilman MC, Kaisaier H, et al. Pre-innervated tissue-engineered muscle promotes a pro-regenerative microenvironment following volumetric muscle loss. Commun Biol 2020 Jun 25;3(1):330 [FREE Full text] [CrossRef] [Medline]
- Murdoch CE, Scott CT. Stem cell tourism and the power of hope. Am J Bioeth 2010 May 10;10(5):16-23. [CrossRef] [Medline]
- Thelwall M, Wilson P. Mendeley readership altmetrics for medical articles: An analysis of 45 fields. J Assn Inf Sci Tec 2015 May 05;67(8):1962-1972. [CrossRef]
- Haustein S, Larivière V, Thelwall M, Amyot D, Peters I. Tweets vs. Mendeley readers: How do these two social media metrics differ? arXiv Preprint posted online on 2014. [FREE Full text] [CrossRef]
- Mohammadi E, Thelwall M. Mendeley readership altmetrics for the social sciences and humanities: Research evaluation and knowledge flows. J Assn Inf Sci Tec 2014 Mar 12;65(8):1627-1638. [CrossRef]
- Haralabopoulos G, Anagnostopoulos I, Zeadally S. Lifespan and propagation of information in On-line Social Networks: A case study based on Reddit. Journal of Network and Computer Applications 2015 Oct;56:88-100. [CrossRef]
- Berger J, Milkman KL. What Makes Online Content Viral? Journal of Marketing Research 2012 Apr 01;49(2):192-205. [CrossRef]
- Pogorielov M. Tissue Engineering: Challenges and Selected Application. ATROA 2017 Nov 7;3(2):330-334. [CrossRef]
- Li X, Thelwall M, Giustini D. Validating online reference managers for scholarly impact measurement. Scientometrics 2011 Dec 21;91(2):461-471. [CrossRef]
- Bik HM, Goldstein MC. An introduction to social media for scientists. PLoS Biol 2013;11(4):e1001535 [FREE Full text] [CrossRef] [Medline]
- Weigold M. Communicating Science. Science Communication 2016 Aug 18;23(2):164-193. [CrossRef]
- Thelwall M. Three practical field normalised alternative indicator formulae for research evaluation. Journal of Informetrics 2017 Feb;11(1):128-151. [CrossRef]
- Orduna-Malea E, Delgado LE. Demography of Altmetrics under the Light of Dimensions: Locations, Institutions, Journals, Disciplines and Funding Bodies in the Global Research Framework. Journal of Altmetrics 2019 Jun 18;2(1):1-18. [CrossRef]
- Thelwall M. The Pros and Cons of the Use of Altmetrics in Research Assessment. Scholarly Assessment Reports 2020 May 12;2(1):1-9 [FREE Full text] [CrossRef]
- Bardus M, El Rassi R, Chahrour M, Akl EW, Raslan AS, Meho LI, et al. The Use of Social Media to Increase the Impact of Health Research: Systematic Review. J Med Internet Res 2020 Jul 06;22(7):e15607 [FREE Full text] [CrossRef] [Medline]
- Costas R, Zahedi Z, Wouters P. Do “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective. J Assn Inf Sci Tec 2014 Jul 28;66(10):2003-2019. [CrossRef]
- Kudlow P, Bissky Dziadyk D, Rutledge A, Shachak A, Eysenbach G. The citation advantage of promoted articles in a cross‐publisher distribution platform: A 12‐month randomized controlled trial. Journal of the Association for Information Science and Technology 2019 Dec 23;71(10):1257-1274. [CrossRef]
- Sinatra R, Deville P, Szell M, Wang D, Barabási A. A century of physics. Nature Phys 2015 Oct 01;11(10):791-796. [CrossRef]
- Moral-Muñoz JA, Herrera-Viedma E, Santisteban-Espejo A, Cobo MJ. Software tools for conducting bibliometric analysis in science: An up-to-date review. EPI 2020 Jan 19;29(1):e290103. [CrossRef]
Abbreviations
TE: tissue engineering |
WoS: Web of Science |
Edited by R Kukafka; submitted 30.10.20; peer-reviewed by Z Ye, Y Bu; comments to author 21.01.21; revised version received 23.02.21; accepted 05.07.21; published 26.11.21
Copyright©Antonio Santisteban-Espejo, Miguel Angel Martin-Piedra, Antonio Campos, Julia Moran-Sanchez, Manuel J Cobo, Ana I Pacheco-Serrano, Jose A Moral-Munoz. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 26.11.2021.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.