Systematic ReviewLeading journalWikiHigh evidence score
Consensus statement on concussion in sport: the 6th International Conference on Concussion in Sport–Amsterdam, October 2022
Jon Patricios, Kathryn Schneider, Jiří Dvořák +28 more · British Journal of Sports Medicine · 2023 · 1,012 citations
This international consensus statement synthesises evidence from 10 systematic reviews to provide updated, evidence-informed guidelines for concussion recognition, assessment, and management in sport, emphasising that no athlete should return to play on the same day as a suspected concussion, and that full cognitive and physical rest for more than 24–48 hours is not beneficial—instead, gradual return to activity should begin after that brief rest period.
Read the breakdown →RCTTop journalWikiHigh evidence score
SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials
A.-W. Chan, Jennifer Tetzlaff, Peter C Gøtzsche +10 more · BMJ · 2013 · 7,001 citations
This paper provides a 33-item checklist and detailed guidance for writing complete, transparent clinical trial protocols, which directly applies to anyone designing a rigorous self-experiment: a well-structured protocol prevents bias, ensures reproducibility, and forces you to think through confounds before you start collecting data.
Read the breakdown →Systematic ReviewTop journalHigh evidence score
Education reform and change driven by digital technology: a bibliometric study from a global perspective
Chengliang Wang, Xiaojiao Chen, Teng Yu +2 more · Humanities and Social Sciences Communications · 2024 · 207 citations
Abstract Amidst the global digital transformation of educational institutions, digital technology has emerged as a significant area of interest among scholars. Such technologies have played an instrumental role in enhancing learner performance and improving the effectiveness of teaching and learning. These digital technologies also ensure the sustainability and stability of education during the epidemic. Despite this, a dearth of systematic reviews exists regarding the current state of digital technology application in education. To address this gap, this study utilized the Web of Science Core Collection as a data source (specifically selecting the high-quality SSCI and SCIE) and implemented a topic search by setting keywords, yielding 1849 initial publications. Furthermore, following the PRISMA guidelines, we refined the selection to 588 high-quality articles. Using software tools such as CiteSpace, VOSviewer, and Charticulator, we reviewed these 588 publications to identify core authors (such as Selwyn, Henderson, Edwards), highly productive countries/regions (England, Australia, USA), key institutions (Monash University, Australian Catholic University), and crucial journals in the field ( Education and Information Technologies , Computers & Education , British Journal of Educational Technology ). Evolutionary analysis reveals four developmental periods in the research field of digital technology education application: the embryonic period, the preliminary development period, the key exploration, and the acceleration period of change. The study highlights the dual influence of technological factors and historical context on the research topic. Technology is a key factor in enabling education to transform and upgrade, and the context of the times is an important driving force in promoting the adoption of new technologies in the education system and the transformation and upgrading of education. Additionally, the study identifies three frontier hotspots in the field: physical education, digital transformation, and professional development under the promotion of digital technology. This study presents a clear framework for digital technology application in education, which can serve as a valuable reference for researchers and educational practitioners concerned with digital technology education application in theory and practice.
Meta-analysisWikiHigh evidence score
Trends in Research on Writing as a Learning Activity
Peter Klein, Pietro Boscolo · Journal of Writing Research · 2016 · 212 citations
Writing reliably improves learning across subjects, but the effect depends on *how* you write — reflective, explanatory writing that forces you to reorganise knowledge works far better than simple note-taking or summarising, and the gains are roughly equivalent to raising test scores by 0.3–0.5 standard deviations (a medium effect).
Read the breakdown →ObservationalTop journalHigh evidence score
Large-Scale Exome Sequencing Study Implicates Both Developmental and Functional Changes in the Neurobiology of Autism
F. Kyle Satterstrom, Jack A. Kosmicki, Jiebiao Wang +97 more · Cell · 2020 · 2,420 citations
We present the largest exome sequencing study of autism spectrum disorder (ASD) to date (n = 35,584 total samples, 11,986 with ASD). Using an enhanced analytical framework to integrate de novo and case-control rare variation, we identify 102 risk genes at a false discovery rate of 0.1 or less. Of these genes, 49 show higher frequencies of disruptive de novo variants in individuals ascertained to have severe neurodevelopmental delay, whereas 53 show higher frequencies in individuals ascertained to have ASD; comparing ASD cases with mutations in these groups reveals phenotypic differences. Expressed early in brain development, most risk genes have roles in regulation of gene expression or neuronal communication (i.e., mutations effect neurodevelopmental and neurophysiological changes), and 13 fall within loci recurrently hit by copy number variants. In cells from the human cortex, expression of risk genes is enriched in excitatory and inhibitory neuronal lineages, consistent with multiple paths to an excitatory-inhibitory imbalance underlying ASD.
StudyTop journalModerate
Global burden of 369 diseases and injuries in 204 countries and territories, 1990–2019: a systematic analysis for the Global Burden of Disease Study 2019
Theo Vos, Stephen S Lim, Cristiana Abbafati +97 more · The Lancet · 2020 · 18,955 citations
BACKGROUND: In an era of shifting global agendas and expanded emphasis on non-communicable diseases and injuries along with communicable diseases, sound evidence on trends by cause at the national level is essential. The Global Burden of Diseases, Injuries, and Risk Factors Study (GBD) provides a systematic scientific assessment of published, publicly available, and contributed data on incidence, prevalence, and mortality for a mutually exclusive and collectively exhaustive list of diseases and injuries. METHODS: GBD estimates incidence, prevalence, mortality, years of life lost (YLLs), years lived with disability (YLDs), and disability-adjusted life-years (DALYs) due to 369 diseases and injuries, for two sexes, and for 204 countries and territories. Input data were extracted from censuses, household surveys, civil registration and vital statistics, disease registries, health service use, air pollution monitors, satellite imaging, disease notifications, and other sources. Cause-specific death rates and cause fractions were calculated using the Cause of Death Ensemble model and spatiotemporal Gaussian process regression. Cause-specific deaths were adjusted to match the total all-cause deaths calculated as part of the GBD population, fertility, and mortality estimates. Deaths were multiplied by standard life expectancy at each age to calculate YLLs. A Bayesian meta-regression modelling tool, DisMod-MR 2.1, was used to ensure consistency between incidence, prevalence, remission, excess mortality, and cause-specific mortality for most causes. Prevalence estimates were multiplied by disability weights for mutually exclusive sequelae of diseases and injuries to calculate YLDs. We considered results in the context of the Socio-demographic Index (SDI), a composite indicator of income per capita, years of schooling, and fertility rate in females younger than 25 years. Uncertainty intervals (UIs) were generated for every metric using the 25th and 975th ordered 1000 draw values of the posterior distribution. FINDINGS: Global health has steadily improved over the past 30 years as measured by age-standardised DALY rates. After taking into account population growth and ageing, the absolute number of DALYs has remained stable. Since 2010, the pace of decline in global age-standardised DALY rates has accelerated in age groups younger than 50 years compared with the 1990-2010 time period, with the greatest annualised rate of decline occurring in the 0-9-year age group. Six infectious diseases were among the top ten causes of DALYs in children younger than 10 years in 2019: lower respiratory infections (ranked second), diarrhoeal diseases (third), malaria (fifth), meningitis (sixth), whooping cough (ninth), and sexually transmitted infections (which, in this age group, is fully accounted for by congenital syphilis; ranked tenth). In adolescents aged 10-24 years, three injury causes were among the top causes of DALYs: road injuries (ranked first), self-harm (third), and interpersonal violence (fifth). Five of the causes that were in the top ten for ages 10-24 years were also in the top ten in the 25-49-year age group: road injuries (ranked first), HIV/AIDS (second), low back pain (fourth), headache disorders (fifth), and depressive disorders (sixth). In 2019, ischaemic heart disease and stroke were the top-ranked causes of DALYs in both the 50-74-year and 75-years-and-older age groups. Since 1990, there has been a marked shift towards a greater proportion of burden due to YLDs from non-communicable diseases and injuries. In 2019, there were 11 countries where non-communicable disease and injury YLDs constituted more than half of all disease burden. Decreases in age-standardised DALY rates have accelerated over the past decade in countries at the lower end of the SDI range, while improvements have started to stagnate or even reverse in countries with higher SDI. INTERPRETATION: As disability becomes an increasingly large component of disease burden and a larger component of health expenditure, greater research and development investment is needed to identify new, more effective intervention strategies. With a rapidly ageing global population, the demands on health services to deal with disabling outcomes, which increase with age, will require policy makers to anticipate these changes. The mix of universal and more geographically specific influences on health reinforces the need for regular reporting on population health in detail and by underlying cause to help decision makers to identify success stories of disease control to emulate, as well as opportunities to improve. FUNDING: Bill & Melinda Gates Foundation.
StudyWikiModerate
Opinion Paper: “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy
Yogesh K. Dwivedi, Nir Kshetri, Laurie Hughes +70 more · International Journal of Information Management · 2023 · 3,487 citations
This opinion paper synthesises perspectives from 43 experts across 13 fields to map the opportunities, risks, and research gaps of generative AI like ChatGPT — concluding that while the technology can boost productivity in banking, hospitality, and marketing, it also introduces unresolved threats around bias, misinformation, privacy, and the erosion of human judgment, with no consensus on whether regulation is needed.
Read the breakdown →RCTHigh evidence score
Application of Artificial Intelligence powered digital writing assistant in higher education: randomized controlled trial
Nabi Nazari, Muhammad Salman Shabbir, Roy Setiawan · Heliyon · 2021 · 374 citations
A major challenge in educational technology integration is to engage students with different affective characteristics. Also, how technology shapes attitude and learning behavior is still lacking. Findings from educational psychology and learning sciences have gained less traction in research. The present study was conducted to examine the efficacy of a group format of an Artificial Intelligence (AI) powered writing tool for English second postgraduate students in the English academic writing context. In the present study, (N = 120) students were randomly allocated to either the equipped AI (n = 60) or non-equipped AI (NEAI). The results of the parametric test of analyzing of covariance revealed that at post-intervention, students who participated in the AI intervention group demonstrated statistically significant improvement in the scores, of the behavioral engagement (Cohen's d = .75, 95% CI [0.38, 1.12]), of the emotional engagement Cohen's d = .82, 95% CI [0.45, 1.25], of the cognitive engagement, Cohen's d = .39,95% CI [0.04, .76], of the self-efficacy for writing, Cohen's d = .54, 95% CI [0.18, 0.91], of the positive emotions Cohen's d = . 44, 95% CI [0.08, 0.80], and of the negative emotions, Cohen's d = −.98, 95% CI [−1.36, −0.60], compared with NEAI. The results suggest that AI-powered writing tools could be an efficient tool to promote learning behavior and attitudinal technology acceptance through formative feedback and assessment for non-native postgraduate students in English academic writing.
StudyTop journalWikiModerate
Dementia prevention, intervention, and care: 2024 report of the Lancet standing Commission
Gill Livingston, Jonathan Huntley, Kathy Liu +24 more · The Lancet · 2024 · 2,694 citations
This 2024 update from the Lancet Commission identifies 14 modifiable risk factors that together account for approximately 45% of dementia cases worldwide, meaning nearly half of all dementia could theoretically be prevented or delayed through addressing these factors across the lifespan.
Read the breakdown →Systematic ReviewHigh evidence score
Immersive Virtual Reality for Foreign Language Education: A PRISMA Systematic Review
Bruno Peixoto, Darque Pinto, Miguel Melo +2 more · IEEE Access · 2021 · 158 citations
Immersion is a proven method of learning a foreign language and using Virtual Reality to achieve that immersion has high potential educational benefits. However, there are no recent systematic reviews that combine both foreign language education and immersive Virtual Reality. This systematic review aims to identify features, educational methods, technologies, and gaps of immersive virtual reality for foreign and second language education. PRISMA method was followed to carry out the systematic review. From the analysis of the results, two main conclusions were drawn. Firstly, the relation between immersive Virtual Reality and foreign language learning is quite positive, particularly when compared with conventional pedagogical practices. Not only that, the connection between immersive Virtual Reality and the user's motivation and satisfaction is also quite positive. Lastly, limitations such as the low sample of studies and gaps in the literature are addressed, and directions for future work and the area's progress are pointed out.
Systematic ReviewTop journalHigh evidence score
BlueHealth: a study programme protocol for mapping and quantifying the potential benefits to public health and well-being from Europe's blue spaces
James Grellier, Mathew P. White, María Albin +11 more · BMJ Open · 2017 · 283 citations
INTRODUCTION: Proximity and access to water have long been central to human culture and accordingly deliver countless societal benefits. Over 200 million people live on Europe's coastline, and aquatic environments are the top recreational destination in the region. In terms of public health, interactions with 'blue space' (eg, coasts, rivers, lakes) are often considered solely in terms of risk (eg, drowning, microbial pollution). Exposure to blue space can, however, promote health and well-being and prevent disease, although underlying mechanisms are poorly understood. AIMS AND METHODS: The BlueHealth project aims to understand the relationships between exposure to blue space and health and well-being, to map and quantify the public health impacts of changes to both natural blue spaces and associated urban infrastructure in Europe, and to provide evidence-based information to policymakers on how to maximise health benefits associated with interventions in and around aquatic environments. To achieve these aims, an evidence base will be created through systematic reviews, analyses of secondary data sets and analyses of new data collected through a bespoke international survey and a wide range of community-level interventions. We will also explore how to deliver the benefits associated with blue spaces to those without direct access through the use of virtual reality. Scenarios will be developed that allow the evaluation of health impacts in plausible future societal contexts and changing environments. BlueHealth will develop key inputs into policymaking and land/water-use planning towards more salutogenic and sustainable uses of blue space, particularly in urban areas. ETHICS AND DISSEMINATION: Throughout the BlueHealth project, ethics review and approval are obtained for all relevant aspects of the study by the local ethics committees prior to any work being initiated and an ethics expert has been appointed to the project advisory board. So far, ethical approval has been obtained for the BlueHealth International Survey and for community-level interventions taking place in Spain, Italy and the UK. Engagement of stakeholders, including the public, involves citizens in many aspects of the project. Results of all individual studies within the BlueHealth project will be published with open access. After full anonymisation and application of any measures necessary to prevent disclosure, data generated in the project will be deposited into open data repositories of the partner institutions, in line with a formal data management plan. Other knowledge and tools developed in the project will be made available via the project website (www.bluehealth2020.eu). Project results will ultimately provide key inputs to planning and policy relating to blue space, further stimulating the integration of environmental and health considerations into decision-making, such that blue infrastructure is developed across Europe with both public health and the environment in mind.
StudyWikiModerate
Generative Agents: Interactive Simulacra of Human Behavior
Joon Sung Park, Joseph O’Brien, Carrie J. Cai +3 more · 2023 · 1,345 citations
Generative agents powered by large language models can simulate believable human-like social behaviors—including waking up, working, forming opinions, planning parties, and coordinating group events—without being explicitly programmed for each action, suggesting that AI-driven social simulations could be used to rehearse interpersonal interactions or prototype social dynamics before running real-world experiments.
Read the breakdown →StudyTop journalModerate
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Andrea C. Tricco, Erin Lillie, Wasifa Zarin +25 more · Annals of Internal Medicine · 2018 · 39,422 citations
Scoping reviews, a type of knowledge synthesis, follow a systematic approach to map evidence on a topic and identify main concepts, theories, sources, and knowledge gaps. Although more scoping reviews are being done, their methodological and reporting quality need improvement. This document presents the PRISMA-ScR (Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews) checklist and explanation. The checklist was developed by a 24-member expert panel and 2 research leads following published guidance from the EQUATOR (Enhancing the QUAlity and Transparency Of health Research) Network. The final checklist contains 20 essential reporting items and 2 optional items. The authors provide a rationale and an example of good reporting for each item. The intent of the PRISMA-ScR is to help readers (including researchers, publishers, commissioners, policymakers, health care providers, guideline developers, and patients or consumers) develop a greater understanding of relevant terminology, core concepts, and key items to report for scoping reviews.
StudyWikiModerate
Guidelines for the Early Management of Patients With Acute Ischemic Stroke
Edward C. Jauch, Jeffrey L. Saver, Harold P. Adams +12 more · Stroke · 2013 · 7,644 citations
This is a clinical practice guideline, not an experimental study—it synthesises evidence from dozens of trials to recommend how hospitals should treat stroke patients in the first 48 hours, with the strongest evidence supporting rapid administration of intravenous tissue plasminogen activator (tPA) within 3–4.5 hours of symptom onset to reduce disability.
Read the breakdown →StudyModerate
ChatGPT: Bullshit spewer or the end of traditional assessments in higher education?
Jürgen Rudolph, Samson Tan, Shannon Tan · Journal of Applied Learning & Teaching · 2023 · 1,635 citations
ChatGPT is the world’s most advanced chatbot thus far. Unlike other chatbots, it can create impressive prose within seconds, and it has created much hype and doomsday predictions when it comes to student assessment in higher education and a host of other matters. ChatGPT is a state-of-the-art language model (a variant of OpenAI’s Generative Pretrained Transformer (GPT) language model) designed to generate text that can be indistinguishable from text written by humans. It can engage in conversation with users in a seemingly natural and intuitive way. In this article, we briefly tell the story of OpenAI, the organisation behind ChatGPT. We highlight the fundamental change from a not-for-profit organisation to a commercial business model. In terms of our methods, we conducted an extensive literature review and experimented with this artificial intelligence (AI) software. Our literature review shows our review to be amongst the first peer-reviewed academic journal articles to explore ChatGPT and its relevance for higher education (especially assessment, learning and teaching). After a description of ChatGPT’s functionality and a summary of its strengths and limitations, we focus on the technology’s implications for higher education and discuss what is the future of learning, teaching and assessment in higher education in the context of AI chatbots such as ChatGPT. We position ChatGPT in the context of current Artificial Intelligence in Education (AIEd) research, discuss student-facing, teacher-facing and system-facing applications, and analyse opportunities and threats. We conclude the article with recommendations for students, teachers and higher education institutions. Many of them focus on assessment.
StudyWikiModerate
Guidelines for the Management of Aneurysmal Subarachnoid Hemorrhage
E. Sander Connolly, Alejandro A. Rabinstein, J. Ricardo Carhuapoma +10 more · Stroke · 2012 · 3,494 citations
This is a clinical practice guideline for doctors treating aneurysmal subarachnoid hemorrhage (aSAH)—a type of stroke caused by a ruptured brain aneurysm—and it does not contain experimental data suitable for a personal n=1 experiment, but it provides critical context for understanding why self-experimentation on brain blood vessel health, blood pressure control, and aneurysm screening is not advisable without medical supervision.
Read the breakdown →StudyModerate
Bias in data‐driven artificial intelligence systems—An introductory survey
Eirini Ntoutsi, Pavlos Fafalios, Ujwal Gadiraju +20 more · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · 2020 · 971 citations
Abstract Artificial Intelligence (AI)‐based systems are widely employed nowadays to make decisions that have far‐reaching impact on individuals and society. Their decisions might affect everyone, everywhere, and anytime, entailing concerns about potential human rights issues. Therefore, it is necessary to move beyond traditional AI algorithms optimized for predictive performance and embed ethical and legal principles in their design, training, and deployment to ensure social good while still benefiting from the huge potential of the AI technology. The goal of this survey is to provide a broad multidisciplinary overview of the area of bias in AI systems, focusing on technical challenges and solutions as well as to suggest new research directions towards approaches well‐grounded in a legal frame. In this survey, we focus on data‐driven AI, as a large part of AI is powered nowadays by (big) data and powerful machine learning algorithms. If otherwise not specified, we use the general term bias to describe problems related to the gathering or processing of data that might result in prejudiced decisions on the bases of demographic features such as race, sex, and so forth. This article is categorized under: Commercial, Legal, and Ethical Issues > Fairness in Data Mining Commercial, Legal, and Ethical Issues > Ethical Considerations Commercial, Legal, and Ethical Issues > Legal Issues
StudyTop journalWikiModerate
CONSORT 2010 statement: extension to randomised pilot and feasibility trials
Sandra Eldridge, Claire Chan, Michael J. Campbell +4 more · BMJ · 2016 · 3,389 citations
This paper provides a standardised checklist for reporting pilot and feasibility trials, which helps researchers (including self-experimenters) distinguish between studies that test whether an intervention *can* work from those that test whether it *does* work—preventing premature conclusions from underpowered data.
Read the breakdown →StudyModerate
2017 Guidelines of the American Thyroid Association for the Diagnosis and Management of Thyroid Disease During Pregnancy and the Postpartum
Erik K. Alexander, Elizabeth N. Pearce, Gregory A. Brent +9 more · Thyroid · 2017 · 2,667 citations
Background: Thyroid disease in pregnancy is a common clinical problem. Since the guidelines for the management of these disorders by the American Thyroid Association (ATA) were first published in 2011, significant clinical and scientific advances have occurred in the field. The aim of these guidelines is to inform clinicians, patients, researchers, and health policy makers on published evidence relating to the diagnosis and management of thyroid disease in women during pregnancy, preconception, and the postpartum period. Methods: The specific clinical questions addressed in these guidelines were based on prior versions of the guidelines, stakeholder input, and input of task force members. Task force panel members were educated on knowledge synthesis methods, including electronic database searching, review and selection of relevant citations, and critical appraisal of selected studies. Published English language articles were eligible for inclusion. The American College of Physicians Guideline Grading System was used for critical appraisal of evidence and grading strength of recommendations. The guideline task force had complete editorial independence from the ATA. Competing interests of guideline task force members were regularly updated, managed, and communicated to the ATA and task force members. Results: The revised guidelines for the management of thyroid disease in pregnancy include recommendations regarding the interpretation of thyroid function tests in pregnancy, iodine nutrition, thyroid autoantibodies and pregnancy complications, thyroid considerations in infertile women, hypothyroidism in pregnancy, thyrotoxicosis in pregnancy, thyroid nodules and cancer in pregnant women, fetal and neonatal considerations, thyroid disease and lactation, screening for thyroid dysfunction in pregnancy, and directions for future research. Conclusions: We have developed evidence-based recommendations to inform clinical decision-making in the management of thyroid disease in pregnant and postpartum women. While all care must be individualized, such recommendations provide, in our opinion, optimal care paradigms for patients with these disorders.
StudyModerate
2016 ESC Guidelines for the management of atrial fibrillation developed in collaboration with EACTS
Paulus Kirchhof, Stefano Benussi, Dipak Kotecha +47 more · European Journal of Cardio-Thoracic Surgery · 2016 · 1,421 citations
Guidelines summarize and evaluate all available evidence on a particular issue at the time of the writing process, with the aim of assisting health professionals in selecting the best management strategies for an individual patient with a given condition, taking into account the impact on outcome, as well as the risk–benefit ratio of particular diagnostic or therapeutic means. Guidelines and recommendations should help health professionals to make decisions in their daily practice. However, the final decisions concerning an individual patient must be made by the responsible health professional(s) in consultation with the patient and caregiver as appropriate. A great number of Guidelines have been issued in recent years by the European Society of Cardiology (ESC) and by the European Association for Cardio-Thoracic Surgery (EACTS), as well as by other societies and organisations. Because of the impact on clinical practice, quality criteria for the development of guidelines have been established in order to make all decisions transparent to the user. The recommendations for formulating and issuing ESC Guidelines can be found on the ESC website (http://www.escardio.org/Guidelines-&-Education/Clinical-Practice-Guidelines/Guidelines-development/Writing-ESC-Guidelines). ESC Guidelines represent the official position of the ESC on a given topic and are regularly updated. Members of this Task Force were selected by the ESC, including representation from the European Heart Rhythm Association (EHRA), and EACTS as well as by the European Stroke Organisation (ESO) to represent professionals involved with the medical care of patients with this pathology. Selected experts in the field undertook a comprehensive review of the published evidence for management (including diagnosis, treatment, prevention and rehabilitation) of a given condition according to ESC Committee for Practice Guidelines (CPG) policy and approved by the EACTS and ESO. A critical evaluation of diagnostic and therapeutic procedures was performed, including assessment of the risk–benefit ratio. Estimates of expected health outcomes for larger populations were included, where data exist. The level of evidence and the strength of the recommendation of particular management options were weighed and graded according to predefined scales, as outlined in Tables 1 and 2.
Meta-analysisHigh evidence score
The Effect of Computers on Student Writing: A Meta-analysis of Studies from 1992 to 2002
Amie Goldberg, Michael Russell, Abigail Cook · Open Access Journals at BC (Boston College) · 2003 · 394 citations
Meta-analyses were performed including 26 studies conducted between 1992-2002 focused on the comparison between k-2 students writing with computers vs. paper-and-pencil.Significant mean effect sizes in favor of computers were found for quantity of writing (d=.50, n=4) and quality of writing (d=.4, n=5).Studies focused on revision behaviors between these two writing conditions (n=6) revealed mixed results.Other studies collected for the meta-analysis which did not meet the statistical criteria were also reviewed briefly.These articles (n=35) indicate that the writing process is more collaborative, iterative, and social in computer classrooms as compared with paper-and-pencil environments.For educational leaders questioning whether computers should be used to help students develop writing skills, the results of the meta-analyses suggest that, on average, students who use computers when learning to write are not only more engaged and motivated in their writing, but they produce written work that is of greater length and higher quality.
RCTHigh evidence score
Do u smoke after txt? Results of a randomised trial of smoking cessation using mobile phone text messaging
Anthony Rodgers, Thomas Corbett, Dale Bramley +4 more · Tobacco Control · 2005 · 758 citations
OBJECTIVES: To determine the effectiveness of a mobile phone text messaging smoking cessation programme. DESIGN: Randomised controlled trial SETTING: New Zealand PARTICIPANTS: 1705 smokers from throughout New Zealand who wanted to quit, were aged over 15 years, and owned a mobile phone were randomised to an intervention group that received regular, personalised text messages providing smoking cessation advice, support, and distraction, or to a control group. All participants received a free month of text messaging; starting for the intervention group on their quit day to assist with quitting, and starting for the control group at six months to encourage follow up. Follow up data were available for 1624 (95%) at six weeks and 1265 (74%) at six months. MAIN OUTCOME MEASURES: The main trial outcome was current non-smoking (that is, not smoking in the past week) six weeks after randomisation. Secondary outcomes included current non-smoking at 12 and 26 weeks. RESULTS: More participants had quit at six weeks in the intervention compared to the control group: 239 (28%) v 109 (13%), relative risk 2.20 (95% confidence interval 1.79 to 2.70), p < 0.0001. This treatment effect was consistent across subgroups defined by age, sex, income level, or geographic location (p homogeneity > 0.2). The relative risk estimates were similar in sensitivity analyses adjusting for missing data and salivary cotinine verification tests. Reported quit rates remained high at six months, but there was some uncertainty about between group differences because of incomplete follow up. CONCLUSIONS: This programme offers potential for a new way to help young smokers to quit, being affordable, personalised, age appropriate, and not location dependent. Future research should test these findings in different settings, and provide further assessment of long term quit rates.
StudyTop journalModerate
Creation and analysis of biochemical constraint-based models using the COBRA Toolbox v.3.0
Laurent Heirendt, Sylvain Arreckx, Thomas Pfau +52 more · Nature Protocols · 2019 · 1,354 citations
StudyModerate
European Resuscitation Council and European Society of Intensive Care Medicine guidelines 2021: post-resuscitation care
Jerry P. Nolan, Claudio Sandroni, Bernd W. Böttiger +12 more · Intensive Care Medicine · 2021 · 1,093 citations
StudyLeading journalModerate
Management of hyperglycaemia in type 2 diabetes: a patient-centered approach. Position statement of the American Diabetes Association (ADA) and the European Association for the Study of Diabetes (EASD)
S. E. Inzucchi, Richard M. Bergenstal, John B. Buse +7 more · Diabetologia · 2012 · 3,931 citations
StudyTop journalModerate
Consort 2010 statement: extension to cluster randomised trials
Marion Campbell, Gilda Piaggio, Diana R Elbourne +2 more · BMJ · 2012 · 3,551 citations
<h3>Abstract</h3> In age-related neurodegenerative disease, like Alzheimer’s and Parkinson’s disease, disease-specific proteins become aggregation-prone and form amyloid-like deposits. Depletion of SERF proteins ameliorates this toxic process in worm- and human cell models for disease. Whether SERF modifies amyloid pathology in mammalian brain, however, has remained unknown. Here, we generated SERF2 brain-specific knockout mice which, unlike full body knockout mice, were viable, and showed no major behavioral and cognitive abnormalities. We combined these knockout mice with the APPPS1 mouse model for human amyloid beta aggregation. Using structure-specific amyloid dyes, previously used to distinguish amyloid polymorphisms in human brain, we show that knockout of SERF2 alters the structure of amyloid fibrils and deposits. Moreover, scanning transmission electron microscopy revealed thicker, shorter and more densely packed amyloid in absence of SERF2. Altogether, our data reveal pleiotropic functions of SERF in development and aging and support a function as a modifier of amyloid aggregation in mammalian brain. Our results indicate that single cellular factors like SERF can determine the structural outcome of amyloid aggregation, offering possibilities for polymorphism-based disease interventions.
Systematic ReviewHigh evidence score
Investigating the prevalence and causes of prescribing errors in general practice : the PRACtICe Study
Anita Avery, Nick Barber, Maisoon Ghaleb +10 more · CentAUR (University of Reading) · 2012 · 159 citations
Aim: \nTo determine the prevalence and nature of prescribing errors in general practice; to explore the causes, and to identify defences against error. \n \nMethods: \n1) Systematic reviews; 2) Retrospective review of unique medication items prescribed over a 12 month period to a 2% sample of patients from 15 general practices in England; 3) Interviews with 34 prescribers regarding 70 potential errors; 15 root cause analyses, and six focus groups involving 46 primary health care team members \n \nResults: \nThe study involved examination of 6,048 unique prescription items for 1,777 patients. Prescribing or monitoring errors were detected for one in eight patients, involving around one in 20 of all prescription items. The vast majority of the errors were of mild to moderate severity, with one in 550 items being associated with a severe error. The following factors were associated with increased risk of prescribing or monitoring errors: male gender, age less than 15 years or greater than 64 years, number of unique medication items prescribed, and being prescribed preparations in the following therapeutic areas: cardiovascular, infections, malignant disease and immunosuppression, musculoskeletal, eye, ENT and skin. Prescribing or monitoring errors were not associated with the grade of GP or whether prescriptions were issued as acute or repeat items. \nA wide range of underlying causes of error were identified relating to the prescriber, patient, the team, the working environment, the task, the computer system and the primary/secondary care interface. Many defences against error were also identified, including strategies employed by individual prescribers and primary care teams, and making best use of health information technology. \n \nConclusion: \nPrescribing errors in general practices are common, although severe errors are unusual. Many factors increase the risk of error. Strategies for reducing the prevalence of error should focus on GP training, continuing professional development for GPs, clinical governance, effective use of clinical computer systems, and improving safety systems within general practices and at the interface with secondary care.
StudyTop journalWikiModerate
Direct air capture: process technology, techno-economic and socio-political challenges
María Erans, Eloy S. Sanz-Pérez, Dawid P. Hanak +3 more · Energy & Environmental Science · 2022 · 621 citations
This comprehensive review finds that direct air capture (DAC) technologies can remove CO₂ from ambient air at costs currently ranging from $100–$1,000 per tonne of CO₂, with significant technical, economic, and policy barriers remaining before deployment at climate-relevant scales (billions of tonnes per year) becomes feasible.
Read the breakdown →StudyModerate
The Circular Economy: An Interdisciplinary Exploration of the Concept and Application in a Global Context
Alan Murray, Keith R. Skene, Kathryn Haynes · Journal of Business Ethics · 2015 · 3,169 citations
StudyWikiModerate
Six Human-Centered Artificial Intelligence Grand Challenges
Özlem Özmen Garibay, Brent Winslow, Salvatore Andolina +23 more · International Journal of Human-Computer Interaction · 2023 · 419 citations
This paper identifies six grand challenges for developing AI that is ethical, fair, and enhances human well-being, but it does not report any experimental data, effect sizes, or testable interventions — it is a consensus-based position paper, not a study you can directly replicate in a self-experiment.
Read the breakdown →StudyTop journalModerate
Promoting novelty, rigor, and style in energy social science: Towards codes of practice for appropriate methods and research design
Benjamin K. Sovacool, Jonn Axsen, Steve Sorrell · Energy Research & Social Science · 2018 · 1,133 citations
A series of weaknesses in creativity, research design, and quality of writing continue to handicap energy social science. Many studies ask uninteresting research questions, make only marginal contributions, and lack innovative methods or application to theory. Many studies also have no explicit research design, lack rigor, or suffer from mangled structure and poor quality of writing. To help remedy these shortcomings, this Review offers suggestions for how to construct research questions; thoughtfully engage with concepts; state objectives; and appropriately select research methods. Then, the Review offers suggestions for enhancing theoretical, methodological, and empirical novelty. In terms of rigor, codes of practice are presented across seven method categories: experiments, literature reviews, data collection, data analysis, quantitative energy modeling, qualitative analysis, and case studies. We also recommend that researchers beware of hierarchies of evidence utilized in some disciplines, and that researchers place more emphasis on balance and appropriateness in research design. In terms of style, we offer tips regarding macro and microstructure and analysis, as well as coherent writing. Our hope is that this Review will inspire more interesting, robust, multi-method, comparative, interdisciplinary and impactful research that will accelerate the contribution that energy social science can make to both theory and practice.
StudyModerate
Toward an Entrepreneurial Ecosystem Research Program
Bernd Wurth, Erik Stam, Ben Spigel · Entrepreneurship Theory and Practice · 2021 · 666 citations
Entrepreneurial ecosystems have become a prominent concept, yet in its current state, the concept itself represents a paradox. While it draws on a rich intellectual history and provides an opportunity to synthesize different strands of research, it is also under-theorized and the mechanisms that govern ecosystem evolution are not well understood. This paper takes stock of recent advancements in ecosystem scholarship and synthesizes the empirical reality of the causal mechanisms. We use these dynamics to position ecosystems in a broader context, within and beyond the domain of entrepreneurship research, and propose a transdisciplinary research program for ecosystem research and practice.
StudyModerate
Replicability, Robustness, and Reproducibility in Psychological Science
Brian A. Nosek, Tom E Hardwicke, Hannah Moshontz +13 more · Annual Review of Psychology · 2021 · 726 citations
Replication-an important, uncommon, and misunderstood practice-is gaining appreciation in psychology. Achieving replicability is important for making research progress. If findings are not replicable, then prediction and theory development are stifled. If findings are replicable, then interrogation of their meaning and validity can advance knowledge. Assessing replicability can be productive for generating and testing hypotheses by actively confronting current understandings to identify weaknesses and spur innovation. For psychology, the 2010s might be characterized as a decade of active confrontation. Systematic and multi-site replication projects assessed current understandings and observed surprising failures to replicate many published findings. Replication efforts highlighted sociocultural challenges such as disincentives to conduct replications and a tendency to frame replication as a personal attack rather than a healthy scientific practice, and they raised awareness that replication contributes to self-correction. Nevertheless, innovation in doing and understanding replication and its cousins, reproducibility and robustness, has positioned psychology to improve research practices and accelerate progress.
StudyModerate
Beyond misinformation: Understanding and coping with the “post-truth” era.
Stephan Lewandowsky, Ullrich K. H. Ecker, John Cook · Journal of Applied Research in Memory and Cognition · 2017 · 1,883 citations
The terms "post-truth" and "fake news" have become increasingly prevalent in public discourse over the last year. This article explores the growing abundance of misinformation, how it influences people, and how to counter it. We examine the ways in which misinformation can have an adverse impact on society. We summarize how people respond to corrections of misinformation, and what kinds of corrections are most effective. We argue that to be effective, scientific research into misinformation must be considered within a larger political, technological, and societal context. The post-truth world emerged as a result of societal mega-trends such as a decline in social capital, growing economic inequality, increased polarization, declining trust in science, and an increasingly fractionated media landscape. We suggest that responses to this malaise must involve technological solutions incorporating psychological principles, an interdisciplinary approach that we describe as "technocognition." We outline a number of recommendations to counter misinformation in a post-truth world.
StudyModerate
Groupware: some issues and experiences
Clarence A. Ellis, Simon Gibbs, Gail L. Rein · Communications of the ACM · 1991 · 2,758 citations
<p>Groupware reflects a change in emphasis from using the computer to solve problems to using the computer to facilitate human interaction. This article describes categories and examples of group-ware and discusses some underlying research and development issues. GROVE, a novel group editor, is explained in some detail as a salient groupware example.</p>
StudyModerate
European Resuscitation Council and European Society of Intensive Care Medicine Guidelines 2021: Post-resuscitation care
Jerry P. Nolan, Claudio Sandroni, Bernd W. Böttiger +12 more · Resuscitation · 2021 · 704 citations
RCTHigh evidence score
A Cost-Effectiveness Analysis of Blended Versus Face-to-Face Delivery of Evidence-Based Medicine to Medical Students
Stephen Maloney, Peter Nicklen, George Rivers +5 more · Journal of Medical Internet Research · 2015 · 135 citations
BACKGROUND: Blended learning describes a combination of teaching methods, often utilizing digital technologies. Research suggests that learner outcomes can be improved through some blended learning formats. However, the cost-effectiveness of delivering blended learning is unclear. OBJECTIVE: This study aimed to determine the cost-effectiveness of a face-to-face learning and blended learning approach for evidence-based medicine training within a medical program. METHODS: The economic evaluation was conducted as part of a randomized controlled trial (RCT) comparing the evidence-based medicine (EBM) competency of medical students who participated in two different modes of education delivery. In the traditional face-to-face method, students received ten 2-hour classes. In the blended learning approach, students received the same total face-to-face hours but with different activities and additional online and mobile learning. Online activities utilized YouTube and a library guide indexing electronic databases, guides, and books. Mobile learning involved self-directed interactions with patients in their regular clinical placements. The attribution and differentiation of costs between the interventions within the RCT was measured in conjunction with measured outcomes of effectiveness. An incremental cost-effectiveness ratio was calculated comparing the ongoing operation costs of each method with the level of EBM proficiency achieved. Present value analysis was used to calculate the break-even point considering the transition cost and the difference in ongoing operation cost. RESULTS: The incremental cost-effectiveness ratio indicated that it costs 24% less to educate a student to the same level of EBM competency via the blended learning approach used in the study, when excluding transition costs. The sunk cost of approximately AUD $40,000 to transition to the blended model exceeds any savings from using the approach within the first year of its implementation; however, a break-even point is achieved within its third iteration and relative savings in the subsequent years. The sensitivity analysis indicates that approaches with higher transition costs, or staffing requirements over that of a traditional method, are likely to result in negative value propositions. CONCLUSIONS: Under the study conditions, a blended learning approach was more cost-effective to operate and resulted in improved value for the institution after the third year iteration, when compared to the traditional face-to-face model. The wider applicability of the findings are dependent on the type of blended learning utilized, staffing expertise, and educational context.
StudyWikiModerate
Speculative futures on ChatGPT and generative artificial intelligence (AI): A collective reflection from the educational landscape
Aras Bozkurt, J. Xiao, Steven Imanuel Lambert +33 more · Dublin City University Open Access Institutional Repository (Dublin City University) · 2023 · 322 citations
This speculative paper identifies 12 key themes about how ChatGPT and generative AI might reshape education—including personalised tutoring, assessment redesign, and the risk of cognitive offloading—but provides no experimental data, so its claims are expert opinion rather than tested findings, meaning you should treat its recommendations as hypotheses to test in your own learning experiments.
Read the breakdown →StudyModerate
Can Large Language Models Transform Computational Social Science?
Caleb Ziems, William A. Held, Omar Ahmed Shaikh +3 more · Computational Linguistics · 2023 · 417 citations
Abstract Large language models (LLMs) are capable of successfully performing many language processing tasks zero-shot (without training data). If zero-shot LLMs can also reliably classify and explain social phenomena like persuasiveness and political ideology, then LLMs could augment the computational social science (CSS) pipeline in important ways. This work provides a road map for using LLMs as CSS tools. Towards this end, we contribute a set of prompting best practices and an extensive evaluation pipeline to measure the zero-shot performance of 13 language models on 25 representative English CSS benchmarks. On taxonomic labeling tasks (classification), LLMs fail to outperform the best fine-tuned models but still achieve fair levels of agreement with humans. On free-form coding tasks (generation), LLMs produce explanations that often exceed the quality of crowdworkers’ gold references. We conclude that the performance of today’s LLMs can augment the CSS research pipeline in two ways: (1) serving as zero-shot data annotators on human annotation teams, and (2) bootstrapping challenging creative generation tasks (e.g., explaining the underlying attributes of a text). In summary, LLMs are posed to meaningfully participate in social science analysis in partnership with humans.
StudyModerate
International clinical practice recommendations on the definition, diagnosis, assessment, intervention, and psychosocial aspects of developmental coordination disorder
Rainer Blank, Anna L. Barnett, John Cairney +8 more · Developmental Medicine & Child Neurology · 2019 · 787 citations
AIM: These international clinical practice recommendations (CPR) for developmental coordination disorder (DCD), initiated by the European Academy of Childhood Disability (EACD), aim to address key questions on the definition, diagnosis, assessment, intervention, and psychosocial aspects of DCD relevant for clinical practice. METHOD: Key questions in five areas were considered through literature reviews and formal expert consensus. For recommendations based on evidence, literature searches on 'mechanisms', 'assessment', and 'intervention' were updated since the last recommendations in 2012. New searches were conducted for 'psychosocial issues' and 'adolescents/adults'. Evidence was rated according to the Oxford Centre for Evidence-Based Medicine (level of evidence [LOE] 1-4) and transferred into recommendations. For recommendations based on formal consensus, two meetings of an international, multidisciplinary expert panel were conducted with a further five Delphi rounds to develop good clinical practice (GCP) recommendations. RESULTS: Thirty-five recommendations were made. Eight were based on the evidence from literature reviews (three on 'assessment', five on 'intervention'). Twenty-two were updated from the 2012 recommendations. New recommendations relate to diagnosis and assessment (two GCPs) and psychosocial issues (three GCPs). Additionally, one new recommendation (LOE) reflects active video games as adjuncts to more traditional activity-oriented and participation-oriented interventions, and two new recommendations (one GCP, one LOE) were made for adolescents and adults with DCD. INTERPRETATION: The CPR-DCD is a comprehensive overview of DCD and current understanding based on research evidence and expert consensus. It reflects the state of the art for clinicians and scientists of varied disciplines. The international CPR-DCD may serve as a basis for national guidelines. WHAT THIS PAPER ADDS: Updated international clinical practice guidelines on developmental coordination disorder (DCD). Refined and extended recommendations on clinical assessment and intervention for DCD. A critical synopsis of current research on mechanisms of DCD. A critical synopsis of psychosocial issues in DCD, with implications for clinical practice. The first international recommendations to consider adolescents and adults with DCD.
StudyModerate
Toward the future of psychiatric diagnosis: the seven pillars of RDoC
Bruce N. Cuthbert, Thomas R. Insel · BMC Medicine · 2013 · 3,044 citations
BACKGROUND: Current diagnostic systems for mental disorders rely upon presenting signs and symptoms, with the result that current definitions do not adequately reflect relevant neurobiological and behavioral systems--impeding not only research on etiology and pathophysiology but also the development of new treatments. DISCUSSION: The National Institute of Mental Health began the Research Domain Criteria (RDoC) project in 2009 to develop a research classification system for mental disorders based upon dimensions of neurobiology and observable behavior. RDoC supports research to explicate fundamental biobehavioral dimensions that cut across current heterogeneous disorder categories. We summarize the rationale, status and long-term goals of RDoC, outline challenges in developing a research classification system (such as construct validity and a suitable process for updating the framework) and discuss seven distinct differences in conception and emphasis from current psychiatric nosologies. SUMMARY: Future diagnostic systems cannot reflect ongoing advances in genetics, neuroscience and cognitive science until a literature organized around these disciplines is available to inform the revision efforts. The goal of the RDoC project is to provide a framework for research to transform the approach to the nosology of mental disorders.
StudyLeading journalModerate
Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted language learning for EFL students
Cuiping Song, Yanping Song · Frontiers in Psychology · 2023 · 522 citations
Introduction: This mixed-methods study evaluates the impact of AI-assisted language learning on Chinese English as a Foreign Language (EFL) students' writing skills and writing motivation. As artificial intelligence (AI) becomes more prevalent in educational settings, understanding its effects on language learning outcomes is crucial. Methods: The study employs a comprehensive approach, combining quantitative and qualitative methods. The quantitative phase utilizes a pre-test and post-test design to assess writing skills. Fifty EFL students, matched for proficiency, are randomly assigned to experimental (AI-assisted instruction via ChatGPT) or control (traditional instruction) groups. Writing samples are evaluated using established scoring rubrics. Concurrently, semi-structured interviews are conducted with a subset of participants to explore writing motivation and experiences with AI-assisted learning. Results: Quantitative analysis reveals significant improvements in both writing skills and motivation among students who received AI-assisted instruction compared to the control group. The experimental group demonstrates enhanced proficiency in various aspects of writing, including organization, coherence, grammar, and vocabulary. Qualitative findings showcase diverse perspectives, ranging from recognition of AI's innovative instructional role and its positive influence on writing skills and motivation to concerns about contextual accuracy and over-reliance. Participants also reflect on the long-term impact and sustainability of AI-assisted instruction, emphasizing the need for ongoing development and adaptation of AI tools. Discussion: The nuanced findings offer a comprehensive understanding of AI's transformative potential in education. These insights have practical implications for practitioners and researchers, emphasizing the benefits, challenges, and the evolving nature of AI's role in language instruction.
RCTHigh evidence score
The Effects of Rhythm and Robotic Interventions on the Imitation/Praxis, Interpersonal Synchrony, and Motor Performance of Children with Autism Spectrum Disorder (ASD): A Pilot Randomized Controlled Trial
Sudha Srinivasan, Maninderjit Kaur, Isabel K. Park +3 more · Autism Research and Treatment · 2015 · 111 citations
We assessed the effects of three interventions, rhythm, robotic, and standard-of-care, on the imitation/praxis, interpersonal synchrony, and overall motor performance of 36 children with Autism Spectrum Disorder (ASD) between 5 and 12 years of age. Children were matched on age, level of functioning, and services received, prior to random assignment to one of the three groups. Training was provided for 8 weeks with 4 sessions provided each week. We assessed generalized changes in motor skills from the pretest to the posttest using a standardized test of motor performance, the Bruininks-Oseretsky Test of Motor Proficiency, 2nd edition (BOT-2). We also assessed training-specific changes in imitation/praxis and interpersonal synchrony during an early and a late session. Consistent with the training activities practiced, the rhythm and robot groups improved on the body coordination composite of the BOT-2, whereas the comparison group improved on the fine manual control composite of the BOT-2. All three groups demonstrated improvements in imitation/praxis. The rhythm and robot groups also showed improved interpersonal synchrony performance from the early to the late session. Overall, socially embedded movement-based contexts are valuable in promoting imitation/praxis, interpersonal synchrony, and motor performance and should be included within the standard-of-care treatment for children with ASD.
StudyModerate
Innovation in education: what works, what doesn’t, and what to do about it?
Peter Serdyukov · Journal of Research in Innovative Teaching & Learning · 2017 · 915 citations
Purpose The purpose of this paper is to present an analytical review of the educational innovation field in the USA. It outlines classification of innovations, discusses the hurdles to innovation, and offers ways to increase the scale and rate of innovation-based transformations in the education system. Design/methodology/approach The paper is based on a literature survey and author research. Findings US education badly needs effective innovations of scale that can help produce the needed high-quality learning outcomes across the system. The primary focus of educational innovations should be on teaching and learning theory and practice, as well as on the learner, parents, community, society, and its culture. Technology applications need a solid theoretical foundation based on purposeful, systemic research, and a sound pedagogy. One of the critical areas of research and innovation can be cost and time efficiency of the learning. Practical implications Several practical recommendations stem out of this paper: how to create a base for large-scale innovations and their implementation; how to increase effectiveness of technology innovations in education, particularly online learning; how to raise time and cost efficiency of education. Social implications Innovations in education are regarded, along with the education system, within the context of a societal supersystem demonstrating their interrelations and interdependencies at all levels. Raising the quality and scale of innovations in education will positively affect education itself and benefit the whole society. Originality/value Originality is in the systemic approach to education and educational innovations, in offering a comprehensive classification of innovations; in exposing the hurdles to innovations, in new arguments about effectiveness of technology applications, and in time efficiency of education.
StudyModerate
Framework for the development and evaluation of complex interventions: gap analysis, workshop and consultation-informed update
Kathryn Skivington, Lynsay Matthews, Sharon Simpson +11 more · Health Technology Assessment · 2021 · 530 citations
BACKGROUND: The Medical Research Council published the second edition of its framework in 2006 on developing and evaluating complex interventions. Since then, there have been considerable developments in the field of complex intervention research. The objective of this project was to update the framework in the light of these developments. The framework aims to help research teams prioritise research questions and design, and conduct research with an appropriate choice of methods, rather than to provide detailed guidance on the use of specific methods. METHODS: There were four stages to the update: (1) gap analysis to identify developments in the methods and practice since the previous framework was published; (2) an expert workshop of 36 participants to discuss the topics identified in the gap analysis; (3) an open consultation process to seek comments on a first draft of the new framework; and (4) findings from the previous stages were used to redraft the framework, and final expert review was obtained. The process was overseen by a Scientific Advisory Group representing the range of relevant National Institute for Health Research and Medical Research Council research investments. RESULTS: Key changes to the previous framework include (1) an updated definition of complex interventions, highlighting the dynamic relationship between the intervention and its context; (2) an emphasis on the use of diverse research perspectives: efficacy, effectiveness, theory-based and systems perspectives; (3) a focus on the usefulness of evidence as the basis for determining research perspective and questions; (4) an increased focus on interventions developed outside research teams, for example changes in policy or health services delivery; and (5) the identification of six 'core elements' that should guide all phases of complex intervention research: consider context; develop, refine and test programme theory; engage stakeholders; identify key uncertainties; refine the intervention; and economic considerations. We divide the research process into four phases: development, feasibility, evaluation and implementation. For each phase we provide a concise summary of recent developments, key points to address and signposts to further reading. We also present case studies to illustrate the points being made throughout. LIMITATIONS: The framework aims to help research teams prioritise research questions and design and conduct research with an appropriate choice of methods, rather than to provide detailed guidance on the use of specific methods. In many of the areas of innovation that we highlight, such as the use of systems approaches, there are still only a few practical examples. We refer to more specific and detailed guidance where available and note where promising approaches require further development. CONCLUSIONS: This new framework incorporates developments in complex intervention research published since the previous edition was written in 2006. As well as taking account of established practice and recent refinements, we draw attention to new approaches and place greater emphasis on economic considerations in complex intervention research. We have introduced a new emphasis on the importance of context and the value of understanding interventions as 'events in systems' that produce effects through interactions with features of the contexts in which they are implemented. The framework adopts a pluralist approach, encouraging researchers and research funders to adopt diverse research perspectives and to select research questions and methods pragmatically, with the aim of providing evidence that is useful to decision-makers. FUTURE WORK: We call for further work to develop relevant methods and provide examples in practice. The use of this framework should be monitored and the move should be made to a more fluid resource in the future, for example a web-based format that can be frequently updated to incorporate new material and links to emerging resources. FUNDING: This project was jointly funded by the Medical Research Council (MRC) and the National Institute for Health Research (Department of Health and Social Care 73514).
StudyModerate
Translation, Cross-Cultural Adaptation, and Validation of Measurement Instruments: A Practical Guideline for Novice Researchers
Paulo Cruchinho, María Dolores López-Franco, Manuel Luís Capelas +7 more · Journal of Multidisciplinary Healthcare · 2024 · 294 citations
Cross-cultural validation of self-reported measurement instruments for research is a long and complex process, which involves specific risks of bias that could affect the research process and results. Furthermore, it requires researchers to have a wide range of technical knowledge about the translation, adaptation and pre-test aspects, their purposes and options, about the different psychometric properties, and the required evidence for their assessment and knowledge about the quantitative data processing and analysis using statistical software. This article aimed: 1) identify all guidelines and recommendations for translation, cross-cultural adaptation, and validation within the healthcare sciences; 2) describe the methodological approaches established in these guidelines for conducting translation, adaptation, and cross-cultural validation; and 3) provide a practical guideline featuring various methodological options for novice researchers involved in translating, adapting, and validating measurement instruments. Forty-two guidelines on translation, adaptation, or cross-cultural validation of measurement instruments were obtained from "CINAHL with Full Text" (via EBSCO) and "MEDLINE with Full Text". A content analysis was conducted to identify the similarities and differences in the methodological approaches recommended. Bases on these similarities and differences, we proposed an eight-step guideline that includes: a) forward translation; 2) synthesis of translations; 3) back translation; 4) harmonization; 5) pre-testing; 6) field testing; 7) psychometric validation, and 8) analysis of psychometric properties. It is a practical guideline because it provides extensive and comprehensive information on the methodological approaches available to researchers. This is the first methodological literature review carried out in the healthcare sciences regarding the methodological approaches recommended by existing guidelines.
StudyTop journalModerate
Many Analysts, One Data Set: Making Transparent How Variations in Analytic Choices Affect Results
Raphael Silberzahn, Eric Luis Uhlmann, Daniel P. Martin +62 more · Advances in Methods and Practices in Psychological Science · 2018 · 847 citations
Twenty-nine teams involving 61 analysts used the same data set to address the same research question: whether soccer referees are more likely to give red cards to dark-skin-toned players than to light-skin-toned players. Analytic approaches varied widely across the teams, and the estimated effect sizes ranged from 0.89 to 2.93 ( Mdn = 1.31) in odds-ratio units. Twenty teams (69%) found a statistically significant positive effect, and 9 teams (31%) did not observe a significant relationship. Overall, the 29 different analyses used 21 unique combinations of covariates. Neither analysts’ prior beliefs about the effect of interest nor their level of expertise readily explained the variation in the outcomes of the analyses. Peer ratings of the quality of the analyses also did not account for the variability. These findings suggest that significant variation in the results of analyses of complex data may be difficult to avoid, even by experts with honest intentions. Crowdsourcing data analysis, a strategy in which numerous research teams are recruited to simultaneously investigate the same research question, makes transparent how defensible, yet subjective, analytic choices influence research results.
StudyModerate
Augmenting human innovation teams with artificial intelligence: Exploring transformer‐based language models
Sebastian Gregor Bouschery, Vera Blažević, Frank T. Piller · Journal of Product Innovation Management · 2023 · 373 citations
Abstract The use of transformer‐based language models in artificial intelligence (AI) has increased adoption in various industries and led to significant productivity advancements in business operations. This article explores how these models can be used to augment human innovation teams in the new product development process, allowing for larger problem and solution spaces to be explored and ultimately leading to higher innovation performance. The article proposes the use of the AI‐augmented double diamond framework to structure the exploration of how these models can assist in new product development (NPD) tasks, such as text summarization, sentiment analysis, and idea generation. It also discusses the limitations of the technology and the potential impact of AI on established practices in NPD. The article establishes a research agenda for exploring the use of language models in this area and the role of humans in hybrid innovation teams. (Note: Following the idea of this article, GPT‐3 alone generated this abstract. Only minor formatting edits were performed by humans.)
StudyModerate
Strengthening State Capabilities: The Role of Financial Incentives in the Call to Public Service*
Ernesto Dal Bó, Frederico Finan, Martı́n A. Rossi · The Quarterly Journal of Economics · 2013 · 560 citations
Abstract We study a recent recruitment drive for public sector positions in Mexico. Different salaries were announced randomly across recruitment sites, and job offers were subsequently randomized. Screening relied on exams designed to measure applicants’ intellectual ability, personality, and motivation. This allows the first experimental estimates of (1) the role of financial incentives in attracting a larger and more qualified pool of applicants, (2) the elasticity of the labor supply facing the employer, and (3) the role of job attributes (distance, attractiveness of the municipal environment) in helping fill vacancies, as well as the role of wages in helping fill positions in less attractive municipalities. A theoretical model of job applications and acceptance guides the empirical inquiry. We find that higher wages attract more able applicants as measured by their IQ, personality, and proclivity toward public sector work—that is, we find no evidence of adverse selection effects on motivation; higher wage offers also increased acceptance rates, implying a labor supply elasticity of around 2 and some degree of monopsony power. Distance and worse municipal characteristics strongly decrease acceptance rates, but higher wages help bridge the recruitment gap in worse municipalities.
StudyModerate
Survey of the State of the Art in Natural Language Generation: Core tasks, applications and evaluation
Albert Gatt, Emiel Krahmer · Journal of Artificial Intelligence Research · 2018 · 750 citations
This paper surveys the current state of the art in Natural Language Generation (NLG), defined as the task of generating text or speech from non-linguistic input. A survey of NLG is timely in view of the changes that the field has undergone over the past two decades, especially in relation to new (usually data-driven) methods, as well as new applications of NLG technology. This survey therefore aims to (a) give an up-to-date synthesis of research on the core tasks in NLG and the architectures adopted in which such tasks are organised; (b) highlight a number of recent research topics that have arisen partly as a result of growing synergies between NLG and other areas of artificial intelligence; (c) draw attention to the challenges in NLG evaluation, relating them to similar challenges faced in other areas of NLP, with an emphasis on different evaluation methods and the relationships between them.