Concept: Gene V. Glass
Meta-analyses play an important role in cumulative science by combining information across multiple studies and attempting to provide effect size estimates corrected for publication bias. Research on the reproducibility of meta-analyses reveals that errors are common, and the percentage of effect size calculations that cannot be reproduced is much higher than is desirable. Furthermore, the flexibility in inclusion criteria when performing a meta-analysis, combined with the many conflicting conclusions drawn by meta-analyses of the same set of studies performed by different researchers, has led some people to doubt whether meta-analyses can provide objective conclusions.
The objective of this study was to conduct a systematic review and meta-analysis of teamwork interventions that were carried out with the purpose of improving teamwork and team performance, using controlled experimental designs. A literature search returned 16,849 unique articles. The meta-analysis was ultimately conducted on 51 articles, comprising 72 (k) unique interventions, 194 effect sizes, and 8439 participants, using a random effects model. Positive and significant medium-sized effects were found for teamwork interventions on both teamwork and team performance. Moderator analyses were also conducted, which generally revealed positive and significant effects with respect to several sample, intervention, and measurement characteristics. Implications for effective teamwork interventions as well as considerations for future research are discussed.
A meta-analysis of research examining the relationships between multidimensional perfectionism and burnout is provided. In doing so, relationships before and after controlling for the relationship between dimensions of perfectionism were examined along with whether relationships were moderated by domain (work, sport, or education). A literature search yielded 43 studies (N = 9,838) and 663 effect sizes. Meta-analysis using random-effects models revealed that perfectionistic strivings had small negative or non-significant relationships with overall burnout and symptoms of burnout. By contrast, perfectionistic concerns displayed medium-to-large and medium positive relationships with overall burnout and symptoms of burnout. After controlling for the relationship between dimensions of perfectionism, “pure” perfectionistic strivings displayed notably larger negative relationships. In terms of moderation, in some cases, perfectionistic strivings were less adaptive and perfectionistic concerns more maladaptive in the work domain. Future research should examine explanatory mechanisms, adopt longitudinal designs, and develop interventions to reduce perfectionistic concerns fueled burnout.
Most meta-analyses include data from one or more small studies that, individually, do not have power to detect an intervention effect. The relative influence of adequately powered and underpowered studies in published meta-analyses has not previously been explored. We examine the distribution of power available in studies within meta-analyses published in Cochrane reviews, and investigate the impact of underpowered studies on meta-analysis results.
- The journal of pain : official journal of the American Pain Society
- Published almost 3 years ago
Despite wide use in clinical practice, acupuncture remains a controversial treatment for chronic pain. Our objective was to update an individual patient data meta-analysis to determine the effect size of acupuncture for four chronic pain conditions.We searched MEDLINE and the Cochrane Central Registry of Controlled Trials randomized trials published up until December 31, 2015. We included randomized trials of acupuncture needling versus either sham acupuncture or no acupuncture control for non-specific musculoskeletal pain, osteoarthritis, chronic headache, or shoulder pain. Trials were only included if allocation concealment was unambiguously determined to be adequate. Raw data were obtained from study authors and entered into an individual patient data meta-analysis. The main outcome measures were pain and function. An additional 13 trials were identified, with data received for a total of 20,827 patients from 39 trials. Acupuncture was superior to both sham and no acupuncture control for each pain condition (all p<0.001) with differences between groups close to 0.5 standard deviations (SD) for comparison with no acupuncture control and close to 0.2 SDs in comparison with sham. We also found clear evidence that the effects of acupuncture persist over time with only a small decrease, approximately 15%, in treatment effect at one year. In secondary analyses, we found no obvious association between trial outcome and characteristics of acupuncture treatment, but effect sizes of acupuncture were associated with the type of control group, with smaller effects sizes for sham controlled trials that used a penetrating needle for sham, and for trials that had high intensity of intervention in the control arm.We conclude that acupuncture is effective for the treatment of chronic pain, with treatment effects persisting over time. While factors in addition to the specific effects of needling at correct acupuncture point locations are important contributors to the treatment effect, decreases in pain following acupuncture cannot be explained solely in terms of placebo effects. Variations in the effect size of acupuncture in different trials are driven predominately by differences in treatments received by the control group rather than by differences in the characteristics of acupuncture treatment.
To estimate the proportion of systematic reviews that meet the optimal information size (OIS) and assess the impact heterogeneity and effect size have on the OIS estimate by type of outcome (eg, mortality, semiobjective or subjective).
Many factors affect the microbiomes of humans, mice, and other mammals, but substantial challenges remain in determining which of these factors are of practical importance. Considering the relative effect sizes of both biological and technical covariates can help improve study design and the quality of biological conclusions. Care must be taken to avoid technical bias that can lead to incorrect biological conclusions. The presentation of quantitative effect sizes in addition to P values will improve our ability to perform meta-analysis and to evaluate potentially relevant biological effects. A better consideration of effect size and statistical power will lead to more robust biological conclusions in microbiome studies.
- Obesity reviews : an official journal of the International Association for the Study of Obesity
- Published almost 5 years ago
According to learning-based models of behavior, food cue reactivity and craving are conditioned responses that lead to increased eating and subsequent weight gain. However, evidence supporting this relationship has been mixed. We conducted a quantitative meta-analysis to assess the predictive effects of food cue reactivity and craving on eating and weight-related outcomes. Across 69 reported statistics from 45 published reports representing 3,292 participants, we found an overall medium effect of food cue reactivity and craving on outcomes (r = 0.33, p < 0.001; approximately 11% of variance), suggesting that cue exposure and the experience of craving significantly influence and contribute to eating behavior and weight gain. Follow-up tests revealed a medium effect size for the effect of both tonic and cue-induced craving on eating behavior (r = 0.33). We did not find significant differences in effect sizes based on body mass index, age, or dietary restraint. However, we did find that visual food cues (e.g. pictures and videos) were associated with a similar effect size to real food exposure and a stronger effect size than olfactory cues. Overall, the present findings suggest that food cue reactivity, cue-induced craving and tonic craving systematically and prospectively predict food-related outcomes. These results have theoretical, methodological, public health and clinical implications.
A systematic review and meta-analysis was conducted on 11 randomized placebo-controlled human studies of acute effects of tea constituents L-theanine and epigallocatechin gallate, administered alone or in combination with caffeine, on cognitive function and mood. The outcome measures of mood were alertness, calmness, and contentedness, derived from the Bond-Lader scales, and state anxiety, from the State-Trait Anxiety Inventory. Cognitive measures assessed were attentional switch, intersensory attention, and rapid visual information processing. Standardized mean differences between placebo and treatment groups are presented for each study and outcome measure. Meta-analysis using a random-effects model was conducted when data were available for three or more studies. Evidence of moderate effect sizes in favor of combined caffeine and L-theanine in the first 2 hours postdose were found for outcome measures Bond-Lader alertness, attentional switching accuracy, and, to a lesser extent, some unisensory and multisensory attentional outcomes. Moderator analysis of caffeine and L-theanine doses revealed trends toward greater change in effect size for caffeine dose than for L-theanine dose, particularly during the first hour postdose.
Although the effect of stereotype threat concerning women and mathematics has been subject to various systematic reviews, none of them have been performed on the sub-population of children and adolescents. In this meta-analysis we estimated the effects of stereotype threat on performance of girls on math, science and spatial skills (MSSS) tests. Moreover, we studied publication bias and four moderators: test difficulty, presence of boys, gender equality within countries, and the type of control group that was used in the studies. We selected study samples when the study included girls, samples had a mean age below 18years, the design was (quasi-)experimental, the stereotype threat manipulation was administered between-subjects, and the dependent variable was a MSSS test related to a gender stereotype favoring boys. To analyze the 47 effect sizes, we used random effects and mixed effects models. The estimated mean effect size equaled -0.22 and significantly differed from 0. None of the moderator variables was significant; however, there were several signs for the presence of publication bias. We conclude that publication bias might seriously distort the literature on the effects of stereotype threat among schoolgirls. We propose a large replication study to provide a less biased effect size estimate.