This document includes an overview of all analyses conducted for the manuscript “Individual Differences in Personality Trait Changes Across the Lifespan: A Meta-Analysis of Longitudinal Studies”. The structure and content of this supplementary document is based on a similar meta-analysis:
[BLINDED FOR PEER-REVIEW]
Tabs
To make the document easier to read, we use tabs. You can use the tabs to choose between different information (e.g., tables or figures or different traits). Note: Sometimes there are several levels of tabs. For example, on the first level you decide which trait you are interested in and on the second level you decide whether you want to see tables or graphics.
Analysis Code
The document includes all R code used to create the graphs and tables or to perform the analyses. However, the code is hidden by default to enhance readability. If you want to see the code, simply click on the respective CODE button on the right hand side just above the figure or table—you will then see the associated codechunk. If you want to show all codechunks by default, click CODE > Show all Code at the very top of the document.
Preregistration
The meta-analysis has been preregistered at https://osf.io/kzjfw/?view_only=d22f0976a7754e3dbb3d15b9242d29e1. Deviations from this preregistration are summarized in the following table.
deviations <- data.frame(
`Preregistered Plan` = c("We had preregistered to account for the dependency of effect sizes based on similar traits within a sample or multiple assessments to compute the variance-covariance matrix", "We had preregistered to compute all analyses in a trait-specific fashion"),
"Deviation" = c("We additionally accounted for dependency due to different types of reports (e.g., self-report vs. other report) within a sample. Based on the meta-analysis by Connolly et al. (2007), we assumed a correlation of r = .55 for this type of dependency", "We additionally included two exploratory analyses to examine (1) whether individual differences significantly differed across traits and (2) how the methdological moderators are related to individual differences in personality changes in a model across traits"),
"Reason" = c("After creating the meta-analytic dataset, we realized that this type of dependency of effect sizes was also present in the dataset", "These exploratory analysis allowed us to address further interesting research questions")
)
names(deviations) <- c("Preregistered Plan", "Deviation", "Reason")
kable(deviations
, caption="**Deviations from the Preregistration**"
, escape=FALSE
, label = NA) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| Preregistered Plan | Deviation | Reason |
|---|---|---|
| We had preregistered to account for the dependency of effect sizes based on similar traits within a sample or multiple assessments to compute the variance-covariance matrix | We additionally accounted for dependency due to different types of reports (e.g., self-report vs. other report) within a sample. Based on the meta-analysis by Connolly et al. (2007), we assumed a correlation of r = .55 for this type of dependency | After creating the meta-analytic dataset, we realized that this type of dependency of effect sizes was also present in the dataset |
| We had preregistered to compute all analyses in a trait-specific fashion | We additionally included two exploratory analyses to examine (1) whether individual differences significantly differed across traits and (2) how the methdological moderators are related to individual differences in personality changes in a model across traits | These exploratory analysis allowed us to address further interesting research questions |
Roberts et al. (2006): StudyIDs 1 to 100
names(studies) <- c("StudyID", "Source", "Reference", "Country", "SampleID", "*N* at T1",
"Age at T1", "Number of waves", "Total time lag", "Traits")
studies.rob <- filter(studies, Source == "2") %>% select(-Source)
kable(studies.rob
, caption="**Overview of Included Studies from Roberts et al. (2006)**"
, escape=FALSE
, label = NA) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| StudyID | Reference | Country | SampleID | N at T1 | Age at T1 | Number of waves | Total time lag | Traits |
|---|---|---|---|---|---|---|---|---|
| 2 | Asendorpf & Wilpers (1998) | Germany | 1 | 132 | 20.0 | 2 | 1.5 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness, Shyness, Sociability |
| 26 | Gustavsson et al. (1997) | Sweden | 1 | 130 | 43.0 | 2 | 9.0 | Detachment, Guilt, Impulsivity, Indirect Aggression, Irritability, Somatic Anxiety, Lack of Assertiveness, Monotony Avoidance, Psychasthenia, Psychic Anxiety, Social Desirability, Socialization, Suspicion, Verbal Aggression |
| 34 | Karney & Bradbury (1997) | US | 1 | 53 | 25.4 | 2 | 4.0 | Neuroticism |
| 34 | Karney & Bradbury (1997) | US | 2 | 53 | 24.0 | 2 | 4.0 | Neuroticism |
| 37 | Kitchener et al. (1984) | US | 1 | 17 | 16.2 | 2 | 2.0 | Ego Development |
| 37 | Kitchener et al. (1984) | US | 2 | 30 | 19.6 | 2 | 2.0 | Ego Development |
| 37 | Kitchener et al. (1984) | US | 3 | 14 | 28.2 | 2 | 2.0 | Ego Development |
| 40 | Leadbeater et al. (1999) | US | 1 | 230 | 12.0 | 2 | 1.0 | Withdrawn, Aggressive Behavior, Anxious, Delinquent Behavior |
| 40 | Leadbeater et al. (1999) | US | 2 | 230 | 12.0 | 2 | 1.0 | Withdrawn, Aggressive Behavior, Anxious, Delinquent Behavior |
| 44 | Martin et al. (2002) | US | 1 | 67 | 64.9 | 2 | 5.0 | Boldness, Conscientiousness, Dominance, Emotional Stability, Enthusiasm, Imagination, Insecurity, Intelligence, Radicalism, Self Discipline, Self Sufficiency, Sensitivity, Shrewdness, Suspiciousness, Tension, Warmth |
| 44 | Martin et al. (2002) | US | 2 | 57 | 82.8 | 2 | 5.0 | Boldness, Conscientiousness, Dominance, Emotional Stability, Enthusiasm, Imagination, Insecurity, Intelligence, Radicalism, Self Discipline, Self Sufficiency, Sensitivity, Shrewdness, Suspiciousness, Tension, Warmth |
| 44 | Martin et al. (2002) | US | 3 | 55 | 100.5 | 2 | 1.5 | Boldness, Conscientiousness, Dominance, Emotional Stability, Enthusiasm, Imagination, Insecurity, Intelligence, Radicalism, Self Discipline, Self Sufficiency, Sensitivity, Shrewdness, Suspiciousness, Tension, Warmth |
| 49 | Mortimer et al. (1982) | US | 1 | 368 | 18.0 | 3 | 14.0 | Sociability, Unconventionality, Well Being |
| 51 | Mroczek & Spiro (2003) | US | 1 | 402 | 50.0 | 7 | 12.0 | Extraversion, Neuroticism |
| 51 | Mroczek & Spiro (2003) | US | 2 | 735 | 63.0 | 4 | 6.0 | Extraversion, Neuroticism |
| 52 | Mussen et al. (1980) | US | 1 | 53 | 30.0 | 2 | 40.0 | Cheerfulness, Excitability, Open-mindedness, Self Assurance Poise, Talkativeness, Tendency to Criticize, Tendency to Criticize Child, Worrisome |
| 54 | Neyer & Asendorpf (2001) | Germany | 1 | 489 | 24.4 | 2 | 4.0 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Shyness, Sociability |
| 57 | Ormel & Rijsdijk (2000) | Netherlands | 1 | 157 | 35.0 | 4 | 15.0 | Neuroticism |
| 57 | Ormel & Rijsdijk (2000) | Netherlands | 2 | 139 | 34.0 | 5 | 16.0 | Neuroticism |
| 60 | Peterson & Lane (2001) | US | 1 | 69 | 18.0 | 2 | 4.0 | Authoritarianism |
| 61 | Piccione et al. (1989) | US | 1 | 24 | 19.5 | 3 | 25.0 | Hypnotizability |
| 61 | Piccione et al. (1989) | US | 2 | 26 | 19.5 | 3 | 25.0 | Hypnotizability |
| 67 | Roberts et al. (2001) | New Zealand | 1 | 464 | 18.0 | 2 | 8.0 | Achievement, Aggression, Alienation, Control, Harm Avoidance, Constraint, Negative Emotionality, Positive Emotionality, Social Closeness, Social Potency, Stress Reaction, Traditionalism, Well Being |
| 67 | Roberts et al. (2001) | New Zealand | 2 | 457 | 18.0 | 2 | 8.0 | Achievement, Aggression, Alienation, Control, Harm Avoidance, Constraint, Negative Emotionality, Positive Emotionality, Social Closeness, Social Potency, Stress Reaction, Traditionalism, Well Being |
| 7 | Branje et al. (2004) | Netherlands | 1 | 285 | 14.5 | 3 | 2.0 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness |
| 7 | Branje et al. (2004) | Netherlands | 2 | 285 | 12.4 | 2 | 1.0 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness |
| 7 | Branje et al. (2004) | Netherlands | 3 | 285 | 43.9 | 3 | 2.0 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness |
| 7 | Branje et al. (2004) | Netherlands | 4 | 285 | 41.7 | 3 | 2.0 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness |
| 70 | Robins et al. (2000) | US | 1 | 270 | 18.0 | 2 | 4.0 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness |
| 77 | Stevens & Truss (1985) | US | 1 | 62 | 18.0 | 2 | 22.0 | Abasement, Affiliation, Aggression, Autonomy, Change, Deference, Dominance, Achievement, Endurance, Exhibition, Heterosexuality, Intraception, Nurturance, Orderliness, Succorance |
| 77 | Stevens & Truss (1985) | US | 2 | 30 | 18.0 | 2 | 22.0 | Abasement, Affiliation, Aggression, Autonomy, Change, Deference, Dominance, Achievement, Endurance, Exhibition, Heterosexuality, Intraception, Nurturance, Orderliness, Succorance |
| 79 | Townsend et al. (1989) | US | 1 | 112 | 47.0 | 2 | 1.0 | Depression Symptoms |
| 80 | Vaidya et al. (2002) | US | 1 | 392 | 18.0 | 2 | 2.5 | Agreeableness, Conscientiousness, Extraversion, Fear, Negative Affect, Guilt, Hostility, Sadness, Neuroticism, Openness, Attentiveness, Positive Affect, Joviality, Self Assurance, Serenity, Shyness |
| 81 | van der Velde et al. (1995) | Netherlands | 1 | 146 | 18.4 | 2 | 4.0 | Boredom Susceptibility, Depression, Disinhibition, Extraversion, Impulsiveness, Locus of Control, Neuroticism |
| 81 | van der Velde et al. (1995) | Netherlands | 2 | 168 | 19.8 | 2 | 4.0 | Boredom Susceptibility, Depression, Disinhibition, Extraversion, Impulsiveness, Locus of Control, Neuroticism |
| 83 | Watson & Slack (1993) | US | 1 | 82 | 45.0 | 2 | 2.0 | Negative Emotionality, Positive Emotionality |
| 89 | Woodall & Matthews (1993) | US | 1 | 43 | 14.0 | 2 | 4.0 | Potential for Hostility, Hostility |
| 89 | Woodall & Matthews (1993) | US | 2 | 65 | 14.0 | 2 | 4.0 | Potential for Hostility, Hostility |
Bleidorn et al. (2022): StudyIDs 10000 to 30000
studies.blei <- filter(studies, Source == "1") %>% select(-Source)
kable(studies.blei
, caption="**Overview of Included Studies from Bleidorn et al. (2022)**"
, escape=FALSE
, label = NA) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| StudyID | Reference | Country | SampleID | N at T1 | Age at T1 | Number of waves | Total time lag | Traits |
|---|---|---|---|---|---|---|---|---|
| 10094 | Zupančič & Kavčič (2005) | Slovenia | 1 | 314 | 3.16 | 2 | 1.00 | Conscientiousness, Disagreeableness, Externalizing Behavior, Extraversion, Internalizing Behavior, Neuroticism, Social Competence |
| 10111 | Brendgen et al. (2005) | Canada | 1 | 414 | 6.00 | 2 | 1.00 | Reactivity |
| 10161 | Mayzer (2005) | US | 1 | 165 | 4.00 | 4 | 9.00 | Aggression, Delinquency |
| 10161 | Mayzer (2005) | US | 2 | 55 | 4.00 | 4 | 9.00 | Aggression, Delinquency |
| 10203 | Harakeh et al. (2006) | Netherlands | 1 | 416 | 15.22 | 2 | 1.00 | Agreeableness, Conscientiousness, Emotional Stability, Extraversion, Openness to Experience |
| 10203 | Harakeh et al. (2006) | Netherlands | 2 | 416 | 13.35 | 2 | 1.00 | Agreeableness, Conscientiousness, Emotional Stability, Extraversion, Openness to Experience |
| 10257 | Wood & Roberts (2006) | US | 1 | 149 | 19.00 | 2 | 0.50 | Emotional Stability, Extraversion |
| 10309 | Putnam & Rothbart (2006) | US | 1 | 98 | 2.73 | 2 | 1.04 | Activity, Anger Frustration, Approach Positive Anticipation, Attentional Focusing, Discomfort, Fear, High Intensity Pleasure, Impulsivity, Inhibitory Control, Low Intensity Pleasure, Perceptual Sensitivity, Sadness, Shyness, Smiling and Laughter, Soothability |
| 10415 | Dancho (2006) | US | 1 | 31 | 10.42 | 4 | 2.90 | Rumination |
| 10539 | Allemand et al. (2007) | Germany | 1 | 455 | 43.70 | 2 | 4.00 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness to Experience |
| 10539 | Allemand et al. (2007) | Germany | 2 | 420 | 62.40 | 2 | 2.00 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness to Experience |
| 10656 | Thomas (2007) | US | 1 | 298 | 6.40 | 2 | 4.10 | Activity, Emotionality, Sociability |
| 10656 | Thomas (2007) | US | 2 | 268 | 6.50 | 2 | 4.00 | Activity, Emotionality, Sociability |
| 10761 | Prinzie & Deković (2008) | Belgium | 1 | 475 | 7.83 | 2 | 3.00 | Achievement Motivation, Altruism, Anxiety, Benevolence, Compliance, Concentration, Conscientiousness, Creativity, Curiosity, Dominance, Egocentric, Emotional Stability, Energy, Expressiveness, Extraversion, Imagination, Intellect, Irritability, Optimism, Orderliness, Perseverance, Self Confidence, Shyness |
| 10979 | Duckworth & Quinn (2009) | US | 1 | 279 | 13.94 | 2 | 1.00 | Grit |
| 10983 | Lodi-Smith et al. (2009) | US | 1 | 170 | 18.25 | 2 | 3.00 | Agreeableness, Conscientiousness, Emotional Stability, Extraversion, Openness to Experience |
| 11005 | Lüdtke et al. (2009) | Germany | 1 | 2141 | 19.51 | 2 | 2.00 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness to Experience |
| 11137 | Slining et al. (2009) | US | 1 | 132 | 1.00 | 2 | 0.50 | Activity |
| 11157 | Hutteman et al. (2009) | Germany | 1 | 120 | 4.00 | 7 | 12.00 | Aggression, Shyness |
| 11252 | Zhou et al. (2010) | China | 1 | 419 | 7.70 | 2 | 3.90 | Anger Frustration, Effortful Control, Social Competence |
| 11255 | de Leeuw et al. (2010) | Netherlands | 1 | 824 | 13.40 | 3 | 2.00 | Agreeableness, Conscientiousness, Emotional Stability, Extraversion, Openness to Experience |
| 11284 | Klimstra et al. (2010) | Netherlands | 1 | 468 | 12.40 | 5 | 4.00 | Aggression |
| 11284 | Klimstra et al. (2010) | Netherlands | 2 | 455 | 12.40 | 5 | 4.00 | Aggression |
| 11284 | Klimstra et al. (2010) | Netherlands | 3 | 169 | 16.70 | 5 | 4.00 | Aggression |
| 11284 | Klimstra et al. (2010) | Netherlands | 4 | 221 | 16.70 | 5 | 4.00 | Aggression |
| 11336 | Zupančič et al. (2009) | Slovenia | 1 | 192 | 3.15 | 3 | 2.00 | Conscientiousness, Disagreeableness, Extraversion, Neuroticism |
| 11466 | Kim et al. (2010) | US | 1 | 906 | 6.00 | 3 | 4.00 | Hyperactivity-Impulsivity |
| 11494 | Dennis (2010) | Canada | 1 | 319 | 2.50 | 3 | 4.00 | Aggression, Difficult Temperament |
| 11596 | Muñoz et al. (2011) | UK | 1 | 81 | 14.50 | 2 | 1.00 | Callous Unemotional, Delinquency |
| 11644 | Lüdtke et al. (2011) | Germany | 1 | 4544 | 19.51 | 3 | 4.00 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness to Experience |
| 11761 | Kuzma et al. (2011) | Germany | 2 | 141 | 74.10 | 5 | 24.00 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness to Experience |
| 11851 | Hill & Burrow (2012) | US | 1 | 208 | 16.07 | 2 | 0.50 | Identity Commitment, Identity Exploration, Purpose Commitment, Purpose Exploration |
| 11937 | Šerek et al. (2012) | Czech Republic | 1 | 444 | 15.00 | 2 | 2.00 | Avoidant Coping Style |
| 11964 | Zavos et al. (2012) | UK | 1 | 2630 | 15.00 | 2 | 2.00 | Anxiety Sensitivity |
| 12027 | Windsor et al. (2012) | Australia | 1 | 2489 | 22.00 | 3 | 8.00 | Avoidance Sensitivity, Drive, Reward Responsiveness |
| 12027 | Windsor et al. (2012) | Australia | 2 | 2489 | 42.00 | 3 | 8.00 | Avoidance Sensitivity, Drive, Reward Responsiveness |
| 12027 | Windsor et al. (2012) | Australia | 3 | 2502 | 62.00 | 3 | 8.00 | Avoidance Sensitivity, Drive, Reward Responsiveness |
| 12055 | Duriez et al. (2012) | Belgium | 1 | 458 | 18.60 | 2 | 1.00 | Right Wing Authoritarianism |
| 12055 | Duriez et al. (2012) | Belgium | 2 | 590 | 14.90 | 2 | 1.00 | Right Wing Authoritarianism |
| 12059 | Edelstein et al. (2012) | US | 1 | 70 | 43.00 | 2 | 10.00 | Autonomy, Depression, Hypersensitivity, Willfulness |
| 12069 | Xia et al. (2012) | China | 1 | 320 | 13.93 | 2 | 0.50 | Flexibility, Independence, Initiative, Openness to Experience, Reappraisal, Responsibility, Suppression |
| 12078 | Barker et al. (2012) | UK | 1 | 2995 | 8.00 | 2 | 2.00 | Irritability |
| 12132 | Lee et al. (2013) | China | 1 | 401 | 7.70 | 2 | 3.90 | Anger Frustration, Effortful Control |
| 12136 | Brenning et al. (2013) | Belgium | 1 | 234 | 12.00 | 4 | 3.00 | Attachment Anxiety, Attachment Avoidance, Autonomy, Sociotropy |
| 12156 | Fortman (2012) | US | 1 | 147 | 16.62 | 4 | 1.50 | Hope |
| 12160 | Sun (2012) | US | 1 | 385 | 19.62 | 2 | 1.00 | Agreeableness, Conscientiousness |
| 12168 | Ericson (2012) | US | 1 | 587 | 9.58 | 2 | 5.29 | Aggression, Delinquency, Psychopathy |
| 12181 | Terrett et al. (2012) | Australia | 1 | 1308 | 7.50 | 2 | 4.00 | Aggression, Anxiety, Hyperactivity, Negative Reactivity, Persistence, Sociability |
| 12182 | Bould et al. (2013) | UK | 1 | 7429 | 3.20 | 3 | 2.60 | Activity, Emotionality, Shyness, Sociability, Sociability |
| 12246 | van der Voort et al. (2013) | Netherlands | 1 | 145 | 7.00 | 2 | 7.00 | Distracted Easily, Does not Stick with Activity, Easily Approaches Strangers, Easily Approaches Unfamiliar Children, Finishes Task, Shy in Presence of Unfamiliar People |
| 12306 | Martin et al. (2013) | Australia | 1 | 969 | 14.40 | 2 | 1.00 | Adaptability, Agreeableness, Buoyancy, Conscientiousness, Emotional Instability, Extraversion, Neuroticism, Openness to Experience, Self Regulation |
| 12385 | Fanti et al. (2014) | Cyprus | 1 | 904 | 9.50 | 2 | 1.00 | Callous Unemotional |
| 12433 | Taylor et al. (2013) | UK | 1 | 888 | 8.00 | 2 | 4.00 | Attention-Deficit-Hyperactivity-Disorder, Autism |
| 12435 | Josefsson et al. (2013) | Finland | 1 | 420 | 23.00 | 3 | 10.00 | Harm Avoidance, Novelty Seeking, Persistence, Reward Dependence, Self Directedness |
| 12435 | Josefsson et al. (2013) | Finland | 2 | 420 | 23.00 | 3 | 8.00 | Cooperativeness, Harm Avoidance, Novelty Seeking, Persistence, Reward Dependence, Self Directedness |
| 12435 | Josefsson et al. (2013) | Finland | 3 | 631 | 23.00 | 3 | 8.00 | Cooperativeness, Harm Avoidance, Novelty Seeking, Persistence, Reward Dependence, Self Transcendence |
| 12435 | Josefsson et al. (2013) | Finland | 4 | 631 | 32.00 | 3 | 10.00 | Harm Avoidance, Novelty Seeking, Persistence, Reward Dependence, Self Transcendence |
| 12440 | Vecchione et al. (2013) | Italy | 1 | 104 | 15.00 | 3 | 6.00 | Egoistic Enhancement, Moralistic Enhancement |
| 12473 | Hayden et al. (2013) | US | 1 | 205 | 7.37 | 3 | 2.26 | Attributional Style for Negative Events, Attributional Style for Positive Events |
| 12481 | Spence et al. (2013) | US | 1 | 1208 | 14.51 | 2 | 2.95 | Activity, Emotionality, Shyness, Sociability |
| 12499 | Malmberg et al. (2013) | Netherlands | 1 | 1068 | 12.92 | 4 | 2.67 | Anxiety, Hopelessness, Impulsivity, Sensation Seeking |
| 12665 | Childs et al. (2014) | US | 1 | 120 | 10.56 | 4 | 3.00 | Antisocial Behavior, Callous Unemotional |
| 12750 | Taylor et al. (2014) | US | 1 | 82 | 18.05 | 2 | 0.78 | Ego Resiliency |
| 12759 | Galla et al. (2014) | US | 1 | 135 | 8.40 | 3 | 2.00 | Academic Self Efficacy |
| 12803 | Karukivi et al. (2014) | Finland | 1 | 315 | 19.00 | 2 | 4.00 | Alexithymia |
| 12825 | Kanacri et al. (2014) | Italy | 1 | 573 | 13.00 | 2 | 8.00 | Agreeableness, Conscientiousness, Emotional Stability, Energy, Openness to Experience |
| 12842 | Hull et al. (2014) | US | 1 | 5019 | 13.80 | 2 | 0.70 | Rebelliousness, Sensation Seeking |
| 12848 | Klimstra et al. (2014) | Netherlands | 1 | 485 | 18.63 | 4 | 3.00 | Activity, Aesthetic Interests, Agreeableness, Anxiety, Conscientiousness, Dependability, Depression, Extraversion, Goal Striving, Intellectual Interests, Neuroticism, Nonantoganistic Orientation, Openness to Experience, Orderliness, Positive Affect, Prosocial Orientation, Self Reproach, Sociability, Unconventionality |
| 12853 | Banny et al. (2014) | US | 1 | 196 | 10.11 | 2 | 1.00 | Borderline Personality Features, Proactive Physical Aggression, Proactive Relational Aggression, Reactive Physical Aggression, Reactive Relational Aggression |
| 12882 | Van den Akker et al. (2014) | Belgium | 1 | 576 | 7.50 | 5 | 11.00 | Benevolence, Conscientiousness, Emotional Stability, Extraversion, Imagination |
| 12975 | Rosander et al. (2014) | Sweden | 1 | 197 | 16.00 | 2 | 3.00 | Achievement Striving, Activity, Adventurousness, Agreeableness, Altruism, Anger, Anxiety, Artistic Interests, Assertiveness, Cautiousness, Cheerfulness, Conscientiousness, Cooperation, Depression, Dutifulness, Emotionality, Excitement Seeking, Extraversion, Friendliness, Gregariousness, Imagination, Intellect, Modesty, Morality, Neuroticism, Openness to Experience, Orderliness, Self Consciousness, Self Discipline, Self Efficacy, Sympathy, Trust, Vulnerability |
| 13017 | Laceulle et al. (2015) | Netherlands | 1 | 1475 | 11.10 | 3 | 8.00 | Affiliation, Effortful Control, Fear, Frustration, Shyness |
| 13062 | Settles et al. (2014) | US | 1 | 1843 | 11.00 | 3 | 1.00 | Positive Urgency |
| 13070 | Leikas & Salmela-Aro (2015) | Finland | 1 | 597 | 20.00 | 2 | 3.00 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness to Experience |
| 13092 | Allemand et al. (2015) | Switzerland | 2 | 346 | 47.80 | 2 | 8.00 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness to Experience |
| 13180 | Slagt et al. (2015) | Netherlands | 1 | 285 | 15.50 | 2 | 1.00 | Delinquency |
| 13190 | Hallquist et al. (2015) | US | 1 | 2228 | 14.00 | 5 | 4.00 | Borderline Personality Symptoms, Negative Emotionality, Poor Self Control |
| 13198 | Clark et al. (2015) | US | 1 | 674 | 10.40 | 2 | 3.87 | Aggression, Depressive Mood, Surgency |
| 13212 | Orth & Luciano (2015) | Switzerland | 1 | 328 | 21.20 | 4 | 1.50 | Narcissism |
| 13212 | Orth & Luciano (2015) | Switzerland | 2 | 371 | 29.00 | 2 | 0.50 | Narcissism |
| 13233 | Weybright et al. (2015) | South Africa | 1 | 2580 | 14.50 | 7 | 5.14 | Leisure Boredom, Restructuring |
| 13262 | Dekker et al. (2015) | Netherlands | 1 | 1620 | 11.11 | 2 | 2.44 | Autism |
| 13262 | Dekker et al. (2015) | Netherlands | 2 | 67 | 11.11 | 2 | 2.44 | Autism |
| 13298 | Ashenhurst et al. (2015) | US | 1 | 2245 | 18.00 | 3 | 6.00 | Impulsivity, Sensation Seeking |
| 13410 | Grevenstein & Bluemke (2015) | Germany | 1 | 286 | 15.00 | 2 | 9.00 | Self Efficacy, Sense of Coherence |
| 13462 | LeRoy (2015) | US | 1 | 164 | 0.25 | 2 | 0.75 | Dull Temperament, Fussy Temperament, Unadaptable Temperament, Unpredictable Temperament |
| 13574 | Luan et al. (2016) | Germany | 1 | 173 | 12.00 | 3 | 17.00 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness to Experience |
| 13574 | Luan et al. (2016) | Netherlands | 2 | 576 | 14.50 | 3 | 2.00 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness to Experience |
| 13576 | Greischel et al. (2016) | Germany | 1 | 741 | 15.63 | 2 | 0.87 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness to Experience |
| 13596 | Romero & Alonso (2015) | Spain | 1 | 192 | 8.05 | 2 | 5.88 | Distraction Attention Problems, Hyperactivity Impulsivity |
| 13615 | Song (2016) | US | 1 | 208 | 6.00 | 2 | 4.00 | Externalizing Behaviors |
| 13627 | Tian et al. (2016) | China | 1 | 114 | 19.96 | 2 | 0.74 | Anxiety |
| 13636 | Eisenbarth et al. (2016) | Cyprus | 1 | 1537 | 17.00 | 2 | 1.00 | Callous Unemotional, Conduct Disorder |
| 13636 | Eisenbarth et al. (2016) | Cyprus | 2 | 180 | 17.00 | 2 | 1.00 | Callous Unemotional, Conduct Disorder |
| 13636 | Eisenbarth et al. (2016) | Cyprus | 3 | 111 | 17.00 | 2 | 1.00 | Callous Unemotional, Conduct Disorder |
| 13636 | Eisenbarth et al. (2016) | Cyprus | 4 | 114 | 17.00 | 2 | 1.00 | Callous Unemotional, Conduct Disorder |
| 13636 | Eisenbarth et al. (2016) | Cyprus | 5 | 96 | 17.00 | 2 | 1.00 | Callous Unemotional, Conduct Disorder |
| 13672 | Wetzel & Robins (2016) | US | 1 | 674 | 14.00 | 2 | 2.00 | Exploitativeness, Narcissism, Superiority |
| 13676 | Joyce et al. (2016) | US | 1 | 69 | 3.00 | 2 | 1.00 | Inhibitory Control |
| 13769 | Baardstu et al. (2016) | Norway | 1 | 937 | 1.50 | 3 | 3.00 | Difficultness |
| 13786 | Meldrum et al. (2016) | US | 1 | 1022 | 9.00 | 3 | 2.00 | Self Control |
| 13821 | Fossati et al. (2016) | Italy | 1 | 805 | 16.43 | 2 | 0.50 | Borderline Personality Features |
| 20040 | Jambon & Smetana (2018) | US | 1 | 135 | 5.64 | 2 | 0.75 | Aggression |
| 20052 | Burris et al. (2017) | US | 1 | 1906 | 10.75 | 8 | 4.00 | Negative Affect, Urgency |
| 20079 | Zhang & Ziegler (2018) | China | 1 | 836 | 15.35 | 3 | 1.75 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness |
| 20087 | Christensen et al. (2017) | Australia | 1 | 4983 | 4.75 | 6 | 10.07 | Psychosocial Functioning |
| 20115 | Golle et al. (2019) | Germany | 1 | 212 | 16.70 | 2 | 6.00 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness |
| 20117 | Asendorpf & Motti-Stefanidi (2018) | Greece | 1 | 1118 | 12.60 | 3 | 2.00 | Agreeableness, Conduct Being, Conscientiousness, Emotional Stability, Extraversion, Openness |
| 20171 | Van der Graaff et al. (2018) | Netherlands | 1 | 283 | 13.03 | 6 | 5.00 | Empathic Concern, Perspective Taking, Prosocial Behavior |
| 20210 | Damian et al. (2019) | US | 1 | 1795 | 16.00 | 2 | 51.00 | Calmness, Culture, Impulsiveness, Leadership, Mature Personality, Self Confidence, Sociability, Social Sensitivity, Tidiness, Vigor |
| 20265 | Stavropoulos et al. (2018) | Greece | 1 | 515 | 15.68 | 2 | 1.99 | Emotional Stability |
| 20284 | Bornstein et al. (2019) | UK | 1 | 9115 | 3.21 | 3 | 2.59 | Activity Level, Emotionality, Shyness, Sociability |
| 20290 | Fisher & Brown (2018) | US | 1 | 357 | 8.06 | 2 | 6.99 | Delinquency |
| 20294 | Whipp et al. (2018) | Finland | 1 | 1302 | 12.00 | 2 | 2.00 | Aggression |
| 20296 | Thartori et al. (2018) | Italy | 1 | 106 | 12.34 | 3 | 1.97 | Externalizing Behavior, Inhibitory Control |
| 20304 | Israel et al. (2019) | Germany | 1 | 4355 | 12.90 | 2 | 2.00 | Agreeableness, Conscientiousness, Externalizing, Neuroticism, Openness |
| 20338 | Suen et al. (2018) | China | 1 | 92 | 24.75 | 2 | 0.50 | Hope |
| 20351 | Kienbaum et al. (2018) | Italy | 1 | 85 | 5.85 | 3 | 1.80 | Aggression, Inhibition, Sympathy |
| 20357 | Wang et al. (2018) | NA | 1 | 214 | 6.08 | 2 | 1.58 | Attention Focusing, Impulsivity, Inhibitory Control, Resiliency |
| 20366 | Nichols et al. (2019) | US | 1 | 129 | 19.10 | 2 | 0.80 | Constraint, Negative Emotionality |
| 20366 | Nichols et al. (2019) | US | 2 | 80 | 19.10 | 2 | 0.80 | Constraint, Negative Emotionality |
| 20368 | Stephan et al. (2019) | US | 1 | 4279 | 53.18 | 2 | 18.50 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness |
| 20373 | Skinner et al. (2019) | US | 1 | 352 | 12.04 | 3 | 2.00 | Expressivity, Instrumentality |
| 20388 | Wagers & Kiel (2019) | US | 1 | 117 | 2.00 | 2 | 1.00 | Empathy |
| 20408 | Wettstein et al. (2019) | Germany | 1 | 500 | 62.87 | 4 | 21.00 | Agreeableness, Conscientiousness, Extraversion, Neuroticism |
| 20409 | Gómez-Baya & Mendoza (2018) | Spain | 1 | 880 | 14.74 | 2 | 1.00 | Depressive Rumination, Distraction, Emotional Attention, Emotional Clarity, Emotional Repair |
| 20419 | Rawlings et al. (2019) | Finland | 1 | 212 | 13.50 | 3 | 2.00 | Sensitivity to Punishment, Sensitivity to Reward |
| 20443 | Schwaba et al. (2019) | US | 1 | 489 | 18.58 | 3 | 23.00 | Aesthetic Interests, Intellectual Interests, Unconventionality |
| 20458 | Ilmarinen et al. (2019) | Finland | 1 | 618 | 7.47 | 3 | 5.35 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness |
| 20464 | Luan & Bleidorn (2019) | Netherlands | 1 | 570 | 14.50 | 2 | 1.00 | Internalizing Problems |
| 20475 | Negru et al. (2019) | Romania | 1 | 971 | 16.45 | 2 | 0.63 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness |
| 20478 | Brandt et al. (2019) | US | 1 | 3655 | 10.50 | 6 | 10.00 | Impulse Control |
| 20480 | Wang & Xia (2019) | China | 1 | 932 | 20.83 | 2 | 0.50 | Hostility |
| 20516 | Van Heel et al. (2019) | Belgium | 1 | 1116 | 13.79 | 3 | 1.95 | Agreeableness, Conscientiousness |
| 20535 | MacDonell & Willoughby (2019) | Canada | 1 | 1201 | 10.74 | 2 | 1.00 | Aggression, Honesty Humility, Impulsivity |
| 20542 | Fosco et al. (2019) | US | 1 | 387 | 12.09 | 3 | 2.02 | Inhibitory Control |
| 20641 | Damian et al. (2017) | Romania | 1 | 386 | 15.90 | 2 | 0.77 | Perfectionistic Concerns, Perfectionistic Strivings |
| 20646 | Frogner et al. (2018) | Sweden | 1 | 885 | 3.86 | 3 | 2.00 | Conduct Problems |
| 20661 | Wei (2018) | China | 1 | 612 | 15.84 | 2 | 1.00 | Approach, Avoidance, Prevention Focus, Promotion Focus |
| 20661 | Wei (2018) | China | 2 | 1075 | 12.89 | 2 | 1.00 | Anxiety |
| 20690 | Zubizarreta et al. (2019) | Spain | 1 | 262 | 8.47 | 2 | 0.67 | Aggressive Behavior, Depression, Rule Breaking, Somatization |
| 20690 | Zubizarreta et al. (2019) | Spain | 2 | 308 | 8.47 | 2 | 0.67 | Aggressive Behavior, Depression, Rule Breaking, Somatization |
| 20750 | Hong et al. (2017) | Singapore | 1 | 263 | 8.00 | 3 | 3.00 | Critical Self Oriented Perfectionism, Socially Prescribed Perfectionism |
| 20758 | Oshri et al. (2018) | US | 1 | 9421 | 16.20 | 2 | 5.00 | Impulsivity |
| 20763 | Vaillancourt & Brittain (2019) | Canada | 1 | 253 | 14.00 | 5 | 4.00 | Anxiety, Borderline Personality Features, Primary Psychopathic Traits, Secondary Psychopathic Traits |
| 20763 | Vaillancourt & Brittain (2019) | Canada | 2 | 319 | 14.00 | 5 | 4.00 | Anxiety, Borderline Personality Features, Primary Psychopathic Traits, Secondary Psychopathic Traits |
| 20771 | Sijtsema et al. (2019) | Netherlands | 1 | 253 | 13.57 | 3 | 2.00 | Delinquency, Direct Aggression, Indirect Aggression, Machiavellianism, Narcissism, Psychopathy |
| 20771 | Sijtsema et al. (2019) | Netherlands | 2 | 241 | 13.57 | 3 | 2.00 | Machiavellianism, Narcissism, Psychopathy |
| 20778 | Kechter & Leventhal (2019) | US | 1 | 2309 | 15.50 | 2 | 1.00 | Absorption, Appraisal, Regulation, Tolerance |
| 20780 | Liu & Xia (2018) | China | 1 | 502 | 16.60 | 2 | 0.50 | Interpersonal Flexibility, Interpersonal Independence, Interpersonal Initiative, Interpersonal Responsibility |
| 20839 | Guarneri-White (2018) | US | 1 | 95 | 12.88 | 2 | 2.96 | Neuroticism |
| 20971 | Holzman (2019) | NA | 1 | 117 | 1.50 | 2 | 0.50 | Fear, Inhibitory Control, Shyness |
| 21069 | Farrell et al. (2019) | Canada | 1 | 296 | 15.00 | 3 | 2.00 | Empathic Concern, Exploitation |
| 21069 | Farrell et al. (2019) | Canada | 2 | 235 | 15.00 | 3 | 2.00 | Empathic Concern, Exploitation |
| 21077 | Schwaba & Bleidorn (2018) | Netherlands | 1 | 252 | 15.00 | 5 | 6.00 | Agreeableness, Conscientiousness, Emotional Stability, Extraversion, Openness |
| 21077 | Schwaba & Bleidorn (2018) | Netherlands | 2 | 254 | 20.00 | 5 | 6.00 | Agreeableness, Conscientiousness, Emotional Stability, Extraversion, Openness |
| 21077 | Schwaba & Bleidorn (2018) | Netherlands | 3 | 256 | 25.00 | 5 | 6.00 | Agreeableness, Conscientiousness, Emotional Stability, Extraversion, Openness |
| 21077 | Schwaba & Bleidorn (2018) | Netherlands | 4 | 359 | 30.00 | 5 | 6.00 | Agreeableness, Conscientiousness, Emotional Stability, Extraversion, Openness |
| 21077 | Schwaba & Bleidorn (2018) | Netherlands | 5 | 473 | 35.00 | 5 | 6.00 | Agreeableness, Conscientiousness, Emotional Stability, Extraversion, Openness |
| 21077 | Schwaba & Bleidorn (2018) | Netherlands | 6 | 483 | 40.00 | 5 | 6.00 | Agreeableness, Conscientiousness, Emotional Stability, Extraversion, Openness |
| 21077 | Schwaba & Bleidorn (2018) | Netherlands | 7 | 529 | 45.00 | 5 | 6.00 | Agreeableness, Conscientiousness, Emotional Stability, Extraversion, Openness |
| 21077 | Schwaba & Bleidorn (2018) | Netherlands | 8 | 521 | 50.00 | 5 | 6.00 | Agreeableness, Conscientiousness, Emotional Stability, Extraversion, Openness |
| 21077 | Schwaba & Bleidorn (2018) | Netherlands | 9 | 527 | 55.00 | 5 | 6.00 | Agreeableness, Conscientiousness, Emotional Stability, Extraversion, Openness |
| 21077 | Schwaba & Bleidorn (2018) | Netherlands | 10 | 530 | 60.00 | 5 | 6.00 | Agreeableness, Conscientiousness, Emotional Stability, Extraversion, Openness |
| 21077 | Schwaba & Bleidorn (2018) | Netherlands | 11 | 371 | 65.00 | 5 | 6.00 | Agreeableness, Conscientiousness, Emotional Stability, Extraversion, Openness |
| 21077 | Schwaba & Bleidorn (2018) | Netherlands | 12 | 197 | 70.00 | 5 | 6.00 | Agreeableness, Conscientiousness, Emotional Stability, Extraversion, Openness |
| 21077 | Schwaba & Bleidorn (2018) | Netherlands | 13 | 116 | 75.00 | 5 | 6.00 | Agreeableness, Conscientiousness, Emotional Stability, Extraversion, Openness |
Note: Data for the study with the ID 20646 was send after the deadline so that it was not included in the estimation of the spline-approach but in the estimation of all resulting models.
Haehner et al. (2024): StudyIDs N1 to N1400
studies.new <- filter(studies, Source == "0") %>% select(-Source)
kable(studies.new
, caption="**Overview of Included Studies from Haehner et al. (2024)**"
, escape=FALSE
, label = NA) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| StudyID | Reference | Country | SampleID | N at T1 | Age at T1 | Number of waves | Total time lag | Traits |
|---|---|---|---|---|---|---|---|---|
| N1018 | Stolarski et al. (2021) | Poland | 1 | 162 | 16.82 | 2 | 1.00 | Behavioral Activation System Fun Seeking, Behavioral Activation System Drive, Behavioral Inhibition |
| N1025 | Boyle & Rogers (2023) | US | 1 | 147 | 19.88 | 2 | 0.50 | Self-sentiments Evaluation, Self-sentiments Potency |
| N1028 | Luan & Bleidorn (2020) | Netherlands | 1 | 570 | 14.50 | 2 | 1.00 | Anxiety/Depression, Withdrawal |
| N1047 | Negru-Subtirica et al. (2020) | Romania | 1 | 971 | 16.45 | 2 | 0.60 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness |
| N1059 | Atherton et al. (2021) | USA | 1 | 489 | 18.60 | 3 | 24.00 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness |
| N1067 | Plachti et al. (2023) | Denmark | 1 | 66 | 12.94 | 4 | 2.50 | Neuroticism |
| N1080 | Hirschi & Spurk (2021) | Germany | 1 | 394 | 30.51 | 2 | 0.50 | Ambition |
| N1153 | Ringwald et al. (2023) | US | 1 | 604 | 14.00 | 5 | 9.00 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness |
| N1154 | Lawson et al. (2023) | USA | 1 | 668 | 10.90 | 4 | 6.00 | Shyness |
| N1155 | Wang et al. (2020) | USA | 1 | 3073 | 13.00 | 6 | 5.00 | Personality Hardiness – External Locus of Control |
| N1173 | Zhang et al. (2022) | China | 1 | 235 | 14.85 | 2 | 0.50 | Antagonism, Constraint, Detachment, Disinhibition, Negative Affectivity, Psychoticism |
| N1202 | Quan et al. (2021) | China | 1 | 942 | 21.09 | 2 | 0.50 | Aggression, Agreeableness, Anger Rumination |
| N1204 | Li & Xia (2020) | China | 1 | 1209 | 18.92 | 3 | 1.00 | Anger Rumination Tendency, Hostile Attribution Tendency, Social Aggression, Trait Anger |
| N1207 | Yang et al. (2023) | China | 1 | 1977 | 12.75 | 3 | 2.00 | Trait Anger |
| N1209 | Afzali et al. (2020) | Canada | 1 | 3800 | 12.80 | 4 | 3.00 | Anxiety Sensitivity, Hopelessness, Impulsivity, Sensation Seeking |
| N1219 | Zhou et al. (2023) | China | 1 | 2722 | 16.30 | 2 | 0.50 | Mindfulness |
| N1226 | Zhao et al. (2023) | China | 1 | 153 | 21.79 | 2 | 0.92 | Schizotypal Personality |
| N1239 | Atherton et al. (2020) | US | 1 | 674 | 10.86 | 4 | 6.00 | Effortful Control |
| N1253 | Lawson et al. (2022) | NA | 1 | 580 | 12.81 | 3 | 4.00 | Positive Emotionality |
| N1257 | Stolarski et al. (2021) | Poland | 1 | 169 | 16.80 | 2 | 1.00 | Agreeableness, Conscientiousness, Emotional Stability, Extraversion, Intellect |
| N1273 | Negru-Subtirica et al. (2021) | Romania | 1 | 744 | 15.20 | 2 | 0.58 | Ruminative Exploration, Self Oriented Perfectionism, Socially Prescribed Perfectionism |
| N1280 | Loukas et al. (2021) | US | 1 | 4037 | 20.46 | 5 | 2.00 | Impulsivity, Sensation Seeking |
| N1303 | Shi et al. (2020) | USA | 1 | 675 | 6.57 | 7 | 6.00 | Externalizing Problems, Internalizing Problems |
| N1306 | Zhou et al. (2023) | China | 1 | 3307 | 11.30 | 4 | 3.00 | Extraversion, Neuroticism |
| N1313 | Dunlop et al. (2021) | Australia | 1 | 214 | 25.20 | 2 | 2.00 | Diligence, Flexibility, Forgiveness, Gentleness, Organized, Patience, Perfectionism, Prudence |
| N1347 | Teng et al. (2022) | China | 1 | 774 | 13.50 | 3 | 1.00 | Aggressiveness |
| N1353 | Lasko & Chester (2021) | USA | 1 | 1079 | 16.55 | 10 | 4.50 | Grandiose Manipulative Psychopathy Traits, Impulse Control, Impulsive Irresponsible Psychopathy Traits, Suppression of Aggression |
| N1360 | Wang et al. (2022) | China | 1 | 1074 | 21.12 | 2 | 0.50 | Neuroticism |
| N1371 | Speyer et al. (2022) | UK | 1 | 9374 | 4.00 | 7 | 12.00 | Conduct Problems, Emotional Problems, Hyperactivity, Peer Problems, Prosociality |
| N164 | Colvert et al. (2022) | UK | 1 | 111 | 4.00 | 2 | 3.00 | Conduct Problems, Emotional Difficulties, Hyperactivity |
| N177 | Neville et al. (2021) | Ireland | 1 | 8824 | 3.00 | 4 | 6.00 | Externalizing Behavior, Internalizing Behavior |
| N178 | López-Romero et al. (2021) | Spain | 1 | 1833 | 4.24 | 2 | 1.00 | Callous Unemotional Psychopathy Component, Conduct Problems, Impulsive Need of Stimulation, Interpersonal Psychopathy Component |
| N198 | Farrell & Vaillancourt (2020) | Canada | 1 | 616 | 12.91 | 6 | 5.00 | Narcistic Personality Trait |
| N209 | Defoe et al. (2022) | USA | 1 | 364 | 13.51 | 4 | 3.00 | Antisocial Behavior, Impulsivity |
| N219 | Halvorson (2023) | USA | 1 | 246 | 13.00 | 5 | 12.00 | Active Coping, Active Problem Focused Coping, Avoidant Coping, Emotionality Temperament, Impulsivity Temperament |
| N221 | Falch-Madsen et al. (2021) | Norway | 1 | 1007 | 4.59 | 5 | 8.00 | Emotion Regulation |
| N224 | Olson et al. (2023) | USA | 1 | 941 | 12.37 | 3 | 4.00 | Externalizing Problems, Internalizing Problems |
| N225 | Tamm et al. (2021) | Estonia | 1 | 567 | 5.96 | 2 | 2.00 | Benevolence, Conscientiousness, Emotional Stability, Extraversion, Imagination |
| N238 | Sesker et al. (2021) | Australia | 1 | 8416 | 8.88 | 4 | 6.00 | Persistence, Reactivity, Sociability |
| N251 | Goh et al. (2020) | USA | 1 | 525 | 18.95 | 3 | 2.00 | Lack of Perseverance, Lack of Premeditation, Negative Urgency, Positive Urgency, Sensation Seeking |
| N270 | Cardinale et al. (2023) | NA | 1 | 89 | 2.00 | 8 | 13.00 | Anxiety, Irritability |
| N304 | Hassan et al. (2021) | Canada | 1 | 1284 | 10.72 | 3 | 2.00 | Emotion Reactivity, Emotion Regulation, Shyness |
| N318 | Hoff et al. (2020) | Iceland | 1 | 485 | 15.30 | 4 | 8.00 | Agreeableness, Conscientiousness, Emotional Stability, Extraversion, Openness |
| N321 | Jones et al. (2022) | US | 1 | 813 | 16.16 | 5 | 3.86 | Agreeableness, Conscientiousness, Emotional Stability, Extraversion, Openness |
| N358 | Cheng et al. (2023) | USA | 1 | 674 | 10.90 | 4 | 6.00 | Negative Emotionality |
| N373 | Molnar et al. (2023) | Canada | 1 | 185 | 17.96 | 2 | 0.75 | Anxiety, Self Oriented Perfectionism, Socially Prescribed Perfectionism |
| N38 | Prince et al. (2021) | US | 1 | 489 | 18.60 | 2 | 6.50 | Extraversion, Neuroticism |
| N397 | Garofalo et al. (2021) | USA | 1 | 784 | 16.00 | 4 | 9.00 | Boldness, Disinhibition, Meanness |
| N408 | Farrell et al. (2020) | Canada | 1 | 296 | 14.96 | 2 | 1.00 | Empathic Concern |
| N416 | Lei et al. (2020) | UK | 1 | 182 | 18.27 | 2 | 0.50 | Social Anxiety |
| N429 | Farell & Vaillancourt (2021) | Canada | 1 | 255 | 14.95 | 3 | 2.00 | Machiavellianism |
| N429 | Farell & Vaillancourt (2021) | Canada | 2 | 193 | 14.95 | 3 | 2.00 | Indirect Aggression, Machiavellianism |
| N455 | Brandes et al. (2021) | Canada | 1 | 328 | 9.97 | 4 | 3.09 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness to Experience |
| N482 | Hill et al. (2022) | Sweden | 1 | 5263 | 63.09 | 6 | 5.00 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness |
| N524 | Marciano et al. (2021) | Switzerland | 1 | 420 | 13.36 | 2 | 1.00 | Antagonism, Detachment, Disinhibition, Negative Affect, Psychoticism |
| N524 | Marciano et al. (2021) | Switzerland | 2 | 459 | 13.36 | 2 | 1.00 | Antagonism, Detachment, Disinhibition, Negative Affect |
| N548 | Syrén et al. (2020) | Finland | 1 | 163 | 42.00 | 2 | 8.00 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness to Experiences |
| N586 | Vaughan et al. (2023) | US | 1 | 1216 | 15.29 | 6 | 5.00 | Callous Unemotional Traits |
| N620 | Bondü et al. (2020) | Germany | 1 | 708 | 16.77 | 2 | 1.50 | Angry Rejection Sensitivity, Anxious Rejection Sensitivity |
| N642 | Lee et al. (2022) | China | 1 | 247 | 20.96 | 2 | 0.50 | Mindfulness |
| N652 | Zhang et al. (2020) | China | 1 | 2067 | 10.85 | 3 | 1.00 | Depression, Neuroticism |
| N652 | Zhang et al. (2020) | China | 2 | 1624 | 10.85 | 3 | 1.00 | Depression, Neuroticism |
| N653 | Hwang et al. (2022) | South Korea | 1 | 213 | 11.03 | 2 | 0.75 | Antisocial Behavior, Callous Unemotional Traits |
| N659 | Kochanova (2023) | US | 1 | 333 | 14.17 | 2 | 0.50 | Proactive Aggression, Reactive Aggression |
| N660 | Davis et al. (2022) | US | 1 | 446 | 15.91 | 3 | 2.00 | Delinquency |
| N661 | Etkin et al. (2022) | Spain | 1 | 411 | 14.35 | 3 | 2.00 | Agreeableness, Conscientiousness, Extraversion, Neuroticism |
| N662 | Borghuis et al. (2020) | Netherlands | 1 | 859 | 13.10 | 6 | 5.00 | Neuroticism |
| N676 | Baardstu et al. (2020) | Norway | 1 | 479 | 1.50 | 5 | 11.00 | Shyness |
| N688 | Wissenburg et al. (2022) | Netherlands | 1 | 958 | 20.00 | 2 | 1.50 | Aggression, Agreeableness, Conscientiousness, Empathy, Impulsivity, Prosocial Behavior, Self Control, Sensation Seeking |
| N729 | Stephan et al. (2021) | US | 1 | 3232 | 64.28 | 2 | 7.00 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness |
| N739 | Ma et Xiang (2023) | China | 1 | 504 | 15.11 | 2 | 0.70 | Mindfulness |
| N77 | Raufelder et al. (2021) | Germany | 1 | 41 | 15.63 | 2 | 1.85 | Agreeableness, Autonomy, Conscientiousness, Emotional Instability, Extraversion |
| N828 | Hatano et al. (2023) | Japan | 1 | 618 | 16.00 | 4 | 3.00 | Agreeableness, Conscientiousness, Externalizing Problems, Extraversion, Internalizing Problems, Neuroticism, Openness |
| N829 | Goldstein et al. (2021) | USA | 1 | 767 | 19.19 | 2 | 5.00 | Anxiety, Extraversion, Neuroticism |
| N83 | Wrzus et al. (2023) | Germany | 1 | 253 | 21.80 | 7 | 4.00 | Agreeableness, Conscientiousness, Emotional Stability, Extraversion, Openness |
| N831 | Kaniušonytė & Laursen (2022) | Lithuania | 1 | 442 | 17.14 | 2 | 1.00 | Agreeableness, Neuroticism, Resilience |
| N832 | Seong et al. (2021) | South Korea | 1 | 336 | 15.83 | 2 | 0.50 | Concern over Mistakes, Discrepancy, High Standards, Personal Standards |
| N84 | Pueyo et al. (2022) | Spain | 1 | 313 | 3.00 | 11 | 10.00 | Callous Unemotional Traits Total Score, Conduct Problems |
| N84 | Pueyo et al. (2022) | Spain | 2 | 307 | 3.00 | 11 | 10.00 | Callous Unemotional Traits Total Score, Conduct Problems |
| N850 | Oltmanns et al. (2020) | US | 1 | 1612 | 62.50 | 3 | 6.50 | Agreeableness, Conscientiousness, Extraversion, Neuroticism, Openness |
| N852 | van Dijk et al. (2020) | Netherlands | 1 | 683 | 12.70 | 6 | 9.00 | Agreeableness, Conscientiousness, Emotional Stability, Extraversion, Openness to Experiences |
| N852 | van Dijk et al. (2020) | Netherlands | 2 | 268 | 16.87 | 6 | 9.00 | Agreeableness, Conscientiousness, Emotional Stability, Extraversion, Openness to Experiences |
| N882 | Finik et al. (2020) | US | 1 | 235 | 0.50 | 4 | 1.50 | Negative Affect |
| N889 | De Clerq et al. (2021) | NA | 1 | 720 | 10.73 | 4 | 6.00 | Aggressive Traits, Dominance, Impulsivity, Lack of Empathy, Narcissism, Resistance |
| N951 | Hřebíčková et al. (2023) | Czech Republic | 1 | 85 | 19.07 | 2 | 0.50 | Agreeableness, Conscientiousness, Emotional Stability, Extraversion, Openness |
| N968 | Brumback et al. (2021) | US | 1 | 774 | 16.71 | 4 | 3.00 | Lack of Perseverance, Negative Urgency, Sensation Seeking |
numbers <- data.frame(
Construct = c("Total", "Agreeableness", "Conscientiousness", "Extraversion", "Neuroticism",
"Openness"),
`Number of studies` = c(length(unique(data_all$StudyID)), length(unique(data_agree$StudyID)),
length(unique(data_consc$StudyID)), length(unique(data_extra$StudyID)),
length(unique(data_neuro$StudyID)), length(unique(data_open$StudyID))),
`Roberts` = c(length(unique(filter(data_all, Source == 2)$StudyID)),
length(unique(filter(data_agree, Source == 2)$StudyID)),
length(unique(filter(data_consc, Source == 2)$StudyID)),
length(unique(filter(data_extra, Source == 2)$StudyID)),
length(unique(filter(data_neuro, Source == 2)$StudyID)),
length(unique(filter(data_open, Source == 2)$StudyID))),
`Bleidorn` = c(length(unique(filter(data_all, Source == 1)$StudyID)),
length(unique(filter(data_agree, Source == 1)$StudyID)),
length(unique(filter(data_consc, Source == 1)$StudyID)),
length(unique(filter(data_extra, Source == 1)$StudyID)),
length(unique(filter(data_neuro, Source == 1)$StudyID)),
length(unique(filter(data_open, Source == 1)$StudyID))),
`Haehner` = c(length(unique(filter(data_all, Source == 0)$StudyID)),
length(unique(filter(data_agree, Source == 0)$StudyID)),
length(unique(filter(data_consc, Source == 0)$StudyID)),
length(unique(filter(data_extra, Source == 0)$StudyID)),
length(unique(filter(data_neuro, Source == 0)$StudyID)),
length(unique(filter(data_open, Source == 0)$StudyID))),
Total = c(nrow(data_all), nrow(data_agree), nrow(data_consc), nrow(data_extra),
nrow(data_neuro), nrow(data_open)),
Roberts = c(nrow(filter(data_all, Source == 2)), nrow(filter(data_agree, Source == 2)),
nrow(filter(data_consc, Source == 2)), nrow(filter(data_extra, Source == 2)),
nrow(filter(data_neuro, Source == 2)), nrow(filter(data_open, Source == 2))),
Bleidorn = c(nrow(filter(data_all, Source == 1)), nrow(filter(data_agree, Source == 1)),
nrow(filter(data_consc, Source == 1)), nrow(filter(data_extra, Source == 1)),
nrow(filter(data_neuro, Source == 1)), nrow(filter(data_open, Source == 1))),
New = c(nrow(filter(data_all, Source == 0)), nrow(filter(data_agree, Source == 0)),
nrow(filter(data_consc, Source == 0)), nrow(filter(data_extra, Source == 0)),
nrow(filter(data_neuro, Source == 0)), nrow(filter(data_open, Source == 0)))
)
names(numbers) <- c("Construct", "Total", "Roberts", "Bleidorn", "Haehner",
"Total", "Roberts", "Bleidorn", "Haehner")
kable(numbers
, caption="**Numbers of effect sizes and studies for different traits**"
, escape=FALSE
, label = NA) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left") %>%
add_header_above(c(" " = 1, "Number of studies" = 4, "Number of effect sizes" = 4))
| Construct | Total | Roberts | Bleidorn | Haehner | Total | Roberts | Bleidorn | Haehner |
|---|---|---|---|---|---|---|---|---|
| Total | 229 | 22 | 129 | 78 | 2294 | 285 | 1349 | 660 |
| Agreeableness | 138 | 12 | 81 | 45 | 615 | 50 | 360 | 205 |
| Conscientiousness | 127 | 10 | 76 | 41 | 531 | 49 | 335 | 147 |
| Extraversion | 117 | 14 | 63 | 40 | 503 | 83 | 291 | 129 |
| Neuroticism | 185 | 17 | 101 | 67 | 816 | 101 | 461 | 254 |
| Openness | 73 | 10 | 43 | 20 | 306 | 37 | 190 | 79 |
## Unique samples
samples <- data_all %>% filter(duplicated(StudyID) == FALSE |
(duplicated(StudyID) == TRUE & duplicated(SampleID) == FALSE))
## Total number of participants
n.total <- sum(samples$T1_N, na.rm = TRUE)
In total, the meta-analysis includes data from 230492 participants.
## Metric characteristics
mod_metric <- data_all %>% select(Year, Alpha_T1, T2_lag, T1_AgeM, Female) %>% psych::describe() %>% select(c(2:4, 8, 9)) %>% round(2)
row.names(mod_metric) <- c("Publication year", "Cronbach's Alpha",
"Time lag between assessments", "Age at baseline",
"% Female")
names(mod_metric) <- c("Number of effect sizes", "Mean", "SD", "Min", "Max")
kable(mod_metric
, caption="**Descriptive statistics on metric moderators**"
, escape=FALSE
, label = NA) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| Number of effect sizes | Mean | SD | Min | Max | |
|---|---|---|---|---|---|
| Publication year | 2294 | 2014.47 | 8.04 | 1980.00 | 2023.00 |
| Cronbach’s Alpha | 1820 | 0.78 | 0.11 | 0.22 | 0.98 |
| Time lag between assessments | 2294 | 2.87 | 5.09 | 0.50 | 51.00 |
| Age at baseline | 2294 | 23.56 | 19.89 | 0.25 | 100.50 |
| % Female | 2242 | 53.08 | 24.73 | 0.00 | 100.00 |
All metric moderators were centered before conducting the analyses.
## Categorical variables
mod <- data_all %>% filter(Source == 0 | Source == 1 | Source == 2)
mod$Source <- droplevels.factor(mod$Source)
mod_cat <- rbind(as.data.frame(cbind(table(data_all$BigFive), round(prop.table(table(data_all$BigFive)),4) * 100)),
as.data.frame(cbind(table(data_all$OtherReport), round(prop.table(table(data_all$OtherReport)),4) * 100)),
as.data.frame(cbind(table(data_all$Facet), round(prop.table(table(data_all$Facet)),4) * 100)),
as.data.frame(cbind(table(data_all$Facet), round(prop.table(table(data_all$Facet)),4) * 100)),
as.data.frame(cbind(table(data_all$Represent), round(prop.table(table(data_all$Represent)),4) * 100)),
as.data.frame(cbind(table(data_all$Region), round(prop.table(table(mod$Region)),4) * 100)),
as.data.frame(cbind(table(data_agree$Inverse), round(prop.table(table(data_agree$Inverse)),4) * 100)),
as.data.frame(cbind(table(data_consc$Inverse), round(prop.table(table(data_consc$Inverse)),4) * 100)),
as.data.frame(cbind(table(data_extra$Inverse), round(prop.table(table(data_extra$Inverse)),4) * 100)),
as.data.frame(cbind(table(data_neuro$Inverse), round(prop.table(table(data_neuro$Inverse)),4) * 100)),
as.data.frame(cbind(table(data_open$Inverse), round(prop.table(table(data_open$Inverse)),4) * 100)))
names(mod_cat) <- c("Number of effect sizes", "Percentage of effect sizes")
row.names(mod_cat) <- NULL
mod_cat$Variable <- c("No", "Yes", "Self-report", "Other-report",
"No", "Yes", "No", "Yes", "No", "Yes",
"North America", "Asia", "Global South","Northern Europe",
"Southern Europe",
rep(c("No", "Yes"),5))
mod_cat <- mod_cat[, c(3,1,2)]
kable(mod_cat
, caption="**Descriptive statistics on categorical moderators**"
, escape=FALSE
, label = NA) %>%
pack_rows(index = c("Big Five taxonomy" = 2, "Report type" = 2,
"Assessed at facet level" = 2, "Maladaptive trait" = 2,
"Representative sample" = 2, "Region of origin" = 5,
"Agreeableness inverse coded" = 2,
"Conscientiousness inverse coded" = 2,
"Extraversion inverse coded" = 2,
"Neuroticism inverse coded" = 2,
"Openness inverse coded" = 2)) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| Variable | Number of effect sizes | Percentage of effect sizes |
|---|---|---|
| Big Five taxonomy | ||
| No | 1146 | 49.96 |
| Yes | 1148 | 50.04 |
| Report type | ||
| Self-report | 1672 | 72.89 |
| Other-report | 622 | 27.11 |
| Assessed at facet level | ||
| No | 1274 | 55.54 |
| Yes | 1020 | 44.46 |
| Maladaptive trait | ||
| No | 1274 | 55.54 |
| Yes | 1020 | 44.46 |
| Representative sample | ||
| No | 1662 | 74.03 |
| Yes | 583 | 25.97 |
| Region of origin | ||
| North America | 702 | 31.20 |
| Asia | 108 | 4.80 |
| Global South | 93 | 4.13 |
| Northern Europe | 1210 | 53.78 |
| Southern Europe | 137 | 6.09 |
| Agreeableness inverse coded | ||
| No | 308 | 50.08 |
| Yes | 307 | 49.92 |
| Conscientiousness inverse coded | ||
| No | 352 | 66.29 |
| Yes | 179 | 33.71 |
| Extraversion inverse coded | ||
| No | 413 | 82.11 |
| Yes | 90 | 17.89 |
| Neuroticism inverse coded | ||
| No | 654 | 80.15 |
| Yes | 162 | 19.85 |
| Openness inverse coded | ||
| No | 255 | 83.33 |
| Yes | 51 | 16.67 |
## Agreeableness
meta.base.agree <- rma.mv(yi = ES, V = V_agree,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_agree, sparse = TRUE)
sigma_base.level1_agree <- meta.base.agree$sigma2[1]
sigma_base.level2_agree <- meta.base.agree$sigma2[2]
results.base <- robust(meta.base.agree, cluster = StudyID, clubSandwich = TRUE)
base.agree <- round(c(results.base$beta, results.base$se, results.base$zval,
results.base$pval, exp(results.base$beta),
exp(results.base$ci.lb), exp(results.base$ci.ub)),3)
## Conscientiousness
meta.base.consc <- rma.mv(yi = ES, V = V_consc,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_consc, sparse = TRUE)
sigma_base.level1_consc <- meta.base.consc$sigma2[1]
sigma_base.level2_consc <- meta.base.consc$sigma2[2]
results.base <- robust(meta.base.consc, cluster = StudyID, clubSandwich = TRUE)
base.consc <- round(c(results.base$beta, results.base$se, results.base$zval,
results.base$pval, exp(results.base$beta),
exp(results.base$ci.lb), exp(results.base$ci.ub)),3)
## Extraversion
meta.base.extra <- rma.mv(yi = ES, V = V_extra,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_extra, sparse = TRUE)
sigma_base.level1_extra <- meta.base.extra$sigma2[1]
sigma_base.level2_extra <- meta.base.extra$sigma2[2]
results.base <- robust(meta.base.extra, cluster = StudyID, clubSandwich = TRUE)
base.extra <- round(c(results.base$beta, results.base$se, results.base$zval,
results.base$pval, exp(results.base$beta),
exp(results.base$ci.lb), exp(results.base$ci.ub)),3)
## Neuroticism
meta.base.neuro <- rma.mv(yi = ES, V = V_neuro,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_neuro, sparse = TRUE)
sigma_base.level1_neuro <- meta.base.neuro$sigma2[1]
sigma_base.level2_neuro <- meta.base.neuro$sigma2[2]
results.base <- robust(meta.base.neuro, cluster = StudyID, clubSandwich = TRUE)
base.neuro <- round(c(results.base$beta, results.base$se, results.base$zval,
results.base$pval, exp(results.base$beta),
exp(results.base$ci.lb), exp(results.base$ci.ub)),3)
## Openness
meta.base.open <- rma.mv(yi = ES, V = V_open,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_open, sparse = TRUE)
sigma_base.level1_open <- meta.base.open$sigma2[1]
sigma_base.level2_open <- meta.base.open$sigma2[2]
results.base <- robust(meta.base.open, cluster = StudyID, clubSandwich = TRUE)
base.open <- round(c(results.base$beta, results.base$se, results.base$zval,
results.base$pval, exp(results.base$beta),
exp(results.base$ci.lb), exp(results.base$ci.ub)),3)
## Create table
base.results <- as.data.frame(rbind(base.agree, base.consc, base.extra, base.neuro, base.open))
names(base.results) <- c("*b*", "*SE*", "*z*", "*p*", "SD~POMP~", "Lower CI", "Upper CI")
row.names(base.results) <- c("Agreeableness", "Conscientiousness", "Extraversion", "Neuroticism", "Openness")
kable(base.results
, caption="**Results: Meta-analysis without moderators**"
, escape=FALSE
, label = NA
, digits = 3) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| b | SE | z | p | SDPOMP | Lower CI | Upper CI | |
|---|---|---|---|---|---|---|---|
| Agreeableness | -1.996 | 0.031 | -63.627 | 0 | 0.136 | 0.128 | 0.145 |
| Conscientiousness | -1.927 | 0.032 | -60.644 | 0 | 0.146 | 0.137 | 0.155 |
| Extraversion | -1.963 | 0.032 | -60.672 | 0 | 0.140 | 0.132 | 0.150 |
| Neuroticism | -1.878 | 0.024 | -79.139 | 0 | 0.153 | 0.146 | 0.160 |
| Openness | -2.052 | 0.048 | -42.815 | 0 | 0.128 | 0.117 | 0.141 |
The b-coefficients of the meta-analytic models are difficult to interpret due to the logarithmic transformation of the effect sizes. The SDPOMP values are back-transformed, with higher values indicating more pronounced individual differences in change. They can be interpreted in the following way: A value of SDPOMP = 0.10, for example, indicates that people on average differ by about 10% of the maximum possible score from the overall mean-level trajectory. If a trait was assessed on a scale from 0 to 5, an SD[POMP] = 0.10 would indicate that the mean-level changes of an average person differed by 0.5 units from the overall mean-level trajectory (i.e., 0.10 * (5 - 0) = 0.5).
### Compute effect size in overall data frame
## Recode trait variables as factors
data_all$A.f <- as.factor(ifelse(data_all$A != 0, 1, 0))
data_all$C.f <- as.factor(ifelse(data_all$C != 0, 1, 0))
data_all$E.f <- as.factor(ifelse(data_all$E != 0, 1, 0))
data_all$N.f <- as.factor(ifelse(data_all$N != 0, 1, 0))
data_all$O.f <- as.factor(ifelse(data_all$O != 0, 1, 0))
## Create ID variables
data_all <- data_all %>%
group_by(StudyID) %>%
mutate(TraitID = as.numeric(factor(Trait, levels = unique(Trait))))
data_all <- data_all %>%
group_by(StudyID, TraitID, SampleID, T1_AgeM) %>%
mutate(TypeID = row_number())
data_all$EffsizeID <- 1:nrow(data_all)
## Impute correlation based on results of Bleidorn
data_all$Age1 <- ifelse(data_all$T1_AgeM <= 20, data_all$T1_AgeM, 20)
data_all$Age2 <- ifelse(data_all$T1_AgeM <= 25 & data_all$T1_AgeM > 20,
data_all$T1_AgeM - 20, ifelse(data_all$T1_AgeM <= 20, 0, 25-20))
data_all$Age3 <- ifelse(data_all$T1_AgeM > 25, data_all$T1_AgeM - 25, 0)
data_all$T2_r <- ifelse(is.na(data_all$T2_r),
(0.069 + ((data_all$T2_lag -3.6)* -0.011) + 0.029 * data_all$Age1 +
0.018 * data_all$Age2 + 0.001 * data_all$Age3), data_all$T2_r)
## Compute variance of personality change
data_all <- data_all %>%
mutate(sd.diff = sqrt(T1_SD^2 + T2_SD^2 - 2 * (T2_r * T1_SD * T2_SD)))
## Compute pomp score to make variance comparable
data_all <- data_all %>%
mutate(pomp.sd = sd.diff/(Max-Min))
## Compute effect sizes for the different rows
data_all$ES <- rep(NA, nrow(data_all))
data_all$SamVar <- rep(NA, nrow(data_all))
for(i in 1:nrow(data_all)) {
## Compute meta-analytic effect size
data_all$ES[i] <- as.numeric(escalc("SDLN", sdi = data_all$pomp.sd[i], ni = data_all$T1_N[i], correct = TRUE)$yi)
data_all$SamVar[i] <- as.numeric(escalc("SDLN", sdi = data_all$pomp.sd[i], ni = data_all$T1_N[i], correct = TRUE)$vi)
}
##Estimate approximate variance-covariance matrix
V <- vcalc(data_all$SamVar, cluster = data_all$StudyID, subgroup = data_all$SampleID,
obs = data_all$TraitID, type = data_all$TypeID,
time1 = data_all$T1_AgeM, rho = c(0.484, 0.548), phi = 0.608)
## Meta-analytic models
meta.trait.agree <- rma.mv(yi = ES, V = V, mods = ~ A.f,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_all, sparse = TRUE)
robust.trait.agree <- robust(meta.trait.agree, cluster = StudyID, clubSandwich = TRUE)
results.trait.agree <- round(as.data.frame(cbind(robust.trait.agree$beta[2], robust.trait.agree$se[2], robust.trait.agree$zval[2],
robust.trait.agree$pval[2])),3)
meta.trait.consc <- rma.mv(yi = ES, V = V, mods = ~ C.f,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_all, sparse = TRUE)
robust.trait.consc <- robust(meta.trait.consc, cluster = StudyID, clubSandwich = TRUE)
results.trait.consc <- round(as.data.frame(cbind(robust.trait.consc$beta[2], robust.trait.consc$se[2], robust.trait.consc$zval[2],
robust.trait.consc$pval[2])),3)
meta.trait.extra <- rma.mv(yi = ES, V = V, mods = ~ E.f,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_all, sparse = TRUE)
robust.trait.extra <- robust(meta.trait.extra, cluster = StudyID, clubSandwich = TRUE)
results.trait.extra <- round(as.data.frame(cbind(robust.trait.extra$beta[2], robust.trait.extra$se[2], robust.trait.extra$zval[2],
robust.trait.extra$pval[2])),3)
meta.trait.neuro <- rma.mv(yi = ES, V = V, mods = ~ N.f,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_all, sparse = TRUE)
robust.trait.neuro <- robust(meta.trait.neuro, cluster = StudyID, clubSandwich = TRUE)
results.trait.neuro <- round(as.data.frame(cbind(robust.trait.neuro$beta[2], robust.trait.neuro$se[2], robust.trait.neuro$zval[2],
robust.trait.neuro$pval[2])),3)
meta.trait.open <- rma.mv(yi = ES, V = V, mods = ~ O.f,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_all, sparse = TRUE)
robust.trait.open <- robust(meta.trait.open, cluster = StudyID, clubSandwich = TRUE)
results.trait.open <- round(as.data.frame(cbind(robust.trait.open$beta[2], robust.trait.open$se[2], robust.trait.open$zval[2],
robust.trait.open$pval[2])),3)
results.trait <- rbind(results.trait.agree, results.trait.consc,
results.trait.extra, results.trait.neuro,
results.trait.open)
names(results.trait) <- c("*b*", "*SE*", "*z*", "*p*")
row.names(results.trait) <- c("Agreeableness", "Conscientiousness",
"Extraversion", "Neuroticism",
"Openness")
kable(results.trait
, caption="**Results: Meta-analysis with trait category as moderator**"
, escape=FALSE
, label = NA
, digits = 3) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| b | SE | z | p | |
|---|---|---|---|---|
| Agreeableness | -0.083 | 0.022 | -3.722 | 0.001 |
| Conscientiousness | 0.005 | 0.022 | 0.214 | 0.832 |
| Extraversion | -0.005 | 0.016 | -0.286 | 0.776 |
| Neuroticism | 0.109 | 0.023 | 4.740 | 0.000 |
| Openness | -0.081 | 0.029 | -2.807 | 0.013 |
## Prepare loop
plot_data <- data.frame(Trait = factor(c("Agreeableness", "Conscientiousness",
"Extraversion", "Neuroticism",
"Openness"),
levels = c("Agreeableness", "Conscientiousness",
"Extraversion", "Neuroticism",
"Openness"),
ordered = TRUE),
SD = NA,
CI.lower = NA,
CI.upper = NA)
plot_data$ID <- 1:nrow(plot_data)
meta.models <- list(meta.base.agree, meta.base.consc, meta.base.extra,
meta.base.neuro, meta.base.open)
## Loop to create plot data
for (i in 1:nrow(plot_data)) {
plot_data$SD[i] <- predict(meta.models[[i]],
transf=exp, addx=TRUE)$pred
plot_data$CI.lower[i] <- predict(meta.models[[i]],
transf=exp, addx=TRUE)$ci.lb
plot_data$CI.upper[i] <- predict(meta.models[[i]],
transf=exp, addx=TRUE)$ci.ub
}
plot_data$Colour <- as.factor(c(1,0,0,1,1))
## Plot
plot <- ggplot(data = plot_data, aes(x = SD, y = Trait)) +
geom_errorbar(aes(xmin=CI.lower, xmax=CI.upper, colour = Colour),
position=position_dodge(0.75), width = 0) +
geom_point_interactive(aes(tooltip =
paste0("SD = ", round(SD,3),
", 95% CI = [", round(CI.lower,3),
", ", round(CI.upper,3), "]"),
data_id = ID, colour = Colour),
size = 1.8, position=position_dodge(0.75)) +
theme_pub() +
scale_x_continuous(limits = c(0,0.3)) +
scale_colour_manual(values = c("0" = "grey", "1" = "black")) +
theme(legend.position = "none",
axis.text.y = element_text(hjust = 1)) +
labs(y = "Traits", x = expression(bold("SD"[POMP])))
girafe(ggobj = plot)
Note. The estimate for a trait is depicted in black if it significantly differed from the average of the other traits.
spline.agree$AIC <- as.numeric(spline.agree$AIC)
spline.agree$BIC <- as.numeric(spline.agree$BIC)
spline.consc$AIC <- as.numeric(spline.consc$AIC)
spline.consc$BIC <- as.numeric(spline.consc$BIC)
spline.extra$AIC <- as.numeric(spline.extra$AIC)
spline.extra$BIC <- as.numeric(spline.extra$BIC)
spline.neuro$AIC <- as.numeric(spline.neuro$AIC)
spline.neuro$BIC <- as.numeric(spline.neuro$BIC)
spline.open$AIC <- as.numeric(spline.open$AIC)
spline.open$BIC <- as.numeric(spline.open$BIC)
## Agreeableness
spline.agree <- spline.agree[order(spline.agree$AIC), ]
AIC_agree <- c("AIC", spline.agree$Num[1:4])
spline.agree <- spline.agree[order(spline.agree$BIC), ]
BIC_agree <- c("BIC", spline.agree$Num[1:4])
## Conscientiousness
spline.consc <- spline.consc[order(spline.consc$AIC), ]
AIC_consc <- c("AIC", spline.consc$Num[1:4])
spline.consc <- spline.consc[order(spline.consc$BIC), ]
BIC_consc <- c("BIC", spline.consc$Num[1:4])
## Extraversion
spline.extra <- spline.extra[order(spline.extra$AIC), ]
AIC_extra <- c("AIC", spline.extra$Num[1:4])
spline.extra <- spline.extra[order(spline.extra$BIC), ]
BIC_extra <- c("BIC", spline.extra$Num[1:4])
## Neuroticsim
spline.neuro <- spline.neuro[order(spline.neuro$AIC), ]
AIC_neuro <- c("AIC", spline.neuro$Num[1:4])
spline.neuro <- spline.neuro[order(spline.neuro$BIC), ]
BIC_neuro <- c("BIC", spline.neuro$Num[1:4])
## Openness
spline.open <- spline.open[order(spline.open$AIC), ]
AIC_open <- c("AIC", spline.open$Num[1:4])
spline.open <- spline.open[order(spline.open$BIC), ]
BIC_open <- c("BIC", spline.open$Num[1:4])
## Create table
best.fit <- as.data.frame(rbind(AIC_agree, BIC_agree,
AIC_consc, BIC_consc,
AIC_extra, BIC_extra, AIC_neuro, BIC_neuro,
AIC_open, BIC_open))
names(best.fit) <- c("Fit index", "Best model", "Second-best", "Third-best", "Fourth-best")
row.names(best.fit) <- NULL
best.fit <- best.fit %>%
select(-`Fourth-best`) %>%
mutate(
`Best model` = case_match(`Best model`, "32763" ~ "Age.1-25 + Age.25>",
"32724" ~ "Age.1-15 + Age.15-25 + Age.25>",
"32725" ~ "Age.1-15 + Age.15-20 + Age.20>",
"32762" ~ "Age.1-30 + Age.30>",
"32633" ~ "Age.1-5 + Age.5-15 + Age.15-25 + Age.25>",
"32748" ~ "Age.1-5 + Age.5-30 + Age.30>",
"32749" ~ "Age.1-5 + Age.5-25 + Age.25>",
"31913" ~ "Age.1-5 + Age.5-30 + Age.30-70 + Age.70-75 + Age.75>",
"32761" ~ "Age.1-35 + Age.35>",
"32764" ~ "Age.1-20 + Age.20>",
"32634" ~ "Age.1-5 + Age.5-15 + Age.15-20 + Age.20>",
"32556" ~ "Age.1-10 + Age.10-15 + Age.15-20 + Age.20>",
"32470" ~ "Age.1-15 + Age.15-20 + Age.20-65 + Age.65>",
"32471" ~ "Age.1-15 + Age.15-20 + Age.20-60 + Age.60>",
"32469" ~ "Age.1-15 + Age.15-20 + Age.20-70 + Age.70>",
"32468" ~ "Age.1-15 + Age.15-20 + Age.20-75 + Age.75>",
"32760" ~ "Age.1-40 + Age.40>",
"32757" ~ "Age.1-55 + Age.55>",
"32758" ~ "Age.1-50 + Age.50>",
"32602" ~ "Age.1-5 + Age.5-25 + Age.25-75 + Age.75>",
"31949" ~ "Age.1-5 + Age.5-25 + Age.25-70 + Age.70-75 + Age.75>",
"32693" ~ "Age.1-25 + Age.25-75 + Age.75>",
"32694" ~ "Age.1-25 + Age.25-70 + Age.70>",
"32695" ~ "Age.1-25 + Age.25-65 + Age.65>",
"32703" ~ "Age.1-20 + Age.20-75 + Age.75>",
"32458" ~ "Age.1-15 + Age.15-25 + Age.25-75 + Age.75>",
"32104" ~ "Age.1-5 + Age.5-15 + Age.15-20 + Age.20-75 + Age.75>",
"31818" ~ "Age.1-10 + Age.10-15 + Age.15-20 + Age.20-75 + Age.75>",
.default = `Best model`),
`Second-best` = case_match(`Second-best`, "32763" ~ "Age.1-25 + Age.25>",
"32724" ~ "Age.1-15 + Age.15-25 + Age.25>",
"32725" ~ "Age.1-15 + Age.15-20 + Age.20>",
"32762" ~ "Age.1-30 + Age.30>",
"32633" ~ "Age.1-5 + Age.5-15 + Age.15-25 + Age.25>",
"32748" ~ "Age.1-5 + Age.5-30 + Age.30>",
"32749" ~ "Age.1-5 + Age.5-25 + Age.25>",
"31913" ~ "Age.1-5 + Age.5-30 + Age.30-70 + Age.70-75 + Age.75>",
"32761" ~ "Age.1-35 + Age.35>",
"32764" ~ "Age.1-20 + Age.20>",
"32634" ~ "Age.1-5 + Age.5-15 + Age.15-20 + Age.20>",
"32556" ~ "Age.1-10 + Age.10-15 + Age.15-20 + Age.20>",
"32470" ~ "Age.1-15 + Age.15-20 + Age.20-65 + Age.65>",
"32471" ~ "Age.1-15 + Age.15-20 + Age.20-60 + Age.60>",
"32469" ~ "Age.1-15 + Age.15-20 + Age.20-70 + Age.70>",
"32468" ~ "Age.1-15 + Age.15-20 + Age.20-75 + Age.75>",
"32760" ~ "Age.1-40 + Age.40>",
"32757" ~ "Age.1-55 + Age.55>",
"32758" ~ "Age.1-50 + Age.50>",
"32602" ~ "Age.1-5 + Age.5-25 + Age.25-75 + Age.75>",
"31949" ~ "Age.1-5 + Age.5-25 + Age.25-70 + Age.70-75 + Age.75>",
"32693" ~ "Age.1-25 + Age.25-75 + Age.75>",
"32694" ~ "Age.1-25 + Age.25-70 + Age.70>",
"32695" ~ "Age.1-25 + Age.25-65 + Age.65>",
"32703" ~ "Age.1-20 + Age.20-75 + Age.75>",
"32458" ~ "Age.1-15 + Age.15-25 + Age.25-75 + Age.75>",
"32104" ~ "Age.1-5 + Age.5-15 + Age.15-20 + Age.20-75 + Age.75>",
"31818" ~ "Age.1-10 + Age.10-15 + Age.15-20 + Age.20-75 + Age.75>",
.default = `Second-best`),
`Third-best` = case_match(`Third-best`, "32763" ~ "Age.1-25 + Age.25>",
"32724" ~ "Age.1-15 + Age.15-25 + Age.25>",
"32725" ~ "Age.1-15 + Age.15-20 + Age.20>",
"32762" ~ "Age.1-30 + Age.30>",
"32633" ~ "Age.1-5 + Age.5-15 + Age.15-25 + Age.25>",
"32748" ~ "Age.1-5 + Age.5-30 + Age.30>",
"32749" ~ "Age.1-5 + Age.5-25 + Age.25>",
"31913" ~ "Age.1-5 + Age.5-30 + Age.30-70 + Age.70-75 + Age.75>",
"32761" ~ "Age.1-35 + Age.35>",
"32764" ~ "Age.1-20 + Age.20>",
"32634" ~ "Age.1-5 + Age.5-15 + Age.15-20 + Age.20>",
"32556" ~ "Age.1-10 + Age.10-15 + Age.15-20 + Age.20>",
"32470" ~ "Age.1-15 + Age.15-20 + Age.20-65 + Age.65>",
"32471" ~ "Age.1-15 + Age.15-20 + Age.20-60 + Age.60>",
"32469" ~ "Age.1-15 + Age.15-20 + Age.20-70 + Age.70>",
"32468" ~ "Age.1-15 + Age.15-20 + Age.20-75 + Age.75>",
"32760" ~ "Age.1-40 + Age.40>",
"32757" ~ "Age.1-55 + Age.55>",
"32758" ~ "Age.1-50 + Age.50>",
"32602" ~ "Age.1-5 + Age.5-25 + Age.25-75 + Age.75>",
"31949" ~ "Age.1-5 + Age.5-25 + Age.25-70 + Age.70-75 + Age.75>",
"32693" ~ "Age.1-25 + Age.25-75 + Age.75>",
"32694" ~ "Age.1-25 + Age.25-70 + Age.70>",
"32695" ~ "Age.1-25 + Age.25-65 + Age.65>",
"32703" ~ "Age.1-20 + Age.20-75 + Age.75>",
"32458" ~ "Age.1-15 + Age.15-25 + Age.25-75 + Age.75>",
"32104" ~ "Age.1-5 + Age.5-15 + Age.15-20 + Age.20-75 + Age.75>",
"31818" ~ "Age.1-10 + Age.10-15 + Age.15-20 + Age.20-75 + Age.75>",
.default = `Third-best`)
)
kable(best.fit
, caption="**Best-fitting model of spline approach with age and time lag as predictors**"
, escape=FALSE
, label = NA) %>%
pack_rows(index = c("Agreeableness" = 2, "Conscientiousness" = 2,
"Extraversion" = 2, "Neuroticism" = 2,
"Openness" = 2)) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| Fit index | Best model | Second-best | Third-best |
|---|---|---|---|
| Agreeableness | |||
| AIC | Age.1-15 + Age.15-20 + Age.20-65 + Age.65> | Age.1-15 + Age.15-20 + Age.20-60 + Age.60> | Age.1-15 + Age.15-20 + Age.20-70 + Age.70> |
| BIC | Age.1-25 + Age.25> | Age.1-30 + Age.30> | Age.1-15 + Age.15-25 + Age.25> |
| Conscientiousness | |||
| AIC | Age.1-5 + Age.5-30 + Age.30-70 + Age.70-75 + Age.75> | Age.1-5 + Age.5-25 + Age.25-75 + Age.75> | Age.1-5 + Age.5-25 + Age.25-70 + Age.70-75 + Age.75> |
| BIC | Age.1-40 + Age.40> | Age.1-30 + Age.30> | Age.1-35 + Age.35> |
| Extraversion | |||
| AIC | Age.1-25 + Age.25-75 + Age.75> | Age.1-25 + Age.25-70 + Age.70> | Age.1-25 + Age.25-65 + Age.65> |
| BIC | Age.1-55 + Age.55> | Age.1-50 + Age.50> | Age.1-25 + Age.25-75 + Age.75> |
| Neuroticism | |||
| AIC | Age.1-15 + Age.15-20 + Age.20-75 + Age.75> | Age.1-5 + Age.5-15 + Age.15-20 + Age.20-75 + Age.75> | Age.1-10 + Age.10-15 + Age.15-20 + Age.20-75 + Age.75> |
| BIC | Age.1-25 + Age.25-75 + Age.75> | Age.1-15 + Age.15-20 + Age.20-75 + Age.75> | Age.1-20 + Age.20-75 + Age.75> |
| Openness | |||
| AIC | Age.1-15 + Age.15-20 + Age.20-70 + Age.70> | Age.1-15 + Age.15-20 + Age.20-65 + Age.65> | Age.1-15 + Age.15-25 + Age.25-75 + Age.75> |
| BIC | Age.1-30 + Age.30> | Age.1-25 + Age.25> | Age.1-15 + Age.15-25 + Age.25> |
We selected the two best-fitting models for the following analyses based on the following considerations:
Model with two age-related variables: Age 1-30 and Age 30>
## Create age bins
data_agree$abin_1 <- ifelse(data_agree$T1_AgeM <= 30, data_agree$T1_AgeM, 30)
data_agree$abin_2 <- ifelse(data_agree$T1_AgeM > 30, data_agree$T1_AgeM - 30, 0)
## Spline approach of best-fitting model
meta.spline1 <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 + T2_lag.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_agree, sparse = TRUE)
sigma_spline1.level1_agree <- meta.spline1$sigma2[1]
sigma_spline1.level2_agree <- meta.spline1$sigma2[2]
results.spline1 <- robust(meta.spline1, cluster = StudyID, clubSandwich = TRUE)
spline1.agree <- as.data.frame(round(cbind(results.spline1$b, results.spline1$se, results.spline1$zval,
results.spline1$pval),3))
names(spline1.agree) <- c("*b*", "*SE*", "*z*", "*p*")
row.names(spline1.agree) <- c("Intercept", "Age.1-30",
"Age.30>", "Time lag")
kable(spline1.agree
, caption="**Best-fitting model with age and time lag for agreeableness**"
, escape=FALSE
, label = NA) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| b | SE | z | p | |
|---|---|---|---|---|
| Intercept | -1.702 | 0.070 | -24.273 | 0.000 |
| Age.1-30 | -0.023 | 0.004 | -5.445 | 0.000 |
| Age.30> | 0.001 | 0.002 | 0.250 | 0.827 |
| Time lag | 0.027 | 0.007 | 3.801 | 0.009 |
## Compute models with age only (for separate R2 values)
meta.spline1_age <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_agree, sparse = TRUE)
sigma_spline1.level1_agree_age <- meta.spline1_age$sigma2[1]
sigma_spline1.level2_agree_age <- meta.spline1_age$sigma2[2]
## Compute models with time lag only (for separate R2 values)
meta.spline1_lag <- rma.mv(yi = ES, V = V_agree, mods = ~ T2_lag.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_agree, sparse = TRUE)
sigma_spline1.level1_agree_lag <- meta.spline1_lag$sigma2[1]
sigma_spline1.level2_agree_lag <- meta.spline1_lag$sigma2[2]
## R2 in model with time lag and age
r2.level1 <- round((sigma_base.level1_agree - sigma_spline1.level1_agree)/sigma_base.level1_agree,2)
r2.level1 <- ifelse(r2.level1 < 0, 0, r2.level1)
r2.level2 <- round((sigma_base.level2_agree - sigma_spline1.level2_agree)/sigma_base.level2_agree,2)
r2.level2 <- ifelse(r2.level2 < 0, 0, r2.level2)
r2 <- round(as.data.frame(rbind(c(sigma_spline1.level1_agree, sigma_base.level1_agree, r2.level1), c(sigma_spline1.level2_agree, sigma_base.level2_agree, r2.level2))),5)
## R2 in model with age only
r2.level1_age <- round((sigma_base.level1_agree - sigma_spline1.level1_agree_age)/sigma_base.level1_agree,2)
r2.level1_age <- ifelse(r2.level1_age < 0, 0, r2.level1_age)
r2.level2_age <- round((sigma_base.level2_agree - sigma_spline1.level2_agree_age)/sigma_base.level2_agree,2)
r2.level2_age <- ifelse(r2.level2_age < 0, 0, r2.level2_age)
r2_age <- round(as.data.frame(rbind(c(sigma_spline1.level1_agree_age, sigma_base.level1_agree, r2.level1_age), c(sigma_spline1.level2_agree_age, sigma_base.level2_agree, r2.level2_age))),5)
## R2 in model with time lag only
r2.level1_lag <- round((sigma_base.level1_agree - sigma_spline1.level1_agree_lag)/sigma_base.level1_agree,2)
r2.level1_lag <- ifelse(r2.level1_lag < 0, 0, r2.level1_lag)
r2.level2_lag <- round((sigma_base.level2_agree - sigma_spline1.level2_agree_lag)/sigma_base.level2_agree,2)
r2.level2_lag <- ifelse(r2.level2_lag < 0, 0, r2.level2_lag)
r2_lag <- round(as.data.frame(rbind(c(sigma_spline1.level1_agree_lag, sigma_base.level1_agree, r2.level1_lag), c(sigma_spline1.level2_agree_lag, sigma_base.level2_agree, r2.level2_lag))),5)
## Combine values in one table
r2_all <- rbind(r2, r2_age, r2_lag)
r2_all$Level <- rep(c("Level 1", "Level 2"), 3)
names(r2_all) <- c("Sigma Moderator", "Sigma Baseline", "R^2^", "Level")
r2_all <- select(r2_all, Level, everything())
kable(r2_all
, caption="**R^2^ of models**"
, escape=FALSE
, label = NA
, digits = 3) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left") %>%
pack_rows(index = c("Age and time lag" = 2, "Age only" = 2, "Time lag only" = 2))
| Level | Sigma Moderator | Sigma Baseline | R2 |
|---|---|---|---|
| Age and time lag | |||
| Level 1 | 0.026 | 0.03 | 0.14 |
| Level 2 | 0.093 | 0.12 | 0.23 |
| Age only | |||
| Level 1 | 0.028 | 0.03 | 0.07 |
| Level 2 | 0.103 | 0.12 | 0.14 |
| Time lag only | |||
| Level 1 | 0.029 | 0.03 | 0.05 |
| Level 2 | 0.119 | 0.12 | 0.01 |
Note: You can hover over the data points to receive more information.
pred <- data.frame(Age = 1:80,
SD = NA,
CI.lower = NA,
CI.upper = NA)
for (i in 1:80) {
pred$SD[i] <- predict(results.spline1,
newmods=c(ifelse(i <= 30, i, 30),
ifelse(i > 30,i - 30, 0),0),
transf=exp, addx=TRUE)$pred
pred$CI.lower[i] <- predict(results.spline1,
newmods=c(ifelse(i <= 30, i, 30),
ifelse(i > 30,i - 30, 0),0),
transf=exp, addx=TRUE)$ci.lb
pred$CI.upper[i] <- predict(results.spline1,
newmods=c(ifelse(i <= 30, i, 30),
ifelse(i > 30,i - 30, 0),0),
transf=exp, addx=TRUE)$ci.ub
}
pred$Type <- "pred"
observed <- select(data_agree, Age = T1_AgeM, ES = ES, N = T1_N) %>% ungroup() %>%
mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)
plot <- ggplot(data = total, aes(x = Age, y = SD)) +
geom_point_interactive(data = subset(total, Type == "observed"),
aes(size = N, tooltip = paste0("SD = ", round(SD,3),
", N = ", N,
", StudyID = ", StudyID),
data_id = ID),
shape = 5, color = "grey") +
geom_errorbar(data = subset(total, Type == "pred"),
aes(ymin = CI.lower, ymax = CI.upper),
color = "black", width = 0) +
geom_point_interactive(data = subset(total, Type == "pred"),
aes(tooltip =
paste0("SD = ", round(SD,3),
", 95% CI = [", round(CI.lower,3),
", ", round(CI.upper,3), "]"),
data_id = ID)) +
scale_y_continuous(limits = c(0, 0.40)) +
scale_x_continuous(limits = c(0, 80), breaks = c(0,10,20,30,40,50,60,70,80)) +
labs(y = expression(bold("SD"[POMP])), title = "Agreeableness") +
theme_pub() +
theme(legend.position = "none")
girafe(ggobj = plot)
Note: You can hover over the data points to receive more information.
pred <- data.frame(Time = seq(from = 0.5, to = 10, by = 0.25),
SD = NA,
CI.lower = NA,
CI.upper = NA)
for (i in 1:nrow(pred)) {
pred$SD[i] <- predict(results.spline1,
newmods=c(20, 0 , pred$Time[i]),
transf=exp, addx=TRUE)$pred
pred$CI.lower[i] <- predict(results.spline1,
newmods=c(20, 0 , pred$Time[i]),
transf=exp, addx=TRUE)$ci.lb
pred$CI.upper[i] <- predict(results.spline1,
newmods=c(20, 0 , pred$Time[i]),
transf=exp, addx=TRUE)$ci.ub
}
pred$Type <- "pred"
observed <- select(data_agree, Time = T2_lag, ES = ES, N = T1_N) %>% ungroup() %>%
mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)
plot <- ggplot(data = total, aes(x = Time, y = SD)) +
geom_point_interactive(data = subset(total, Type == "observed"),
aes(size = N, tooltip = paste0("SD = ", round(SD,3),
", N = ", N,
", StudyID = ", StudyID),
data_id = ID),
shape = 5, color = "grey") +
geom_errorbar(data = subset(total, Type == "pred"),
aes(ymin = CI.lower, ymax = CI.upper),
color = "black", width = 0) +
geom_point_interactive(data = subset(total, Type == "pred"),
aes(tooltip =
paste0("SD = ", round(SD,3),
", 95% CI = [", round(CI.lower,3),
", ", round(CI.upper,3), "]"),
data_id = ID)) +
scale_y_continuous(limits = c(0, 0.40)) +
scale_x_continuous(limits = c(0, 10), breaks = c(0,1,2,3,4,5,6,7,8,9,10)) +
labs(y = expression(bold("SD"[POMP])), title = "Agreeableness") +
theme_pub() +
theme(legend.position = "none")
girafe(ggobj = plot)
Model with four age-related variables: Age 1-15, Age 15-20, Age 20-65, and Age 65>
## Create age bins
data_agree$abin_1 <- ifelse(data_agree$T1_AgeM <= 15, data_agree$T1_AgeM, 15)
data_agree$abin_2 <- ifelse(data_agree$T1_AgeM <= 20 & data_agree$T1_AgeM > 15,
data_agree$T1_AgeM - 15,
ifelse(data_agree$T1_AgeM <= 15, 0, 20 - 15))
data_agree$abin_3 <- ifelse(data_agree$T1_AgeM <= 65 & data_agree$T1_AgeM > 20,
data_agree$T1_AgeM - 20,
ifelse(data_agree$T1_AgeM <= 20, 0, 65 - 20))
data_agree$abin_4 <- ifelse(data_agree$T1_AgeM > 65, data_agree$T1_AgeM - 65, 0)
## Spline approach of best-fitting model
meta.spline2 <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 + abin_3 + abin_4 + T2_lag.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_agree, sparse = TRUE)
sigma_spline2.level1_agree <- meta.spline2$sigma2[1]
sigma_spline2.level2_agree <- meta.spline2$sigma2[2]
results.spline2 <- robust(meta.spline2, cluster = StudyID, clubSandwich = TRUE)
spline2.agree <- as.data.frame(round(cbind(results.spline2$b, results.spline2$se, results.spline2$zval,
results.spline2$pval),3))
names(spline2.agree) <- c("*b*", "*SE*", "*z*", "*p*")
row.names(spline2.agree) <- c("Intercept", "Age.1-15", "Age.15-20",
"Age.20-65", "Age.65>", "Time lag")
kable(spline2.agree
, caption="**Second-best model with age and time lag for agreeableness**"
, escape=FALSE
, label = NA) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| b | SE | z | p | |
|---|---|---|---|---|
| Intercept | -1.716 | 0.075 | -22.975 | 0.000 |
| Age.1-15 | -0.020 | 0.006 | -3.647 | 0.002 |
| Age.15-20 | -0.048 | 0.013 | -3.665 | 0.002 |
| Age.20-65 | -0.004 | 0.001 | -3.036 | 0.067 |
| Age.65> | 0.008 | 0.003 | 2.872 | 0.144 |
| Time lag | 0.027 | 0.007 | 3.695 | 0.011 |
## Compute models with age only (for separate R2 values)
meta.spline2_age <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 + abin_3 + abin_4,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_agree, sparse = TRUE)
sigma_spline2.level1_agree_age <- meta.spline2_age$sigma2[1]
sigma_spline2.level2_agree_age <- meta.spline2_age$sigma2[2]
## Compute models with time lag only (for separate R2 values)
meta.spline2_lag <- rma.mv(yi = ES, V = V_agree, mods = ~ T2_lag.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_agree, sparse = TRUE)
sigma_spline2.level1_agree_lag <- meta.spline2_lag$sigma2[1]
sigma_spline2.level2_agree_lag <- meta.spline2_lag$sigma2[2]
## R2 in model with time lag and age
r2.level1 <- round((sigma_base.level1_agree - sigma_spline2.level1_agree)/sigma_base.level1_agree,2)
r2.level1 <- ifelse(r2.level1 < 0, 0, r2.level1)
r2.level2 <- round((sigma_base.level2_agree - sigma_spline2.level2_agree)/sigma_base.level2_agree,2)
r2.level2 <- ifelse(r2.level2 < 0, 0, r2.level2)
r2 <- round(as.data.frame(rbind(c(sigma_spline2.level1_agree, sigma_base.level1_agree, r2.level1), c(sigma_spline2.level2_agree, sigma_base.level2_agree, r2.level2))),5)
## R2 in model with age only
r2.level1_age <- round((sigma_base.level1_agree - sigma_spline2.level1_agree_age)/sigma_base.level1_agree,2)
r2.level1_age <- ifelse(r2.level1_age < 0, 0, r2.level1_age)
r2.level2_age <- round((sigma_base.level2_agree - sigma_spline2.level2_agree_age)/sigma_base.level2_agree,2)
r2.level2_age <- ifelse(r2.level2_age < 0, 0, r2.level2_age)
r2_age <- round(as.data.frame(rbind(c(sigma_spline2.level1_agree_age, sigma_base.level1_agree, r2.level1_age), c(sigma_spline2.level2_agree_age, sigma_base.level2_agree, r2.level2_age))),5)
## R2 in model with time lag only
r2.level1_lag <- round((sigma_base.level1_agree - sigma_spline2.level1_agree_lag)/sigma_base.level1_agree,2)
r2.level1_lag <- ifelse(r2.level1_lag < 0, 0, r2.level1_lag)
r2.level2_lag <- round((sigma_base.level2_agree - sigma_spline2.level2_agree_lag)/sigma_base.level2_agree,2)
r2.level2_lag <- ifelse(r2.level2_lag < 0, 0, r2.level2_lag)
r2_lag <- round(as.data.frame(rbind(c(sigma_spline2.level1_agree_lag, sigma_base.level1_agree, r2.level1_lag), c(sigma_spline2.level2_agree_lag, sigma_base.level2_agree, r2.level2_lag))),5)
## Combine values in one table
r2_all <- rbind(r2, r2_age, r2_lag)
r2_all$Level <- rep(c("Level 1", "Level 2"), 3)
names(r2_all) <- c("Sigma Moderator", "Sigma Baseline", "R^2^", "Level")
r2_all <- select(r2_all, Level, everything())
kable(r2_all
, caption="**R^2^ of models**"
, escape=FALSE
, label = NA
, digits = 3) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left") %>%
pack_rows(index = c("Age and time lag" = 2, "Age only" = 2, "Time lag only" = 2))
| Level | Sigma Moderator | Sigma Baseline | R2 |
|---|---|---|---|
| Age and time lag | |||
| Level 1 | 0.026 | 0.03 | 0.15 |
| Level 2 | 0.093 | 0.12 | 0.22 |
| Age only | |||
| Level 1 | 0.028 | 0.03 | 0.09 |
| Level 2 | 0.103 | 0.12 | 0.15 |
| Time lag only | |||
| Level 1 | 0.029 | 0.03 | 0.05 |
| Level 2 | 0.119 | 0.12 | 0.01 |
Note: You can hover over the data points to receive more information.
pred <- data.frame(Age = 1:80,
SD = NA,
CI.lower = NA,
CI.upper = NA)
for (i in 1:80) {
pred$SD[i] <- predict(results.spline2,
newmods=c(ifelse(i <= 15, i, 15),
ifelse(i <= 20 & i > 15, i - 15, ifelse(i <= 15, 0, 20 - 15)),
ifelse(i <= 65 & i > 20, i - 20, ifelse(i <= 20, 0, 65 - 20)),
ifelse(i > 65,i - 65, 0),0),
transf=exp, addx=TRUE)$pred
pred$CI.lower[i] <- predict(results.spline2,
newmods=c(ifelse(i <= 15, i, 15),
ifelse(i <= 20 & i > 15, i - 15, ifelse(i <= 15, 0, 20 - 15)),
ifelse(i <= 65 & i > 20, i - 20, ifelse(i <= 20, 0, 65 - 20)),
ifelse(i > 65,i - 65, 0),0),
transf=exp, addx=TRUE)$ci.lb
pred$CI.upper[i] <- predict(results.spline2,
newmods=c(ifelse(i <= 15, i, 15),
ifelse(i <= 20 & i > 15, i - 15, ifelse(i <= 15, 0, 20 - 15)),
ifelse(i <= 65 & i > 20, i - 20, ifelse(i <= 20, 0, 65 - 20)),
ifelse(i > 65,i - 65, 0),0),
transf=exp, addx=TRUE)$ci.ub
}
pred$Type <- "pred"
observed <- select(data_agree, Age = T1_AgeM, ES = ES, N = T1_N) %>% ungroup() %>%
mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)
plot <- ggplot(data = total, aes(x = Age, y = SD)) +
geom_point_interactive(data = subset(total, Type == "observed"),
aes(size = N, tooltip = paste0("SD = ", round(SD,3),
", N = ", N,
", StudyID = ", StudyID),
data_id = ID),
shape = 5, color = "grey") +
geom_errorbar(data = subset(total, Type == "pred"),
aes(ymin = CI.lower, ymax = CI.upper),
color = "black", width = 0) +
geom_point_interactive(data = subset(total, Type == "pred"),
aes(tooltip =
paste0("SD = ", round(SD,3),
", 95% CI = [", round(CI.lower,3),
", ", round(CI.upper,3), "]"),
data_id = ID)) +
scale_y_continuous(limits = c(0, 0.40)) +
scale_x_continuous(limits = c(0, 80), breaks = c(0,10,20,30,40,50,60,70,80)) +
labs(y = expression(bold("SD"[POMP])), title = "Agreeableness") +
theme_pub() +
theme(legend.position = "none")
girafe(ggobj = plot)
Note: You can hover over the data points to receive more information.
pred <- data.frame(Time = seq(from = 0.5, to = 10, by = 0.25),
SD = NA,
CI.lower = NA,
CI.upper = NA)
for (i in 1:nrow(pred)) {
pred$SD[i] <- predict(results.spline2,
newmods=c(15, 5, 0, 0, pred$Time[i]),
transf=exp, addx=TRUE)$pred
pred$CI.lower[i] <- predict(results.spline2,
newmods=c(15, 5, 0, 0, pred$Time[i]),
transf=exp, addx=TRUE)$ci.lb
pred$CI.upper[i] <- predict(results.spline2,
newmods=c(15, 5, 0, 0, pred$Time[i]),
transf=exp, addx=TRUE)$ci.ub
}
pred$Type <- "pred"
observed <- select(data_agree, Time = T2_lag, ES = ES, N = T1_N) %>% ungroup() %>%
mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)
plot <- ggplot(data = total, aes(x = Time, y = SD)) +
geom_point_interactive(data = subset(total, Type == "observed"),
aes(size = N, tooltip = paste0("SD = ", round(SD,3),
", N = ", N,
", StudyID = ", StudyID),
data_id = ID),
shape = 5, color = "grey") +
geom_errorbar(data = subset(total, Type == "pred"),
aes(ymin = CI.lower, ymax = CI.upper),
color = "black", width = 0) +
geom_point_interactive(data = subset(total, Type == "pred"),
aes(tooltip =
paste0("SD = ", round(SD,3),
", 95% CI = [", round(CI.lower,3),
", ", round(CI.upper,3), "]"),
data_id = ID)) +
scale_y_continuous(limits = c(0, 0.40)) +
scale_x_continuous(limits = c(0, 10), breaks = c(0,1,2,3,4,5,6,7,8,9,10)) +
labs(y = expression(bold("SD"[POMP])), title = "Agreeableness") +
theme_pub() +
theme(legend.position = "none")
girafe(ggobj = plot)
Model with two age-related variables: Age 1-40, and Age 40>
## Create age bins
data_consc$abin_1 <- ifelse(data_consc$T1_AgeM <= 40, data_consc$T1_AgeM, 40)
data_consc$abin_2 <- ifelse(data_consc$T1_AgeM > 40, data_consc$T1_AgeM - 40, 0)
## Spline approach of best-fitting model
meta.spline1 <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 + T2_lag.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_consc, sparse = TRUE)
sigma_spline1.level1_consc <- meta.spline1$sigma2[1]
sigma_spline1.level2_consc <- meta.spline1$sigma2[2]
results.spline1 <- robust(meta.spline1, cluster = StudyID, clubSandwich = TRUE)
spline1.consc <- as.data.frame(round(cbind(results.spline1$b, results.spline1$se, results.spline1$zval,
results.spline1$pval),3))
names(spline1.consc) <- c("*b*", "*SE*", "*z*", "*p*")
row.names(spline1.consc) <- c("Intercept", "Age.1-40",
"Age.40>", "Time lag")
kable(spline1.consc
, caption="**Best-fitting model with age and time lag for conscientiousness**"
, escape=FALSE
, label = NA) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| b | SE | z | p | |
|---|---|---|---|---|
| Intercept | -1.760 | 0.047 | -37.785 | 0.000 |
| Age.1-40 | -0.013 | 0.002 | -6.252 | 0.001 |
| Age.40> | -0.001 | 0.002 | -0.250 | 0.826 |
| Time lag | 0.020 | 0.008 | 2.578 | 0.071 |
## Compute models with age only (for separate R2 values)
meta.spline1_age <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_consc, sparse = TRUE)
sigma_spline1.level1_consc_age <- meta.spline1_age$sigma2[1]
sigma_spline1.level2_consc_age <- meta.spline1_age$sigma2[2]
## Compute models with time lag only (for separate R2 values)
meta.spline1_lag <- rma.mv(yi = ES, V = V_consc, mods = ~ T2_lag.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_consc, sparse = TRUE)
sigma_spline1.level1_consc_lag <- meta.spline1_lag$sigma2[1]
sigma_spline1.level2_consc_lag <- meta.spline1_lag$sigma2[2]
## R2 in model with time lag and age
r2.level1 <- round((sigma_base.level1_consc - sigma_spline1.level1_consc)/sigma_base.level1_consc,2)
r2.level1 <- ifelse(r2.level1 < 0, 0, r2.level1)
r2.level2 <- round((sigma_base.level2_consc - sigma_spline1.level2_consc)/sigma_base.level2_consc,2)
r2.level2 <- ifelse(r2.level2 < 0, 0, r2.level2)
r2 <- round(as.data.frame(rbind(c(sigma_spline1.level1_consc, sigma_base.level1_consc, r2.level1), c(sigma_spline1.level2_consc, sigma_base.level2_consc, r2.level2))),5)
## R2 in model with age only
r2.level1_age <- round((sigma_base.level1_consc - sigma_spline1.level1_consc_age)/sigma_base.level1_consc,2)
r2.level1_age <- ifelse(r2.level1_age < 0, 0, r2.level1_age)
r2.level2_age <- round((sigma_base.level2_consc - sigma_spline1.level2_consc_age)/sigma_base.level2_consc,2)
r2.level2_age <- ifelse(r2.level2_age < 0, 0, r2.level2_age)
r2_age <- round(as.data.frame(rbind(c(sigma_spline1.level1_consc_age, sigma_base.level1_consc, r2.level1_age), c(sigma_spline1.level2_consc_age, sigma_base.level2_consc, r2.level2_age))),5)
## R2 in model with time lag only
r2.level1_lag <- round((sigma_base.level1_consc - sigma_spline1.level1_consc_lag)/sigma_base.level1_consc,2)
r2.level1_lag <- ifelse(r2.level1_lag < 0, 0, r2.level1_lag)
r2.level2_lag <- round((sigma_base.level2_consc - sigma_spline1.level2_consc_lag)/sigma_base.level2_consc,2)
r2.level2_lag <- ifelse(r2.level2_lag < 0, 0, r2.level2_lag)
r2_lag <- round(as.data.frame(rbind(c(sigma_spline1.level1_consc_lag, sigma_base.level1_consc, r2.level1_lag), c(sigma_spline1.level2_consc_lag, sigma_base.level2_consc, r2.level2_lag))),5)
## Combine values in one table
r2_all <- rbind(r2, r2_age, r2_lag)
r2_all$Level <- rep(c("Level 1", "Level 2"), 3)
names(r2_all) <- c("Sigma Moderator", "Sigma Baseline", "R^2^", "Level")
r2_all <- select(r2_all, Level, everything())
kable(r2_all
, caption="**R^2^ of models**"
, escape=FALSE
, label = NA
, digits = 3) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left") %>%
pack_rows(index = c("Age and time lag" = 2, "Age only" = 2, "Time lag only" = 2))
| Level | Sigma Moderator | Sigma Baseline | R2 |
|---|---|---|---|
| Age and time lag | |||
| Level 1 | 0.032 | 0.035 | 0.06 |
| Level 2 | 0.090 | 0.112 | 0.20 |
| Age only | |||
| Level 1 | 0.033 | 0.035 | 0.04 |
| Level 2 | 0.096 | 0.112 | 0.14 |
| Time lag only | |||
| Level 1 | 0.034 | 0.035 | 0.02 |
| Level 2 | 0.108 | 0.112 | 0.03 |
Note: You can hover over the data points to receive more information.
pred <- data.frame(Age = 1:80,
SD = NA,
CI.lower = NA,
CI.upper = NA)
for (i in 1:80) {
pred$SD[i] <- predict(results.spline1,
newmods=c(ifelse(i <= 40, i, 40),
ifelse(i > 40,i - 40, 0),0),
transf=exp, addx=TRUE)$pred
pred$CI.lower[i] <- predict(results.spline1,
newmods=c(ifelse(i <= 40, i, 40),
ifelse(i > 40,i - 40, 0),0),
transf=exp, addx=TRUE)$ci.lb
pred$CI.upper[i] <- predict(results.spline1,
newmods=c(ifelse(i <= 40, i, 40),
ifelse(i > 40,i - 40, 0),0),
transf=exp, addx=TRUE)$ci.ub
}
pred$Type <- "pred"
observed <- select(data_consc, Age = T1_AgeM, ES = ES, N = T1_N) %>% ungroup() %>%
mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)
plot <- ggplot(data = total, aes(x = Age, y = SD)) +
geom_point_interactive(data = subset(total, Type == "observed"),
aes(size = N, tooltip = paste0("SD = ", round(SD,3),
", N = ", N,
", StudyID = ", StudyID),
data_id = ID),
shape = 5, color = "grey") +
geom_errorbar(data = subset(total, Type == "pred"),
aes(ymin = CI.lower, ymax = CI.upper),
color = "black", width = 0) +
geom_point_interactive(data = subset(total, Type == "pred"),
aes(tooltip =
paste0("SD = ", round(SD,3),
", 95% CI = [", round(CI.lower,3),
", ", round(CI.upper,3), "]"),
data_id = ID)) +
scale_y_continuous(limits = c(0, 0.40)) +
scale_x_continuous(limits = c(0, 80), breaks = c(0,10,20,30,40,50,60,70,80)) +
labs(y = expression(bold("SD"[POMP])), title = "Conscientiousness") +
theme_pub() +
theme(legend.position = "none")
girafe(ggobj = plot)
Note: You can hover over the data points to receive more information.
pred <- data.frame(Time = seq(from = 0.5, to = 10, by = 0.25),
SD = NA,
CI.lower = NA,
CI.upper = NA)
for (i in 1:nrow(pred)) {
pred$SD[i] <- predict(results.spline1,
newmods=c(20, 0 , pred$Time[i]),
transf=exp, addx=TRUE)$pred
pred$CI.lower[i] <- predict(results.spline1,
newmods=c(20, 0 , pred$Time[i]),
transf=exp, addx=TRUE)$ci.lb
pred$CI.upper[i] <- predict(results.spline1,
newmods=c(20, 0 , pred$Time[i]),
transf=exp, addx=TRUE)$ci.ub
}
pred$Type <- "pred"
observed <- select(data_agree, Time = T2_lag, ES = ES, N = T1_N) %>% ungroup() %>%
mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)
plot <- ggplot(data = total, aes(x = Time, y = SD)) +
geom_point_interactive(data = subset(total, Type == "observed"),
aes(size = N, tooltip = paste0("SD = ", round(SD,3),
", N = ", N,
", StudyID = ", StudyID),
data_id = ID),
shape = 5, color = "grey") +
geom_errorbar(data = subset(total, Type == "pred"),
aes(ymin = CI.lower, ymax = CI.upper),
color = "black", width = 0) +
geom_point_interactive(data = subset(total, Type == "pred"),
aes(tooltip =
paste0("SD = ", round(SD,3),
", 95% CI = [", round(CI.lower,3),
", ", round(CI.upper,3), "]"),
data_id = ID)) +
scale_y_continuous(limits = c(0, 0.40)) +
scale_x_continuous(limits = c(0, 10), breaks = c(0,1,2,3,4,5,6,7,8,9,10)) +
labs(y = expression(bold("SD"[POMP])), title = "Conscientiousness") +
theme_pub() +
theme(legend.position = "none")
girafe(ggobj = plot)
Model with two age-related variables: Age 1-30 and Age 30>
## Create age bins
data_consc$abin_1 <- ifelse(data_consc$T1_AgeM <= 30, data_consc$T1_AgeM, 30)
data_consc$abin_2 <- ifelse(data_consc$T1_AgeM > 30, data_consc$T1_AgeM - 30, 0)
## Spline approach of best-fitting model
meta.spline2 <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 + T2_lag.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_consc, sparse = TRUE)
sigma_spline2.level1_consc <- meta.spline2$sigma2[1]
sigma_spline2.level2_consc <- meta.spline2$sigma2[2]
results.spline2 <- robust(meta.spline2, cluster = StudyID, clubSandwich = TRUE)
spline2.consc <- as.data.frame(round(cbind(results.spline2$b, results.spline2$se, results.spline2$zval,
results.spline2$pval),3))
names(spline2.consc) <- c("*b*", "*SE*", "*z*", "*p*")
row.names(spline2.consc) <- c("Intercept", "Age.1-30",
"Age.30>", "Time lag")
kable(spline2.consc
, caption="**Second-best model with age and time lag for conscientiousness**"
, escape=FALSE
, label = NA) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| b | SE | z | p | |
|---|---|---|---|---|
| Intercept | -1.717 | 0.057 | -30.352 | 0.000 |
| Age.1-30 | -0.016 | 0.003 | -5.526 | 0.000 |
| Age.30> | -0.002 | 0.002 | -1.594 | 0.246 |
| Time lag | 0.020 | 0.008 | 2.578 | 0.070 |
## Compute models with age only (for separate R2 values)
meta.spline2_age <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_consc, sparse = TRUE)
sigma_spline2.level1_consc_age <- meta.spline2_age$sigma2[1]
sigma_spline2.level2_consc_age <- meta.spline2_age$sigma2[2]
## Compute models with time lag only (for separate R2 values)
meta.spline2_lag <- rma.mv(yi = ES, V = V_consc, mods = ~ T2_lag.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_consc, sparse = TRUE)
sigma_spline2.level1_consc_lag <- meta.spline2_lag$sigma2[1]
sigma_spline2.level2_consc_lag <- meta.spline2_lag$sigma2[2]
## R2 in model with time lag and age
r2.level1 <- round((sigma_base.level1_consc - sigma_spline2.level1_consc)/sigma_base.level1_consc,2)
r2.level1 <- ifelse(r2.level1 < 0, 0, r2.level1)
r2.level2 <- round((sigma_base.level2_consc - sigma_spline2.level2_consc)/sigma_base.level2_consc,2)
r2.level2 <- ifelse(r2.level2 < 0, 0, r2.level2)
r2 <- round(as.data.frame(rbind(c(sigma_spline2.level1_consc, sigma_base.level1_consc, r2.level1), c(sigma_spline2.level2_consc, sigma_base.level2_consc, r2.level2))),5)
## R2 in model with age only
r2.level1_age <- round((sigma_base.level1_consc - sigma_spline2.level1_consc_age)/sigma_base.level1_consc,2)
r2.level1_age <- ifelse(r2.level1_age < 0, 0, r2.level1_age)
r2.level2_age <- round((sigma_base.level2_consc - sigma_spline2.level2_consc_age)/sigma_base.level2_consc,2)
r2.level2_age <- ifelse(r2.level2_age < 0, 0, r2.level2_age)
r2_age <- round(as.data.frame(rbind(c(sigma_spline2.level1_consc_age, sigma_base.level1_consc, r2.level1_age), c(sigma_spline2.level2_consc_age, sigma_base.level2_consc, r2.level2_age))),5)
## R2 in model with time lag only
r2.level1_lag <- round((sigma_base.level1_consc - sigma_spline2.level1_consc_lag)/sigma_base.level1_consc,2)
r2.level1_lag <- ifelse(r2.level1_lag < 0, 0, r2.level1_lag)
r2.level2_lag <- round((sigma_base.level2_consc - sigma_spline2.level2_consc_lag)/sigma_base.level2_consc,2)
r2.level2_lag <- ifelse(r2.level2_lag < 0, 0, r2.level2_lag)
r2_lag <- round(as.data.frame(rbind(c(sigma_spline2.level1_consc_lag, sigma_base.level1_consc, r2.level1_lag), c(sigma_spline2.level2_consc_lag, sigma_base.level2_consc, r2.level2_lag))),5)
## Combine values in one table
r2_all <- rbind(r2, r2_age, r2_lag)
r2_all$Level <- rep(c("Level 1", "Level 2"), 3)
names(r2_all) <- c("Sigma Moderator", "Sigma Baseline", "R^2^", "Level")
r2_all <- select(r2_all, Level, everything())
kable(r2_all
, caption="**R^2^ of models**"
, escape=FALSE
, label = NA
, digits = 3) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left") %>%
pack_rows(index = c("Age and time lag" = 2, "Age only" = 2, "Time lag only" = 2))
| Level | Sigma Moderator | Sigma Baseline | R2 |
|---|---|---|---|
| Age and time lag | |||
| Level 1 | 0.032 | 0.035 | 0.07 |
| Level 2 | 0.092 | 0.112 | 0.18 |
| Age only | |||
| Level 1 | 0.033 | 0.035 | 0.04 |
| Level 2 | 0.098 | 0.112 | 0.12 |
| Time lag only | |||
| Level 1 | 0.034 | 0.035 | 0.02 |
| Level 2 | 0.108 | 0.112 | 0.03 |
Note: You can hover over the data points to receive more information.
pred <- data.frame(Age = 1:80,
SD = NA,
CI.lower = NA,
CI.upper = NA)
for (i in 1:80) {
pred$SD[i] <- predict(results.spline2,
newmods=c(ifelse(i <= 30, i, 30),
ifelse(i > 30,i - 30, 0),0),
transf=exp, addx=TRUE)$pred
pred$CI.lower[i] <- predict(results.spline2,
newmods=c(ifelse(i <= 30, i, 30),
ifelse(i > 30,i - 30, 0),0),
transf=exp, addx=TRUE)$ci.lb
pred$CI.upper[i] <- predict(results.spline2,
newmods=c(ifelse(i <= 30, i, 30),
ifelse(i > 30,i - 30, 0),0),
transf=exp, addx=TRUE)$ci.ub
}
pred$Type <- "pred"
observed <- select(data_consc, Age = T1_AgeM, ES = ES, N = T1_N) %>% ungroup() %>%
mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)
plot <- ggplot(data = total, aes(x = Age, y = SD)) +
geom_point_interactive(data = subset(total, Type == "observed"),
aes(size = N, tooltip = paste0("SD = ", round(SD,3),
", N = ", N,
", StudyID = ", StudyID),
data_id = ID),
shape = 5, color = "grey") +
geom_errorbar(data = subset(total, Type == "pred"),
aes(ymin = CI.lower, ymax = CI.upper),
color = "black", width = 0) +
geom_point_interactive(data = subset(total, Type == "pred"),
aes(tooltip =
paste0("SD = ", round(SD,3),
", 95% CI = [", round(CI.lower,3),
", ", round(CI.upper,3), "]"),
data_id = ID)) +
scale_y_continuous(limits = c(0, 0.40)) +
scale_x_continuous(limits = c(0, 80), breaks = c(0,10,20,30,40,50,60,70,80)) +
labs(y = expression(bold("SD"[POMP])), title = "Conscientiousness") +
theme_pub() +
theme(legend.position = "none")
girafe(ggobj = plot)
Note: You can hover over the data points to receive more information.
pred <- data.frame(Time = seq(from = 0.5, to = 10, by = 0.25),
SD = NA,
CI.lower = NA,
CI.upper = NA)
for (i in 1:nrow(pred)) {
pred$SD[i] <- predict(results.spline2,
newmods=c(20, 0 , pred$Time[i]),
transf=exp, addx=TRUE)$pred
pred$CI.lower[i] <- predict(results.spline2,
newmods=c(20, 0 , pred$Time[i]),
transf=exp, addx=TRUE)$ci.lb
pred$CI.upper[i] <- predict(results.spline2,
newmods=c(20, 0 , pred$Time[i]),
transf=exp, addx=TRUE)$ci.ub
}
pred$Type <- "pred"
observed <- select(data_agree, Time = T2_lag, ES = ES, N = T1_N) %>% ungroup() %>%
mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)
plot <- ggplot(data = total, aes(x = Time, y = SD)) +
geom_point_interactive(data = subset(total, Type == "observed"),
aes(size = N, tooltip = paste0("SD = ", round(SD,3),
", N = ", N,
", StudyID = ", StudyID),
data_id = ID),
shape = 5, color = "grey") +
geom_errorbar(data = subset(total, Type == "pred"),
aes(ymin = CI.lower, ymax = CI.upper),
color = "black", width = 0) +
geom_point_interactive(data = subset(total, Type == "pred"),
aes(tooltip =
paste0("SD = ", round(SD,3),
", 95% CI = [", round(CI.lower,3),
", ", round(CI.upper,3), "]"),
data_id = ID)) +
scale_y_continuous(limits = c(0, 0.40)) +
scale_x_continuous(limits = c(0, 10), breaks = c(0,1,2,3,4,5,6,7,8,9,10)) +
labs(y = expression(bold("SD"[POMP])), title = "Conscientiousness") +
theme_pub() +
theme(legend.position = "none")
girafe(ggobj = plot)
Model with two age-related variables: Age 1-55 and Age 55>
## Create age bins
data_extra$abin_1 <- ifelse(data_extra$T1_AgeM <= 55, data_extra$T1_AgeM, 55)
data_extra$abin_2 <- ifelse(data_extra$T1_AgeM > 55, data_extra$T1_AgeM - 55, 0)
## Spline approach of best-fitting model
meta.spline1 <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 + T2_lag.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_extra, sparse = TRUE)
sigma_spline1.level1_extra <- meta.spline1$sigma2[1]
sigma_spline1.level2_extra <- meta.spline1$sigma2[2]
results.spline1 <- robust(meta.spline1, cluster = StudyID, clubSandwich = TRUE)
spline1.extra <- as.data.frame(round(cbind(results.spline1$b, results.spline1$se, results.spline1$zval,
results.spline1$pval),3))
names(spline1.extra) <- c("*b*", "*SE*", "*z*", "*p*")
row.names(spline1.extra) <- c("Intercept", "Age.1-55",
"Age.55>", "Time lag")
kable(spline1.extra
, caption="**Best-fitting model with age and time lag for extraversion**"
, escape=FALSE
, label = NA) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| b | SE | z | p | |
|---|---|---|---|---|
| Intercept | -1.853 | 0.038 | -49.159 | 0.000 |
| Age.1-55 | -0.008 | 0.001 | -7.859 | 0.000 |
| Age.55> | 0.004 | 0.003 | 1.407 | 0.284 |
| Time lag | 0.018 | 0.002 | 8.479 | 0.001 |
## Compute models with age only (for separate R2 values)
meta.spline1_age <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_extra, sparse = TRUE)
sigma_spline1.level1_extra_age <- meta.spline1_age$sigma2[1]
sigma_spline1.level2_extra_age <- meta.spline1_age$sigma2[2]
## Compute models with time lag only (for separate R2 values)
meta.spline1_lag <- rma.mv(yi = ES, V = V_extra, mods = ~ T2_lag.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_extra, sparse = TRUE)
sigma_spline1.level1_extra_lag <- meta.spline1_lag$sigma2[1]
sigma_spline1.level2_extra_lag <- meta.spline1_lag$sigma2[2]
## R2 in model with time lag and age
r2.level1 <- round((sigma_base.level1_extra - sigma_spline1.level1_extra)/sigma_base.level1_extra,2)
r2.level1 <- ifelse(r2.level1 < 0, 0, r2.level1)
r2.level2 <- round((sigma_base.level2_extra - sigma_spline1.level2_extra)/sigma_base.level2_extra,2)
r2.level2 <- ifelse(r2.level2 < 0, 0, r2.level2)
r2 <- round(as.data.frame(rbind(c(sigma_spline1.level1_extra, sigma_base.level1_extra, r2.level1), c(sigma_spline1.level2_extra, sigma_base.level2_extra, r2.level2))),5)
## R2 in model with age only
r2.level1_age <- round((sigma_base.level1_extra - sigma_spline1.level1_extra_age)/sigma_base.level1_extra,2)
r2.level1_age <- ifelse(r2.level1_age < 0, 0, r2.level1_age)
r2.level2_age <- round((sigma_base.level2_extra - sigma_spline1.level2_extra_age)/sigma_base.level2_extra,2)
r2.level2_age <- ifelse(r2.level2_age < 0, 0, r2.level2_age)
r2_age <- round(as.data.frame(rbind(c(sigma_spline1.level1_extra_age, sigma_base.level1_extra, r2.level1_age), c(sigma_spline1.level2_extra_age, sigma_base.level2_extra, r2.level2_age))),5)
## R2 in model with time lag only
r2.level1_lag <- round((sigma_base.level1_extra - sigma_spline1.level1_extra_lag)/sigma_base.level1_extra,2)
r2.level1_lag <- ifelse(r2.level1_lag < 0, 0, r2.level1_lag)
r2.level2_lag <- round((sigma_base.level2_extra - sigma_spline1.level2_extra_lag)/sigma_base.level2_extra,2)
r2.level2_lag <- ifelse(r2.level2_lag < 0, 0, r2.level2_lag)
r2_lag <- round(as.data.frame(rbind(c(sigma_spline1.level1_extra_lag, sigma_base.level1_extra, r2.level1_lag), c(sigma_spline1.level2_extra_lag, sigma_base.level2_extra, r2.level2_lag))),5)
## Combine values in one table
r2_all <- rbind(r2, r2_age, r2_lag)
r2_all$Level <- rep(c("Level 1", "Level 2"), 3)
names(r2_all) <- c("Sigma Moderator", "Sigma Baseline", "R^2^", "Level")
r2_all <- select(r2_all, Level, everything())
kable(r2_all
, caption="**R^2^ of models**"
, escape=FALSE
, label = NA
, digits = 3) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left") %>%
pack_rows(index = c("Age and time lag" = 2, "Age only" = 2, "Time lag only" = 2))
| Level | Sigma Moderator | Sigma Baseline | R2 |
|---|---|---|---|
| Age and time lag | |||
| Level 1 | 0.023 | 0.024 | 0.06 |
| Level 2 | 0.081 | 0.110 | 0.26 |
| Age only | |||
| Level 1 | 0.023 | 0.024 | 0.06 |
| Level 2 | 0.098 | 0.110 | 0.10 |
| Time lag only | |||
| Level 1 | 0.024 | 0.024 | 0.00 |
| Level 2 | 0.097 | 0.110 | 0.11 |
Note: You can hover over the data points to receive more information.
pred <- data.frame(Age = 1:80,
SD = NA,
CI.lower = NA,
CI.upper = NA)
for (i in 1:80) {
pred$SD[i] <- predict(results.spline1,
newmods=c(ifelse(i <= 55, i, 55),
ifelse(i > 55,i - 55, 0),0),
transf=exp, addx=TRUE)$pred
pred$CI.lower[i] <- predict(results.spline1,
newmods=c(ifelse(i <= 55, i, 55),
ifelse(i > 55,i - 55, 0),0),
transf=exp, addx=TRUE)$ci.lb
pred$CI.upper[i] <- predict(results.spline1,
newmods=c(ifelse(i <= 55, i, 55),
ifelse(i > 55,i - 55, 0),0),
transf=exp, addx=TRUE)$ci.ub
}
pred$Type <- "pred"
observed <- select(data_extra, Age = T1_AgeM, ES = ES, N = T1_N) %>% ungroup() %>%
mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)
plot <- ggplot(data = total, aes(x = Age, y = SD)) +
geom_point_interactive(data = subset(total, Type == "observed"),
aes(size = N, tooltip = paste0("SD = ", round(SD,3),
", N = ", N,
", StudyID = ", StudyID),
data_id = ID),
shape = 5, color = "grey") +
geom_errorbar(data = subset(total, Type == "pred"),
aes(ymin = CI.lower, ymax = CI.upper),
color = "black", width = 0) +
geom_point_interactive(data = subset(total, Type == "pred"),
aes(tooltip =
paste0("SD = ", round(SD,3),
", 95% CI = [", round(CI.lower,3),
", ", round(CI.upper,3), "]"),
data_id = ID)) +
scale_y_continuous(limits = c(0, 0.40)) +
scale_x_continuous(limits = c(0, 80), breaks = c(0,10,20,30,40,50,60,70,80)) +
labs(y = expression(bold("SD"[POMP])), title = "Extraversion") +
theme_pub() +
theme(legend.position = "none")
girafe(ggobj = plot)
Note: You can hover over the data points to receive more information.
pred <- data.frame(Time = seq(from = 0.5, to = 10, by = 0.25),
SD = NA,
CI.lower = NA,
CI.upper = NA)
for (i in 1:nrow(pred)) {
pred$SD[i] <- predict(results.spline1,
newmods=c(20, 0 , pred$Time[i]),
transf=exp, addx=TRUE)$pred
pred$CI.lower[i] <- predict(results.spline1,
newmods=c(20, 0 , pred$Time[i]),
transf=exp, addx=TRUE)$ci.lb
pred$CI.upper[i] <- predict(results.spline1,
newmods=c(20, 0 , pred$Time[i]),
transf=exp, addx=TRUE)$ci.ub
}
pred$Type <- "pred"
observed <- select(data_agree, Time = T2_lag, ES = ES, N = T1_N) %>% ungroup() %>%
mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)
plot <- ggplot(data = total, aes(x = Time, y = SD)) +
geom_point_interactive(data = subset(total, Type == "observed"),
aes(size = N, tooltip = paste0("SD = ", round(SD,3),
", N = ", N,
", StudyID = ", StudyID),
data_id = ID),
shape = 5, color = "grey") +
geom_errorbar(data = subset(total, Type == "pred"),
aes(ymin = CI.lower, ymax = CI.upper),
color = "black", width = 0) +
geom_point_interactive(data = subset(total, Type == "pred"),
aes(tooltip =
paste0("SD = ", round(SD,3),
", 95% CI = [", round(CI.lower,3),
", ", round(CI.upper,3), "]"),
data_id = ID)) +
scale_y_continuous(limits = c(0, 0.40)) +
scale_x_continuous(limits = c(0, 10), breaks = c(0,1,2,3,4,5,6,7,8,9,10)) +
labs(y = expression(bold("SD"[POMP])), title = "Extraversion") +
theme_pub() +
theme(legend.position = "none")
girafe(ggobj = plot)
Model with three age-related variables: Age 1-25, Age 25-75, and Age 75>
## Create age bins
data_extra$abin_1 <- ifelse(data_extra$T1_AgeM <= 25, data_extra$T1_AgeM, 25)
data_extra$abin_2 <- ifelse(data_extra$T1_AgeM <= 75 & data_extra$T1_AgeM > 25,
data_extra$T1_AgeM - 25,
ifelse(data_extra$T1_AgeM <= 25, 0, 75 - 25))
data_extra$abin_3 <- ifelse(data_extra$T1_AgeM > 75, data_extra$T1_AgeM - 75, 0)
## Spline approach of best-fitting model
meta.spline2 <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 + abin_3 + T2_lag.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_extra, sparse = TRUE)
sigma_spline2.level1_extra <- meta.spline2$sigma2[1]
sigma_spline2.level2_extra <- meta.spline2$sigma2[2]
results.spline2 <- robust(meta.spline2, cluster = StudyID, clubSandwich = TRUE)
spline2.extra <- as.data.frame(round(cbind(results.spline2$b, results.spline2$se, results.spline2$zval,
results.spline2$pval),3))
names(spline2.extra) <- c("*b*", "*SE*", "*z*", "*p*")
row.names(spline2.extra) <- c("Intercept", "Age.1-25", "Age.25-75",
"Age.75>", "Time lag")
kable(spline2.extra
, caption="**Best-fitting model with age and time lag for extraversion**"
, escape=FALSE
, label = NA) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| b | SE | z | p | |
|---|---|---|---|---|
| Intercept | -1.740 | 0.061 | -28.321 | 0.000 |
| Age.1-25 | -0.016 | 0.003 | -5.393 | 0.000 |
| Age.25-75 | -0.004 | 0.001 | -4.128 | 0.034 |
| Age.75> | 0.011 | 0.002 | 5.579 | 0.101 |
| Time lag | 0.020 | 0.002 | 9.920 | 0.000 |
## Compute models with age only (for separate R2 values)
meta.spline2_age <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 + abin_3,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_extra, sparse = TRUE)
sigma_spline2.level1_extra_age <- meta.spline2_age$sigma2[1]
sigma_spline2.level2_extra_age <- meta.spline2_age$sigma2[2]
## Compute models with time lag only (for separate R2 values)
meta.spline2_lag <- rma.mv(yi = ES, V = V_extra, mods = ~ T2_lag.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_extra, sparse = TRUE)
sigma_spline2.level1_extra_lag <- meta.spline2_lag$sigma2[1]
sigma_spline2.level2_extra_lag <- meta.spline2_lag$sigma2[2]
## R2 in model with time lag and age
r2.level1 <- round((sigma_base.level1_extra - sigma_spline2.level1_extra)/sigma_base.level1_extra,2)
r2.level1 <- ifelse(r2.level1 < 0, 0, r2.level1)
r2.level2 <- round((sigma_base.level2_extra - sigma_spline2.level2_extra)/sigma_base.level2_extra,2)
r2.level2 <- ifelse(r2.level2 < 0, 0, r2.level2)
r2 <- round(as.data.frame(rbind(c(sigma_spline2.level1_extra, sigma_base.level1_extra, r2.level1), c(sigma_spline2.level2_extra, sigma_base.level2_extra, r2.level2))),5)
## R2 in model with age only
r2.level1_age <- round((sigma_base.level1_extra - sigma_spline2.level1_extra_age)/sigma_base.level1_extra,2)
r2.level1_age <- ifelse(r2.level1_age < 0, 0, r2.level1_age)
r2.level2_age <- round((sigma_base.level2_extra - sigma_spline2.level2_extra_age)/sigma_base.level2_extra,2)
r2.level2_age <- ifelse(r2.level2_age < 0, 0, r2.level2_age)
r2_age <- round(as.data.frame(rbind(c(sigma_spline2.level1_extra_age, sigma_base.level1_extra, r2.level1_age), c(sigma_spline2.level2_extra_age, sigma_base.level2_extra, r2.level2_age))),5)
## R2 in model with time lag only
r2.level1_lag <- round((sigma_base.level1_extra - sigma_spline2.level1_extra_lag)/sigma_base.level1_extra,2)
r2.level1_lag <- ifelse(r2.level1_lag < 0, 0, r2.level1_lag)
r2.level2_lag <- round((sigma_base.level2_extra - sigma_spline2.level2_extra_lag)/sigma_base.level2_extra,2)
r2.level2_lag <- ifelse(r2.level2_lag < 0, 0, r2.level2_lag)
r2_lag <- round(as.data.frame(rbind(c(sigma_spline2.level1_extra_lag, sigma_base.level1_extra, r2.level1_lag), c(sigma_spline2.level2_extra_lag, sigma_base.level2_extra, r2.level2_lag))),5)
## Combine values in one table
r2_all <- rbind(r2, r2_age, r2_lag)
r2_all$Level <- rep(c("Level 1", "Level 2"), 3)
names(r2_all) <- c("Sigma Moderator", "Sigma Baseline", "R^2^", "Level")
r2_all <- select(r2_all, Level, everything())
kable(r2_all
, caption="**R^2^ of models**"
, escape=FALSE
, label = NA
, digits = 3) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left") %>%
pack_rows(index = c("Age and time lag" = 2, "Age only" = 2, "Time lag only" = 2))
| Level | Sigma Moderator | Sigma Baseline | R2 |
|---|---|---|---|
| Age and time lag | |||
| Level 1 | 0.022 | 0.024 | 0.08 |
| Level 2 | 0.082 | 0.110 | 0.25 |
| Age only | |||
| Level 1 | 0.022 | 0.024 | 0.07 |
| Level 2 | 0.100 | 0.110 | 0.09 |
| Time lag only | |||
| Level 1 | 0.024 | 0.024 | 0.00 |
| Level 2 | 0.097 | 0.110 | 0.11 |
Note: You can hover over the data points to receive more information.
pred <- data.frame(Age = 1:80,
SD = NA,
CI.lower = NA,
CI.upper = NA)
for (i in 1:80) {
pred$SD[i] <- predict(results.spline2,
newmods=c(ifelse(i <= 25, i, 25),
ifelse(i <= 75 & i > 25, i - 25, ifelse(i <= 25, 0, 75 - 25)),
ifelse(i > 75,i - 75, 0),0),
transf=exp, addx=TRUE)$pred
pred$CI.lower[i] <- predict(results.spline2,
newmods=c(ifelse(i <= 25, i, 25),
ifelse(i <= 75 & i > 25, i - 25, ifelse(i <= 25, 0, 75 - 25)),
ifelse(i > 75,i - 75, 0),0),
transf=exp, addx=TRUE)$ci.lb
pred$CI.upper[i] <- predict(results.spline2,
newmods=c(ifelse(i <= 25, i, 25),
ifelse(i <= 75 & i > 25, i - 25, ifelse(i <= 25, 0, 75 - 25)),
ifelse(i > 75,i - 75, 0),0),
transf=exp, addx=TRUE)$ci.ub
}
pred$Type <- "pred"
observed <- select(data_extra, Age = T1_AgeM, ES = ES, N = T1_N) %>% ungroup() %>%
mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)
plot <- ggplot(data = total, aes(x = Age, y = SD)) +
geom_point_interactive(data = subset(total, Type == "observed"),
aes(size = N, tooltip = paste0("SD = ", round(SD,3),
", N = ", N,
", StudyID = ", StudyID),
data_id = ID),
shape = 5, color = "grey") +
geom_errorbar(data = subset(total, Type == "pred"),
aes(ymin = CI.lower, ymax = CI.upper),
color = "black", width = 0) +
geom_point_interactive(data = subset(total, Type == "pred"),
aes(tooltip =
paste0("SD = ", round(SD,3),
", 95% CI = [", round(CI.lower,3),
", ", round(CI.upper,3), "]"),
data_id = ID)) +
scale_y_continuous(limits = c(0, 0.40)) +
scale_x_continuous(limits = c(0, 80), breaks = c(0,10,20,30,40,50,60,70,80)) +
labs(y = expression(bold("SD"[POMP])), title = "Extraversion") +
theme_pub() +
theme(legend.position = "none")
girafe(ggobj = plot)
Note: You can hover over the data points to receive more information.
pred <- data.frame(Time = seq(from = 0.5, to = 10, by = 0.25),
SD = NA,
CI.lower = NA,
CI.upper = NA)
for (i in 1:nrow(pred)) {
pred$SD[i] <- predict(results.spline2,
newmods=c(20, 0 , 0, pred$Time[i]),
transf=exp, addx=TRUE)$pred
pred$CI.lower[i] <- predict(results.spline2,
newmods=c(20, 0 , 0, pred$Time[i]),
transf=exp, addx=TRUE)$ci.lb
pred$CI.upper[i] <- predict(results.spline2,
newmods=c(20, 0 , 0, pred$Time[i]),
transf=exp, addx=TRUE)$ci.ub
}
pred$Type <- "pred"
observed <- select(data_agree, Time = T2_lag, ES = ES, N = T1_N) %>% ungroup() %>%
mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)
plot <- ggplot(data = total, aes(x = Time, y = SD)) +
geom_point_interactive(data = subset(total, Type == "observed"),
aes(size = N, tooltip = paste0("SD = ", round(SD,3),
", N = ", N,
", StudyID = ", StudyID),
data_id = ID),
shape = 5, color = "grey") +
geom_errorbar(data = subset(total, Type == "pred"),
aes(ymin = CI.lower, ymax = CI.upper),
color = "black", width = 0) +
geom_point_interactive(data = subset(total, Type == "pred"),
aes(tooltip =
paste0("SD = ", round(SD,3),
", 95% CI = [", round(CI.lower,3),
", ", round(CI.upper,3), "]"),
data_id = ID)) +
scale_y_continuous(limits = c(0, 0.40)) +
scale_x_continuous(limits = c(0, 10), breaks = c(0,1,2,3,4,5,6,7,8,9,10)) +
labs(y = expression(bold("SD"[POMP])), title = "Extraversion") +
theme_pub() +
theme(legend.position = "none")
girafe(ggobj = plot)
Model with three age-related variables: Age 1-25, Age 25-75, and Age 75>
## Create age bins
data_neuro$abin_1 <- ifelse(data_neuro$T1_AgeM <= 25, data_neuro$T1_AgeM, 25)
data_neuro$abin_2 <- ifelse(data_neuro$T1_AgeM <= 75 & data_neuro$T1_AgeM > 25,
data_neuro$T1_AgeM - 25,
ifelse(data_neuro$T1_AgeM <= 25, 0, 75 - 25))
data_neuro$abin_3 <- ifelse(data_neuro$T1_AgeM > 75, data_neuro$T1_AgeM - 75, 0)
## Spline approach of best-fitting model
meta.spline1 <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 + T2_lag.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_neuro, sparse = TRUE)
sigma_spline1.level1_neuro <- meta.spline1$sigma2[1]
sigma_spline1.level2_neuro <- meta.spline1$sigma2[2]
results.spline1 <- robust(meta.spline1, cluster = StudyID, clubSandwich = TRUE)
spline1.neuro <- as.data.frame(round(cbind(results.spline1$b, results.spline1$se, results.spline1$zval,
results.spline1$pval),3))
names(spline1.neuro) <- c("*b*", "*SE*", "*z*", "*p*")
row.names(spline1.neuro) <- c("Intercept", "Age.1-25", "Age.25-75",
"Age.75>", "Time lag")
kable(spline1.neuro
, caption="**Best-fitting model with age and time lag for neuroticism**"
, escape=FALSE
, label = NA) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| b | SE | z | p | |
|---|---|---|---|---|
| Intercept | -1.667 | 0.054 | -30.778 | 0.000 |
| Age.1-25 | -0.016 | 0.003 | -4.996 | 0.000 |
| Age.25-75 | -0.004 | 0.001 | -3.471 | 0.044 |
| Age.75> | 0.017 | 0.005 | 3.177 | 0.180 |
| Time lag | 0.017 | 0.002 | 8.957 | 0.000 |
## Compute models with age only (for separate R2 values)
meta.spline1_age <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_neuro, sparse = TRUE)
sigma_spline1.level1_neuro_age <- meta.spline1_age$sigma2[1]
sigma_spline1.level2_neuro_age <- meta.spline1_age$sigma2[2]
## Compute models with time lag only (for separate R2 values)
meta.spline1_lag <- rma.mv(yi = ES, V = V_neuro, mods = ~ T2_lag.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_neuro, sparse = TRUE)
sigma_spline1.level1_neuro_lag <- meta.spline1_lag$sigma2[1]
sigma_spline1.level2_neuro_lag <- meta.spline1_lag$sigma2[2]
## R2 in model with time lag and age
r2.level1 <- round((sigma_base.level1_neuro - sigma_spline1.level1_neuro)/sigma_base.level1_neuro,2)
r2.level1 <- ifelse(r2.level1 < 0, 0, r2.level1)
r2.level2 <- round((sigma_base.level2_neuro - sigma_spline1.level2_neuro)/sigma_base.level2_neuro,2)
r2.level2 <- ifelse(r2.level2 < 0, 0, r2.level2)
r2 <- round(as.data.frame(rbind(c(sigma_spline1.level1_neuro, sigma_base.level1_neuro, r2.level1), c(sigma_spline1.level2_neuro, sigma_base.level2_neuro, r2.level2))),5)
## R2 in model with age only
r2.level1_age <- round((sigma_base.level1_neuro - sigma_spline1.level1_neuro_age)/sigma_base.level1_neuro,2)
r2.level1_age <- ifelse(r2.level1_age < 0, 0, r2.level1_age)
r2.level2_age <- round((sigma_base.level2_neuro - sigma_spline1.level2_neuro_age)/sigma_base.level2_neuro,2)
r2.level2_age <- ifelse(r2.level2_age < 0, 0, r2.level2_age)
r2_age <- round(as.data.frame(rbind(c(sigma_spline1.level1_neuro_age, sigma_base.level1_neuro, r2.level1_age), c(sigma_spline1.level2_neuro_age, sigma_base.level2_neuro, r2.level2_age))),5)
## R2 in model with time lag only
r2.level1_lag <- round((sigma_base.level1_neuro - sigma_spline1.level1_neuro_lag)/sigma_base.level1_neuro,2)
r2.level1_lag <- ifelse(r2.level1_lag < 0, 0, r2.level1_lag)
r2.level2_lag <- round((sigma_base.level2_neuro - sigma_spline1.level2_neuro_lag)/sigma_base.level2_neuro,2)
r2.level2_lag <- ifelse(r2.level2_lag < 0, 0, r2.level2_lag)
r2_lag <- round(as.data.frame(rbind(c(sigma_spline1.level1_neuro_lag, sigma_base.level1_neuro, r2.level1_lag), c(sigma_spline1.level2_neuro_lag, sigma_base.level2_neuro, r2.level2_lag))),5)
## Combine values in one table
r2_all <- rbind(r2, r2_age, r2_lag)
r2_all$Level <- rep(c("Level 1", "Level 2"), 3)
names(r2_all) <- c("Sigma Moderator", "Sigma Baseline", "R^2^", "Level")
r2_all <- select(r2_all, Level, everything())
kable(r2_all
, caption="**R^2^ of models**"
, escape=FALSE
, label = NA
, digits = 3) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left") %>%
pack_rows(index = c("Age and time lag" = 2, "Age only" = 2, "Time lag only" = 2))
| Level | Sigma Moderator | Sigma Baseline | R2 |
|---|---|---|---|
| Age and time lag | |||
| Level 1 | 0.032 | 0.034 | 0.06 |
| Level 2 | 0.075 | 0.088 | 0.15 |
| Age only | |||
| Level 1 | 0.032 | 0.034 | 0.05 |
| Level 2 | 0.081 | 0.088 | 0.08 |
| Time lag only | |||
| Level 1 | 0.033 | 0.034 | 0.00 |
| Level 2 | 0.085 | 0.088 | 0.04 |
Note: You can hover over the data points to receive more information.
pred <- data.frame(Age = 1:80,
SD = NA,
CI.lower = NA,
CI.upper = NA)
for (i in 1:80) {
pred$SD[i] <- predict(results.spline1,
newmods=c(ifelse(i <= 25, i, 25),
ifelse(i <= 75 & i > 25, i - 25, ifelse(i <= 25, 0, 75 - 25)),
ifelse(i > 75,i - 75, 0),0),
transf=exp, addx=TRUE)$pred
pred$CI.lower[i] <- predict(results.spline1,
newmods=c(ifelse(i <= 25, i, 25),
ifelse(i <= 75 & i > 25, i - 25, ifelse(i <= 25, 0, 75 - 25)),
ifelse(i > 75,i - 75, 0),0),
transf=exp, addx=TRUE)$ci.lb
pred$CI.upper[i] <- predict(results.spline1,
newmods=c(ifelse(i <= 25, i, 25),
ifelse(i <= 75 & i > 25, i - 25, ifelse(i <= 25, 0, 75 - 25)),
ifelse(i > 75,i - 75, 0),0),
transf=exp, addx=TRUE)$ci.ub
}
pred$Type <- "pred"
observed <- select(data_neuro, Age = T1_AgeM, ES = ES, N = T1_N) %>% ungroup() %>%
mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)
plot <- ggplot(data = total, aes(x = Age, y = SD)) +
geom_point_interactive(data = subset(total, Type == "observed"),
aes(size = N, tooltip = paste0("SD = ", round(SD,3),
", N = ", N,
", StudyID = ", StudyID),
data_id = ID),
shape = 5, color = "grey") +
geom_errorbar(data = subset(total, Type == "pred"),
aes(ymin = CI.lower, ymax = CI.upper),
color = "black", width = 0) +
geom_point_interactive(data = subset(total, Type == "pred"),
aes(tooltip =
paste0("SD = ", round(SD,3),
", 95% CI = [", round(CI.lower,3),
", ", round(CI.upper,3), "]"),
data_id = ID)) +
scale_y_continuous(limits = c(0, 0.40)) +
scale_x_continuous(limits = c(0, 80), breaks = c(0,10,20,30,40,50,60,70,80)) +
labs(y = expression(bold("SD"[POMP])), title = "Neuroticism") +
theme_pub() +
theme(legend.position = "none")
girafe(ggobj = plot)
Note: You can hover over the data points to receive more information.
pred <- data.frame(Time = seq(from = 0.5, to = 10, by = 0.25),
SD = NA,
CI.lower = NA,
CI.upper = NA)
for (i in 1:nrow(pred)) {
pred$SD[i] <- predict(results.spline1,
newmods=c(20, 0 , 0, pred$Time[i]),
transf=exp, addx=TRUE)$pred
pred$CI.lower[i] <- predict(results.spline1,
newmods=c(20, 0 , 0, pred$Time[i]),
transf=exp, addx=TRUE)$ci.lb
pred$CI.upper[i] <- predict(results.spline1,
newmods=c(20, 0 , 0, pred$Time[i]),
transf=exp, addx=TRUE)$ci.ub
}
pred$Type <- "pred"
observed <- select(data_agree, Time = T2_lag, ES = ES, N = T1_N) %>% ungroup() %>%
mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)
plot <- ggplot(data = total, aes(x = Time, y = SD)) +
geom_point_interactive(data = subset(total, Type == "observed"),
aes(size = N, tooltip = paste0("SD = ", round(SD,3),
", N = ", N,
", StudyID = ", StudyID),
data_id = ID),
shape = 5, color = "grey") +
geom_errorbar(data = subset(total, Type == "pred"),
aes(ymin = CI.lower, ymax = CI.upper),
color = "black", width = 0) +
geom_point_interactive(data = subset(total, Type == "pred"),
aes(tooltip =
paste0("SD = ", round(SD,3),
", 95% CI = [", round(CI.lower,3),
", ", round(CI.upper,3), "]"),
data_id = ID)) +
scale_y_continuous(limits = c(0, 0.40)) +
scale_x_continuous(limits = c(0, 10), breaks = c(0,1,2,3,4,5,6,7,8,9,10)) +
labs(y = expression(bold("SD"[POMP])), title = "Neuroticism") +
theme_pub() +
theme(legend.position = "none")
girafe(ggobj = plot)
Model with four age-related variables: Age 1-15, Age 15-20, Age 20-75, and Age 75+
## Create age bins
data_neuro$abin_1 <- ifelse(data_neuro$T1_AgeM <= 15, data_neuro$T1_AgeM, 15)
data_neuro$abin_2 <- ifelse(data_neuro$T1_AgeM <= 20 & data_neuro$T1_AgeM > 15,
data_neuro$T1_AgeM - 15,
ifelse(data_neuro$T1_AgeM <= 15, 0, 20 - 15))
data_neuro$abin_3 <- ifelse(data_neuro$T1_AgeM <= 75 & data_neuro$T1_AgeM > 20,
data_neuro$T1_AgeM - 20,
ifelse(data_neuro$T1_AgeM <= 20, 0, 75 - 20))
data_neuro$abin_4 <- ifelse(data_neuro$T1_AgeM > 75, data_neuro$T1_AgeM - 75, 0)
## Spline approach of best-fitting model
meta.spline2 <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 + abin_4 + T2_lag.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_neuro, sparse = TRUE)
sigma_spline2.level1_neuro <- meta.spline2$sigma2[1]
sigma_spline2.level2_neuro <- meta.spline2$sigma2[2]
results.spline2 <- robust(meta.spline2, cluster = StudyID, clubSandwich = TRUE)
spline2.neuro <- as.data.frame(round(cbind(results.spline2$b, results.spline2$se, results.spline2$zval,
results.spline2$pval),3))
names(spline2.neuro) <- c("*b*", "*SE*", "*z*", "*p*")
row.names(spline2.neuro) <- c("Intercept", "Age.1-15", "Age.15-20",
"Age.20-75",
"Age.75>", "Time lag")
kable(spline2.neuro
, caption="**Second-best model with age and time lag for neuroticism**"
, escape=FALSE
, label = NA) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| b | SE | z | p | |
|---|---|---|---|---|
| Intercept | -1.739 | 0.064 | -27.391 | 0.000 |
| Age.1-15 | -0.008 | 0.005 | -1.684 | 0.102 |
| Age.15-20 | -0.039 | 0.009 | -4.112 | 0.000 |
| Age.20-75 | -0.004 | 0.001 | -3.659 | 0.034 |
| Age.75> | 0.017 | 0.005 | 3.192 | 0.179 |
| Time lag | 0.018 | 0.002 | 8.389 | 0.000 |
## Compute models with age only (for separate R2 values)
meta.spline2_age <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 + abin_4,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_neuro, sparse = TRUE)
sigma_spline2.level1_neuro_age <- meta.spline2_age$sigma2[1]
sigma_spline2.level2_neuro_age <- meta.spline2_age$sigma2[2]
## Compute models with time lag only (for separate R2 values)
meta.spline2_lag <- rma.mv(yi = ES, V = V_neuro, mods = ~ T2_lag.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_neuro, sparse = TRUE)
sigma_spline2.level1_neuro_lag <- meta.spline2_lag$sigma2[1]
sigma_spline2.level2_neuro_lag <- meta.spline2_lag$sigma2[2]
## R2 in model with time lag and age
r2.level1 <- round((sigma_base.level1_neuro - sigma_spline2.level1_neuro)/sigma_base.level1_neuro,2)
r2.level1 <- ifelse(r2.level1 < 0, 0, r2.level1)
r2.level2 <- round((sigma_base.level2_neuro - sigma_spline2.level2_neuro)/sigma_base.level2_neuro,2)
r2.level2 <- ifelse(r2.level2 < 0, 0, r2.level2)
r2 <- round(as.data.frame(rbind(c(sigma_spline2.level1_neuro, sigma_base.level1_neuro, r2.level1), c(sigma_spline2.level2_neuro, sigma_base.level2_neuro, r2.level2))),5)
## R2 in model with age only
r2.level1_age <- round((sigma_base.level1_neuro - sigma_spline2.level1_neuro_age)/sigma_base.level1_neuro,2)
r2.level1_age <- ifelse(r2.level1_age < 0, 0, r2.level1_age)
r2.level2_age <- round((sigma_base.level2_neuro - sigma_spline2.level2_neuro_age)/sigma_base.level2_neuro,2)
r2.level2_age <- ifelse(r2.level2_age < 0, 0, r2.level2_age)
r2_age <- round(as.data.frame(rbind(c(sigma_spline2.level1_neuro_age, sigma_base.level1_neuro, r2.level1_age), c(sigma_spline2.level2_neuro_age, sigma_base.level2_neuro, r2.level2_age))),5)
## R2 in model with time lag only
r2.level1_lag <- round((sigma_base.level1_neuro - sigma_spline2.level1_neuro_lag)/sigma_base.level1_neuro,2)
r2.level1_lag <- ifelse(r2.level1_lag < 0, 0, r2.level1_lag)
r2.level2_lag <- round((sigma_base.level2_neuro - sigma_spline2.level2_neuro_lag)/sigma_base.level2_neuro,2)
r2.level2_lag <- ifelse(r2.level2_lag < 0, 0, r2.level2_lag)
r2_lag <- round(as.data.frame(rbind(c(sigma_spline2.level1_neuro_lag, sigma_base.level1_neuro, r2.level1_lag), c(sigma_spline2.level2_neuro_lag, sigma_base.level2_neuro, r2.level2_lag))),5)
## Combine values in one table
r2_all <- rbind(r2, r2_age, r2_lag)
r2_all$Level <- rep(c("Level 1", "Level 2"), 3)
names(r2_all) <- c("Sigma Moderator", "Sigma Baseline", "R^2^", "Level")
r2_all <- select(r2_all, Level, everything())
kable(r2_all
, caption="**R^2^ of models**"
, escape=FALSE
, label = NA
, digits = 3) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left") %>%
pack_rows(index = c("Age and time lag" = 2, "Age only" = 2, "Time lag only" = 2))
| Level | Sigma Moderator | Sigma Baseline | R2 |
|---|---|---|---|
| Age and time lag | |||
| Level 1 | 0.032 | 0.034 | 0.06 |
| Level 2 | 0.072 | 0.088 | 0.18 |
| Age only | |||
| Level 1 | 0.032 | 0.034 | 0.05 |
| Level 2 | 0.079 | 0.088 | 0.10 |
| Time lag only | |||
| Level 1 | 0.033 | 0.034 | 0.00 |
| Level 2 | 0.085 | 0.088 | 0.04 |
Note: You can hover over the data points to receive more information.
pred <- data.frame(Age = 1:80,
SD = NA,
CI.lower = NA,
CI.upper = NA)
for (i in 1:80) {
pred$SD[i] <- predict(results.spline2,
newmods=c(ifelse(i <= 15, i, 15),
ifelse(i <= 20 & i > 15, i - 15, ifelse(i <= 15, 0, 20 - 15)),
ifelse(i <= 75 & i > 20, i - 20, ifelse(i <= 20, 0, 75 - 20)),
ifelse(i > 75,i - 75, 0),0),
transf=exp, addx=TRUE)$pred
pred$CI.lower[i] <- predict(results.spline2,
newmods=c(ifelse(i <= 15, i, 15),
ifelse(i <= 20 & i > 15, i - 15, ifelse(i <= 15, 0, 20 - 15)),
ifelse(i <= 75 & i > 20, i - 20, ifelse(i <= 20, 0, 75 - 20)),
ifelse(i > 75,i - 75, 0),0),
transf=exp, addx=TRUE)$ci.lb
pred$CI.upper[i] <- predict(results.spline2,
newmods=c(ifelse(i <= 15, i, 15),
ifelse(i <= 20 & i > 15, i - 15, ifelse(i <= 15, 0, 20 - 15)),
ifelse(i <= 75 & i > 20, i - 20, ifelse(i <= 20, 0, 75 - 20)),
ifelse(i > 75,i - 75, 0),0),
transf=exp, addx=TRUE)$ci.ub
}
pred$Type <- "pred"
observed <- select(data_neuro, Age = T1_AgeM, ES = ES, N = T1_N) %>% ungroup() %>%
mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)
plot <- ggplot(data = total, aes(x = Age, y = SD)) +
geom_point_interactive(data = subset(total, Type == "observed"),
aes(size = N, tooltip = paste0("SD = ", round(SD,3),
", N = ", N,
", StudyID = ", StudyID),
data_id = ID),
shape = 5, color = "grey") +
geom_errorbar(data = subset(total, Type == "pred"),
aes(ymin = CI.lower, ymax = CI.upper),
color = "black", width = 0) +
geom_point_interactive(data = subset(total, Type == "pred"),
aes(tooltip =
paste0("SD = ", round(SD,3),
", 95% CI = [", round(CI.lower,3),
", ", round(CI.upper,3), "]"),
data_id = ID)) +
scale_y_continuous(limits = c(0, 0.40)) +
scale_x_continuous(limits = c(0, 80), breaks = c(0,10,20,30,40,50,60,70,80)) +
labs(y = expression(bold("SD"[POMP])), title = "Neuroticism") +
theme_pub() +
theme(legend.position = "none")
girafe(ggobj = plot)
Note: You can hover over the data points to receive more information.
pred <- data.frame(Time = seq(from = 0.5, to = 10, by = 0.25),
SD = NA,
CI.lower = NA,
CI.upper = NA)
for (i in 1:nrow(pred)) {
pred$SD[i] <- predict(results.spline2,
newmods=c(15, 5, 0, 0, pred$Time[i]),
transf=exp, addx=TRUE)$pred
pred$CI.lower[i] <- predict(results.spline2,
newmods=c(15, 5, 0, 0, pred$Time[i]),
transf=exp, addx=TRUE)$ci.lb
pred$CI.upper[i] <- predict(results.spline2,
newmods=c(15, 5, 0, 0, pred$Time[i]),
transf=exp, addx=TRUE)$ci.ub
}
pred$Type <- "pred"
observed <- select(data_agree, Time = T2_lag, ES = ES, N = T1_N) %>% ungroup() %>%
mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)
plot <- ggplot(data = total, aes(x = Time, y = SD)) +
geom_point_interactive(data = subset(total, Type == "observed"),
aes(size = N, tooltip = paste0("SD = ", round(SD,3),
", N = ", N,
", StudyID = ", StudyID),
data_id = ID),
shape = 5, color = "grey") +
geom_errorbar(data = subset(total, Type == "pred"),
aes(ymin = CI.lower, ymax = CI.upper),
color = "black", width = 0) +
geom_point_interactive(data = subset(total, Type == "pred"),
aes(tooltip =
paste0("SD = ", round(SD,3),
", 95% CI = [", round(CI.lower,3),
", ", round(CI.upper,3), "]"),
data_id = ID)) +
scale_y_continuous(limits = c(0, 0.40)) +
scale_x_continuous(limits = c(0, 10), breaks = c(0,1,2,3,4,5,6,7,8,9,10)) +
labs(y = expression(bold("SD"[POMP])), title = "Neuroticism") +
theme_pub() +
theme(legend.position = "none")
girafe(ggobj = plot)
Model with two age-related variables: Age 1-30 and Age 30>
## Create age bins
data_open$abin_1 <- ifelse(data_open$T1_AgeM <= 30, data_open$T1_AgeM, 30)
data_open$abin_2 <- ifelse(data_open$T1_AgeM > 30, data_open$T1_AgeM - 30, 0)
## Spline approach of best-fitting model
meta.spline1 <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 + T2_lag.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_open, sparse = TRUE)
sigma_spline1.level1_open <- meta.spline1$sigma2[1]
sigma_spline1.level2_open <- meta.spline1$sigma2[2]
results.spline1 <- robust(meta.spline1, cluster = StudyID, clubSandwich = TRUE)
spline1.open <- as.data.frame(round(cbind(results.spline1$b, results.spline1$se, results.spline1$zval,
results.spline1$pval),3))
names(spline1.open) <- c("*b*", "*SE*", "*z*", "*p*")
row.names(spline1.open) <- c("Intercept", "Age.1-30",
"Age.30>", "Time lag")
kable(spline1.open
, caption="**Best-fitting model with age and time lag for openness**"
, escape=FALSE
, label = NA) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| b | SE | z | p | |
|---|---|---|---|---|
| Intercept | -1.826 | 0.090 | -20.357 | 0.000 |
| Age.1-30 | -0.015 | 0.004 | -3.831 | 0.014 |
| Age.30> | 0.001 | 0.002 | 0.391 | 0.740 |
| Time lag | 0.012 | 0.004 | 3.223 | 0.024 |
## Compute models with age only (for separate R2 values)
meta.spline1_age <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_open, sparse = TRUE)
sigma_spline1.level1_open_age <- meta.spline1_age$sigma2[1]
sigma_spline1.level2_open_age <- meta.spline1_age$sigma2[2]
## Compute models with time lag only (for separate R2 values)
meta.spline1_lag <- rma.mv(yi = ES, V = V_open, mods = ~ T2_lag.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_open, sparse = TRUE)
sigma_spline1.level1_open_lag <- meta.spline1_lag$sigma2[1]
sigma_spline1.level2_open_lag <- meta.spline1_lag$sigma2[2]
## R2 in model with time lag and age
r2.level1 <- round((sigma_base.level1_open - sigma_spline1.level1_open)/sigma_base.level1_open,2)
r2.level1 <- ifelse(r2.level1 < 0, 0, r2.level1)
r2.level2 <- round((sigma_base.level2_open - sigma_spline1.level2_open)/sigma_base.level2_open,2)
r2.level2 <- ifelse(r2.level2 < 0, 0, r2.level2)
r2 <- round(as.data.frame(rbind(c(sigma_spline1.level1_open, sigma_base.level1_open, r2.level1), c(sigma_spline1.level2_open, sigma_base.level2_open, r2.level2))),5)
## R2 in model with age only
r2.level1_age <- round((sigma_base.level1_open - sigma_spline1.level1_open_age)/sigma_base.level1_open,2)
r2.level1_age <- ifelse(r2.level1_age < 0, 0, r2.level1_age)
r2.level2_age <- round((sigma_base.level2_open - sigma_spline1.level2_open_age)/sigma_base.level2_open,2)
r2.level2_age <- ifelse(r2.level2_age < 0, 0, r2.level2_age)
r2_age <- round(as.data.frame(rbind(c(sigma_spline1.level1_open_age, sigma_base.level1_open, r2.level1_age), c(sigma_spline1.level2_open_age, sigma_base.level2_open, r2.level2_age))),5)
## R2 in model with time lag only
r2.level1_lag <- round((sigma_base.level1_open - sigma_spline1.level1_open_lag)/sigma_base.level1_open,2)
r2.level1_lag <- ifelse(r2.level1_lag < 0, 0, r2.level1_lag)
r2.level2_lag <- round((sigma_base.level2_open - sigma_spline1.level2_open_lag)/sigma_base.level2_open,2)
r2.level2_lag <- ifelse(r2.level2_lag < 0, 0, r2.level2_lag)
r2_lag <- round(as.data.frame(rbind(c(sigma_spline1.level1_open_lag, sigma_base.level1_open, r2.level1_lag), c(sigma_spline1.level2_open_lag, sigma_base.level2_open, r2.level2_lag))),5)
## Combine values in one table
r2_all <- rbind(r2, r2_age, r2_lag)
r2_all$Level <- rep(c("Level 1", "Level 2"), 3)
names(r2_all) <- c("Sigma Moderator", "Sigma Baseline", "R^2^", "Level")
r2_all <- select(r2_all, Level, everything())
kable(r2_all
, caption="**R^2^ of models**"
, escape=FALSE
, label = NA
, digits = 3) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left") %>%
pack_rows(index = c("Age and time lag" = 2, "Age only" = 2, "Time lag only" = 2))
| Level | Sigma Moderator | Sigma Baseline | R2 |
|---|---|---|---|
| Age and time lag | |||
| Level 1 | 0.015 | 0.016 | 0.04 |
| Level 2 | 0.123 | 0.158 | 0.22 |
| Age only | |||
| Level 1 | 0.015 | 0.016 | 0.05 |
| Level 2 | 0.146 | 0.158 | 0.07 |
| Time lag only | |||
| Level 1 | 0.016 | 0.016 | 0.00 |
| Level 2 | 0.143 | 0.158 | 0.10 |
Note: You can hover over the data points to receive more information.
pred <- data.frame(Age = 1:80,
SD = NA,
CI.lower = NA,
CI.upper = NA)
for (i in 1:80) {
pred$SD[i] <- predict(results.spline1,
newmods=c(ifelse(i <= 30, i, 30),
ifelse(i > 30,i - 30, 0),0),
transf=exp, addx=TRUE)$pred
pred$CI.lower[i] <- predict(results.spline1,
newmods=c(ifelse(i <= 30, i, 30),
ifelse(i > 30,i - 30, 0),0),
transf=exp, addx=TRUE)$ci.lb
pred$CI.upper[i] <- predict(results.spline1,
newmods=c(ifelse(i <= 30, i, 30),
ifelse(i > 30,i - 30, 0),0),
transf=exp, addx=TRUE)$ci.ub
}
pred$Type <- "pred"
observed <- select(data_open, Age = T1_AgeM, ES = ES, N = T1_N) %>% ungroup() %>%
mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)
plot <- ggplot(data = total, aes(x = Age, y = SD)) +
geom_point_interactive(data = subset(total, Type == "observed"),
aes(size = N, tooltip = paste0("SD = ", round(SD,3),
", N = ", N,
", StudyID = ", StudyID),
data_id = ID),
shape = 5, color = "grey") +
geom_errorbar(data = subset(total, Type == "pred"),
aes(ymin = CI.lower, ymax = CI.upper),
color = "black", width = 0) +
geom_point_interactive(data = subset(total, Type == "pred"),
aes(tooltip =
paste0("SD = ", round(SD,3),
", 95% CI = [", round(CI.lower,3),
", ", round(CI.upper,3), "]"),
data_id = ID)) +
scale_y_continuous(limits = c(0, 0.40)) +
scale_x_continuous(limits = c(0, 80), breaks = c(0,10,20,30,40,50,60,70,80)) +
labs(y = expression(bold("SD"[POMP])), title = "Openness") +
theme_pub() +
theme(legend.position = "none")
girafe(ggobj = plot)
Note: You can hover over the data points to receive more information.
pred <- data.frame(Time = seq(from = 0.5, to = 10, by = 0.25),
SD = NA,
CI.lower = NA,
CI.upper = NA)
for (i in 1:nrow(pred)) {
pred$SD[i] <- predict(results.spline1,
newmods=c(20, 0, pred$Time[i]),
transf=exp, addx=TRUE)$pred
pred$CI.lower[i] <- predict(results.spline1,
newmods=c(20, 0, pred$Time[i]),
transf=exp, addx=TRUE)$ci.lb
pred$CI.upper[i] <- predict(results.spline1,
newmods=c(20, 0, pred$Time[i]),
transf=exp, addx=TRUE)$ci.ub
}
pred$Type <- "pred"
observed <- select(data_agree, Time = T2_lag, ES = ES, N = T1_N) %>% ungroup() %>%
mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)
plot <- ggplot(data = total, aes(x = Time, y = SD)) +
geom_point_interactive(data = subset(total, Type == "observed"),
aes(size = N, tooltip = paste0("SD = ", round(SD,3),
", N = ", N,
", StudyID = ", StudyID),
data_id = ID),
shape = 5, color = "grey") +
geom_errorbar(data = subset(total, Type == "pred"),
aes(ymin = CI.lower, ymax = CI.upper),
color = "black", width = 0) +
geom_point_interactive(data = subset(total, Type == "pred"),
aes(tooltip =
paste0("SD = ", round(SD,3),
", 95% CI = [", round(CI.lower,3),
", ", round(CI.upper,3), "]"),
data_id = ID)) +
scale_y_continuous(limits = c(0, 0.40)) +
scale_x_continuous(limits = c(0, 10), breaks = c(0,1,2,3,4,5,6,7,8,9,10)) +
labs(y = expression(bold("SD"[POMP])), title = "Openness") +
theme_pub() +
theme(legend.position = "none")
girafe(ggobj = plot)
Model with four age-related variables: Age 1-15, Age 15-20, Age 20-65, and Age 65>
## Create age bins
data_open$abin_1 <- ifelse(data_open$T1_AgeM <= 15, data_open$T1_AgeM, 15)
data_open$abin_2 <- ifelse(data_open$T1_AgeM <= 20 & data_open$T1_AgeM > 15,
data_open$T1_AgeM - 15,
ifelse(data_open$T1_AgeM <= 15, 0, 20 - 15))
data_open$abin_3 <- ifelse(data_open$T1_AgeM <= 65 & data_open$T1_AgeM > 20,
data_open$T1_AgeM - 20,
ifelse(data_open$T1_AgeM <= 20, 0, 65 - 20))
data_open$abin_4 <- ifelse(data_open$T1_AgeM > 65, data_open$T1_AgeM - 65, 0)
## Spline approach of best-fitting model
meta.spline2 <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 + abin_3 + abin_4 + T2_lag.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_open, sparse = TRUE)
sigma_spline2.level1_open <- meta.spline2$sigma2[1]
sigma_spline2.level2_open <- meta.spline2$sigma2[2]
results.spline2 <- robust(meta.spline2, cluster = StudyID, clubSandwich = TRUE)
spline2.open <- as.data.frame(round(cbind(results.spline2$b, results.spline2$se, results.spline2$zval,
results.spline2$pval),3))
names(spline2.open) <- c("*b*", "*SE*", "*z*", "*p*")
row.names(spline2.open) <- c("Intercept", "Age.1-15",
"Age.15-20", "Age.20-65",
"Age.65>", "Time lag")
kable(spline2.open
, caption="**Second-best model with age and time lag for openness**"
, escape=FALSE
, label = NA) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| b | SE | z | p | |
|---|---|---|---|---|
| Intercept | -1.963 | 0.134 | -14.654 | 0.000 |
| Age.1-15 | -0.002 | 0.008 | -0.294 | 0.786 |
| Age.15-20 | -0.040 | 0.011 | -3.680 | 0.005 |
| Age.20-65 | -0.002 | 0.001 | -2.650 | 0.126 |
| Age.65> | 0.007 | 0.003 | 2.337 | 0.237 |
| Time lag | 0.014 | 0.003 | 3.920 | 0.011 |
## Compute models with age only (for separate R2 values)
meta.spline2_age <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 + abin_3 + abin_4,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_open, sparse = TRUE)
sigma_spline2.level1_open_age <- meta.spline2_age$sigma2[1]
sigma_spline2.level2_open_age <- meta.spline2_age$sigma2[2]
## Compute models with time lag only (for separate R2 values)
meta.spline2_lag <- rma.mv(yi = ES, V = V_open, mods = ~ T2_lag.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_open, sparse = TRUE)
sigma_spline2.level1_open_lag <- meta.spline2_lag$sigma2[1]
sigma_spline2.level2_open_lag <- meta.spline2_lag$sigma2[2]
## R2 in model with time lag and age
r2.level1 <- round((sigma_base.level1_open - sigma_spline2.level1_open)/sigma_base.level1_open,2)
r2.level1 <- ifelse(r2.level1 < 0, 0, r2.level1)
r2.level2 <- round((sigma_base.level2_open - sigma_spline2.level2_open)/sigma_base.level2_open,2)
r2.level2 <- ifelse(r2.level2 < 0, 0, r2.level2)
r2 <- round(as.data.frame(rbind(c(sigma_spline2.level1_open, sigma_base.level1_open, r2.level1), c(sigma_spline2.level2_open, sigma_base.level2_open, r2.level2))),5)
## R2 in model with age only
r2.level1_age <- round((sigma_base.level1_open - sigma_spline2.level1_open_age)/sigma_base.level1_open,2)
r2.level1_age <- ifelse(r2.level1_age < 0, 0, r2.level1_age)
r2.level2_age <- round((sigma_base.level2_open - sigma_spline2.level2_open_age)/sigma_base.level2_open,2)
r2.level2_age <- ifelse(r2.level2_age < 0, 0, r2.level2_age)
r2_age <- round(as.data.frame(rbind(c(sigma_spline2.level1_open_age, sigma_base.level1_open, r2.level1_age), c(sigma_spline2.level2_open_age, sigma_base.level2_open, r2.level2_age))),5)
## R2 in model with time lag only
r2.level1_lag <- round((sigma_base.level1_open - sigma_spline2.level1_open_lag)/sigma_base.level1_open,2)
r2.level1_lag <- ifelse(r2.level1_lag < 0, 0, r2.level1_lag)
r2.level2_lag <- round((sigma_base.level2_open - sigma_spline2.level2_open_lag)/sigma_base.level2_open,2)
r2.level2_lag <- ifelse(r2.level2_lag < 0, 0, r2.level2_lag)
r2_lag <- round(as.data.frame(rbind(c(sigma_spline2.level1_open_lag, sigma_base.level1_open, r2.level1_lag), c(sigma_spline2.level2_open_lag, sigma_base.level2_open, r2.level2_lag))),5)
## Combine values in one table
r2_all <- rbind(r2, r2_age, r2_lag)
r2_all$Level <- rep(c("Level 1", "Level 2"), 3)
names(r2_all) <- c("Sigma Moderator", "Sigma Baseline", "R^2^", "Level")
r2_all <- select(r2_all, Level, everything())
kable(r2_all
, caption="**R^2^ of models**"
, escape=FALSE
, label = NA
, digits = 3) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left") %>%
pack_rows(index = c("Age and time lag" = 2, "Age only" = 2, "Time lag only" = 2))
| Level | Sigma Moderator | Sigma Baseline | R2 |
|---|---|---|---|
| Age and time lag | |||
| Level 1 | 0.015 | 0.016 | 0.04 |
| Level 2 | 0.114 | 0.158 | 0.28 |
| Age only | |||
| Level 1 | 0.015 | 0.016 | 0.05 |
| Level 2 | 0.139 | 0.158 | 0.12 |
| Time lag only | |||
| Level 1 | 0.016 | 0.016 | 0.00 |
| Level 2 | 0.143 | 0.158 | 0.10 |
Note: You can hover over the data points to receive more information.
pred <- data.frame(Age = 1:80,
SD = NA,
CI.lower = NA,
CI.upper = NA)
for (i in 1:80) {
pred$SD[i] <- predict(results.spline2,
newmods=c(ifelse(i <= 15, i, 15),
ifelse(i <= 20 & i > 15, i - 15, ifelse(i <= 15, 0, 20 - 15)),
ifelse(i <= 65 & i > 20, i - 20, ifelse(i <= 20, 0, 65 - 20)),
ifelse(i > 65,i - 65, 0),0),
transf=exp, addx=TRUE)$pred
pred$CI.lower[i] <- predict(results.spline2,
newmods=c(ifelse(i <= 15, i, 15),
ifelse(i <= 20 & i > 15, i - 15, ifelse(i <= 15, 0, 20 - 15)),
ifelse(i <= 65 & i > 20, i - 20, ifelse(i <= 20, 0, 65 - 20)),
ifelse(i > 65,i - 65, 0),0),
transf=exp, addx=TRUE)$ci.lb
pred$CI.upper[i] <- predict(results.spline2,
newmods=c(ifelse(i <= 15, i, 15),
ifelse(i <= 20 & i > 15, i - 15, ifelse(i <= 15, 0, 20 - 15)),
ifelse(i <= 65 & i > 20, i - 20, ifelse(i <= 20, 0, 65 - 20)),
ifelse(i > 65,i - 65, 0),0),
transf=exp, addx=TRUE)$ci.ub
}
pred$Type <- "pred"
observed <- select(data_open, Age = T1_AgeM, ES = ES, N = T1_N) %>% ungroup() %>%
mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)
plot <- ggplot(data = total, aes(x = Age, y = SD)) +
geom_point_interactive(data = subset(total, Type == "observed"),
aes(size = N, tooltip = paste0("SD = ", round(SD,3),
", N = ", N,
", StudyID = ", StudyID),
data_id = ID),
shape = 5, color = "grey") +
geom_errorbar(data = subset(total, Type == "pred"),
aes(ymin = CI.lower, ymax = CI.upper),
color = "black", width = 0) +
geom_point_interactive(data = subset(total, Type == "pred"),
aes(tooltip =
paste0("SD = ", round(SD,3),
", 95% CI = [", round(CI.lower,3),
", ", round(CI.upper,3), "]"),
data_id = ID)) +
scale_y_continuous(limits = c(0, 0.40)) +
scale_x_continuous(limits = c(0, 80), breaks = c(0,10,20,30,40,50,60,70,80)) +
labs(y = expression(bold("SD"[POMP])), title = "Openness") +
theme_pub() +
theme(legend.position = "none")
girafe(ggobj = plot)
Note: You can hover over the data points to receive more information.
pred <- data.frame(Time = seq(from = 0.5, to = 10, by = 0.25),
SD = NA,
CI.lower = NA,
CI.upper = NA)
for (i in 1:nrow(pred)) {
pred$SD[i] <- predict(results.spline2,
newmods=c(15, 5, 0, 0, pred$Time[i]),
transf=exp, addx=TRUE)$pred
pred$CI.lower[i] <- predict(results.spline2,
newmods=c(15, 5, 0, 0, pred$Time[i]),
transf=exp, addx=TRUE)$ci.lb
pred$CI.upper[i] <- predict(results.spline2,
newmods=c(15, 5, 0, 0, pred$Time[i]),
transf=exp, addx=TRUE)$ci.ub
}
pred$Type <- "pred"
observed <- select(data_agree, Time = T2_lag, ES = ES, N = T1_N) %>% ungroup() %>%
mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)
plot <- ggplot(data = total, aes(x = Time, y = SD)) +
geom_point_interactive(data = subset(total, Type == "observed"),
aes(size = N, tooltip = paste0("SD = ", round(SD,3),
", N = ", N,
", StudyID = ", StudyID),
data_id = ID),
shape = 5, color = "grey") +
geom_errorbar(data = subset(total, Type == "pred"),
aes(ymin = CI.lower, ymax = CI.upper),
color = "black", width = 0) +
geom_point_interactive(data = subset(total, Type == "pred"),
aes(tooltip =
paste0("SD = ", round(SD,3),
", 95% CI = [", round(CI.lower,3),
", ", round(CI.upper,3), "]"),
data_id = ID)) +
scale_y_continuous(limits = c(0, 0.40)) +
scale_x_continuous(limits = c(0, 10), breaks = c(0,1,2,3,4,5,6,7,8,9,10)) +
labs(y = expression(bold("SD"[POMP])), title = "Openness") +
theme_pub() +
theme(legend.position = "none")
girafe(ggobj = plot)
For the analyses across traits, we used a model with Age 1-30 and Age 30> as age-related variables because this model was among the best-fitting models for most traits.
## Create age bins
data_all$abin_1 <- ifelse(data_all$T1_AgeM <= 30, data_all$T1_AgeM, 30)
data_all$abin_2 <- ifelse(data_all$T1_AgeM > 30, data_all$T1_AgeM - 30, 0)
## Compute baseline R2
meta.comp <- rma.mv(yi = ES, V = V, mods = ~ abin_1 + abin_2 +
T2_lag.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_all, sparse = TRUE)
sigma_spline1.level1_all <- meta.comp$sigma2[1]
sigma_spline1.level2_all <- meta.comp$sigma2[2]
## Publication Year (Moderator 1)
meta.mod1 <- rma.mv(yi = ES, V = V, mods = ~ abin_1 + abin_2 +
T2_lag.c + Year.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_all, sparse = TRUE)
results.mod1 <- robust(meta.mod1, cluster = StudyID, clubSandwich = TRUE)
sigma_mod1.level1_all <- meta.mod1$sigma2[1]
sigma_mod1.level2_all <- meta.mod1$sigma2[2]
r2.level1.mod1 <- round((sigma_spline1.level1_all - sigma_mod1.level1_all)/sigma_spline1.level1_all,2)
r2.level1.mod1 <- ifelse(r2.level1.mod1 < 0, 0, r2.level1.mod1)
r2.level2.mod1 <- round((sigma_spline1.level2_all - sigma_mod1.level2_all)/sigma_spline1.level2_all,2)
r2.level2.mod1 <- ifelse(r2.level2.mod1 < 0, 0, r2.level2.mod1)
mod1.all <- as.data.frame(round(
cbind(results.mod1$n, results.mod1$b[5], results.mod1$se[5], results.mod1$zval[5],
results.mod1$pval[5], r2.level1 = r2.level1.mod1, r2.level2 = r2.level2.mod1),3))
## Reliability (Moderator 2)
meta.mod2 <- rma.mv(yi = ES, V = V, mods = ~ abin_1 + abin_2 +
T2_lag.c + Alpha_T1.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_all, sparse = TRUE)
results.mod2 <- robust(meta.mod2, cluster = StudyID, clubSandwich = TRUE)
sigma_mod2.level1_all <- meta.mod2$sigma2[1]
sigma_mod2.level2_all <- meta.mod2$sigma2[2]
r2.level1.mod2 <- round((sigma_spline1.level1_all - sigma_mod2.level1_all)/sigma_spline1.level1_all,2)
r2.level1.mod2 <- ifelse(r2.level1.mod2 < 0, 0, r2.level1.mod2)
r2.level2.mod2 <- round((sigma_spline1.level2_all - sigma_mod2.level2_all)/sigma_spline1.level2_all,2)
r2.level2.mod2 <- ifelse(r2.level2.mod2 < 0, 0, r2.level2.mod2)
mod2.all <- as.data.frame(round(
cbind(results.mod2$n, results.mod2$b[5], results.mod2$se[5], results.mod2$zval[5],
results.mod2$pval[5], r2.level1 = r2.level1.mod2, r2.level2 = r2.level2.mod2),3))
## Other report (Moderator 3)
meta.mod3 <- rma.mv(yi = ES, V = V, mods = ~ abin_1 + abin_2 +
T2_lag.c + OtherReport,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_all, sparse = TRUE)
results.mod3 <- robust(meta.mod3, cluster = StudyID, clubSandwich = TRUE)
sigma_mod3.level1_all <- meta.mod3$sigma2[1]
sigma_mod3.level2_all <- meta.mod3$sigma2[2]
r2.level1.mod3 <- round((sigma_spline1.level1_all - sigma_mod3.level1_all)/sigma_spline1.level1_all,2)
r2.level1.mod3 <- ifelse(r2.level1.mod3 < 0, 0, r2.level1.mod3)
r2.level2.mod3 <- round((sigma_spline1.level2_all - sigma_mod3.level2_all)/sigma_spline1.level2_all,2)
r2.level2.mod3 <- ifelse(r2.level2.mod3 < 0, 0, r2.level2.mod3)
mod3.all <- as.data.frame(round(
cbind(results.mod3$n, results.mod3$b[5], results.mod3$se[5], results.mod3$zval[5],
results.mod3$pval[5], r2.level1 = r2.level1.mod3, r2.level2 = r2.level2.mod3),3))
## Facet (Moderator 4)
meta.mod4 <- rma.mv(yi = ES, V = V, mods = ~ abin_1 + abin_2 +
T2_lag.c + Facet,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_all, sparse = TRUE)
results.mod4 <- robust(meta.mod4, cluster = StudyID, clubSandwich = TRUE)
sigma_mod4.level1_all <- meta.mod4$sigma2[1]
sigma_mod4.level2_all <- meta.mod4$sigma2[2]
r2.level1.mod4 <- round((sigma_spline1.level1_all - sigma_mod4.level1_all)/sigma_spline1.level1_all,2)
r2.level1.mod4 <- ifelse(r2.level1.mod4 < 0, 0, r2.level1.mod4)
r2.level2.mod4 <- round((sigma_spline1.level2_all - sigma_mod4.level2_all)/sigma_spline1.level2_all,2)
r2.level2.mod4 <- ifelse(r2.level2.mod4 < 0, 0, r2.level2.mod4)
mod4.all <- as.data.frame(round(
cbind(results.mod4$n, results.mod4$b[5], results.mod4$se[5], results.mod4$zval[5],
results.mod4$pval[5], r2.level1 = r2.level1.mod4, r2.level2 = r2.level2.mod4),3))
## Maladaptive (Moderator 5)
meta.mod5 <- rma.mv(yi = ES, V = V, mods = ~ abin_1 + abin_2 +
T2_lag.c + Maladaptive,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_all, sparse = TRUE)
results.mod5 <- robust(meta.mod5, cluster = StudyID, clubSandwich = TRUE)
sigma_mod5.level1_all <- meta.mod5$sigma2[1]
sigma_mod5.level2_all <- meta.mod5$sigma2[2]
r2.level1.mod5 <- round((sigma_spline1.level1_all - sigma_mod5.level1_all)/sigma_spline1.level1_all,2)
r2.level1.mod5 <- ifelse(r2.level1.mod5 < 0, 0, r2.level1.mod5)
r2.level2.mod5 <- round((sigma_spline1.level2_all - sigma_mod5.level2_all)/sigma_spline1.level2_all,2)
r2.level2.mod5 <- ifelse(r2.level2.mod5 < 0, 0, r2.level2.mod5)
mod5.all <- as.data.frame(round(
cbind(results.mod5$n, results.mod5$b[5], results.mod5$se[5], results.mod5$zval[5],
results.mod5$pval[5], r2.level1 = r2.level1.mod5, r2.level2 = r2.level2.mod5),3))
## Big Five taxonomy (Moderator 6)
meta.mod6 <- rma.mv(yi = ES, V = V, mods = ~ abin_1 + abin_2 +
T2_lag.c + BigFive,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_all, sparse = TRUE)
results.mod6 <- robust(meta.mod6, cluster = StudyID, clubSandwich = TRUE)
sigma_mod6.level1_all <- meta.mod6$sigma2[1]
sigma_mod6.level2_all <- meta.mod6$sigma2[2]
r2.level1.mod6 <- round((sigma_spline1.level1_all - sigma_mod6.level1_all)/sigma_spline1.level1_all,2)
r2.level1.mod6 <- ifelse(r2.level1.mod6 < 0, 0, r2.level1.mod6)
r2.level2.mod6 <- round((sigma_spline1.level2_all - sigma_mod6.level2_all)/sigma_spline1.level2_all,2)
r2.level2.mod6 <- ifelse(r2.level2.mod6 < 0, 0, r2.level2.mod6)
mod6.all <- as.data.frame(round(
cbind(results.mod6$n, results.mod6$b[5], results.mod6$se[5], results.mod6$zval[5],
results.mod6$pval[5], r2.level1 = r2.level1.mod6, r2.level2 = r2.level2.mod6),3))
## Representative sample (Moderator 8)
meta.mod8 <- rma.mv(yi = ES, V = V, mods = ~ abin_1 + abin_2 +
T2_lag.c + Represent,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_all, sparse = TRUE)
results.mod8 <- robust(meta.mod8, cluster = StudyID, clubSandwich = TRUE)
sigma_mod8.level1_all <- meta.mod8$sigma2[1]
sigma_mod8.level2_all <- meta.mod8$sigma2[2]
r2.level1.mod8 <- round((sigma_spline1.level1_all - sigma_mod8.level1_all)/sigma_spline1.level1_all,2)
r2.level1.mod8 <- ifelse(r2.level1.mod8 < 0, 0, r2.level1.mod8)
r2.level2.mod8 <- round((sigma_spline1.level2_all - sigma_mod8.level2_all)/sigma_spline1.level2_all,2)
r2.level2.mod8 <- ifelse(r2.level2.mod8 < 0, 0, r2.level2.mod8)
mod8.all <- as.data.frame(round(
cbind(results.mod8$n, results.mod8$b[5], results.mod8$se[5], results.mod8$zval[5],
results.mod8$pval[5], r2.level1 = r2.level1.mod8, r2.level2 = r2.level2.mod8),3))
## Percentage Female (Moderator 9)
meta.mod9 <- rma.mv(yi = ES, V = V, mods = ~ abin_1 + abin_2 +
T2_lag.c + Female.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_all, sparse = TRUE)
results.mod9 <- robust(meta.mod9, cluster = StudyID, clubSandwich = TRUE)
sigma_mod9.level1_all <- meta.mod9$sigma2[1]
sigma_mod9.level2_all <- meta.mod9$sigma2[2]
r2.level1.mod9 <- round((sigma_spline1.level1_all - sigma_mod9.level1_all)/sigma_spline1.level1_all,2)
r2.level1.mod9 <- ifelse(r2.level1.mod9 < 0, 0, r2.level1.mod9)
r2.level2.mod9 <- round((sigma_spline1.level2_all - sigma_mod9.level2_all)/sigma_spline1.level2_all,2)
r2.level2.mod9 <- ifelse(r2.level2.mod9 < 0, 0, r2.level2.mod9)
mod9.all <- as.data.frame(round(
cbind(results.mod9$n, results.mod9$b[5], results.mod9$se[5], results.mod9$zval[5],
results.mod9$pval[5], r2.level1 = r2.level1.mod9, r2.level2 = r2.level2.mod9),3))
## Region of data collection (Moderator 10)
meta.mod10 <- rma.mv(yi = ES, V = V, mods = ~ abin_1 + abin_2 +
T2_lag.c + Region,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_all, sparse = TRUE)
results.mod10 <- robust(meta.mod10, cluster = StudyID, clubSandwich = TRUE)
sigma_mod10.level1_all <- meta.mod10$sigma2[1]
sigma_mod10.level2_all <- meta.mod10$sigma2[2]
r2.level1.mod10 <- round((sigma_spline1.level1_all - sigma_mod10.level1_all)/sigma_spline1.level1_all,2)
r2.level1.mod10 <- ifelse(r2.level1.mod10 < 0, 0, r2.level1.mod10)
r2.level2.mod10 <- round((sigma_spline1.level2_all - sigma_mod10.level2_all)/sigma_spline1.level2_all,2)
r2.level2.mod10 <- ifelse(r2.level2.mod10 < 0, 0, r2.level2.mod10)
mod10.all <- as.data.frame(round(
cbind(results.mod10$n, results.mod10$b[5:8], results.mod10$se[5:8], results.mod10$zval[5:8],
results.mod10$pval[5:8], r2.level1 = r2.level1.mod10, r2.level2 = r2.level2.mod10),3))
mod.all <- rbind(mod1.all, mod2.all, mod3.all, mod4.all, mod5.all, mod6.all, mod8.all, mod9.all, mod10.all)
names(mod.all) <- c("Studies", "*b*", "*SE*", "*z*", "*p*", "R^2^~Level1~","R^2^~Level2~")
row.names(mod.all) <- c("Publication year",
"Reliability", "Other report", "Facet",
"Maladaptive", "Big Five",
"Representative", "Percentage female",
"Asia", "Global South",
"Nothern Europe", "Southern Europe")
kable(mod.all
, caption="**Moderator analyses across all traits (separate models)**"
, escape=FALSE
, label = NA) %>%
pack_rows("Region", 9, 12) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| Studies | b | SE | z | p | R2Level1 | R2Level2 | |
|---|---|---|---|---|---|---|---|
| Publication year | 229 | 0.002 | 0.003 | 0.724 | 0.474 | 0.00 | 0.00 |
| Reliability | 179 | 0.127 | 0.154 | 0.823 | 0.425 | 0.00 | 0.02 |
| Other report | 229 | -0.026 | 0.040 | -0.654 | 0.529 | 0.00 | 0.01 |
| Facet | 229 | 0.126 | 0.060 | 2.106 | 0.052 | 0.02 | 0.05 |
| Maladaptive | 228 | 0.012 | 0.072 | 0.168 | 0.868 | 0.00 | 0.00 |
| Big Five | 229 | -0.138 | 0.045 | -3.054 | 0.005 | 0.01 | 0.04 |
| Representative | 226 | -0.119 | 0.055 | -2.179 | 0.035 | 0.00 | 0.02 |
| Percentage female | 225 | 0.000 | 0.000 | -1.428 | 0.174 | 0.00 | 0.00 |
| Region | |||||||
| Asia | 224 | -0.027 | 0.072 | -0.368 | 0.715 | 0.00 | 0.00 |
| Global South | 224 | 0.118 | 0.058 | 2.023 | 0.076 | 0.00 | 0.00 |
| Nothern Europe | 224 | -0.072 | 0.047 | -1.535 | 0.127 | 0.00 | 0.00 |
| Southern Europe | 224 | -0.017 | 0.086 | -0.202 | 0.842 | 0.00 | 0.00 |
Note. These Pseudo-R2 values should be interpreted with caution as the included studies slightly differed across moderators (e.g., due to missing values) making a comparison more difficult.
You can hover over the points in this graph to receive more information.
## Run alternative model for Region
data_all$Region.d <- as.factor(ifelse(data_all$Region == "North America", 0, 1))
meta.mod10b <- rma.mv(yi = ES, V = V, mods = ~ abin_1 + abin_2 +
T2_lag.c + Region.d,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_all, sparse = TRUE)
## Prepare loop
plot_data <- data.frame(Moderator = factor(c("Publication year", "Publication year",
"Reliability", "Reliability",
"Other report", "Other report",
"Facet", "Facet",
"Maladaptive", "Maladaptive",
"Big Five", "Big Five",
"Representative", "Representative",
"Percentage female", "Percentage female",
"Region", "Region"),
levels = c("Region", "Percentage female",
"Representative",
"Big Five", "Maladaptive",
"Facet", "Other report",
"Reliability", "Publication year"),
ordered = TRUE),
Score = c(0, 5,
0, 0.10,
0, 1,
0, 1,
0, 1,
0, 1,
0, 1,
0, 10,
0, 1),
SD = NA,
CI.lower = NA,
CI.upper = NA,
Sig = factor(c(0, 0,
0, 0,
0, 0,
0, 0,
0, 0,
1, 1,
1, 1,
0, 0,
0, 0)),
label = c("2015", "2020",
"0.78", "0.88",
"Self", "Other",
"No", "Yes",
"No", "Yes",
"No", "Yes",
"No", "Yes",
"53%", "63%",
"North America", "Other"))
plot_data$ID <- 1:nrow(plot_data)
meta.models <- list(meta.mod1, meta.mod1, meta.mod2, meta.mod2,
meta.mod3, meta.mod3, meta.mod4, meta.mod4,
meta.mod5, meta.mod5, meta.mod6, meta.mod6,
meta.mod8, meta.mod8,
meta.mod9, meta.mod9, meta.mod10b, meta.mod10b)
## Loop to create plot data
for (i in 1:nrow(plot_data)) {
plot_data$SD[i] <- predict(meta.models[[i]],
newmods=c(20, 0, 0, plot_data$Score[i]),
transf=exp, addx=TRUE)$pred
plot_data$CI.lower[i] <- predict(meta.models[[i]],
newmods=c(20, 0, 0, plot_data$Score[i]),
transf=exp, addx=TRUE)$ci.lb
plot_data$CI.upper[i] <- predict(meta.models[[i]],
newmods=c(20, 0, 0, plot_data$Score[i]),
transf=exp, addx=TRUE)$ci.ub
}
## Plot
plot <- ggplot(data = plot_data, aes(x = SD, y = Moderator, group = Score)) +
geom_errorbar(aes(xmin=CI.lower, xmax=CI.upper, group = Score, colour = Sig),
position=position_dodge(0.75), width = 0) +
geom_point_interactive(aes(group = Score, colour = Sig,
tooltip =
paste0("SD = ", round(SD,3),
", 95% CI = [", round(CI.lower,3),
", ", round(CI.upper,3), "]"),
data_id = ID),
size = 1.8, position=position_dodge(0.75)) +
geom_text(aes(label = label, x = CI.upper + 0.001, y = Moderator, group = Score),
position=position_dodge(0.75),
hjust = 0, size = 4.5) +
theme_pub() +
scale_x_continuous(limits = c(0,0.3)) +
scale_colour_manual(values = c("0" = "grey", "1" = "black")) +
theme(legend.position = "none",
axis.text.y = element_text(hjust = 1)) +
labs(y = "Moderators", x = expression(bold("SD"[POMP])), title = "Across traits")
girafe(ggobj = plot)
Note. To allow a better graphical depiction, we dummy-coded the moderator “Region” for the illustration in this graph (0 = “North America”, 1 = “Other”). However, in the main analyses, a polytomous categorical predictor was used. Significant moderation effects are depicted in black, non-significant moderations are in grey. The point estimates are calculated for 20 year old participants that are assessed over a time interval of one year.
## Create age bins
data_agree$abin_1 <- ifelse(data_agree$T1_AgeM <= 30, data_agree$T1_AgeM, 30)
data_agree$abin_2 <- ifelse(data_agree$T1_AgeM > 30, data_agree$T1_AgeM - 30, 0)
## Publication Year (Moderator 1)
meta.mod1 <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 +
T2_lag.c + Year.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_agree, sparse = TRUE)
results.mod1 <- robust(meta.mod1, cluster = StudyID, clubSandwich = TRUE)
sigma_mod1.level1_agree <- meta.mod1$sigma2[1]
sigma_mod1.level2_agree <- meta.mod1$sigma2[2]
r2.level1.mod1 <- round((sigma_spline1.level1_agree - sigma_mod1.level1_agree)/sigma_spline1.level1_agree,2)
r2.level1.mod1 <- ifelse(r2.level1.mod1 < 0, 0, r2.level1.mod1)
r2.level2.mod1 <- round((sigma_spline1.level2_agree - sigma_mod1.level2_agree)/sigma_spline1.level2_agree,2)
r2.level2.mod1 <- ifelse(r2.level2.mod1 < 0, 0, r2.level2.mod1)
mod1.agree <- as.data.frame(round(
cbind(results.mod1$n, results.mod1$b[5], results.mod1$se[5], results.mod1$zval[5],
results.mod1$pval[5], r2.level1 = r2.level1.mod1, r2.level2 = r2.level2.mod1),3))
## Reliability (Moderator 2)
meta.mod2 <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 +
T2_lag.c + Alpha_T1.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_agree, sparse = TRUE)
results.mod2 <- robust(meta.mod2, cluster = StudyID, clubSandwich = TRUE)
sigma_mod2.level1_agree <- meta.mod2$sigma2[1]
sigma_mod2.level2_agree <- meta.mod2$sigma2[2]
r2.level1.mod2 <- round((sigma_spline1.level1_agree - sigma_mod2.level1_agree)/sigma_spline1.level1_agree,2)
r2.level1.mod2 <- ifelse(r2.level1.mod2 < 0, 0, r2.level1.mod2)
r2.level2.mod2 <- round((sigma_spline1.level2_agree - sigma_mod2.level2_agree)/sigma_spline1.level2_agree,2)
r2.level2.mod2 <- ifelse(r2.level2.mod2 < 0, 0, r2.level2.mod2)
mod2.agree <- as.data.frame(round(
cbind(results.mod2$n, results.mod2$b[5], results.mod2$se[5], results.mod2$zval[5],
results.mod2$pval[5], r2.level1 = r2.level1.mod2, r2.level2 = r2.level2.mod2),3))
## Other report (Moderator 3)
meta.mod3 <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 +
T2_lag.c + OtherReport,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_agree, sparse = TRUE)
results.mod3 <- robust(meta.mod3, cluster = StudyID, clubSandwich = TRUE)
sigma_mod3.level1_agree <- meta.mod3$sigma2[1]
sigma_mod3.level2_agree <- meta.mod3$sigma2[2]
r2.level1.mod3 <- round((sigma_spline1.level1_agree - sigma_mod3.level1_agree)/sigma_spline1.level1_agree,2)
r2.level1.mod3 <- ifelse(r2.level1.mod3 < 0, 0, r2.level1.mod3)
r2.level2.mod3 <- round((sigma_spline1.level2_agree - sigma_mod3.level2_agree)/sigma_spline1.level2_agree,2)
r2.level2.mod3 <- ifelse(r2.level2.mod3 < 0, 0, r2.level2.mod3)
mod3.agree <- as.data.frame(round(
cbind(results.mod3$n, results.mod3$b[5], results.mod3$se[5], results.mod3$zval[5],
results.mod3$pval[5], r2.level1 = r2.level1.mod3, r2.level2 = r2.level2.mod3),3))
## Facet (Moderator 4)
meta.mod4 <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 +
T2_lag.c + Facet,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_agree, sparse = TRUE)
results.mod4 <- robust(meta.mod4, cluster = StudyID, clubSandwich = TRUE)
sigma_mod4.level1_agree <- meta.mod4$sigma2[1]
sigma_mod4.level2_agree <- meta.mod4$sigma2[2]
r2.level1.mod4 <- round((sigma_spline1.level1_agree - sigma_mod4.level1_agree)/sigma_spline1.level1_agree,2)
r2.level1.mod4 <- ifelse(r2.level1.mod4 < 0, 0, r2.level1.mod4)
r2.level2.mod4 <- round((sigma_spline1.level2_agree - sigma_mod4.level2_agree)/sigma_spline1.level2_agree,2)
r2.level2.mod4 <- ifelse(r2.level2.mod4 < 0, 0, r2.level2.mod4)
mod4.agree <- as.data.frame(round(
cbind(results.mod4$n, results.mod4$b[5], results.mod4$se[5], results.mod4$zval[5],
results.mod4$pval[5], r2.level1 = r2.level1.mod4, r2.level2 = r2.level2.mod4),3))
## Maladaptive (Moderator 5)
meta.mod5 <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 +
T2_lag.c + Maladaptive,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_agree, sparse = TRUE)
results.mod5 <- robust(meta.mod5, cluster = StudyID, clubSandwich = TRUE)
sigma_mod5.level1_agree <- meta.mod5$sigma2[1]
sigma_mod5.level2_agree <- meta.mod5$sigma2[2]
r2.level1.mod5 <- round((sigma_spline1.level1_agree - sigma_mod5.level1_agree)/sigma_spline1.level1_agree,2)
r2.level1.mod5 <- ifelse(r2.level1.mod5 < 0, 0, r2.level1.mod5)
r2.level2.mod5 <- round((sigma_spline1.level2_agree - sigma_mod5.level2_agree)/sigma_spline1.level2_agree,2)
r2.level2.mod5 <- ifelse(r2.level2.mod5 < 0, 0, r2.level2.mod5)
mod5.agree <- as.data.frame(round(
cbind(results.mod5$n, results.mod5$b[5], results.mod5$se[5], results.mod5$zval[5],
results.mod5$pval[5], r2.level1 = r2.level1.mod5, r2.level2 = r2.level2.mod5),3))
## Big Five taxonomy (Moderator 6)
meta.mod6 <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 +
T2_lag.c + BigFive,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_agree, sparse = TRUE)
results.mod6 <- robust(meta.mod6, cluster = StudyID, clubSandwich = TRUE)
sigma_mod6.level1_agree <- meta.mod6$sigma2[1]
sigma_mod6.level2_agree <- meta.mod6$sigma2[2]
r2.level1.mod6 <- round((sigma_spline1.level1_agree - sigma_mod6.level1_agree)/sigma_spline1.level1_agree,2)
r2.level1.mod6 <- ifelse(r2.level1.mod6 < 0, 0, r2.level1.mod6)
r2.level2.mod6 <- round((sigma_spline1.level2_agree - sigma_mod6.level2_agree)/sigma_spline1.level2_agree,2)
r2.level2.mod6 <- ifelse(r2.level2.mod6 < 0, 0, r2.level2.mod6)
mod6.agree <- as.data.frame(round(
cbind(results.mod6$n, results.mod6$b[5], results.mod6$se[5], results.mod6$zval[5],
results.mod6$pval[5], r2.level1 = r2.level1.mod6, r2.level2 = r2.level2.mod6),3))
## Inverse Coded (Moderator 7)
meta.mod7 <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 +
T2_lag.c + Inverse,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_agree, sparse = TRUE)
results.mod7 <- robust(meta.mod7, cluster = StudyID, clubSandwich = TRUE)
sigma_mod7.level1_agree <- meta.mod7$sigma2[1]
sigma_mod7.level2_agree <- meta.mod7$sigma2[2]
r2.level1.mod7 <- round((sigma_spline1.level1_agree - sigma_mod7.level1_agree)/sigma_spline1.level1_agree,2)
r2.level1.mod7 <- ifelse(r2.level1.mod7 < 0, 0, r2.level1.mod7)
r2.level2.mod7 <- round((sigma_spline1.level2_agree - sigma_mod7.level2_agree)/sigma_spline1.level2_agree,2)
r2.level2.mod7 <- ifelse(r2.level2.mod7 < 0, 0, r2.level2.mod7)
mod7.agree <- as.data.frame(round(
cbind(results.mod7$n, results.mod7$b[5], results.mod7$se[5], results.mod7$zval[5],
results.mod7$pval[5], r2.level1 = r2.level1.mod7, r2.level2 = r2.level2.mod7),3))
## Representative sample (Moderator 8)
meta.mod8 <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 +
T2_lag.c + Represent,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_agree, sparse = TRUE)
results.mod8 <- robust(meta.mod8, cluster = StudyID, clubSandwich = TRUE)
sigma_mod8.level1_agree <- meta.mod8$sigma2[1]
sigma_mod8.level2_agree <- meta.mod8$sigma2[2]
r2.level1.mod8 <- round((sigma_spline1.level1_agree - sigma_mod8.level1_agree)/sigma_spline1.level1_agree,2)
r2.level1.mod8 <- ifelse(r2.level1.mod8 < 0, 0, r2.level1.mod8)
r2.level2.mod8 <- round((sigma_spline1.level2_agree - sigma_mod8.level2_agree)/sigma_spline1.level2_agree,2)
r2.level2.mod8 <- ifelse(r2.level2.mod8 < 0, 0, r2.level2.mod8)
mod8.agree <- as.data.frame(round(
cbind(results.mod8$n, results.mod8$b[5], results.mod8$se[5], results.mod8$zval[5],
results.mod8$pval[5], r2.level1 = r2.level1.mod8, r2.level2 = r2.level2.mod8),3))
## Percentage Female (Moderator 9)
meta.mod9 <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 +
T2_lag.c + Female.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_agree, sparse = TRUE)
results.mod9 <- robust(meta.mod9, cluster = StudyID, clubSandwich = TRUE)
sigma_mod9.level1_agree <- meta.mod9$sigma2[1]
sigma_mod9.level2_agree <- meta.mod9$sigma2[2]
r2.level1.mod9 <- round((sigma_spline1.level1_agree - sigma_mod9.level1_agree)/sigma_spline1.level1_agree,2)
r2.level1.mod9 <- ifelse(r2.level1.mod9 < 0, 0, r2.level1.mod9)
r2.level2.mod9 <- round((sigma_spline1.level2_agree - sigma_mod9.level2_agree)/sigma_spline1.level2_agree,2)
r2.level2.mod9 <- ifelse(r2.level2.mod9 < 0, 0, r2.level2.mod9)
mod9.agree <- as.data.frame(round(
cbind(results.mod9$n, results.mod9$b[5], results.mod9$se[5], results.mod9$zval[5],
results.mod9$pval[5], r2.level1 = r2.level1.mod9, r2.level2 = r2.level2.mod9),3))
## Region of data collection (Moderator 10)
meta.mod10 <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 +
T2_lag.c + Region,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_agree, sparse = TRUE)
results.mod10 <- robust(meta.mod10, cluster = StudyID, clubSandwich = TRUE)
sigma_mod10.level1_agree <- meta.mod10$sigma2[1]
sigma_mod10.level2_agree <- meta.mod10$sigma2[2]
r2.level1.mod10 <- round((sigma_spline1.level1_agree - sigma_mod10.level1_agree)/sigma_spline1.level1_agree,2)
r2.level1.mod10 <- ifelse(r2.level1.mod10 < 0, 0, r2.level1.mod10)
r2.level2.mod10 <- round((sigma_spline1.level2_agree - sigma_mod10.level2_agree)/sigma_spline1.level2_agree,2)
r2.level2.mod10 <- ifelse(r2.level2.mod10 < 0, 0, r2.level2.mod10)
mod10.agree <- as.data.frame(round(
cbind(results.mod10$n, results.mod10$b[5:8], results.mod10$se[5:8], results.mod10$zval[5:8],
results.mod10$pval[5:8], r2.level1 = r2.level1.mod10, r2.level2 = r2.level2.mod10),3))
mod.agree <- rbind(mod1.agree, mod2.agree, mod3.agree, mod4.agree, mod5.agree, mod6.agree, mod7.agree, mod8.agree, mod9.agree, mod10.agree)
names(mod.agree) <- c("Studies", "*b*", "*SE*", "*z*", "*p*", "R^2^~Level1~","R^2^~Level2~")
row.names(mod.agree) <- c("Publication year",
"Reliability", "Other report", "Facet",
"Maladaptive", "Big Five", "Inverse coded",
"Representative", "Percentage female",
"Asia", "Global South",
"Nothern Europe", "Southern Europe")
kable(mod.agree
, caption="**Moderator analyses for agreeableness (separate models)**"
, escape=FALSE
, label = NA) %>%
pack_rows("Region", 10, 13) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| Studies | b | SE | z | p | R2Level1 | R2Level2 | |
|---|---|---|---|---|---|---|---|
| Publication year | 138 | 0.004 | 0.004 | 0.998 | 0.327 | 0.00 | 0.00 |
| Reliability | 110 | -0.139 | 0.276 | -0.505 | 0.623 | 0.25 | 0.00 |
| Other report | 138 | -0.002 | 0.056 | -0.038 | 0.970 | 0.00 | 0.00 |
| Facet | 138 | 0.109 | 0.066 | 1.656 | 0.121 | 0.02 | 0.03 |
| Maladaptive | 137 | 0.102 | 0.069 | 1.463 | 0.159 | 0.01 | 0.00 |
| Big Five | 138 | -0.183 | 0.050 | -3.671 | 0.001 | 0.02 | 0.04 |
| Inverse coded | 138 | -0.001 | 0.063 | -0.015 | 0.988 | 0.00 | 0.00 |
| Representative | 135 | -0.056 | 0.092 | -0.604 | 0.550 | 0.00 | 0.02 |
| Percentage female | 135 | -0.001 | 0.001 | -2.162 | 0.053 | 0.07 | 0.00 |
| Region | |||||||
| Asia | 137 | 0.098 | 0.091 | 1.078 | 0.295 | 0.00 | 0.07 |
| Global South | 137 | 0.441 | 0.269 | 1.641 | 0.162 | 0.00 | 0.07 |
| Nothern Europe | 137 | -0.057 | 0.063 | -0.899 | 0.371 | 0.00 | 0.07 |
| Southern Europe | 137 | -0.085 | 0.117 | -0.730 | 0.473 | 0.00 | 0.07 |
Note. These Pseudo-R2 values should be interpreted with caution as the included studies slightly differed across moderators (e.g., due to missing values) making a comparison more difficult.
You can hover over the points in this graph to receive more information.
## Run alternative model for Region
data_agree$Region.d <- as.factor(ifelse(data_agree$Region == "North America", 0, 1))
meta.mod10b <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 +
T2_lag.c + Region.d,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_agree, sparse = TRUE)
## Prepare loop
plot_data <- data.frame(Moderator = factor(c("Publication year", "Publication year",
"Reliability", "Reliability",
"Other report", "Other report",
"Facet", "Facet",
"Maladaptive", "Maladaptive",
"Big Five", "Big Five",
"Inverse coded", "Inverse coded",
"Representative", "Representative",
"Percentage female", "Percentage female",
"Region", "Region"),
levels = c("Region", "Percentage female",
"Representative", "Inverse coded",
"Big Five", "Maladaptive",
"Facet", "Other report",
"Reliability", "Publication year"),
ordered = TRUE),
Score = c(0, 5,
0, 0.10,
0, 1,
0, 1,
0, 1,
0, 1,
0, 1,
0, 1,
0, 10,
0, 1),
SD = NA,
CI.lower = NA,
CI.upper = NA,
Sig = factor(c(0, 0,
0, 0,
0, 0,
0, 0,
0, 0,
1, 1,
0, 0,
0, 0,
0, 0,
0, 0)),
label = c("2015", "2020",
"0.78", "0.88",
"Self", "Other",
"No", "Yes",
"No", "Yes",
"No", "Yes",
"No", "Yes",
"No", "Yes",
"53%", "63%",
"North America", "Other"))
plot_data$ID <- 1:nrow(plot_data)
meta.models <- list(meta.mod1, meta.mod1, meta.mod2, meta.mod2,
meta.mod3, meta.mod3, meta.mod4, meta.mod4,
meta.mod5, meta.mod5, meta.mod6, meta.mod6,
meta.mod7, meta.mod7, meta.mod8, meta.mod8,
meta.mod9, meta.mod9, meta.mod10b, meta.mod10b)
## Loop to create plot data
for (i in 1:nrow(plot_data)) {
plot_data$SD[i] <- predict(meta.models[[i]],
newmods=c(20, 0, 0, plot_data$Score[i]),
transf=exp, addx=TRUE)$pred
plot_data$CI.lower[i] <- predict(meta.models[[i]],
newmods=c(20, 0, 0, plot_data$Score[i]),
transf=exp, addx=TRUE)$ci.lb
plot_data$CI.upper[i] <- predict(meta.models[[i]],
newmods=c(20, 0, 0, plot_data$Score[i]),
transf=exp, addx=TRUE)$ci.ub
}
## Plot
plot <- ggplot(data = plot_data, aes(x = SD, y = Moderator, group = Score)) +
geom_errorbar(aes(xmin=CI.lower, xmax=CI.upper, group = Score, colour = Sig),
position=position_dodge(0.75), width = 0) +
geom_point_interactive(aes(group = Score, colour = Sig,
tooltip =
paste0("SD = ", round(SD,3),
", 95% CI = [", round(CI.lower,3),
", ", round(CI.upper,3), "]"),
data_id = ID),
size = 1.8, position=position_dodge(0.75)) +
geom_text(aes(label = label, x = CI.upper + 0.001, y = Moderator, group = Score),
position=position_dodge(0.75),
hjust = 0, size = 4.5) +
theme_pub() +
scale_x_continuous(limits = c(0,0.3)) +
scale_colour_manual(values = c("0" = "grey", "1" = "black")) +
theme(legend.position = "none",
axis.text.y = element_text(hjust = 1)) +
labs(y = "Moderators", x = expression(bold("SD"[POMP])), title = "Agreeableness")
girafe(ggobj = plot)
Note. To allow a better graphical depiction, we dummy-coded the moderator “Region” for the illustration in this graph (0 = “North America”, 1 = “Other”). However, in the main analyses, a polytomous categorical predictor was used. Significant moderation effects are depicted in black, non-significant moderations are in grey. The point estimates are calculated for 20 year old participants that are assessed over a time interval of one year.
## Create age bins
data_consc$abin_1 <- ifelse(data_consc$T1_AgeM <= 40, data_consc$T1_AgeM, 40)
data_consc$abin_2 <- ifelse(data_consc$T1_AgeM > 40, data_consc$T1_AgeM - 40, 0)
## Publication Year (Moderator 1)
meta.mod1 <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 +
T2_lag.c + Year.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_consc, sparse = TRUE)
results.mod1 <- robust(meta.mod1, cluster = StudyID, clubSandwich = TRUE)
sigma_mod1.level1_consc <- meta.mod1$sigma2[1]
sigma_mod1.level2_consc <- meta.mod1$sigma2[2]
r2.level1.mod1 <- round((sigma_spline1.level1_consc - sigma_mod1.level1_consc)/sigma_spline1.level1_consc,2)
r2.level1.mod1 <- ifelse(r2.level1.mod1 < 0, 0, r2.level1.mod1)
r2.level2.mod1 <- round((sigma_spline1.level2_consc - sigma_mod1.level2_consc)/sigma_spline1.level2_consc,2)
r2.level2.mod1 <- ifelse(r2.level2.mod1 < 0, 0, r2.level2.mod1)
mod1.consc <- as.data.frame(round(
cbind(results.mod1$n, results.mod1$b[5], results.mod1$se[5], results.mod1$zval[5],
results.mod1$pval[5], r2.level1 = r2.level1.mod1, r2.level2 = r2.level2.mod1),3))
## Reliability (Moderator 2)
meta.mod2 <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 +
T2_lag.c + Alpha_T1.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_consc, sparse = TRUE)
results.mod2 <- robust(meta.mod2, cluster = StudyID, clubSandwich = TRUE)
sigma_mod2.level1_consc <- meta.mod2$sigma2[1]
sigma_mod2.level2_consc <- meta.mod2$sigma2[2]
r2.level1.mod2 <- round((sigma_spline1.level1_consc - sigma_mod2.level1_consc)/sigma_spline1.level1_consc,2)
r2.level1.mod2 <- ifelse(r2.level1.mod2 < 0, 0, r2.level1.mod2)
r2.level2.mod2 <- round((sigma_spline1.level2_consc - sigma_mod2.level2_consc)/sigma_spline1.level2_consc,2)
r2.level2.mod2 <- ifelse(r2.level2.mod2 < 0, 0, r2.level2.mod2)
mod2.consc <- as.data.frame(round(
cbind(results.mod2$n, results.mod2$b[5], results.mod2$se[5], results.mod2$zval[5],
results.mod2$pval[5], r2.level1 = r2.level1.mod2, r2.level2 = r2.level2.mod2),3))
## Other report (Moderator 3)
meta.mod3 <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 +
T2_lag.c + OtherReport,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_consc, sparse = TRUE)
results.mod3 <- robust(meta.mod3, cluster = StudyID, clubSandwich = TRUE)
sigma_mod3.level1_consc <- meta.mod3$sigma2[1]
sigma_mod3.level2_consc <- meta.mod3$sigma2[2]
r2.level1.mod3 <- round((sigma_spline1.level1_consc - sigma_mod3.level1_consc)/sigma_spline1.level1_consc,2)
r2.level1.mod3 <- ifelse(r2.level1.mod3 < 0, 0, r2.level1.mod3)
r2.level2.mod3 <- round((sigma_spline1.level2_consc - sigma_mod3.level2_consc)/sigma_spline1.level2_consc,2)
r2.level2.mod3 <- ifelse(r2.level2.mod3 < 0, 0, r2.level2.mod3)
mod3.consc <- as.data.frame(round(
cbind(results.mod3$n, results.mod3$b[5], results.mod3$se[5], results.mod3$zval[5],
results.mod3$pval[5], r2.level1 = r2.level1.mod3, r2.level2 = r2.level2.mod3),3))
## Facet (Moderator 4)
meta.mod4 <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 +
T2_lag.c + Facet,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_consc, sparse = TRUE)
results.mod4 <- robust(meta.mod4, cluster = StudyID, clubSandwich = TRUE)
sigma_mod4.level1_consc <- meta.mod4$sigma2[1]
sigma_mod4.level2_consc <- meta.mod4$sigma2[2]
r2.level1.mod4 <- round((sigma_spline1.level1_consc - sigma_mod4.level1_consc)/sigma_spline1.level1_consc,2)
r2.level1.mod4 <- ifelse(r2.level1.mod4 < 0, 0, r2.level1.mod4)
r2.level2.mod4 <- round((sigma_spline1.level2_consc - sigma_mod4.level2_consc)/sigma_spline1.level2_consc,2)
r2.level2.mod4 <- ifelse(r2.level2.mod4 < 0, 0, r2.level2.mod4)
mod4.consc <- as.data.frame(round(
cbind(results.mod4$n, results.mod4$b[5], results.mod4$se[5], results.mod4$zval[5],
results.mod4$pval[5], r2.level1 = r2.level1.mod4, r2.level2 = r2.level2.mod4),3))
## Maladaptive (Moderator 5)
meta.mod5 <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 +
T2_lag.c + Maladaptive,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_consc, sparse = TRUE)
results.mod5 <- robust(meta.mod5, cluster = StudyID, clubSandwich = TRUE)
sigma_mod5.level1_consc <- meta.mod5$sigma2[1]
sigma_mod5.level2_consc <- meta.mod5$sigma2[2]
r2.level1.mod5 <- round((sigma_spline1.level1_consc - sigma_mod5.level1_consc)/sigma_spline1.level1_consc,2)
r2.level1.mod5 <- ifelse(r2.level1.mod5 < 0, 0, r2.level1.mod5)
r2.level2.mod5 <- round((sigma_spline1.level2_consc - sigma_mod5.level2_consc)/sigma_spline1.level2_consc,2)
r2.level2.mod5 <- ifelse(r2.level2.mod5 < 0, 0, r2.level2.mod5)
mod5.consc <- as.data.frame(round(
cbind(results.mod5$n, results.mod5$b[5], results.mod5$se[5], results.mod5$zval[5],
results.mod5$pval[5], r2.level1 = r2.level1.mod5, r2.level2 = r2.level2.mod5),3))
## Big Five taxonomy (Moderator 6)
meta.mod6 <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 +
T2_lag.c + BigFive,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_consc, sparse = TRUE)
results.mod6 <- robust(meta.mod6, cluster = StudyID, clubSandwich = TRUE)
sigma_mod6.level1_consc <- meta.mod6$sigma2[1]
sigma_mod6.level2_consc <- meta.mod6$sigma2[2]
r2.level1.mod6 <- round((sigma_spline1.level1_consc - sigma_mod6.level1_consc)/sigma_spline1.level1_consc,2)
r2.level1.mod6 <- ifelse(r2.level1.mod6 < 0, 0, r2.level1.mod6)
r2.level2.mod6 <- round((sigma_spline1.level2_consc - sigma_mod6.level2_consc)/sigma_spline1.level2_consc,2)
r2.level2.mod6 <- ifelse(r2.level2.mod6 < 0, 0, r2.level2.mod6)
mod6.consc <- as.data.frame(round(
cbind(results.mod6$n, results.mod6$b[5], results.mod6$se[5], results.mod6$zval[5],
results.mod6$pval[5], r2.level1 = r2.level1.mod6, r2.level2 = r2.level2.mod6),3))
## Inverse Coded (Moderator 7)
meta.mod7 <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 +
T2_lag.c + Inverse,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_consc, sparse = TRUE)
results.mod7 <- robust(meta.mod7, cluster = StudyID, clubSandwich = TRUE)
sigma_mod7.level1_consc <- meta.mod7$sigma2[1]
sigma_mod7.level2_consc <- meta.mod7$sigma2[2]
r2.level1.mod7 <- round((sigma_spline1.level1_consc - sigma_mod7.level1_consc)/sigma_spline1.level1_consc,2)
r2.level1.mod7 <- ifelse(r2.level1.mod7 < 0, 0, r2.level1.mod7)
r2.level2.mod7 <- round((sigma_spline1.level2_consc - sigma_mod7.level2_consc)/sigma_spline1.level2_consc,2)
r2.level2.mod7 <- ifelse(r2.level2.mod7 < 0, 0, r2.level2.mod7)
mod7.consc <- as.data.frame(round(
cbind(results.mod7$n, results.mod7$b[5], results.mod7$se[5], results.mod7$zval[5],
results.mod7$pval[5], r2.level1 = r2.level1.mod7, r2.level2 = r2.level2.mod7),3))
## Representative sample (Moderator 8)
meta.mod8 <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 +
T2_lag.c + Represent,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_consc, sparse = TRUE)
results.mod8 <- robust(meta.mod8, cluster = StudyID, clubSandwich = TRUE)
sigma_mod8.level1_consc <- meta.mod8$sigma2[1]
sigma_mod8.level2_consc <- meta.mod8$sigma2[2]
r2.level1.mod8 <- round((sigma_spline1.level1_consc - sigma_mod8.level1_consc)/sigma_spline1.level1_consc,2)
r2.level1.mod8 <- ifelse(r2.level1.mod8 < 0, 0, r2.level1.mod8)
r2.level2.mod8 <- round((sigma_spline1.level2_consc - sigma_mod8.level2_consc)/sigma_spline1.level2_consc,2)
r2.level2.mod8 <- ifelse(r2.level2.mod8 < 0, 0, r2.level2.mod8)
mod8.consc <- as.data.frame(round(
cbind(results.mod8$n, results.mod8$b[5], results.mod8$se[5], results.mod8$zval[5],
results.mod8$pval[5], r2.level1 = r2.level1.mod8, r2.level2 = r2.level2.mod8),3))
## Percentage Female (Moderator 9)
meta.mod9 <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 +
T2_lag.c + Female.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_consc, sparse = TRUE)
results.mod9 <- robust(meta.mod9, cluster = StudyID, clubSandwich = TRUE)
sigma_mod9.level1_consc <- meta.mod9$sigma2[1]
sigma_mod9.level2_consc <- meta.mod9$sigma2[2]
r2.level1.mod9 <- round((sigma_spline1.level1_consc - sigma_mod9.level1_consc)/sigma_spline1.level1_consc,2)
r2.level1.mod9 <- ifelse(r2.level1.mod9 < 0, 0, r2.level1.mod9)
r2.level2.mod9 <- round((sigma_spline1.level2_consc - sigma_mod9.level2_consc)/sigma_spline1.level2_consc,2)
r2.level2.mod9 <- ifelse(r2.level2.mod9 < 0, 0, r2.level2.mod9)
mod9.consc <- as.data.frame(round(
cbind(results.mod9$n, results.mod9$b[5], results.mod9$se[5], results.mod9$zval[5],
results.mod9$pval[5], r2.level1 = r2.level1.mod9, r2.level2 = r2.level2.mod9),3))
## Region of data collection (Moderator 10)
meta.mod10 <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 +
T2_lag.c + Region,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_consc, sparse = TRUE)
results.mod10 <- robust(meta.mod10, cluster = StudyID, clubSandwich = TRUE)
sigma_mod10.level1_consc <- meta.mod10$sigma2[1]
sigma_mod10.level2_consc <- meta.mod10$sigma2[2]
r2.level1.mod10 <- round((sigma_spline1.level1_consc - sigma_mod10.level1_consc)/sigma_spline1.level1_consc,2)
r2.level1.mod10 <- ifelse(r2.level1.mod10 < 0, 0, r2.level1.mod10)
r2.level2.mod10 <- round((sigma_spline1.level2_consc - sigma_mod10.level2_consc)/sigma_spline1.level2_consc,2)
r2.level2.mod10 <- ifelse(r2.level2.mod10 < 0, 0, r2.level2.mod10)
mod10.consc <- as.data.frame(round(
cbind(results.mod10$n, results.mod10$b[5:8], results.mod10$se[5:8], results.mod10$zval[5:8],
results.mod10$pval[5:8], r2.level1 = r2.level1.mod10, r2.level2 = r2.level2.mod10),3))
mod.consc <- rbind(mod1.consc, mod2.consc, mod3.consc, mod4.consc, mod5.consc, mod6.consc, mod7.consc, mod8.consc, mod9.consc, mod10.consc)
names(mod.consc) <- c("Studies", "*b*", "*SE*", "*z*", "*p*", "R^2^~Level1~","R^2^~Level2~")
row.names(mod.consc) <- c("Publication year",
"Reliability", "Other report", "Facet",
"Maladaptive", "Big Five", "Inverse coded",
"Representative", "Percentage female",
"Asia", "Global South",
"Nothern Europe", "Southern Europe")
kable(mod.consc
, caption="**Moderator analyses for conscientiousness (separate models)**"
, escape=FALSE
, label = NA) %>%
pack_rows("Region", 10, 13) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| Studies | b | SE | z | p | R2Level1 | R2Level2 | |
|---|---|---|---|---|---|---|---|
| Publication year | 127 | 0.006 | 0.004 | 1.484 | 0.151 | 0.00 | 0.01 |
| Reliability | 100 | -0.766 | 0.280 | -2.738 | 0.017 | 0.04 | 0.14 |
| Other report | 127 | -0.087 | 0.064 | -1.369 | 0.191 | 0.00 | 0.02 |
| Facet | 127 | 0.184 | 0.042 | 4.370 | 0.001 | 0.05 | 0.02 |
| Maladaptive | 127 | 0.134 | 0.151 | 0.889 | 0.382 | 0.02 | 0.00 |
| Big Five | 127 | -0.164 | 0.051 | -3.218 | 0.003 | 0.01 | 0.05 |
| Inverse coded | 127 | -0.104 | 0.075 | -1.374 | 0.193 | 0.04 | 0.00 |
| Representative | 125 | -0.101 | 0.082 | -1.233 | 0.227 | 0.00 | 0.00 |
| Percentage female | 123 | 0.000 | 0.000 | 0.156 | 0.880 | 0.00 | 0.03 |
| Region | |||||||
| Asia | 124 | -0.073 | 0.114 | -0.637 | 0.534 | 0.03 | 0.00 |
| Global South | 124 | 0.109 | 0.078 | 1.402 | 0.198 | 0.03 | 0.00 |
| Nothern Europe | 124 | -0.078 | 0.072 | -1.079 | 0.284 | 0.03 | 0.00 |
| Southern Europe | 124 | -0.109 | 0.102 | -1.071 | 0.297 | 0.03 | 0.00 |
Note. These Pseudo-R2 values should be interpreted with caution as the included studies slightly differed across moderators (e.g., due to missing values) making a comparison more difficult.
You can hover over the points in this graph to receive more information.
## Run alternative model for Region
data_consc$Region.d <- as.factor(ifelse(data_consc$Region == "North America", 0, 1))
meta.mod10b <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 +
T2_lag.c + Region.d,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_consc, sparse = TRUE)
## Prepare loop
plot_data <- data.frame(Moderator = factor(c("Publication year", "Publication year",
"Reliability", "Reliability",
"Other report", "Other report",
"Facet", "Facet",
"Maladaptive", "Maladaptive",
"Big Five", "Big Five",
"Inverse coded", "Inverse coded",
"Representative", "Representative",
"Percentage female", "Percentage female",
"Region", "Region"),
levels = c("Region", "Percentage female",
"Representative", "Inverse coded",
"Big Five", "Maladaptive",
"Facet", "Other report",
"Reliability", "Publication year"),
ordered = TRUE),
Score = c(0, 5,
0, 0.10,
0, 1,
0, 1,
0, 1,
0, 1,
0, 1,
0, 1,
0, 10,
0, 1),
SD = NA,
CI.lower = NA,
CI.upper = NA,
Sig = factor(c(0, 0,
1, 1,
0, 0,
1, 1,
0, 0,
1, 1,
0, 0,
0, 0,
0, 0,
0, 0)),
label = c("2015", "2020",
"0.78", "0.88",
"Self", "Other",
"No", "Yes",
"No", "Yes",
"No", "Yes",
"No", "Yes",
"No", "Yes",
"53%", "63%",
"North America", "Other"))
plot_data$ID <- 1:nrow(plot_data)
meta.models <- list(meta.mod1, meta.mod1, meta.mod2, meta.mod2,
meta.mod3, meta.mod3, meta.mod4, meta.mod4,
meta.mod5, meta.mod5, meta.mod6, meta.mod6,
meta.mod7, meta.mod7, meta.mod8, meta.mod8,
meta.mod9, meta.mod9, meta.mod10b, meta.mod10b)
## Loop to create plot data
for (i in 1:nrow(plot_data)) {
plot_data$SD[i] <- predict(meta.models[[i]],
newmods=c(20, 0, 0, plot_data$Score[i]),
transf=exp, addx=TRUE)$pred
plot_data$CI.lower[i] <- predict(meta.models[[i]],
newmods=c(20, 0, 0, plot_data$Score[i]),
transf=exp, addx=TRUE)$ci.lb
plot_data$CI.upper[i] <- predict(meta.models[[i]],
newmods=c(20, 0, 0, plot_data$Score[i]),
transf=exp, addx=TRUE)$ci.ub
}
## Plot
plot <- ggplot(data = plot_data, aes(x = SD, y = Moderator, group = Score)) +
geom_errorbar(aes(xmin=CI.lower, xmax=CI.upper, group = Score, colour = Sig),
position=position_dodge(0.75), width = 0) +
geom_point_interactive(aes(group = Score, colour = Sig,
tooltip =
paste0("SD = ", round(SD,3),
", 95% CI = [", round(CI.lower,3),
", ", round(CI.upper,3), "]"),
data_id = ID),
size = 1.8, position=position_dodge(0.75)) +
geom_text(aes(label = label, x = CI.upper + 0.001, y = Moderator, group = Score),
position=position_dodge(0.75),
hjust = 0, size = 4.5) +
theme_pub() +
scale_x_continuous(limits = c(0,0.3)) +
scale_colour_manual(values = c("0" = "grey", "1" = "black")) +
theme(legend.position = "none",
axis.text.y = element_text(hjust = 1)) +
labs(y = "Moderators", x = expression(bold("SD"[POMP])), title = "Conscientiousness")
girafe(ggobj = plot)
Note. To allow a better graphical depiction, we dummy-coded the moderator “Region” for the illustration in this graph (0 = “North America”, 1 = “Other”). However, in the main analyses, a polytomous categorical predictor was used. Significant moderation effects are depicted in black, non-significant moderations are in grey. The point estimates are calculated for 20 year old participants that are assessed over a time interval of one year.
## Create age bins
data_extra$abin_1 <- ifelse(data_extra$T1_AgeM <= 55, data_extra$T1_AgeM, 55)
data_extra$abin_2 <- ifelse(data_extra$T1_AgeM > 55, data_extra$T1_AgeM - 55, 0)
## Publication Year (Moderator 1)
meta.mod1 <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 +
T2_lag.c + Year.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_extra, sparse = TRUE)
results.mod1 <- robust(meta.mod1, cluster = StudyID, clubSandwich = TRUE)
sigma_mod1.level1_extra <- meta.mod1$sigma2[1]
sigma_mod1.level2_extra <- meta.mod1$sigma2[2]
r2.level1.mod1 <- round((sigma_spline1.level1_extra - sigma_mod1.level1_extra)/sigma_spline1.level1_extra,2)
r2.level1.mod1 <- ifelse(r2.level1.mod1 < 0, 0, r2.level1.mod1)
r2.level2.mod1 <- round((sigma_spline1.level2_extra - sigma_mod1.level2_extra)/sigma_spline1.level2_extra,2)
r2.level2.mod1 <- ifelse(r2.level2.mod1 < 0, 0, r2.level2.mod1)
mod1.extra <- as.data.frame(round(
cbind(results.mod1$n, results.mod1$b[5], results.mod1$se[5], results.mod1$zval[5],
results.mod1$pval[5], r2.level1 = r2.level1.mod1, r2.level2 = r2.level2.mod1),3))
## Reliability (Moderator 2)
meta.mod2 <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 +
T2_lag.c + Alpha_T1.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_extra, sparse = TRUE)
results.mod2 <- robust(meta.mod2, cluster = StudyID, clubSandwich = TRUE)
sigma_mod2.level1_extra <- meta.mod2$sigma2[1]
sigma_mod2.level2_extra <- meta.mod2$sigma2[2]
r2.level1.mod2 <- round((sigma_spline1.level1_extra - sigma_mod2.level1_extra)/sigma_spline1.level1_extra,2)
r2.level1.mod2 <- ifelse(r2.level1.mod2 < 0, 0, r2.level1.mod2)
r2.level2.mod2 <- round((sigma_spline1.level2_extra - sigma_mod2.level2_extra)/sigma_spline1.level2_extra,2)
r2.level2.mod2 <- ifelse(r2.level2.mod2 < 0, 0, r2.level2.mod2)
mod2.extra <- as.data.frame(round(
cbind(results.mod2$n, results.mod2$b[5], results.mod2$se[5], results.mod2$zval[5],
results.mod2$pval[5], r2.level1 = r2.level1.mod2, r2.level2 = r2.level2.mod2),3))
## Other report (Moderator 3)
meta.mod3 <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 +
T2_lag.c + OtherReport,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_extra, sparse = TRUE)
results.mod3 <- robust(meta.mod3, cluster = StudyID, clubSandwich = TRUE)
sigma_mod3.level1_extra <- meta.mod3$sigma2[1]
sigma_mod3.level2_extra <- meta.mod3$sigma2[2]
r2.level1.mod3 <- round((sigma_spline1.level1_extra - sigma_mod3.level1_extra)/sigma_spline1.level1_extra,2)
r2.level1.mod3 <- ifelse(r2.level1.mod3 < 0, 0, r2.level1.mod3)
r2.level2.mod3 <- round((sigma_spline1.level2_extra - sigma_mod3.level2_extra)/sigma_spline1.level2_extra,2)
r2.level2.mod3 <- ifelse(r2.level2.mod3 < 0, 0, r2.level2.mod3)
mod3.extra <- as.data.frame(round(
cbind(results.mod3$n, results.mod3$b[5], results.mod3$se[5], results.mod3$zval[5],
results.mod3$pval[5], r2.level1 = r2.level1.mod3, r2.level2 = r2.level2.mod3),3))
## Facet (Moderator 4)
meta.mod4 <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 +
T2_lag.c + Facet,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_extra, sparse = TRUE)
results.mod4 <- robust(meta.mod4, cluster = StudyID, clubSandwich = TRUE)
sigma_mod4.level1_extra <- meta.mod4$sigma2[1]
sigma_mod4.level2_extra <- meta.mod4$sigma2[2]
r2.level1.mod4 <- round((sigma_spline1.level1_extra - sigma_mod4.level1_extra)/sigma_spline1.level1_extra,2)
r2.level1.mod4 <- ifelse(r2.level1.mod4 < 0, 0, r2.level1.mod4)
r2.level2.mod4 <- round((sigma_spline1.level2_extra - sigma_mod4.level2_extra)/sigma_spline1.level2_extra,2)
r2.level2.mod4 <- ifelse(r2.level2.mod4 < 0, 0, r2.level2.mod4)
mod4.extra <- as.data.frame(round(
cbind(results.mod4$n, results.mod4$b[5], results.mod4$se[5], results.mod4$zval[5],
results.mod4$pval[5], r2.level1 = r2.level1.mod4, r2.level2 = r2.level2.mod4),3))
## Maladaptive (Moderator 5)
meta.mod5 <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 +
T2_lag.c + Maladaptive,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_extra, sparse = TRUE)
results.mod5 <- robust(meta.mod5, cluster = StudyID, clubSandwich = TRUE)
sigma_mod5.level1_extra <- meta.mod5$sigma2[1]
sigma_mod5.level2_extra <- meta.mod5$sigma2[2]
r2.level1.mod5 <- round((sigma_spline1.level1_extra - sigma_mod5.level1_extra)/sigma_spline1.level1_extra,2)
r2.level1.mod5 <- ifelse(r2.level1.mod5 < 0, 0, r2.level1.mod5)
r2.level2.mod5 <- round((sigma_spline1.level2_extra - sigma_mod5.level2_extra)/sigma_spline1.level2_extra,2)
r2.level2.mod5 <- ifelse(r2.level2.mod5 < 0, 0, r2.level2.mod5)
mod5.extra <- as.data.frame(round(
cbind(results.mod5$n, results.mod5$b[5], results.mod5$se[5], results.mod5$zval[5],
results.mod5$pval[5], r2.level1 = r2.level1.mod5, r2.level2 = r2.level2.mod5),3))
## Big Five taxonomy (Moderator 6)
meta.mod6 <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 +
T2_lag.c + BigFive,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_extra, sparse = TRUE)
results.mod6 <- robust(meta.mod6, cluster = StudyID, clubSandwich = TRUE)
sigma_mod6.level1_extra <- meta.mod6$sigma2[1]
sigma_mod6.level2_extra <- meta.mod6$sigma2[2]
r2.level1.mod6 <- round((sigma_spline1.level1_extra - sigma_mod6.level1_extra)/sigma_spline1.level1_extra,2)
r2.level1.mod6 <- ifelse(r2.level1.mod6 < 0, 0, r2.level1.mod6)
r2.level2.mod6 <- round((sigma_spline1.level2_extra - sigma_mod6.level2_extra)/sigma_spline1.level2_extra,2)
r2.level2.mod6 <- ifelse(r2.level2.mod6 < 0, 0, r2.level2.mod6)
mod6.extra <- as.data.frame(round(
cbind(results.mod6$n, results.mod6$b[5], results.mod6$se[5], results.mod6$zval[5],
results.mod6$pval[5], r2.level1 = r2.level1.mod6, r2.level2 = r2.level2.mod6),3))
## Inverse Coded (Moderator 7)
meta.mod7 <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 +
T2_lag.c + Inverse,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_extra, sparse = TRUE)
results.mod7 <- robust(meta.mod7, cluster = StudyID, clubSandwich = TRUE)
sigma_mod7.level1_extra <- meta.mod7$sigma2[1]
sigma_mod7.level2_extra <- meta.mod7$sigma2[2]
r2.level1.mod7 <- round((sigma_spline1.level1_extra - sigma_mod7.level1_extra)/sigma_spline1.level1_extra,2)
r2.level1.mod7 <- ifelse(r2.level1.mod7 < 0, 0, r2.level1.mod7)
r2.level2.mod7 <- round((sigma_spline1.level2_extra - sigma_mod7.level2_extra)/sigma_spline1.level2_extra,2)
r2.level2.mod7 <- ifelse(r2.level2.mod7 < 0, 0, r2.level2.mod7)
mod7.extra <- as.data.frame(round(
cbind(results.mod7$n, results.mod7$b[5], results.mod7$se[5], results.mod7$zval[5],
results.mod7$pval[5], r2.level1 = r2.level1.mod7, r2.level2 = r2.level2.mod7),3))
## Representative sample (Moderator 8)
meta.mod8 <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 +
T2_lag.c + Represent,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_extra, sparse = TRUE)
results.mod8 <- robust(meta.mod8, cluster = StudyID, clubSandwich = TRUE)
sigma_mod8.level1_extra <- meta.mod8$sigma2[1]
sigma_mod8.level2_extra <- meta.mod8$sigma2[2]
r2.level1.mod8 <- round((sigma_spline1.level1_extra - sigma_mod8.level1_extra)/sigma_spline1.level1_extra,2)
r2.level1.mod8 <- ifelse(r2.level1.mod8 < 0, 0, r2.level1.mod8)
r2.level2.mod8 <- round((sigma_spline1.level2_extra - sigma_mod8.level2_extra)/sigma_spline1.level2_extra,2)
r2.level2.mod8 <- ifelse(r2.level2.mod8 < 0, 0, r2.level2.mod8)
mod8.extra <- as.data.frame(round(
cbind(results.mod8$n, results.mod8$b[5], results.mod8$se[5], results.mod8$zval[5],
results.mod8$pval[5], r2.level1 = r2.level1.mod8, r2.level2 = r2.level2.mod8),3))
## Percentage Female (Moderator 9)
meta.mod9 <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 +
T2_lag.c + Female.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_extra, sparse = TRUE)
results.mod9 <- robust(meta.mod9, cluster = StudyID, clubSandwich = TRUE)
sigma_mod9.level1_extra <- meta.mod9$sigma2[1]
sigma_mod9.level2_extra <- meta.mod9$sigma2[2]
r2.level1.mod9 <- round((sigma_spline1.level1_extra - sigma_mod9.level1_extra)/sigma_spline1.level1_extra,2)
r2.level1.mod9 <- ifelse(r2.level1.mod9 < 0, 0, r2.level1.mod9)
r2.level2.mod9 <- round((sigma_spline1.level2_extra - sigma_mod9.level2_extra)/sigma_spline1.level2_extra,2)
r2.level2.mod9 <- ifelse(r2.level2.mod9 < 0, 0, r2.level2.mod9)
mod9.extra <- as.data.frame(round(
cbind(results.mod9$n, results.mod9$b[5], results.mod9$se[5], results.mod9$zval[5],
results.mod9$pval[5], r2.level1 = r2.level1.mod9, r2.level2 = r2.level2.mod9),3))
## Region of data collection (Moderator 10)
meta.mod10 <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 +
T2_lag.c + Region,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_extra, sparse = TRUE)
results.mod10 <- robust(meta.mod10, cluster = StudyID, clubSandwich = TRUE)
sigma_mod10.level1_extra <- meta.mod10$sigma2[1]
sigma_mod10.level2_extra <- meta.mod10$sigma2[2]
r2.level1.mod10 <- round((sigma_spline1.level1_extra - sigma_mod10.level1_extra)/sigma_spline1.level1_extra,2)
r2.level1.mod10 <- ifelse(r2.level1.mod10 < 0, 0, r2.level1.mod10)
r2.level2.mod10 <- round((sigma_spline1.level2_extra - sigma_mod10.level2_extra)/sigma_spline1.level2_extra,2)
r2.level2.mod10 <- ifelse(r2.level2.mod10 < 0, 0, r2.level2.mod10)
mod10.extra <- as.data.frame(round(
cbind(results.mod10$n, results.mod10$b[5:8], results.mod10$se[5:8], results.mod10$zval[5:8],
results.mod10$pval[5:8], r2.level1 = r2.level1.mod10, r2.level2 = r2.level2.mod10),3))
mod.extra <- rbind(mod1.extra, mod2.extra, mod3.extra, mod4.extra, mod5.extra, mod6.extra, mod7.extra, mod8.extra, mod9.extra, mod10.extra)
names(mod.extra) <- c("Studies", "*b*", "*SE*", "*z*", "*p*", "R^2^~Level1~","R^2^~Level2~")
row.names(mod.extra) <- c("Publication year",
"Reliability", "Other report", "Facet",
"Maladaptive", "Big Five", "Inverse coded",
"Representative", "Percentage female",
"Asia", "Global South",
"Nothern Europe", "Southern Europe")
kable(mod.extra
, caption="**Moderator analyses for extraversion (separate models)**"
, escape=FALSE
, label = NA) %>%
pack_rows("Region", 10, 13) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| Studies | b | SE | z | p | R2Level1 | R2Level2 | |
|---|---|---|---|---|---|---|---|
| Publication year | 117 | 0.002 | 0.004 | 0.456 | 0.652 | 0.00 | 0.00 |
| Reliability | 91 | -0.100 | 0.258 | -0.389 | 0.709 | 0.25 | 0.00 |
| Other report | 117 | 0.005 | 0.036 | 0.144 | 0.888 | 0.00 | 0.00 |
| Facet | 117 | 0.212 | 0.047 | 4.554 | 0.001 | 0.06 | 0.09 |
| Maladaptive | 117 | 0.335 | 0.202 | 1.657 | 0.133 | 0.09 | 0.00 |
| Big Five | 117 | -0.183 | 0.055 | -3.338 | 0.002 | 0.00 | 0.13 |
| Inverse coded | 117 | -0.060 | 0.076 | -0.800 | 0.440 | 0.02 | 0.00 |
| Representative | 116 | -0.109 | 0.063 | -1.727 | 0.093 | 0.05 | 0.01 |
| Percentage female | 114 | 0.000 | 0.000 | -0.211 | 0.840 | 0.04 | 0.01 |
| Region | |||||||
| Asia | 114 | -0.260 | 0.148 | -1.759 | 0.103 | 0.00 | 0.00 |
| Global South | 114 | -0.029 | 0.066 | -0.442 | 0.672 | 0.00 | 0.00 |
| Nothern Europe | 114 | -0.096 | 0.065 | -1.477 | 0.144 | 0.00 | 0.00 |
| Southern Europe | 114 | -0.035 | 0.155 | -0.227 | 0.824 | 0.00 | 0.00 |
Note. These Pseudo-R2 values should be interpreted with caution as the included studies slightly differed across moderators (e.g., due to missing values) making a comparison more difficult.
You can hover over the points in this graph to receive more information.
## Run alternative model for Region
data_extra$Region.d <- as.factor(ifelse(data_extra$Region == "North America", 0, 1))
meta.mod10b <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 +
T2_lag.c + Region.d,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_extra, sparse = TRUE)
## Prepare loop
plot_data <- data.frame(Moderator = factor(c("Publication year", "Publication year",
"Reliability", "Reliability",
"Other report", "Other report",
"Facet", "Facet",
"Maladaptive", "Maladaptive",
"Big Five", "Big Five",
"Inverse coded", "Inverse coded",
"Representative", "Representative",
"Percentage female", "Percentage female",
"Region", "Region"),
levels = c("Region", "Percentage female",
"Representative", "Inverse coded",
"Big Five", "Maladaptive",
"Facet", "Other report",
"Reliability", "Publication year"),
ordered = TRUE),
Score = c(0, 5,
0, 0.10,
0, 1,
0, 1,
0, 1,
0, 1,
0, 1,
0, 1,
0, 10,
0, 1),
SD = NA,
CI.lower = NA,
CI.upper = NA,
Sig = factor(c(0, 0,
0, 0,
0, 0,
1, 1,
0, 0,
1, 1,
0, 0,
0, 0,
0, 0,
0, 0)),
label = c("2015", "2020",
"0.78", "0.88",
"Self", "Other",
"No", "Yes",
"No", "Yes",
"No", "Yes",
"No", "Yes",
"No", "Yes",
"53%", "63%",
"North America", "Other"))
plot_data$ID <- 1:nrow(plot_data)
meta.models <- list(meta.mod1, meta.mod1, meta.mod2, meta.mod2,
meta.mod3, meta.mod3, meta.mod4, meta.mod4,
meta.mod5, meta.mod5, meta.mod6, meta.mod6,
meta.mod7, meta.mod7, meta.mod8, meta.mod8,
meta.mod9, meta.mod9, meta.mod10b, meta.mod10b)
## Loop to create plot data
for (i in 1:nrow(plot_data)) {
plot_data$SD[i] <- predict(meta.models[[i]],
newmods=c(20, 0, 0, plot_data$Score[i]),
transf=exp, addx=TRUE)$pred
plot_data$CI.lower[i] <- predict(meta.models[[i]],
newmods=c(20, 0, 0, plot_data$Score[i]),
transf=exp, addx=TRUE)$ci.lb
plot_data$CI.upper[i] <- predict(meta.models[[i]],
newmods=c(20, 0, 0, plot_data$Score[i]),
transf=exp, addx=TRUE)$ci.ub
}
## Plot
plot <- ggplot(data = plot_data, aes(x = SD, y = Moderator, group = Score)) +
geom_errorbar(aes(xmin=CI.lower, xmax=CI.upper, group = Score, colour = Sig),
position=position_dodge(0.75), width = 0) +
geom_point_interactive(aes(group = Score, colour = Sig,
tooltip =
paste0("SD = ", round(SD,3),
", 95% CI = [", round(CI.lower,3),
", ", round(CI.upper,3), "]"),
data_id = ID),
size = 1.8, position=position_dodge(0.75)) +
geom_text(aes(label = label, x = CI.upper + 0.001, y = Moderator, group = Score),
position=position_dodge(0.75),
hjust = 0, size = 4.5) +
theme_pub() +
scale_x_continuous(limits = c(0,0.3)) +
scale_colour_manual(values = c("0" = "grey", "1" = "black")) +
theme(legend.position = "none",
axis.text.y = element_text(hjust = 1)) +
labs(y = "Moderators", x = expression(bold("SD"[POMP])), title = "Extraversion")
girafe(ggobj = plot)
Note. To allow a better graphical depiction, we dummy-coded the moderator “Region” for the illustration in this graph (0 = “North America”, 1 = “Other”). However, in the main analyses, a polytomous categorical predictor was used. Significant moderation effects are depicted in black, non-significant moderations are in grey. The point estimates are calculated for 20 year old participants that are assessed over a time interval of one year.
## Create age bins
data_neuro$abin_1 <- ifelse(data_neuro$T1_AgeM <= 25, data_neuro$T1_AgeM, 25)
data_neuro$abin_2 <- ifelse(data_neuro$T1_AgeM <= 75 & data_neuro$T1_AgeM > 25,
data_neuro$T1_AgeM - 25,
ifelse(data_neuro$T1_AgeM <= 25, 0, 75 - 25))
data_neuro$abin_3 <- ifelse(data_neuro$T1_AgeM > 75, data_neuro$T1_AgeM - 75, 0)
## Publication Year (Moderator 1)
meta.mod1 <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 +
T2_lag.c + Year.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_neuro, sparse = TRUE)
results.mod1 <- robust(meta.mod1, cluster = StudyID, clubSandwich = TRUE)
sigma_mod1.level1_neuro <- meta.mod1$sigma2[1]
sigma_mod1.level2_neuro <- meta.mod1$sigma2[2]
r2.level1.mod1 <- round((sigma_spline1.level1_neuro - sigma_mod1.level1_neuro)/sigma_spline1.level1_neuro,2)
r2.level1.mod1 <- ifelse(r2.level1.mod1 < 0, 0, r2.level1.mod1)
r2.level2.mod1 <- round((sigma_spline1.level2_neuro - sigma_mod1.level2_neuro)/sigma_spline1.level2_neuro,2)
r2.level2.mod1 <- ifelse(r2.level2.mod1 < 0, 0, r2.level2.mod1)
mod1.neuro <- as.data.frame(round(
cbind(results.mod1$n, results.mod1$b[6], results.mod1$se[6], results.mod1$zval[6],
results.mod1$pval[6], r2.level1 = r2.level1.mod1, r2.level2 = r2.level2.mod1),3))
## Reliability (Moderator 2)
meta.mod2 <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 +
T2_lag.c + Alpha_T1.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_neuro, sparse = TRUE)
results.mod2 <- robust(meta.mod2, cluster = StudyID, clubSandwich = TRUE)
sigma_mod2.level1_neuro <- meta.mod2$sigma2[1]
sigma_mod2.level2_neuro <- meta.mod2$sigma2[2]
r2.level1.mod2 <- round((sigma_spline1.level1_neuro - sigma_mod2.level1_neuro)/sigma_spline1.level1_neuro,2)
r2.level1.mod2 <- ifelse(r2.level1.mod2 < 0, 0, r2.level1.mod2)
r2.level2.mod2 <- round((sigma_spline1.level2_neuro - sigma_mod2.level2_neuro)/sigma_spline1.level2_neuro,2)
r2.level2.mod2 <- ifelse(r2.level2.mod2 < 0, 0, r2.level2.mod2)
mod2.neuro <- as.data.frame(round(
cbind(results.mod2$n, results.mod2$b[6], results.mod2$se[6], results.mod2$zval[6],
results.mod2$pval[6], r2.level1 = r2.level1.mod2, r2.level2 = r2.level2.mod2),3))
## Other report (Moderator 3)
meta.mod3 <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 +
T2_lag.c + OtherReport,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_neuro, sparse = TRUE)
results.mod3 <- robust(meta.mod3, cluster = StudyID, clubSandwich = TRUE)
sigma_mod3.level1_neuro <- meta.mod3$sigma2[1]
sigma_mod3.level2_neuro <- meta.mod3$sigma2[2]
r2.level1.mod3 <- round((sigma_spline1.level1_neuro - sigma_mod3.level1_neuro)/sigma_spline1.level1_neuro,2)
r2.level1.mod3 <- ifelse(r2.level1.mod3 < 0, 0, r2.level1.mod3)
r2.level2.mod3 <- round((sigma_spline1.level2_neuro - sigma_mod3.level2_neuro)/sigma_spline1.level2_neuro,2)
r2.level2.mod3 <- ifelse(r2.level2.mod3 < 0, 0, r2.level2.mod3)
mod3.neuro <- as.data.frame(round(
cbind(results.mod3$n, results.mod3$b[6], results.mod3$se[6], results.mod3$zval[6],
results.mod3$pval[6], r2.level1 = r2.level1.mod3, r2.level2 = r2.level2.mod3),3))
## Facet (Moderator 4)
meta.mod4 <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 +
T2_lag.c + Facet,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_neuro, sparse = TRUE)
results.mod4 <- robust(meta.mod4, cluster = StudyID, clubSandwich = TRUE)
sigma_mod4.level1_neuro <- meta.mod4$sigma2[1]
sigma_mod4.level2_neuro <- meta.mod4$sigma2[2]
r2.level1.mod4 <- round((sigma_spline1.level1_neuro - sigma_mod4.level1_neuro)/sigma_spline1.level1_neuro,2)
r2.level1.mod4 <- ifelse(r2.level1.mod4 < 0, 0, r2.level1.mod4)
r2.level2.mod4 <- round((sigma_spline1.level2_neuro - sigma_mod4.level2_neuro)/sigma_spline1.level2_neuro,2)
r2.level2.mod4 <- ifelse(r2.level2.mod4 < 0, 0, r2.level2.mod4)
mod4.neuro <- as.data.frame(round(
cbind(results.mod4$n, results.mod4$b[6], results.mod4$se[6], results.mod4$zval[6],
results.mod4$pval[6], r2.level1 = r2.level1.mod4, r2.level2 = r2.level2.mod4),3))
## Maladaptive (Moderator 5)
meta.mod5 <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 +
T2_lag.c + Maladaptive,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_neuro, sparse = TRUE)
results.mod5 <- robust(meta.mod5, cluster = StudyID, clubSandwich = TRUE)
sigma_mod5.level1_neuro <- meta.mod5$sigma2[1]
sigma_mod5.level2_neuro <- meta.mod5$sigma2[2]
r2.level1.mod5 <- round((sigma_spline1.level1_neuro - sigma_mod5.level1_neuro)/sigma_spline1.level1_neuro,2)
r2.level1.mod5 <- ifelse(r2.level1.mod5 < 0, 0, r2.level1.mod5)
r2.level2.mod5 <- round((sigma_spline1.level2_neuro - sigma_mod5.level2_neuro)/sigma_spline1.level2_neuro,2)
r2.level2.mod5 <- ifelse(r2.level2.mod5 < 0, 0, r2.level2.mod5)
mod5.neuro <- as.data.frame(round(
cbind(results.mod5$n, results.mod5$b[6], results.mod5$se[6], results.mod5$zval[6],
results.mod5$pval[6], r2.level1 = r2.level1.mod5, r2.level2 = r2.level2.mod5),3))
## Big Five taxonomy (Moderator 6)
meta.mod6 <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 +
T2_lag.c + BigFive,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_neuro, sparse = TRUE)
results.mod6 <- robust(meta.mod6, cluster = StudyID, clubSandwich = TRUE)
sigma_mod6.level1_neuro <- meta.mod6$sigma2[1]
sigma_mod6.level2_neuro <- meta.mod6$sigma2[2]
r2.level1.mod6 <- round((sigma_spline1.level1_neuro - sigma_mod6.level1_neuro)/sigma_spline1.level1_neuro,2)
r2.level1.mod6 <- ifelse(r2.level1.mod6 < 0, 0, r2.level1.mod6)
r2.level2.mod6 <- round((sigma_spline1.level2_neuro - sigma_mod6.level2_neuro)/sigma_spline1.level2_neuro,2)
r2.level2.mod6 <- ifelse(r2.level2.mod6 < 0, 0, r2.level2.mod6)
mod6.neuro <- as.data.frame(round(
cbind(results.mod6$n, results.mod6$b[6], results.mod6$se[6], results.mod6$zval[6],
results.mod6$pval[6], r2.level1 = r2.level1.mod6, r2.level2 = r2.level2.mod6),3))
## Inverse Coded (Moderator 7)
meta.mod7 <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 +
T2_lag.c + Inverse,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_neuro, sparse = TRUE)
results.mod7 <- robust(meta.mod7, cluster = StudyID, clubSandwich = TRUE)
sigma_mod7.level1_neuro <- meta.mod7$sigma2[1]
sigma_mod7.level2_neuro <- meta.mod7$sigma2[2]
r2.level1.mod7 <- round((sigma_spline1.level1_neuro - sigma_mod7.level1_neuro)/sigma_spline1.level1_neuro,2)
r2.level1.mod7 <- ifelse(r2.level1.mod7 < 0, 0, r2.level1.mod7)
r2.level2.mod7 <- round((sigma_spline1.level2_neuro - sigma_mod7.level2_neuro)/sigma_spline1.level2_neuro,2)
r2.level2.mod7 <- ifelse(r2.level2.mod7 < 0, 0, r2.level2.mod7)
mod7.neuro <- as.data.frame(round(
cbind(results.mod7$n, results.mod7$b[6], results.mod7$se[6], results.mod7$zval[6],
results.mod7$pval[6], r2.level1 = r2.level1.mod7, r2.level2 = r2.level2.mod7),3))
## Representative sample (Moderator 8)
meta.mod8 <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 +
T2_lag.c + Represent,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_neuro, sparse = TRUE)
results.mod8 <- robust(meta.mod8, cluster = StudyID, clubSandwich = TRUE)
sigma_mod8.level1_neuro <- meta.mod8$sigma2[1]
sigma_mod8.level2_neuro <- meta.mod8$sigma2[2]
r2.level1.mod8 <- round((sigma_spline1.level1_neuro - sigma_mod8.level1_neuro)/sigma_spline1.level1_neuro,2)
r2.level1.mod8 <- ifelse(r2.level1.mod8 < 0, 0, r2.level1.mod8)
r2.level2.mod8 <- round((sigma_spline1.level2_neuro - sigma_mod8.level2_neuro)/sigma_spline1.level2_neuro,2)
r2.level2.mod8 <- ifelse(r2.level2.mod8 < 0, 0, r2.level2.mod8)
mod8.neuro <- as.data.frame(round(
cbind(results.mod8$n, results.mod8$b[6], results.mod8$se[6], results.mod8$zval[6],
results.mod8$pval[6], r2.level1 = r2.level1.mod8, r2.level2 = r2.level2.mod8),3))
## Percentage Female (Moderator 9)
meta.mod9 <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 +
T2_lag.c + Female.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_neuro, sparse = TRUE)
results.mod9 <- robust(meta.mod9, cluster = StudyID, clubSandwich = TRUE)
sigma_mod9.level1_neuro <- meta.mod9$sigma2[1]
sigma_mod9.level2_neuro <- meta.mod9$sigma2[2]
r2.level1.mod9 <- round((sigma_spline1.level1_neuro - sigma_mod9.level1_neuro)/sigma_spline1.level1_neuro,2)
r2.level1.mod9 <- ifelse(r2.level1.mod9 < 0, 0, r2.level1.mod9)
r2.level2.mod9 <- round((sigma_spline1.level2_neuro - sigma_mod9.level2_neuro)/sigma_spline1.level2_neuro,2)
r2.level2.mod9 <- ifelse(r2.level2.mod9 < 0, 0, r2.level2.mod9)
mod9.neuro <- as.data.frame(round(
cbind(results.mod9$n, results.mod9$b[6], results.mod9$se[6], results.mod9$zval[6],
results.mod9$pval[6], r2.level1 = r2.level1.mod9, r2.level2 = r2.level2.mod9),3))
## Region of data collection (Moderator 10)
meta.mod10 <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 +
T2_lag.c + Region,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_neuro, sparse = TRUE)
results.mod10 <- robust(meta.mod10, cluster = StudyID, clubSandwich = TRUE)
sigma_mod10.level1_neuro <- meta.mod10$sigma2[1]
sigma_mod10.level2_neuro <- meta.mod10$sigma2[2]
r2.level1.mod10 <- round((sigma_spline1.level1_neuro - sigma_mod10.level1_neuro)/sigma_spline1.level1_neuro,2)
r2.level1.mod10 <- ifelse(r2.level1.mod10 < 0, 0, r2.level1.mod10)
r2.level2.mod10 <- round((sigma_spline1.level2_neuro - sigma_mod10.level2_neuro)/sigma_spline1.level2_neuro,2)
r2.level2.mod10 <- ifelse(r2.level2.mod10 < 0, 0, r2.level2.mod10)
mod10.neuro <- as.data.frame(round(
cbind(results.mod10$n, results.mod10$b[6:9], results.mod10$se[6:9], results.mod10$zval[6:9],
results.mod10$pval[6:9], r2.level1 = r2.level1.mod10, r2.level2 = r2.level2.mod10),3))
mod.neuro <- rbind(mod1.neuro, mod2.neuro, mod3.neuro, mod4.neuro, mod5.neuro, mod6.neuro, mod7.neuro, mod8.neuro, mod9.neuro, mod10.neuro)
names(mod.neuro) <- c("Studies", "*b*", "*SE*", "*z*", "*p*", "R^2^~Level1~","R^2^~Level2~")
row.names(mod.neuro) <- c("Publication year",
"Reliability", "Other report", "Facet",
"Maladaptive", "Big Five", "Inverse coded",
"Representative", "Percentage female",
"Asia", "Global South",
"Nothern Europe", "Southern Europe")
kable(mod.neuro
, caption="**Moderator analyses for neuroticism (separate models)**"
, escape=FALSE
, label = NA) %>%
pack_rows("Region", 10, 13) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| Studies | b | SE | z | p | R2Level1 | R2Level2 | |
|---|---|---|---|---|---|---|---|
| Publication year | 185 | 0.003 | 0.003 | 0.886 | 0.380 | 0.00 | 0.00 |
| Reliability | 147 | -0.350 | 0.162 | -2.164 | 0.054 | 0.16 | 0.00 |
| Other report | 185 | -0.052 | 0.043 | -1.213 | 0.239 | 0.00 | 0.02 |
| Facet | 185 | 0.029 | 0.060 | 0.472 | 0.642 | 0.00 | 0.01 |
| Maladaptive | 184 | -0.088 | 0.069 | -1.285 | 0.216 | 0.01 | 0.00 |
| Big Five | 185 | -0.030 | 0.055 | -0.544 | 0.589 | 0.00 | 0.00 |
| Inverse coded | 185 | 0.000 | 0.042 | -0.002 | 0.998 | 0.00 | 0.00 |
| Representative | 183 | -0.097 | 0.054 | -1.806 | 0.079 | 0.00 | 0.02 |
| Percentage female | 180 | -0.001 | 0.001 | -0.798 | 0.440 | 0.02 | 0.03 |
| Region | |||||||
| Asia | 181 | -0.015 | 0.067 | -0.218 | 0.829 | 0.00 | 0.00 |
| Global South | 181 | 0.131 | 0.094 | 1.390 | 0.204 | 0.00 | 0.00 |
| Nothern Europe | 181 | -0.031 | 0.054 | -0.583 | 0.561 | 0.00 | 0.00 |
| Southern Europe | 181 | 0.033 | 0.101 | 0.327 | 0.746 | 0.00 | 0.00 |
Note. These Pseudo-R2 values should be interpreted with caution as the included studies slightly differed across moderators (e.g., due to missing values) making a comparison more difficult.
You can hover over the points in this graph to receive more information.
## Run alternative model for Region
data_neuro$Region.d <- as.factor(ifelse(data_neuro$Region == "North America", 0, 1))
meta.mod10b <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 +
T2_lag.c + Region.d,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_neuro, sparse = TRUE)
## Prepare loop
plot_data <- data.frame(Moderator = factor(c("Publication year", "Publication year",
"Reliability", "Reliability",
"Other report", "Other report",
"Facet", "Facet",
"Maladaptive", "Maladaptive",
"Big Five", "Big Five",
"Inverse coded", "Inverse coded",
"Representative", "Representative",
"Percentage female", "Percentage female",
"Region", "Region"),
levels = c("Region", "Percentage female",
"Representative", "Inverse coded",
"Big Five", "Maladaptive",
"Facet", "Other report",
"Reliability", "Publication year"),
ordered = TRUE),
Score = c(0, 5,
0, 0.10,
0, 1,
0, 1,
0, 1,
0, 1,
0, 1,
0, 1,
0, 10,
0, 1),
SD = NA,
CI.lower = NA,
CI.upper = NA,
Sig = factor(c(0, 0,
0, 0,
0, 0,
0, 0,
0, 0,
0, 0,
0, 0,
0, 0,
0, 0,
0, 0)),
label = c("2015", "2020",
"0.78", "0.88",
"Self", "Other",
"No", "Yes",
"No", "Yes",
"No", "Yes",
"No", "Yes",
"No", "Yes",
"53%", "63%",
"North America", "Other"))
plot_data$ID <- 1:nrow(plot_data)
meta.models <- list(meta.mod1, meta.mod1, meta.mod2, meta.mod2,
meta.mod3, meta.mod3, meta.mod4, meta.mod4,
meta.mod5, meta.mod5, meta.mod6, meta.mod6,
meta.mod7, meta.mod7, meta.mod8, meta.mod8,
meta.mod9, meta.mod9, meta.mod10b, meta.mod10b)
## Loop to create plot data
for (i in 1:nrow(plot_data)) {
plot_data$SD[i] <- predict(meta.models[[i]],
newmods=c(20, 0, 0, 0, plot_data$Score[i]),
transf=exp, addx=TRUE)$pred
plot_data$CI.lower[i] <- predict(meta.models[[i]],
newmods=c(20, 0, 0, 0, plot_data$Score[i]),
transf=exp, addx=TRUE)$ci.lb
plot_data$CI.upper[i] <- predict(meta.models[[i]],
newmods=c(20, 0, 0, 0, plot_data$Score[i]),
transf=exp, addx=TRUE)$ci.ub
}
## Plot
plot <- ggplot(data = plot_data, aes(x = SD, y = Moderator, group = Score)) +
geom_errorbar(aes(xmin=CI.lower, xmax=CI.upper, group = Score, colour = Sig),
position=position_dodge(0.75), width = 0) +
geom_point_interactive(aes(group = Score, colour = Sig,
tooltip =
paste0("SD = ", round(SD,3),
", 95% CI = [", round(CI.lower,3),
", ", round(CI.upper,3), "]"),
data_id = ID),
size = 1.8, position=position_dodge(0.75)) +
geom_text(aes(label = label, x = CI.upper + 0.001, y = Moderator, group = Score),
position=position_dodge(0.75),
hjust = 0, size = 4.5) +
theme_pub() +
scale_x_continuous(limits = c(0,0.3)) +
scale_colour_manual(values = c("0" = "grey", "1" = "black")) +
theme(legend.position = "none",
axis.text.y = element_text(hjust = 1)) +
labs(y = "Moderators", x = expression(bold("SD"[POMP])), title = "Neuroticism")
girafe(ggobj = plot)
Note. To allow a better graphical depiction, we dummy-coded the moderator “Region” for the illustration in this graph (0 = “North America”, 1 = “Other”). However, in the main analyses, a polytomous categorical predictor was used. Significant moderation effects are depicted in black, non-significant moderations are in grey. The point estimates are calculated for 20 year old participants that are assessed over a time interval of one year.
## Create age bins
data_open$abin_1 <- ifelse(data_open$T1_AgeM <= 30, data_open$T1_AgeM, 30)
data_open$abin_2 <- ifelse(data_open$T1_AgeM > 30, data_open$T1_AgeM - 30, 0)
## Publication Year (Moderator 1)
meta.mod1 <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 +
T2_lag.c + Year.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_open, sparse = TRUE)
results.mod1 <- robust(meta.mod1, cluster = StudyID, clubSandwich = TRUE)
sigma_mod1.level1_open <- meta.mod1$sigma2[1]
sigma_mod1.level2_open <- meta.mod1$sigma2[2]
r2.level1.mod1 <- round((sigma_spline1.level1_open - sigma_mod1.level1_open)/sigma_spline1.level1_open,2)
r2.level1.mod1 <- ifelse(r2.level1.mod1 < 0, 0, r2.level1.mod1)
r2.level2.mod1 <- round((sigma_spline1.level2_open - sigma_mod1.level2_open)/sigma_spline1.level2_open,2)
r2.level2.mod1 <- ifelse(r2.level2.mod1 < 0, 0, r2.level2.mod1)
mod1.open <- as.data.frame(round(
cbind(results.mod1$n, results.mod1$b[5], results.mod1$se[5], results.mod1$zval[5],
results.mod1$pval[5], r2.level1 = r2.level1.mod1, r2.level2 = r2.level2.mod1),3))
## Reliability (Moderator 2)
meta.mod2 <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 +
T2_lag.c + Alpha_T1.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_open, sparse = TRUE)
results.mod2 <- robust(meta.mod2, cluster = StudyID, clubSandwich = TRUE)
sigma_mod2.level1_open <- meta.mod2$sigma2[1]
sigma_mod2.level2_open <- meta.mod2$sigma2[2]
r2.level1.mod2 <- round((sigma_spline1.level1_open - sigma_mod2.level1_open)/sigma_spline1.level1_open,2)
r2.level1.mod2 <- ifelse(r2.level1.mod2 < 0, 0, r2.level1.mod2)
r2.level2.mod2 <- round((sigma_spline1.level2_open - sigma_mod2.level2_open)/sigma_spline1.level2_open,2)
r2.level2.mod2 <- ifelse(r2.level2.mod2 < 0, 0, r2.level2.mod2)
mod2.open <- as.data.frame(round(
cbind(results.mod2$n, results.mod2$b[5], results.mod2$se[5], results.mod2$zval[5],
results.mod2$pval[5], r2.level1 = r2.level1.mod2, r2.level2 = r2.level2.mod2),3))
## Other report (Moderator 3)
meta.mod3 <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 +
T2_lag.c + OtherReport,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_open, sparse = TRUE)
results.mod3 <- robust(meta.mod3, cluster = StudyID, clubSandwich = TRUE)
sigma_mod3.level1_open <- meta.mod3$sigma2[1]
sigma_mod3.level2_open <- meta.mod3$sigma2[2]
r2.level1.mod3 <- round((sigma_spline1.level1_open - sigma_mod3.level1_open)/sigma_spline1.level1_open,2)
r2.level1.mod3 <- ifelse(r2.level1.mod3 < 0, 0, r2.level1.mod3)
r2.level2.mod3 <- round((sigma_spline1.level2_open - sigma_mod3.level2_open)/sigma_spline1.level2_open,2)
r2.level2.mod3 <- ifelse(r2.level2.mod3 < 0, 0, r2.level2.mod3)
mod3.open <- as.data.frame(round(
cbind(results.mod3$n, results.mod3$b[5], results.mod3$se[5], results.mod3$zval[5],
results.mod3$pval[5], r2.level1 = r2.level1.mod3, r2.level2 = r2.level2.mod3),3))
## Facet (Moderator 4)
meta.mod4 <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 +
T2_lag.c + Facet,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_open, sparse = TRUE)
results.mod4 <- robust(meta.mod4, cluster = StudyID, clubSandwich = TRUE)
sigma_mod4.level1_open <- meta.mod4$sigma2[1]
sigma_mod4.level2_open <- meta.mod4$sigma2[2]
r2.level1.mod4 <- round((sigma_spline1.level1_open - sigma_mod4.level1_open)/sigma_spline1.level1_open,2)
r2.level1.mod4 <- ifelse(r2.level1.mod4 < 0, 0, r2.level1.mod4)
r2.level2.mod4 <- round((sigma_spline1.level2_open - sigma_mod4.level2_open)/sigma_spline1.level2_open,2)
r2.level2.mod4 <- ifelse(r2.level2.mod4 < 0, 0, r2.level2.mod4)
mod4.open <- as.data.frame(round(
cbind(results.mod4$n, results.mod4$b[5], results.mod4$se[5], results.mod4$zval[5],
results.mod4$pval[5], r2.level1 = r2.level1.mod4, r2.level2 = r2.level2.mod4),3))
## Maladaptive (Moderator 5)
meta.mod5 <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 +
T2_lag.c + Maladaptive,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_open, sparse = TRUE)
results.mod5 <- robust(meta.mod5, cluster = StudyID, clubSandwich = TRUE)
sigma_mod5.level1_open <- meta.mod5$sigma2[1]
sigma_mod5.level2_open <- meta.mod5$sigma2[2]
r2.level1.mod5 <- round((sigma_spline1.level1_open - sigma_mod5.level1_open)/sigma_spline1.level1_open,2)
r2.level1.mod5 <- ifelse(r2.level1.mod5 < 0, 0, r2.level1.mod5)
r2.level2.mod5 <- round((sigma_spline1.level2_open - sigma_mod5.level2_open)/sigma_spline1.level2_open,2)
r2.level2.mod5 <- ifelse(r2.level2.mod5 < 0, 0, r2.level2.mod5)
mod5.open <- as.data.frame(round(
cbind(results.mod5$n, results.mod5$b[5], results.mod5$se[5], results.mod5$zval[5],
results.mod5$pval[5], r2.level1 = r2.level1.mod5, r2.level2 = r2.level2.mod5),3))
## Big Five taxonomy (Moderator 6)
meta.mod6 <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 +
T2_lag.c + BigFive,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_open, sparse = TRUE)
results.mod6 <- robust(meta.mod6, cluster = StudyID, clubSandwich = TRUE)
sigma_mod6.level1_open <- meta.mod6$sigma2[1]
sigma_mod6.level2_open <- meta.mod6$sigma2[2]
r2.level1.mod6 <- round((sigma_spline1.level1_open - sigma_mod6.level1_open)/sigma_spline1.level1_open,2)
r2.level1.mod6 <- ifelse(r2.level1.mod6 < 0, 0, r2.level1.mod6)
r2.level2.mod6 <- round((sigma_spline1.level2_open - sigma_mod6.level2_open)/sigma_spline1.level2_open,2)
r2.level2.mod6 <- ifelse(r2.level2.mod6 < 0, 0, r2.level2.mod6)
mod6.open <- as.data.frame(round(
cbind(results.mod6$n, results.mod6$b[5], results.mod6$se[5], results.mod6$zval[5],
results.mod6$pval[5], r2.level1 = r2.level1.mod6, r2.level2 = r2.level2.mod6),3))
## Inverse Coded (Moderator 7)
meta.mod7 <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 +
T2_lag.c + Inverse,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_open, sparse = TRUE)
results.mod7 <- robust(meta.mod7, cluster = StudyID, clubSandwich = TRUE)
sigma_mod7.level1_open <- meta.mod7$sigma2[1]
sigma_mod7.level2_open <- meta.mod7$sigma2[2]
r2.level1.mod7 <- round((sigma_spline1.level1_open - sigma_mod7.level1_open)/sigma_spline1.level1_open,2)
r2.level1.mod7 <- ifelse(r2.level1.mod7 < 0, 0, r2.level1.mod7)
r2.level2.mod7 <- round((sigma_spline1.level2_open - sigma_mod7.level2_open)/sigma_spline1.level2_open,2)
r2.level2.mod7 <- ifelse(r2.level2.mod7 < 0, 0, r2.level2.mod7)
mod7.open <- as.data.frame(round(
cbind(results.mod7$n, results.mod7$b[5], results.mod7$se[5], results.mod7$zval[5],
results.mod7$pval[5], r2.level1 = r2.level1.mod7, r2.level2 = r2.level2.mod7),3))
## Representative sample (Moderator 8)
meta.mod8 <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 +
T2_lag.c + Represent,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_open, sparse = TRUE)
results.mod8 <- robust(meta.mod8, cluster = StudyID, clubSandwich = TRUE)
sigma_mod8.level1_open <- meta.mod8$sigma2[1]
sigma_mod8.level2_open <- meta.mod8$sigma2[2]
r2.level1.mod8 <- round((sigma_spline1.level1_open - sigma_mod8.level1_open)/sigma_spline1.level1_open,2)
r2.level1.mod8 <- ifelse(r2.level1.mod8 < 0, 0, r2.level1.mod8)
r2.level2.mod8 <- round((sigma_spline1.level2_open - sigma_mod8.level2_open)/sigma_spline1.level2_open,2)
r2.level2.mod8 <- ifelse(r2.level2.mod8 < 0, 0, r2.level2.mod8)
mod8.open <- as.data.frame(round(
cbind(results.mod8$n, results.mod8$b[5], results.mod8$se[5], results.mod8$zval[5],
results.mod8$pval[5], r2.level1 = r2.level1.mod8, r2.level2 = r2.level2.mod8),3))
## Percentage Female (Moderator 9)
meta.mod9 <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 +
T2_lag.c + Female.c,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_open, sparse = TRUE)
results.mod9 <- robust(meta.mod9, cluster = StudyID, clubSandwich = TRUE)
sigma_mod9.level1_open <- meta.mod9$sigma2[1]
sigma_mod9.level2_open <- meta.mod9$sigma2[2]
r2.level1.mod9 <- round((sigma_spline1.level1_open - sigma_mod9.level1_open)/sigma_spline1.level1_open,2)
r2.level1.mod9 <- ifelse(r2.level1.mod9 < 0, 0, r2.level1.mod9)
r2.level2.mod9 <- round((sigma_spline1.level2_open - sigma_mod9.level2_open)/sigma_spline1.level2_open,2)
r2.level2.mod9 <- ifelse(r2.level2.mod9 < 0, 0, r2.level2.mod9)
mod9.open <- as.data.frame(round(
cbind(results.mod9$n, results.mod9$b[5], results.mod9$se[5], results.mod9$zval[5],
results.mod9$pval[5], r2.level1 = r2.level1.mod9, r2.level2 = r2.level2.mod9),3))
## Region of data collection (Moderator 10)
meta.mod10 <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 +
T2_lag.c + Region,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_open, sparse = TRUE)
results.mod10 <- robust(meta.mod10, cluster = StudyID, clubSandwich = TRUE)
sigma_mod10.level1_open <- meta.mod10$sigma2[1]
sigma_mod10.level2_open <- meta.mod10$sigma2[2]
r2.level1.mod10 <- round((sigma_spline1.level1_open - sigma_mod10.level1_open)/sigma_spline1.level1_open,2)
r2.level1.mod10 <- ifelse(r2.level1.mod10 < 0, 0, r2.level1.mod10)
r2.level2.mod10 <- round((sigma_spline1.level2_open - sigma_mod10.level2_open)/sigma_spline1.level2_open,2)
r2.level2.mod10 <- ifelse(r2.level2.mod10 < 0, 0, r2.level2.mod10)
mod10.open <- as.data.frame(round(
cbind(results.mod10$n, results.mod10$b[5:8], results.mod10$se[5:8], results.mod10$zval[5:8],
results.mod10$pval[5:8], r2.level1 = r2.level1.mod10, r2.level2 = r2.level2.mod10),3))
mod.open <- rbind(mod1.open, mod2.open, mod3.open, mod4.open, mod5.open, mod6.open, mod7.open, mod8.open, mod9.open, mod10.open)
names(mod.open) <- c("Studies", "*b*", "*SE*", "*z*", "*p*", "R^2^~Level1~","R^2^~Level2~")
row.names(mod.open) <- c("Publication year",
"Reliability", "Other report", "Facet",
"Maladaptive", "Big Five", "Inverse coded",
"Representative", "Percentage female",
"Asia", "Global South",
"Nothern Europe", "Southern Europe")
kable(mod.open
, caption="**Moderator analyses for openness (separate models)**"
, escape=FALSE
, label = NA) %>%
pack_rows("Region", 10, 13) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| Studies | b | SE | z | p | R2Level1 | R2Level2 | |
|---|---|---|---|---|---|---|---|
| Publication year | 73 | 0.000 | 0.006 | 0.062 | 0.951 | 0.00 | 0.00 |
| Reliability | 57 | 0.159 | 0.135 | 1.178 | 0.353 | 0.00 | 0.01 |
| Other report | 73 | -0.052 | 0.050 | -1.049 | 0.359 | 0.00 | 0.01 |
| Facet | 73 | 0.400 | 0.054 | 7.479 | 0.010 | 0.43 | 0.00 |
| Maladaptive | 72 | 0.045 | 0.184 | 0.246 | 0.812 | 0.00 | 0.00 |
| Big Five | 73 | -0.177 | 0.094 | -1.896 | 0.074 | 0.02 | 0.00 |
| Inverse coded | 73 | -0.190 | 0.063 | -3.000 | 0.038 | 0.05 | 0.00 |
| Representative | 73 | -0.123 | 0.134 | -0.918 | 0.374 | 0.00 | 0.00 |
| Percentage female | 72 | 0.000 | 0.001 | -0.738 | 0.510 | 0.00 | 0.00 |
| Region | |||||||
| Asia | 73 | -0.167 | 0.196 | -0.852 | 0.440 | 0.00 | 0.04 |
| Global South | 73 | 0.385 | 0.126 | 3.043 | 0.068 | 0.00 | 0.04 |
| Nothern Europe | 73 | -0.010 | 0.105 | -0.093 | 0.926 | 0.00 | 0.04 |
| Southern Europe | 73 | 0.203 | 0.149 | 1.367 | 0.196 | 0.00 | 0.04 |
Note. These Pseudo-R2 values should be interpreted with caution as the included studies slightly differed across moderators (e.g., due to missing values) making a comparison more difficult.
You can hover over the points in this graph to receive more information.
## Run alternative model for Region
data_open$Region.d <- as.factor(ifelse(data_open$Region == "North America", 0, 1))
meta.mod10b <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 +
T2_lag.c + Region.d,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_open, sparse = TRUE)
## Prepare loop
plot_data <- data.frame(Moderator = factor(c("Publication year", "Publication year",
"Reliability", "Reliability",
"Other report", "Other report",
"Facet", "Facet",
"Maladaptive", "Maladaptive",
"Big Five", "Big Five",
"Inverse coded", "Inverse coded",
"Representative", "Representative",
"Percentage female", "Percentage female",
"Region", "Region"),
levels = c("Region", "Percentage female",
"Representative", "Inverse coded",
"Big Five", "Maladaptive",
"Facet", "Other report",
"Reliability", "Publication year"),
ordered = TRUE),
Score = c(0, 5,
0, 0.10,
0, 1,
0, 1,
0, 1,
0, 1,
0, 1,
0, 1,
0, 10,
0, 1),
SD = NA,
CI.lower = NA,
CI.upper = NA,
Sig = factor(c(0, 0,
0, 0,
0, 0,
1, 1,
0, 0,
0, 0,
1, 1,
0, 0,
0, 0,
0, 0)),
label = c("2015", "2020",
"0.78", "0.88",
"Self", "Other",
"No", "Yes",
"No", "Yes",
"No", "Yes",
"No", "Yes",
"No", "Yes",
"53%", "63%",
"North America", "Other"))
plot_data$ID <- 1:nrow(plot_data)
meta.models <- list(meta.mod1, meta.mod1, meta.mod2, meta.mod2,
meta.mod3, meta.mod3, meta.mod4, meta.mod4,
meta.mod5, meta.mod5, meta.mod6, meta.mod6,
meta.mod7, meta.mod7, meta.mod8, meta.mod8,
meta.mod9, meta.mod9, meta.mod10b, meta.mod10b)
## Loop to create plot data
for (i in 1:nrow(plot_data)) {
plot_data$SD[i] <- predict(meta.models[[i]],
newmods=c(20, 0, 0, plot_data$Score[i]),
transf=exp, addx=TRUE)$pred
plot_data$CI.lower[i] <- predict(meta.models[[i]],
newmods=c(20, 0, 0, plot_data$Score[i]),
transf=exp, addx=TRUE)$ci.lb
plot_data$CI.upper[i] <- predict(meta.models[[i]],
newmods=c(20, 0, 0, plot_data$Score[i]),
transf=exp, addx=TRUE)$ci.ub
}
## Plot
plot <- ggplot(data = plot_data, aes(x = SD, y = Moderator, group = Score)) +
geom_errorbar(aes(xmin=CI.lower, xmax=CI.upper, group = Score, colour = Sig),
position=position_dodge(0.75), width = 0) +
geom_point_interactive(aes(group = Score, colour = Sig,
tooltip =
paste0("SD = ", round(SD,3),
", 95% CI = [", round(CI.lower,3),
", ", round(CI.upper,3), "]"),
data_id = ID),
size = 1.8, position=position_dodge(0.75)) +
geom_text(aes(label = label, x = CI.upper + 0.001, y = Moderator, group = Score),
position=position_dodge(0.75),
hjust = 0, size = 4.5) +
theme_pub() +
scale_x_continuous(limits = c(0,0.3)) +
scale_colour_manual(values = c("0" = "grey", "1" = "black")) +
theme(legend.position = "none",
axis.text.y = element_text(hjust = 1)) +
labs(y = "Moderators", x = expression(bold("SD"[POMP])), title = "Openness")
girafe(ggobj = plot)
Note. To allow a better graphical depiction, we dummy-coded the moderator “Region” for the illustration in this graph (0 = “North America”, 1 = “Other”). However, in the main analyses, a polytomous categorical predictor was used. Significant moderation effects are depicted in black, non-significant moderations are in grey. The point estimates are calculated for 20 year old participants that are assessed over a time interval of one year.
For the analyses across traits, we used a model with Age 1-30 and Age 30> as age-related variables because this model was among the best-fitting models for most traits.
## Create age bins
data_all$abin_1 <- ifelse(data_all$T1_AgeM <= 30, data_all$T1_AgeM, 30)
data_all$abin_2 <- ifelse(data_all$T1_AgeM > 30, data_all$T1_AgeM - 30, 0)
## All
meta.modcom <- rma.mv(yi = ES, V = V, mods = ~ abin_1 + abin_2 +
T2_lag.c + Year.c + Alpha_T1.c +
OtherReport + Facet + Maladaptive + BigFive +
Represent + Female.c + Region,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_all, sparse = TRUE)
results.modcom <- robust(meta.modcom, cluster = StudyID, clubSandwich = TRUE)
sigma_modcom.level1_all <- meta.modcom$sigma2[1]
sigma_modcom.level2_all <- meta.modcom$sigma2[2]
r2.level1.modcom <- round((sigma_spline1.level1_all - sigma_modcom.level1_all)/sigma_spline1.level1_all,2)
r2.level1.modcom <- ifelse(r2.level1.modcom < 0, 0, r2.level1.modcom)
r2.level2.modcom <- round((sigma_spline1.level2_all - sigma_modcom.level2_all)/sigma_spline1.level2_all,2)
r2.level2.modcom <- ifelse(r2.level2.modcom < 0, 0, r2.level2.modcom)
modcom.all <- as.data.frame(round(
cbind(results.modcom$n, results.modcom$b[5:16], results.modcom$se[5:16], results.modcom$zval[5:16],
results.modcom$pval[5:16], r2.level1 = r2.level1.modcom, r2.level2 = r2.level2.modcom),3))
## Create table
names(modcom.all) <- c("Studies", "*b*", "*SE*", "*z*", "*p*", "R^2^~Level1~","R^2^~Level2~")
row.names(modcom.all) <- c("Publication year",
"Reliability", "Other report", "Facet",
"Maladaptive", "Big Five",
"Representative", "Percentage female",
"Asia", "Global South",
"Nothern Europe", "Southern Europe")
kable(modcom.all
, caption="**Moderator analyses across traits (combined model)**"
, escape=FALSE
, label = NA) %>%
pack_rows("Region", 9, 12) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| Studies | b | SE | z | p | R2Level1 | R2Level2 | |
|---|---|---|---|---|---|---|---|
| Publication year | 171 | 0.006 | 0.004 | 1.418 | 0.165 | 0.02 | 0.09 |
| Reliability | 171 | 0.158 | 0.195 | 0.812 | 0.431 | 0.02 | 0.09 |
| Other report | 171 | -0.028 | 0.048 | -0.587 | 0.579 | 0.02 | 0.09 |
| Facet | 171 | 0.115 | 0.102 | 1.129 | 0.288 | 0.02 | 0.09 |
| Maladaptive | 171 | -0.018 | 0.082 | -0.216 | 0.831 | 0.02 | 0.09 |
| Big Five | 171 | -0.070 | 0.095 | -0.740 | 0.466 | 0.02 | 0.09 |
| Representative | 171 | -0.142 | 0.070 | -2.033 | 0.051 | 0.02 | 0.09 |
| Percentage female | 171 | 0.000 | 0.000 | -0.979 | 0.347 | 0.02 | 0.09 |
| Region | |||||||
| Asia | 171 | -0.061 | 0.074 | -0.823 | 0.416 | 0.02 | 0.09 |
| Global South | 171 | 0.181 | 0.080 | 2.270 | 0.059 | 0.02 | 0.09 |
| Nothern Europe | 171 | 0.019 | 0.055 | 0.341 | 0.734 | 0.02 | 0.09 |
| Southern Europe | 171 | 0.016 | 0.090 | 0.173 | 0.864 | 0.02 | 0.09 |
Note. These Pseudo-R2 values should be interpreted with caution as some studies that were include in the baseline model were not included in the moderator model due to missing values in some moderators.
## Create age bins
data_agree$abin_1 <- ifelse(data_agree$T1_AgeM <= 30, data_agree$T1_AgeM, 30)
data_agree$abin_2 <- ifelse(data_agree$T1_AgeM > 30, data_agree$T1_AgeM - 30, 0)
## All
meta.modcom <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 +
T2_lag.c + Year.c + Alpha_T1.c +
OtherReport + Facet + Maladaptive + BigFive + Inverse +
Represent + Female.c + Region,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_agree, sparse = TRUE)
results.modcom <- robust(meta.modcom, cluster = StudyID, clubSandwich = TRUE)
sigma_modcom.level1_agree <- meta.modcom$sigma2[1]
sigma_modcom.level2_agree <- meta.modcom$sigma2[2]
r2.level1.modcom <- round((sigma_spline1.level1_agree - sigma_modcom.level1_agree)/sigma_spline1.level1_agree,2)
r2.level1.modcom <- ifelse(r2.level1.modcom < 0, 0, r2.level1.modcom)
r2.level2.modcom <- round((sigma_spline1.level2_agree - sigma_modcom.level2_agree)/sigma_spline1.level2_agree,2)
r2.level2.modcom <- ifelse(r2.level2.modcom < 0, 0, r2.level2.modcom)
modcom.agree <- as.data.frame(round(
cbind(results.modcom$n, results.modcom$b[5:17], results.modcom$se[5:17], results.modcom$zval[5:17],
results.modcom$pval[5:17], r2.level1 = r2.level1.modcom, r2.level2 = r2.level2.modcom),3))
## Create table
names(modcom.agree) <- c("Studies", "*b*", "*SE*", "*z*", "*p*", "R^2^~Level1~","R^2^~Level2~")
row.names(modcom.agree) <- c("Publication year",
"Reliability", "Other report", "Facet",
"Maladaptive", "Big Five", "Inverse coded",
"Representative", "Percentage female",
"Asia", "Global South",
"Nothern Europe", "Southern Europe")
kable(modcom.agree
, caption="**Moderator analyses for agreeableness (combined model)**"
, escape=FALSE
, label = NA) %>%
pack_rows("Region", 10, 13) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| Studies | b | SE | z | p | R2Level1 | R2Level2 | |
|---|---|---|---|---|---|---|---|
| Publication year | 106 | 0.005 | 0.004 | 1.051 | 0.304 | 0.36 | 0.11 |
| Reliability | 106 | -0.349 | 0.281 | -1.239 | 0.235 | 0.36 | 0.11 |
| Other report | 106 | 0.087 | 0.066 | 1.312 | 0.230 | 0.36 | 0.11 |
| Facet | 106 | 0.021 | 0.085 | 0.245 | 0.812 | 0.36 | 0.11 |
| Maladaptive | 106 | 0.077 | 0.087 | 0.881 | 0.396 | 0.36 | 0.11 |
| Big Five | 106 | -0.210 | 0.101 | -2.088 | 0.049 | 0.36 | 0.11 |
| Inverse coded | 106 | -0.062 | 0.081 | -0.770 | 0.464 | 0.36 | 0.11 |
| Representative | 106 | -0.032 | 0.107 | -0.302 | 0.765 | 0.36 | 0.11 |
| Percentage female | 106 | -0.001 | 0.000 | -2.317 | 0.046 | 0.36 | 0.11 |
| Region | |||||||
| Asia | 106 | 0.038 | 0.090 | 0.419 | 0.681 | 0.36 | 0.11 |
| Global South | 106 | 0.639 | 0.431 | 1.484 | 0.248 | 0.36 | 0.11 |
| Nothern Europe | 106 | 0.007 | 0.074 | 0.098 | 0.922 | 0.36 | 0.11 |
| Southern Europe | 106 | -0.057 | 0.119 | -0.479 | 0.636 | 0.36 | 0.11 |
Note. These Pseudo-R2 values should be interpreted with caution as some studies that were include in the baseline model were not included in the moderator model due to missing values in some moderators.
## Create age bins
data_consc$abin_1 <- ifelse(data_consc$T1_AgeM <= 40, data_consc$T1_AgeM, 40)
data_consc$abin_2 <- ifelse(data_consc$T1_AgeM > 40, data_consc$T1_AgeM - 40, 0)
## All
meta.modcom <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 +
T2_lag.c + Year.c + Alpha_T1.c +
OtherReport + Facet + Maladaptive + BigFive + Inverse +
Represent + Female.c + Region,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_consc, sparse = TRUE)
results.modcom <- robust(meta.modcom, cluster = StudyID, clubSandwich = TRUE)
sigma_modcom.level1_consc <- meta.modcom$sigma2[1]
sigma_modcom.level2_consc <- meta.modcom$sigma2[2]
r2.level1.modcom <- round((sigma_spline1.level1_consc - sigma_modcom.level1_consc)/sigma_spline1.level1_consc,2)
r2.level1.modcom <- ifelse(r2.level1.modcom < 0, 0, r2.level1.modcom)
r2.level2.modcom <- round((sigma_spline1.level2_consc - sigma_modcom.level2_consc)/sigma_spline1.level2_consc,2)
r2.level2.modcom <- ifelse(r2.level2.modcom < 0, 0, r2.level2.modcom)
modcom.consc <- as.data.frame(round(
cbind(results.modcom$n, results.modcom$b[5:17], results.modcom$se[5:17], results.modcom$zval[5:17],
results.modcom$pval[5:17], r2.level1 = r2.level1.modcom, r2.level2 = r2.level2.modcom),3))
## Create table
names(modcom.consc) <- c("Studies", "*b*", "*SE*", "*z*", "*p*", "R^2^~Level1~","R^2^~Level2~")
row.names(modcom.consc) <- c("Publication year",
"Reliability", "Other report", "Facet",
"Maladaptive", "Big Five", "Inverse coded",
"Representative", "Percentage female",
"Asia", "Global South",
"Nothern Europe", "Southern Europe")
kable(modcom.consc
, caption="**Moderator analyses for conscientiousness (combined model)**"
, escape=FALSE
, label = NA) %>%
pack_rows("Region", 10, 13) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| Studies | b | SE | z | p | R2Level1 | R2Level2 | |
|---|---|---|---|---|---|---|---|
| Publication year | 94 | 0.010 | 0.005 | 2.095 | 0.047 | 0.17 | 0.17 |
| Reliability | 94 | -0.502 | 0.231 | -2.170 | 0.044 | 0.17 | 0.17 |
| Other report | 94 | -0.051 | 0.096 | -0.531 | 0.607 | 0.17 | 0.17 |
| Facet | 94 | 0.136 | 0.067 | 2.013 | 0.086 | 0.17 | 0.17 |
| Maladaptive | 94 | 0.101 | 0.124 | 0.816 | 0.421 | 0.17 | 0.17 |
| Big Five | 94 | -0.141 | 0.093 | -1.519 | 0.144 | 0.17 | 0.17 |
| Inverse coded | 94 | -0.191 | 0.073 | -2.610 | 0.037 | 0.17 | 0.17 |
| Representative | 94 | -0.197 | 0.114 | -1.732 | 0.098 | 0.17 | 0.17 |
| Percentage female | 94 | 0.000 | 0.000 | -0.108 | 0.917 | 0.17 | 0.17 |
| Region | |||||||
| Asia | 94 | -0.140 | 0.105 | -1.331 | 0.201 | 0.17 | 0.17 |
| Global South | 94 | 0.189 | 0.133 | 1.423 | 0.203 | 0.17 | 0.17 |
| Nothern Europe | 94 | 0.120 | 0.083 | 1.453 | 0.153 | 0.17 | 0.17 |
| Southern Europe | 94 | -0.113 | 0.106 | -1.068 | 0.297 | 0.17 | 0.17 |
Note. These Pseudo-R2 values should be interpreted with caution as some studies that were include in the baseline model were not included in the moderator model due to missing values in some moderators.
## Create age bins
data_extra$abin_1 <- ifelse(data_extra$T1_AgeM <= 55, data_extra$T1_AgeM, 55)
data_extra$abin_2 <- ifelse(data_extra$T1_AgeM > 55, data_extra$T1_AgeM - 55, 0)
## All
meta.modcom <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 +
T2_lag.c + Year.c + Alpha_T1.c +
OtherReport + Facet + Maladaptive + BigFive + Inverse +
Represent + Female.c + Region,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_extra, sparse = TRUE)
results.modcom <- robust(meta.modcom, cluster = StudyID, clubSandwich = TRUE)
sigma_modcom.level1_extra <- meta.modcom$sigma2[1]
sigma_modcom.level2_extra <- meta.modcom$sigma2[2]
r2.level1.modcom <- round((sigma_spline1.level1_extra - sigma_modcom.level1_extra)/sigma_spline1.level1_extra,2)
r2.level1.modcom <- ifelse(r2.level1.modcom < 0, 0, r2.level1.modcom)
r2.level2.modcom <- round((sigma_spline1.level2_extra - sigma_modcom.level2_extra)/sigma_spline1.level2_extra,2)
r2.level2.modcom <- ifelse(r2.level2.modcom < 0, 0, r2.level2.modcom)
modcom.extra <- as.data.frame(round(
cbind(results.modcom$n, results.modcom$b[5:17], results.modcom$se[5:17], results.modcom$zval[5:17],
results.modcom$pval[5:17], r2.level1 = r2.level1.modcom, r2.level2 = r2.level2.modcom),3))
## Create table
names(modcom.extra) <- c("Studies", "*b*", "*SE*", "*z*", "*p*", "R^2^~Level1~","R^2^~Level2~")
row.names(modcom.extra) <- c("Publication year",
"Reliability", "Other report", "Facet",
"Maladaptive", "Big Five", "Inverse coded",
"Representative", "Percentage female",
"Asia", "Global South",
"Nothern Europe", "Southern Europe")
kable(modcom.extra
, caption="**Moderator analyses for extraversion (combined model)**"
, escape=FALSE
, label = NA) %>%
pack_rows("Region", 10, 13) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| Studies | b | SE | z | p | R2Level1 | R2Level2 | |
|---|---|---|---|---|---|---|---|
| Publication year | 87 | 0.008 | 0.006 | 1.296 | 0.207 | 0.32 | 0.06 |
| Reliability | 87 | 0.091 | 0.234 | 0.390 | 0.706 | 0.32 | 0.06 |
| Other report | 87 | 0.001 | 0.038 | 0.019 | 0.985 | 0.32 | 0.06 |
| Facet | 87 | 0.209 | 0.080 | 2.605 | 0.049 | 0.32 | 0.06 |
| Maladaptive | 87 | 0.077 | 0.118 | 0.650 | 0.529 | 0.32 | 0.06 |
| Big Five | 87 | -0.059 | 0.076 | -0.773 | 0.455 | 0.32 | 0.06 |
| Inverse coded | 87 | -0.094 | 0.084 | -1.113 | 0.302 | 0.32 | 0.06 |
| Representative | 87 | -0.155 | 0.081 | -1.918 | 0.067 | 0.32 | 0.06 |
| Percentage female | 87 | 0.000 | 0.000 | 0.288 | 0.785 | 0.32 | 0.06 |
| Region | |||||||
| Asia | 87 | -0.184 | 0.141 | -1.313 | 0.208 | 0.32 | 0.06 |
| Global South | 87 | 0.059 | 0.099 | 0.601 | 0.566 | 0.32 | 0.06 |
| Nothern Europe | 87 | 0.059 | 0.079 | 0.749 | 0.458 | 0.32 | 0.06 |
| Southern Europe | 87 | 0.100 | 0.148 | 0.678 | 0.512 | 0.32 | 0.06 |
Note. These Pseudo-R2 values should be interpreted with caution as some studies that were include in the baseline model were not included in the moderator model due to missing values in some moderators.
## Create age bins
data_neuro$abin_1 <- ifelse(data_neuro$T1_AgeM <= 25, data_neuro$T1_AgeM, 25)
data_neuro$abin_2 <- ifelse(data_neuro$T1_AgeM <= 75 & data_neuro$T1_AgeM > 25,
data_neuro$T1_AgeM - 25,
ifelse(data_neuro$T1_AgeM <= 25, 0, 75 - 25))
data_neuro$abin_3 <- ifelse(data_neuro$T1_AgeM > 75, data_neuro$T1_AgeM - 75, 0)
## All
meta.modcom <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 +
T2_lag.c + Year.c + Alpha_T1.c +
OtherReport + Facet + Maladaptive + BigFive + Inverse +
Represent + Female.c + Region,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_neuro, sparse = TRUE)
results.modcom <- robust(meta.modcom, cluster = StudyID, clubSandwich = TRUE)
sigma_modcom.level1_neuro <- meta.modcom$sigma2[1]
sigma_modcom.level2_neuro <- meta.modcom$sigma2[2]
r2.level1.modcom <- round((sigma_spline1.level1_neuro - sigma_modcom.level1_neuro)/sigma_spline1.level1_neuro,2)
r2.level1.modcom <- ifelse(r2.level1.modcom < 0, 0, r2.level1.modcom)
r2.level2.modcom <- round((sigma_spline1.level2_neuro - sigma_modcom.level2_neuro)/sigma_spline1.level2_neuro,2)
r2.level2.modcom <- ifelse(r2.level2.modcom < 0, 0, r2.level2.modcom)
modcom.neuro <- as.data.frame(round(
cbind(results.modcom$n, results.modcom$b[6:18], results.modcom$se[6:18], results.modcom$zval[6:18],
results.modcom$pval[6:18], r2.level1 = r2.level1.modcom, r2.level2 = r2.level2.modcom),3))
## Create table
names(modcom.neuro) <- c("Studies", "*b*", "*SE*", "*z*", "*p*", "R^2^~Level1~","R^2^~Level2~")
row.names(modcom.neuro) <- c("Publication year",
"Reliability", "Other report", "Facet",
"Maladaptive", "Big Five", "Inverse coded",
"Representative", "Percentage female",
"Asia", "Global South",
"Nothern Europe", "Southern Europe")
kable(modcom.neuro
, caption="**Moderator analyses for neuroticisim (combined model)**"
, escape=FALSE
, label = NA) %>%
pack_rows("Region", 10, 13) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| Studies | b | SE | z | p | R2Level1 | R2Level2 | |
|---|---|---|---|---|---|---|---|
| Publication year | 140 | 0.006 | 0.004 | 1.527 | 0.137 | 0.15 | 0.09 |
| Reliability | 140 | -0.453 | 0.182 | -2.489 | 0.027 | 0.15 | 0.09 |
| Other report | 140 | -0.007 | 0.048 | -0.157 | 0.878 | 0.15 | 0.09 |
| Facet | 140 | 0.042 | 0.078 | 0.538 | 0.600 | 0.15 | 0.09 |
| Maladaptive | 140 | -0.063 | 0.070 | -0.900 | 0.388 | 0.15 | 0.09 |
| Big Five | 140 | -0.049 | 0.105 | -0.460 | 0.649 | 0.15 | 0.09 |
| Inverse coded | 140 | -0.012 | 0.045 | -0.277 | 0.784 | 0.15 | 0.09 |
| Representative | 140 | -0.129 | 0.069 | -1.864 | 0.072 | 0.15 | 0.09 |
| Percentage female | 140 | 0.000 | 0.000 | 0.104 | 0.919 | 0.15 | 0.09 |
| Region | |||||||
| Asia | 140 | -0.088 | 0.078 | -1.130 | 0.265 | 0.15 | 0.09 |
| Global South | 140 | 0.190 | 0.095 | 1.997 | 0.084 | 0.15 | 0.09 |
| Nothern Europe | 140 | -0.005 | 0.065 | -0.084 | 0.934 | 0.15 | 0.09 |
| Southern Europe | 140 | 0.035 | 0.099 | 0.350 | 0.728 | 0.15 | 0.09 |
Note. These Pseudo-R2 values should be interpreted with caution as some studies that were include in the baseline model were not included in the moderator model due to missing values in some moderators.
## Create age bins
data_open$abin_1 <- ifelse(data_open$T1_AgeM <= 30, data_open$T1_AgeM, 30)
data_open$abin_2 <- ifelse(data_open$T1_AgeM > 30, data_open$T1_AgeM - 30, 0)
## All
meta.modcom <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 +
T2_lag.c + Year.c + Alpha_T1.c +
OtherReport + Facet + Maladaptive + BigFive + Inverse +
Represent + Female.c + Region,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_open, sparse = TRUE)
results.modcom <- robust(meta.modcom, cluster = StudyID, clubSandwich = TRUE)
sigma_modcom.level1_open <- meta.modcom$sigma2[1]
sigma_modcom.level2_open <- meta.modcom$sigma2[2]
r2.level1.modcom <- round((sigma_spline1.level1_open - sigma_modcom.level1_open)/sigma_spline1.level1_open,2)
r2.level1.modcom <- ifelse(r2.level1.modcom < 0, 0, r2.level1.modcom)
r2.level2.modcom <- round((sigma_spline1.level2_open - sigma_modcom.level2_open)/sigma_spline1.level2_open,2)
r2.level2.modcom <- ifelse(r2.level2.modcom < 0, 0, r2.level2.modcom)
modcom.open <- as.data.frame(round(
cbind(results.modcom$n, results.modcom$b[5:17], results.modcom$se[5:17], results.modcom$zval[5:17],
results.modcom$pval[5:17], r2.level1 = r2.level1.modcom, r2.level2 = r2.level2.modcom),3))
## Create table
names(modcom.open) <- c("Studies", "*b*", "*SE*", "*z*", "*p*", "R^2^~Level1~","R^2^~Level2~")
row.names(modcom.open) <- c("Publication year",
"Reliability", "Other report", "Facet",
"Maladaptive", "Big Five", "Inverse coded",
"Representative", "Percentage female",
"Asia", "Global South",
"Nothern Europe", "Southern Europe")
kable(modcom.open
, caption="**Moderator analyses for openness (combined model)**"
, escape=FALSE
, label = NA) %>%
pack_rows("Region", 10, 13) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| Studies | b | SE | z | p | R2Level1 | R2Level2 | |
|---|---|---|---|---|---|---|---|
| Publication year | 55 | 0.007 | 0.008 | 0.829 | 0.418 | 0.67 | 0 |
| Reliability | 55 | 0.613 | 0.175 | 3.499 | 0.083 | 0.67 | 0 |
| Other report | 55 | -0.088 | 0.056 | -1.561 | 0.253 | 0.67 | 0 |
| Facet | 55 | 0.546 | 0.043 | 12.653 | 0.028 | 0.67 | 0 |
| Maladaptive | 55 | 0.172 | 0.248 | 0.693 | 0.507 | 0.67 | 0 |
| Big Five | 55 | 0.261 | 0.081 | 3.231 | 0.045 | 0.67 | 0 |
| Inverse coded | 55 | -0.234 | 0.052 | -4.485 | 0.053 | 0.67 | 0 |
| Representative | 55 | 0.014 | 0.194 | 0.072 | 0.944 | 0.67 | 0 |
| Percentage female | 55 | 0.000 | 0.001 | -0.399 | 0.716 | 0.67 | 0 |
| Region | |||||||
| Asia | 55 | 0.184 | 0.266 | 0.693 | 0.515 | 0.67 | 0 |
| Global South | 55 | 0.535 | 0.213 | 2.507 | 0.084 | 0.67 | 0 |
| Nothern Europe | 55 | 0.181 | 0.143 | 1.268 | 0.218 | 0.67 | 0 |
| Southern Europe | 55 | 0.487 | 0.195 | 2.500 | 0.024 | 0.67 | 0 |
Note. These Pseudo-R2 values should be interpreted with caution as some studies that were include in the baseline model were not included in the moderator model due to missing values in some moderators.
## Agreeableness
meta.base <- rma.mv(yi = ES, V = V_agree,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_agree, sparse = TRUE)
funnel_agree <- funnel(meta.base, refline=meta.base$b[1],
level=c(90, 95, 99), shade=c("white", "red", "orange"),
main="Agreeableness",
xlab = "Residual Value", ylab = "Standard error")
## Conscientiousness
meta.base <- rma.mv(yi = ES, V = V_consc,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_consc, sparse = TRUE)
funnel_consc <- funnel(meta.base, refline=meta.base$b[1],
level=c(90, 95, 99), shade=c("white", "red", "orange"),
main="Conscientiousness",
xlab = "Residual Value", ylab = "Standard error")
## Extraversion
meta.base <- rma.mv(yi = ES, V = V_extra,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_extra, sparse = TRUE)
funnel_extra <- funnel(meta.base, refline=meta.base$b[1],
level=c(90, 95, 99), shade=c("white", "red", "orange"),
main="Extraversion",
xlab = "Residual Value", ylab = "Standard error")
## Neuroticism
meta.base <- rma.mv(yi = ES, V = V_neuro,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_neuro, sparse = TRUE)
funnel_neuro <- funnel(meta.base, refline=meta.base$b[1],
level=c(90, 95, 99), shade=c("white", "red", "orange"),
main="Neuroticism",
xlab = "Residual Value", ylab = "Standard error")
## Openness
meta.base <- rma.mv(yi = ES, V = V_open,
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_open, sparse = TRUE)
funnel_open <- funnel(meta.base, refline=meta.base$b[1],
level=c(90, 95, 99), shade=c("white", "red", "orange"),
main="Openness",
xlab = "Residual Value", ylab = "Standard error")
## Agreeableness
meta.agree.peese <- rma.mv(yi = ES, V = V_agree, mods = ~ sqrt(SamVar),
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_agree, sparse = TRUE)
results.agree.peese <- robust(meta.agree.peese, cluster = StudyID, clubSandwich = TRUE)
peese.agree <- as.data.frame(round(cbind(results.agree.peese$b[2], results.agree.peese$se[2], results.agree.peese$zval[2],
results.agree.peese$pval[2]),3))
## Conscientiousness
meta.consc.peese <- rma.mv(yi = ES, V = V_consc, mods = ~ sqrt(SamVar),
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_consc, sparse = TRUE)
results.consc.peese <- robust(meta.consc.peese, cluster = StudyID, clubSandwich = TRUE)
peese.consc <- as.data.frame(round(cbind(results.consc.peese$b[2], results.consc.peese$se[2], results.consc.peese$zval[2],
results.consc.peese$pval[2]),3))
## Extraversion
meta.extra.peese <- rma.mv(yi = ES, V = V_extra, mods = ~ sqrt(SamVar),
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_extra, sparse = TRUE)
results.extra.peese <- robust(meta.extra.peese, cluster = StudyID, clubSandwich = TRUE)
peese.extra <- as.data.frame(round(cbind(results.extra.peese$b[2], results.extra.peese$se[2], results.extra.peese$zval[2],
results.extra.peese$pval[2]),3))
## Neuroticism
meta.neuro.peese <- rma.mv(yi = ES, V = V_neuro, mods = ~ sqrt(SamVar),
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_neuro, sparse = TRUE)
results.neuro.peese <- robust(meta.neuro.peese, cluster = StudyID, clubSandwich = TRUE)
peese.neuro <- as.data.frame(round(cbind(results.neuro.peese$b[2], results.neuro.peese$se[2], results.neuro.peese$zval[2],
results.neuro.peese$pval[2]),3))
## Openness
meta.open.peese <- rma.mv(yi = ES, V = V_open, mods = ~ sqrt(SamVar),
random = list(~ 1 | EffsizeID, ~ 1 | StudyID),
data = data_open, sparse = TRUE)
results.open.peese <- robust(meta.open.peese, cluster = StudyID, clubSandwich = TRUE)
peese.open <- as.data.frame(round(cbind(results.open.peese$b[2], results.open.peese$se[2], results.open.peese$zval[2],
results.open.peese$pval[2]),3))
## Combine to table
peese.results <- as.data.frame(rbind(peese.agree, peese.consc, peese.extra, peese.neuro, peese.open))
names(peese.results) <- c("*b*", "*SE*", "*z*", "*p*")
row.names(peese.results) <- c("Agreeableness", "Conscientiousness", "Extraversion", "Neuroticism", "Openness")
kable(peese.results
, caption="**Regression test of publication bias**"
, escape=FALSE
, label = NA) %>%
kable_styling(bootstrap_options = c("striped", "hover", "condensed"),
fixed_thead = T, full_width = TRUE, position="left")
| b | SE | z | p | |
|---|---|---|---|---|
| Agreeableness | 0.461 | 1.394 | 0.331 | 0.745 |
| Conscientiousness | -0.505 | 1.593 | -0.317 | 0.756 |
| Extraversion | 0.130 | 1.343 | 0.097 | 0.924 |
| Neuroticism | 0.343 | 1.263 | 0.271 | 0.788 |
| Openness | -0.164 | 1.361 | -0.120 | 0.908 |