ReadMe

This document includes an overview of all analyses conducted for the manuscript “Individual Differences in Personality Trait Changes Across the Lifespan: A Meta-Analysis of Longitudinal Studies”. The structure and content of this supplementary document is based on a similar meta-analysis:

[BLINDED FOR PEER-REVIEW]

Tabs
To make the document easier to read, we use tabs. You can use the tabs to choose between different information (e.g., tables or figures or different traits). Note: Sometimes there are several levels of tabs. For example, on the first level you decide which trait you are interested in and on the second level you decide whether you want to see tables or graphics.

Analysis Code
The document includes all R code used to create the graphs and tables or to perform the analyses. However, the code is hidden by default to enhance readability. If you want to see the code, simply click on the respective CODE button on the right hand side just above the figure or table—you will then see the associated codechunk. If you want to show all codechunks by default, click CODE > Show all Code at the very top of the document.

Preregistration

The meta-analysis has been preregistered at https://osf.io/kzjfw/?view_only=d22f0976a7754e3dbb3d15b9242d29e1. Deviations from this preregistration are summarized in the following table.

deviations <- data.frame(
  `Preregistered Plan` = c("We had preregistered to account for the dependency of effect sizes based on similar traits within a sample or multiple assessments to compute the variance-covariance matrix", "We had preregistered to compute all analyses in a trait-specific fashion"), 
  "Deviation" = c("We additionally accounted for dependency due to different types of reports (e.g., self-report vs. other report) within a sample. Based on the meta-analysis by Connolly et al. (2007), we assumed a correlation of r = .55 for this type of dependency", "We additionally included two exploratory analyses to examine (1) whether individual differences significantly differed across traits and (2) how the methdological moderators are related to individual differences in personality changes in a model across traits"), 
  "Reason" = c("After creating the meta-analytic dataset, we realized that this type of dependency of effect sizes was also present in the dataset", "These exploratory analysis allowed us to address further interesting research questions")
)

names(deviations) <- c("Preregistered Plan", "Deviation", "Reason")

kable(deviations
      , caption="**Deviations from the Preregistration**"
      , escape=FALSE
      , label = NA) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Deviations from the Preregistration
Preregistered Plan Deviation Reason
We had preregistered to account for the dependency of effect sizes based on similar traits within a sample or multiple assessments to compute the variance-covariance matrix We additionally accounted for dependency due to different types of reports (e.g., self-report vs. other report) within a sample. Based on the meta-analysis by Connolly et al. (2007), we assumed a correlation of r = .55 for this type of dependency After creating the meta-analytic dataset, we realized that this type of dependency of effect sizes was also present in the dataset
We had preregistered to compute all analyses in a trait-specific fashion We additionally included two exploratory analyses to examine (1) whether individual differences significantly differed across traits and (2) how the methdological moderators are related to individual differences in personality changes in a model across traits These exploratory analysis allowed us to address further interesting research questions

Section 1: Study Characteristics of Included Studies

Section 2: Descriptive Statistics

Number of Studies and Effect Sizes

numbers <- data.frame(
  Construct = c("Total", "Agreeableness", "Conscientiousness", "Extraversion", "Neuroticism", 
                "Openness"),
  `Number of studies` = c(length(unique(data_all$StudyID)), length(unique(data_agree$StudyID)), 
              length(unique(data_consc$StudyID)), length(unique(data_extra$StudyID)),
              length(unique(data_neuro$StudyID)), length(unique(data_open$StudyID))),
  `Roberts` = c(length(unique(filter(data_all, Source == 2)$StudyID)), 
                length(unique(filter(data_agree, Source == 2)$StudyID)), 
                length(unique(filter(data_consc, Source == 2)$StudyID)),
                length(unique(filter(data_extra, Source == 2)$StudyID)),
                length(unique(filter(data_neuro, Source == 2)$StudyID)),
                length(unique(filter(data_open, Source == 2)$StudyID))), 
  `Bleidorn` = c(length(unique(filter(data_all, Source == 1)$StudyID)), 
                length(unique(filter(data_agree, Source == 1)$StudyID)), 
                length(unique(filter(data_consc, Source == 1)$StudyID)),
                length(unique(filter(data_extra, Source == 1)$StudyID)),
                length(unique(filter(data_neuro, Source == 1)$StudyID)),
                length(unique(filter(data_open, Source == 1)$StudyID))), 
  `Haehner` = c(length(unique(filter(data_all, Source == 0)$StudyID)), 
                length(unique(filter(data_agree, Source == 0)$StudyID)), 
                length(unique(filter(data_consc, Source == 0)$StudyID)),
                length(unique(filter(data_extra, Source == 0)$StudyID)),
                length(unique(filter(data_neuro, Source == 0)$StudyID)),
                length(unique(filter(data_open, Source == 0)$StudyID))), 
  Total = c(nrow(data_all), nrow(data_agree), nrow(data_consc), nrow(data_extra), 
            nrow(data_neuro), nrow(data_open)), 
  Roberts = c(nrow(filter(data_all, Source == 2)), nrow(filter(data_agree, Source == 2)), 
              nrow(filter(data_consc, Source == 2)), nrow(filter(data_extra, Source == 2)),
              nrow(filter(data_neuro, Source == 2)), nrow(filter(data_open, Source == 2))), 
  Bleidorn = c(nrow(filter(data_all, Source == 1)), nrow(filter(data_agree, Source == 1)), 
              nrow(filter(data_consc, Source == 1)), nrow(filter(data_extra, Source == 1)),
              nrow(filter(data_neuro, Source == 1)), nrow(filter(data_open, Source == 1))),
  New = c(nrow(filter(data_all, Source == 0)), nrow(filter(data_agree, Source == 0)), 
              nrow(filter(data_consc, Source == 0)), nrow(filter(data_extra, Source == 0)),
              nrow(filter(data_neuro, Source == 0)), nrow(filter(data_open, Source == 0)))
)

names(numbers) <- c("Construct", "Total", "Roberts", "Bleidorn", "Haehner", 
                    "Total", "Roberts", "Bleidorn", "Haehner")
kable(numbers
      , caption="**Numbers of effect sizes and studies for different traits**"
      , escape=FALSE
      , label = NA) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left") %>% 
  add_header_above(c(" " = 1, "Number of studies" = 4, "Number of effect sizes" = 4))
Numbers of effect sizes and studies for different traits
Number of studies
Number of effect sizes
Construct Total Roberts Bleidorn Haehner Total Roberts Bleidorn Haehner
Total 229 22 129 78 2294 285 1349 660
Agreeableness 138 12 81 45 615 50 360 205
Conscientiousness 127 10 76 41 531 49 335 147
Extraversion 117 14 63 40 503 83 291 129
Neuroticism 185 17 101 67 816 101 461 254
Openness 73 10 43 20 306 37 190 79
## Unique samples
samples <- data_all %>% filter(duplicated(StudyID) == FALSE |
                                 (duplicated(StudyID) == TRUE & duplicated(SampleID) == FALSE))

## Total number of participants
n.total <- sum(samples$T1_N, na.rm = TRUE)

In total, the meta-analysis includes data from 230492 participants.

Descriptive Statistics of Moderators

Metric Moderators

## Metric characteristics
mod_metric <- data_all %>% select(Year, Alpha_T1, T2_lag, T1_AgeM,  Female) %>% psych::describe() %>% select(c(2:4, 8, 9)) %>% round(2)

row.names(mod_metric) <- c("Publication year", "Cronbach's Alpha", 
                           "Time lag between assessments", "Age at baseline",
                           "% Female")

names(mod_metric) <- c("Number of effect sizes", "Mean", "SD", "Min", "Max")

kable(mod_metric
      , caption="**Descriptive statistics on metric moderators**"
      , escape=FALSE
      , label = NA) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Descriptive statistics on metric moderators
Number of effect sizes Mean SD Min Max
Publication year 2294 2014.47 8.04 1980.00 2023.00
Cronbach’s Alpha 1820 0.78 0.11 0.22 0.98
Time lag between assessments 2294 2.87 5.09 0.50 51.00
Age at baseline 2294 23.56 19.89 0.25 100.50
% Female 2242 53.08 24.73 0.00 100.00

All metric moderators were centered before conducting the analyses.

Categorical Moderators

## Categorical variables
mod <- data_all %>% filter(Source == 0 | Source == 1 | Source == 2)
mod$Source <- droplevels.factor(mod$Source)
mod_cat <- rbind(as.data.frame(cbind(table(data_all$BigFive), round(prop.table(table(data_all$BigFive)),4) * 100)), 
                 as.data.frame(cbind(table(data_all$OtherReport), round(prop.table(table(data_all$OtherReport)),4) * 100)), 
                 as.data.frame(cbind(table(data_all$Facet), round(prop.table(table(data_all$Facet)),4) * 100)),
                 as.data.frame(cbind(table(data_all$Facet), round(prop.table(table(data_all$Facet)),4) * 100)), 
                 as.data.frame(cbind(table(data_all$Represent), round(prop.table(table(data_all$Represent)),4) * 100)), 
                 as.data.frame(cbind(table(data_all$Region), round(prop.table(table(mod$Region)),4) * 100)), 
                 as.data.frame(cbind(table(data_agree$Inverse), round(prop.table(table(data_agree$Inverse)),4) * 100)), 
                 as.data.frame(cbind(table(data_consc$Inverse), round(prop.table(table(data_consc$Inverse)),4) * 100)),
                 as.data.frame(cbind(table(data_extra$Inverse), round(prop.table(table(data_extra$Inverse)),4) * 100)),
                 as.data.frame(cbind(table(data_neuro$Inverse), round(prop.table(table(data_neuro$Inverse)),4) * 100)),
                 as.data.frame(cbind(table(data_open$Inverse), round(prop.table(table(data_open$Inverse)),4) * 100)))

names(mod_cat) <- c("Number of effect sizes", "Percentage of effect sizes")
row.names(mod_cat) <- NULL
mod_cat$Variable <- c("No", "Yes", "Self-report", "Other-report", 
                       "No", "Yes", "No", "Yes", "No", "Yes", 
                      "North America", "Asia", "Global South","Northern Europe",
                      "Southern Europe", 
                      rep(c("No", "Yes"),5))

mod_cat <- mod_cat[, c(3,1,2)]

kable(mod_cat
      , caption="**Descriptive statistics on categorical moderators**"
      , escape=FALSE
      , label = NA) %>%  
  pack_rows(index = c("Big Five taxonomy" = 2, "Report type" = 2, 
                      "Assessed at facet level" = 2, "Maladaptive trait" = 2, 
                      "Representative sample" = 2, "Region of origin" = 5, 
                      "Agreeableness inverse coded" = 2, 
                      "Conscientiousness inverse coded" = 2, 
                      "Extraversion inverse coded" = 2, 
                      "Neuroticism inverse coded" = 2, 
                      "Openness inverse coded" = 2)) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Descriptive statistics on categorical moderators
Variable Number of effect sizes Percentage of effect sizes
Big Five taxonomy
No 1146 49.96
Yes 1148 50.04
Report type
Self-report 1672 72.89
Other-report 622 27.11
Assessed at facet level
No 1274 55.54
Yes 1020 44.46
Maladaptive trait
No 1274 55.54
Yes 1020 44.46
Representative sample
No 1662 74.03
Yes 583 25.97
Region of origin
North America 702 31.20
Asia 108 4.80
Global South 93 4.13
Northern Europe 1210 53.78
Southern Europe 137 6.09
Agreeableness inverse coded
No 308 50.08
Yes 307 49.92
Conscientiousness inverse coded
No 352 66.29
Yes 179 33.71
Extraversion inverse coded
No 413 82.11
Yes 90 17.89
Neuroticism inverse coded
No 654 80.15
Yes 162 19.85
Openness inverse coded
No 255 83.33
Yes 51 16.67

Section 3: Meta-Analysis Without Any Predictors and Trait Differences

Model Without Any Predictors

## Agreeableness
meta.base.agree <- rma.mv(yi = ES, V = V_agree, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_agree, sparse = TRUE)
sigma_base.level1_agree <- meta.base.agree$sigma2[1]
sigma_base.level2_agree <- meta.base.agree$sigma2[2]
results.base <- robust(meta.base.agree, cluster = StudyID, clubSandwich = TRUE) 

base.agree <- round(c(results.base$beta, results.base$se, results.base$zval, 
  results.base$pval, exp(results.base$beta), 
  exp(results.base$ci.lb), exp(results.base$ci.ub)),3)

## Conscientiousness
meta.base.consc <- rma.mv(yi = ES, V = V_consc, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_consc, sparse = TRUE)
sigma_base.level1_consc <- meta.base.consc$sigma2[1]
sigma_base.level2_consc <- meta.base.consc$sigma2[2]
results.base <- robust(meta.base.consc, cluster = StudyID, clubSandwich = TRUE) 

base.consc <- round(c(results.base$beta, results.base$se, results.base$zval, 
  results.base$pval, exp(results.base$beta), 
  exp(results.base$ci.lb), exp(results.base$ci.ub)),3)

## Extraversion
meta.base.extra <- rma.mv(yi = ES, V = V_extra, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_extra, sparse = TRUE)
sigma_base.level1_extra <- meta.base.extra$sigma2[1]
sigma_base.level2_extra <- meta.base.extra$sigma2[2]
results.base <- robust(meta.base.extra, cluster = StudyID, clubSandwich = TRUE) 

base.extra <- round(c(results.base$beta, results.base$se, results.base$zval, 
  results.base$pval, exp(results.base$beta), 
  exp(results.base$ci.lb), exp(results.base$ci.ub)),3)

## Neuroticism
meta.base.neuro <- rma.mv(yi = ES, V = V_neuro, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_neuro, sparse = TRUE)
sigma_base.level1_neuro <- meta.base.neuro$sigma2[1]
sigma_base.level2_neuro <- meta.base.neuro$sigma2[2]
results.base <- robust(meta.base.neuro, cluster = StudyID, clubSandwich = TRUE) 

base.neuro <- round(c(results.base$beta, results.base$se, results.base$zval, 
  results.base$pval, exp(results.base$beta), 
  exp(results.base$ci.lb), exp(results.base$ci.ub)),3)

## Openness
meta.base.open <- rma.mv(yi = ES, V = V_open, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_open, sparse = TRUE)
sigma_base.level1_open <- meta.base.open$sigma2[1]
sigma_base.level2_open <- meta.base.open$sigma2[2]
results.base <- robust(meta.base.open, cluster = StudyID, clubSandwich = TRUE) 

base.open <- round(c(results.base$beta, results.base$se, results.base$zval, 
  results.base$pval, exp(results.base$beta), 
  exp(results.base$ci.lb), exp(results.base$ci.ub)),3)


## Create table
base.results <- as.data.frame(rbind(base.agree, base.consc, base.extra, base.neuro, base.open))
names(base.results) <- c("*b*", "*SE*", "*z*", "*p*", "SD~POMP~", "Lower CI", "Upper CI")
row.names(base.results) <- c("Agreeableness", "Conscientiousness", "Extraversion",  "Neuroticism", "Openness")


kable(base.results
      , caption="**Results: Meta-analysis without moderators**"
      , escape=FALSE
      , label = NA
      , digits = 3) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Results: Meta-analysis without moderators
b SE z p SDPOMP Lower CI Upper CI
Agreeableness -1.996 0.031 -63.627 0 0.136 0.128 0.145
Conscientiousness -1.927 0.032 -60.644 0 0.146 0.137 0.155
Extraversion -1.963 0.032 -60.672 0 0.140 0.132 0.150
Neuroticism -1.878 0.024 -79.139 0 0.153 0.146 0.160
Openness -2.052 0.048 -42.815 0 0.128 0.117 0.141

The b-coefficients of the meta-analytic models are difficult to interpret due to the logarithmic transformation of the effect sizes. The SDPOMP values are back-transformed, with higher values indicating more pronounced individual differences in change. They can be interpreted in the following way: A value of SDPOMP = 0.10, for example, indicates that people on average differ by about 10% of the maximum possible score from the overall mean-level trajectory. If a trait was assessed on a scale from 0 to 5, an SD[POMP] = 0.10 would indicate that the mean-level changes of an average person differed by 0.5 units from the overall mean-level trajectory (i.e., 0.10 * (5 - 0) = 0.5).

Examination of Trait Differences (Exploratory)

### Compute effect size in overall data frame

## Recode trait variables as factors
data_all$A.f <- as.factor(ifelse(data_all$A != 0, 1, 0))
data_all$C.f <- as.factor(ifelse(data_all$C != 0, 1, 0))
data_all$E.f <- as.factor(ifelse(data_all$E != 0, 1, 0))
data_all$N.f <- as.factor(ifelse(data_all$N != 0, 1, 0))
data_all$O.f <- as.factor(ifelse(data_all$O != 0, 1, 0))

## Create ID variables
data_all <- data_all %>%
  group_by(StudyID) %>%
  mutate(TraitID = as.numeric(factor(Trait, levels = unique(Trait))))

data_all <- data_all %>%
  group_by(StudyID, TraitID, SampleID, T1_AgeM) %>%
  mutate(TypeID = row_number())

data_all$EffsizeID <- 1:nrow(data_all)

## Impute correlation based on results of Bleidorn
data_all$Age1 <- ifelse(data_all$T1_AgeM <= 20, data_all$T1_AgeM, 20)
data_all$Age2 <- ifelse(data_all$T1_AgeM <= 25 & data_all$T1_AgeM > 20, 
                        data_all$T1_AgeM - 20, ifelse(data_all$T1_AgeM <= 20, 0, 25-20))
data_all$Age3 <- ifelse(data_all$T1_AgeM > 25, data_all$T1_AgeM - 25, 0)
  
data_all$T2_r <- ifelse(is.na(data_all$T2_r), 
                      (0.069 + ((data_all$T2_lag -3.6)* -0.011) + 0.029 * data_all$Age1 +
                         0.018 * data_all$Age2  + 0.001 * data_all$Age3), data_all$T2_r)
  
## Compute variance of personality change
data_all <- data_all %>% 
  mutate(sd.diff = sqrt(T1_SD^2 + T2_SD^2  - 2 * (T2_r * T1_SD * T2_SD)))

## Compute pomp score to make variance comparable
data_all <- data_all %>% 
  mutate(pomp.sd = sd.diff/(Max-Min))

## Compute effect sizes for the different rows
data_all$ES <- rep(NA, nrow(data_all))
data_all$SamVar <- rep(NA, nrow(data_all))

for(i in 1:nrow(data_all)) {

    
    ## Compute meta-analytic effect size
    data_all$ES[i] <- as.numeric(escalc("SDLN", sdi = data_all$pomp.sd[i], ni = data_all$T1_N[i], correct = TRUE)$yi)
    data_all$SamVar[i] <- as.numeric(escalc("SDLN", sdi = data_all$pomp.sd[i], ni = data_all$T1_N[i], correct = TRUE)$vi)
    
  }

##Estimate approximate variance-covariance matrix 
V <- vcalc(data_all$SamVar, cluster = data_all$StudyID, subgroup = data_all$SampleID,
           obs = data_all$TraitID, type = data_all$TypeID,
           time1 = data_all$T1_AgeM, rho = c(0.484, 0.548), phi = 0.608) 


## Meta-analytic models
meta.trait.agree <- rma.mv(yi = ES, V = V, mods = ~ A.f, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_all, sparse = TRUE)
robust.trait.agree <- robust(meta.trait.agree, cluster = StudyID, clubSandwich = TRUE) 

results.trait.agree <- round(as.data.frame(cbind(robust.trait.agree$beta[2], robust.trait.agree$se[2], robust.trait.agree$zval[2], 
  robust.trait.agree$pval[2])),3)


meta.trait.consc <- rma.mv(yi = ES, V = V, mods = ~ C.f, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_all, sparse = TRUE)
robust.trait.consc <- robust(meta.trait.consc, cluster = StudyID, clubSandwich = TRUE) 

results.trait.consc <- round(as.data.frame(cbind(robust.trait.consc$beta[2], robust.trait.consc$se[2], robust.trait.consc$zval[2], 
  robust.trait.consc$pval[2])),3)


meta.trait.extra <- rma.mv(yi = ES, V = V, mods = ~ E.f, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_all, sparse = TRUE)
robust.trait.extra <- robust(meta.trait.extra, cluster = StudyID, clubSandwich = TRUE) 

results.trait.extra <- round(as.data.frame(cbind(robust.trait.extra$beta[2], robust.trait.extra$se[2], robust.trait.extra$zval[2], 
  robust.trait.extra$pval[2])),3)


meta.trait.neuro <- rma.mv(yi = ES, V = V, mods = ~ N.f, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_all, sparse = TRUE)
robust.trait.neuro <- robust(meta.trait.neuro, cluster = StudyID, clubSandwich = TRUE) 

results.trait.neuro <- round(as.data.frame(cbind(robust.trait.neuro$beta[2], robust.trait.neuro$se[2], robust.trait.neuro$zval[2], 
  robust.trait.neuro$pval[2])),3)


meta.trait.open <- rma.mv(yi = ES, V = V, mods = ~ O.f, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_all, sparse = TRUE)
robust.trait.open <- robust(meta.trait.open, cluster = StudyID, clubSandwich = TRUE) 

results.trait.open <- round(as.data.frame(cbind(robust.trait.open$beta[2], robust.trait.open$se[2], robust.trait.open$zval[2], 
  robust.trait.open$pval[2])),3)

results.trait <- rbind(results.trait.agree, results.trait.consc, 
                       results.trait.extra, results.trait.neuro, 
                       results.trait.open)

names(results.trait) <- c("*b*", "*SE*", "*z*", "*p*")
row.names(results.trait) <- c("Agreeableness", "Conscientiousness", 
                              "Extraversion", "Neuroticism", 
                              "Openness")


kable(results.trait
      , caption="**Results: Meta-analysis with trait category as moderator**"
      , escape=FALSE
      , label = NA
      , digits = 3) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Results: Meta-analysis with trait category as moderator
b SE z p
Agreeableness -0.083 0.022 -3.722 0.001
Conscientiousness 0.005 0.022 0.214 0.832
Extraversion -0.005 0.016 -0.286 0.776
Neuroticism 0.109 0.023 4.740 0.000
Openness -0.081 0.029 -2.807 0.013

Plot

## Prepare loop
plot_data <- data.frame(Trait = factor(c("Agreeableness", "Conscientiousness", 
                                      "Extraversion", "Neuroticism", 
                                      "Openness"), 
                                      levels = c("Agreeableness", "Conscientiousness", 
                                      "Extraversion", "Neuroticism", 
                                      "Openness"), 
                                      ordered = TRUE),
                        SD = NA, 
                        CI.lower = NA,
                        CI.upper = NA)
plot_data$ID <- 1:nrow(plot_data)

meta.models <- list(meta.base.agree, meta.base.consc, meta.base.extra, 
                    meta.base.neuro, meta.base.open)                

## Loop to create plot data
for (i in 1:nrow(plot_data)) {                       
  plot_data$SD[i] <- predict(meta.models[[i]], 
                             transf=exp, addx=TRUE)$pred
  plot_data$CI.lower[i] <- predict(meta.models[[i]], 
                                   transf=exp, addx=TRUE)$ci.lb
  plot_data$CI.upper[i] <- predict(meta.models[[i]], 
                                   transf=exp, addx=TRUE)$ci.ub
} 
plot_data$Colour <- as.factor(c(1,0,0,1,1))

## Plot
plot <- ggplot(data = plot_data, aes(x = SD, y = Trait)) +
  geom_errorbar(aes(xmin=CI.lower, xmax=CI.upper, colour = Colour), 
                position=position_dodge(0.75), width = 0) + 
  geom_point_interactive(aes(tooltip = 
                               paste0("SD = ", round(SD,3), 
                                      ", 95% CI = [", round(CI.lower,3),
                                      ", ", round(CI.upper,3), "]"), 
                             data_id = ID, colour = Colour), 
             size = 1.8, position=position_dodge(0.75)) + 
  theme_pub() +
  scale_x_continuous(limits = c(0,0.3)) +
  scale_colour_manual(values = c("0" = "grey", "1" = "black")) +
  theme(legend.position = "none", 
        axis.text.y = element_text(hjust = 1)) +
  labs(y = "Traits", x = expression(bold("SD"[POMP])))

girafe(ggobj = plot)

Note. The estimate for a trait is depicted in black if it significantly differed from the average of the other traits.

Section 4: Models with Age and Time Lag (Piecewise-Approach)

Overview of Results of Piecewise-Approach

spline.agree$AIC <- as.numeric(spline.agree$AIC)
spline.agree$BIC <- as.numeric(spline.agree$BIC)

spline.consc$AIC <- as.numeric(spline.consc$AIC)
spline.consc$BIC <- as.numeric(spline.consc$BIC)

spline.extra$AIC <- as.numeric(spline.extra$AIC)
spline.extra$BIC <- as.numeric(spline.extra$BIC)

spline.neuro$AIC <- as.numeric(spline.neuro$AIC)
spline.neuro$BIC <- as.numeric(spline.neuro$BIC)

spline.open$AIC <- as.numeric(spline.open$AIC)
spline.open$BIC <- as.numeric(spline.open$BIC)

## Agreeableness
spline.agree <- spline.agree[order(spline.agree$AIC), ]
AIC_agree <- c("AIC", spline.agree$Num[1:4])

spline.agree <- spline.agree[order(spline.agree$BIC), ]
BIC_agree <- c("BIC", spline.agree$Num[1:4])

## Conscientiousness
spline.consc <- spline.consc[order(spline.consc$AIC), ]
AIC_consc <- c("AIC", spline.consc$Num[1:4])

spline.consc <- spline.consc[order(spline.consc$BIC), ]
BIC_consc <- c("BIC", spline.consc$Num[1:4])

## Extraversion
spline.extra <- spline.extra[order(spline.extra$AIC), ]
AIC_extra <- c("AIC", spline.extra$Num[1:4])

spline.extra <- spline.extra[order(spline.extra$BIC), ]
BIC_extra <- c("BIC", spline.extra$Num[1:4])

## Neuroticsim
spline.neuro <- spline.neuro[order(spline.neuro$AIC), ]
AIC_neuro <- c("AIC", spline.neuro$Num[1:4])

spline.neuro <- spline.neuro[order(spline.neuro$BIC), ]
BIC_neuro <- c("BIC", spline.neuro$Num[1:4])

## Openness
spline.open <- spline.open[order(spline.open$AIC), ]
AIC_open <- c("AIC", spline.open$Num[1:4])

spline.open <- spline.open[order(spline.open$BIC), ]
BIC_open <- c("BIC", spline.open$Num[1:4])

## Create table
best.fit <- as.data.frame(rbind(AIC_agree, BIC_agree, 
                                AIC_consc, BIC_consc, 
                  AIC_extra, BIC_extra, AIC_neuro, BIC_neuro, 
                  AIC_open, BIC_open))
names(best.fit) <- c("Fit index", "Best model", "Second-best", "Third-best", "Fourth-best")
row.names(best.fit) <- NULL

best.fit <- best.fit %>% 
  select(-`Fourth-best`) %>% 
  mutate(
  `Best model` = case_match(`Best model`, "32763" ~ "Age.1-25 + Age.25>", 
                             "32724" ~ "Age.1-15 + Age.15-25 + Age.25>", 
                             "32725" ~ "Age.1-15 + Age.15-20 + Age.20>", 
                             "32762" ~ "Age.1-30 + Age.30>", 
                             "32633" ~ "Age.1-5 + Age.5-15 + Age.15-25 + Age.25>", 
                             "32748" ~ "Age.1-5 + Age.5-30 + Age.30>",
                             "32749" ~ "Age.1-5 + Age.5-25 + Age.25>",
                             "31913" ~ "Age.1-5 + Age.5-30 + Age.30-70 + Age.70-75 + Age.75>",
                             "32761" ~ "Age.1-35 + Age.35>",
                             "32764" ~ "Age.1-20 + Age.20>",
                             "32634" ~ "Age.1-5 + Age.5-15 + Age.15-20 + Age.20>",
                             "32556" ~ "Age.1-10 + Age.10-15 + Age.15-20 + Age.20>",
                             "32470" ~ "Age.1-15 + Age.15-20 + Age.20-65 + Age.65>",
                             "32471" ~ "Age.1-15 + Age.15-20 + Age.20-60 + Age.60>",
                             "32469" ~ "Age.1-15 + Age.15-20 + Age.20-70 + Age.70>",
                             "32468" ~ "Age.1-15 + Age.15-20 + Age.20-75 + Age.75>",
                             "32760" ~ "Age.1-40 + Age.40>",
                             "32757" ~ "Age.1-55 + Age.55>",
                             "32758" ~ "Age.1-50 + Age.50>",
                             "32602" ~ "Age.1-5 + Age.5-25 + Age.25-75 + Age.75>",
                             "31949" ~ "Age.1-5 + Age.5-25 + Age.25-70 + Age.70-75 + Age.75>",
                             "32693" ~ "Age.1-25 + Age.25-75 + Age.75>",
                             "32694" ~ "Age.1-25 + Age.25-70 + Age.70>",
                             "32695" ~ "Age.1-25 + Age.25-65 + Age.65>",
                             "32703" ~ "Age.1-20 + Age.20-75 + Age.75>",
                             "32458" ~ "Age.1-15 + Age.15-25 + Age.25-75 + Age.75>",
                             "32104" ~ "Age.1-5 + Age.5-15 + Age.15-20 + Age.20-75 + Age.75>",
                             "31818" ~ "Age.1-10 + Age.10-15 + Age.15-20 + Age.20-75 + Age.75>",
                            .default = `Best model`), 
  `Second-best` = case_match(`Second-best`, "32763" ~ "Age.1-25 + Age.25>", 
                             "32724" ~ "Age.1-15 + Age.15-25 + Age.25>", 
                             "32725" ~ "Age.1-15 + Age.15-20 + Age.20>", 
                             "32762" ~ "Age.1-30 + Age.30>", 
                             "32633" ~ "Age.1-5 + Age.5-15 + Age.15-25 + Age.25>", 
                             "32748" ~ "Age.1-5 + Age.5-30 + Age.30>",
                             "32749" ~ "Age.1-5 + Age.5-25 + Age.25>",
                             "31913" ~ "Age.1-5 + Age.5-30 + Age.30-70 + Age.70-75 + Age.75>",
                             "32761" ~ "Age.1-35 + Age.35>",
                             "32764" ~ "Age.1-20 + Age.20>",
                             "32634" ~ "Age.1-5 + Age.5-15 + Age.15-20 + Age.20>",
                             "32556" ~ "Age.1-10 + Age.10-15 + Age.15-20 + Age.20>",
                             "32470" ~ "Age.1-15 + Age.15-20 + Age.20-65 + Age.65>",
                             "32471" ~ "Age.1-15 + Age.15-20 + Age.20-60 + Age.60>",
                             "32469" ~ "Age.1-15 + Age.15-20 + Age.20-70 + Age.70>",
                             "32468" ~ "Age.1-15 + Age.15-20 + Age.20-75 + Age.75>",
                             "32760" ~ "Age.1-40 + Age.40>",
                             "32757" ~ "Age.1-55 + Age.55>",
                             "32758" ~ "Age.1-50 + Age.50>",
                             "32602" ~ "Age.1-5 + Age.5-25 + Age.25-75 + Age.75>",
                             "31949" ~ "Age.1-5 + Age.5-25 + Age.25-70 + Age.70-75 + Age.75>",
                             "32693" ~ "Age.1-25 + Age.25-75 + Age.75>",
                             "32694" ~ "Age.1-25 + Age.25-70 + Age.70>",
                             "32695" ~ "Age.1-25 + Age.25-65 + Age.65>",
                             "32703" ~ "Age.1-20 + Age.20-75 + Age.75>",
                             "32458" ~ "Age.1-15 + Age.15-25 + Age.25-75 + Age.75>",
                             "32104" ~ "Age.1-5 + Age.5-15 + Age.15-20 + Age.20-75 + Age.75>",
                             "31818" ~ "Age.1-10 + Age.10-15 + Age.15-20 + Age.20-75 + Age.75>",
                             .default = `Second-best`), 
  `Third-best` = case_match(`Third-best`, "32763" ~ "Age.1-25 + Age.25>", 
                             "32724" ~ "Age.1-15 + Age.15-25 + Age.25>", 
                             "32725" ~ "Age.1-15 + Age.15-20 + Age.20>", 
                             "32762" ~ "Age.1-30 + Age.30>", 
                             "32633" ~ "Age.1-5 + Age.5-15 + Age.15-25 + Age.25>", 
                             "32748" ~ "Age.1-5 + Age.5-30 + Age.30>",
                             "32749" ~ "Age.1-5 + Age.5-25 + Age.25>",
                             "31913" ~ "Age.1-5 + Age.5-30 + Age.30-70 + Age.70-75 + Age.75>",
                             "32761" ~ "Age.1-35 + Age.35>",
                             "32764" ~ "Age.1-20 + Age.20>",
                             "32634" ~ "Age.1-5 + Age.5-15 + Age.15-20 + Age.20>",
                             "32556" ~ "Age.1-10 + Age.10-15 + Age.15-20 + Age.20>",
                             "32470" ~ "Age.1-15 + Age.15-20 + Age.20-65 + Age.65>",
                             "32471" ~ "Age.1-15 + Age.15-20 + Age.20-60 + Age.60>",
                             "32469" ~ "Age.1-15 + Age.15-20 + Age.20-70 + Age.70>",
                             "32468" ~ "Age.1-15 + Age.15-20 + Age.20-75 + Age.75>",
                             "32760" ~ "Age.1-40 + Age.40>",
                             "32757" ~ "Age.1-55 + Age.55>",
                             "32758" ~ "Age.1-50 + Age.50>",
                             "32602" ~ "Age.1-5 + Age.5-25 + Age.25-75 + Age.75>",
                             "31949" ~ "Age.1-5 + Age.5-25 + Age.25-70 + Age.70-75 + Age.75>",
                             "32693" ~ "Age.1-25 + Age.25-75 + Age.75>",
                             "32694" ~ "Age.1-25 + Age.25-70 + Age.70>",
                             "32695" ~ "Age.1-25 + Age.25-65 + Age.65>",
                             "32703" ~ "Age.1-20 + Age.20-75 + Age.75>",
                             "32458" ~ "Age.1-15 + Age.15-25 + Age.25-75 + Age.75>",
                             "32104" ~ "Age.1-5 + Age.5-15 + Age.15-20 + Age.20-75 + Age.75>",
                             "31818" ~ "Age.1-10 + Age.10-15 + Age.15-20 + Age.20-75 + Age.75>",
                             .default = `Third-best`)
)

kable(best.fit
      , caption="**Best-fitting model of spline approach with age and time lag as predictors**"
      , escape=FALSE
      , label = NA) %>% 
    pack_rows(index = c("Agreeableness" = 2, "Conscientiousness" = 2, 
                      "Extraversion" = 2, "Neuroticism" = 2, 
                      "Openness" = 2)) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Best-fitting model of spline approach with age and time lag as predictors
Fit index Best model Second-best Third-best
Agreeableness
AIC Age.1-15 + Age.15-20 + Age.20-65 + Age.65> Age.1-15 + Age.15-20 + Age.20-60 + Age.60> Age.1-15 + Age.15-20 + Age.20-70 + Age.70>
BIC Age.1-25 + Age.25> Age.1-30 + Age.30> Age.1-15 + Age.15-25 + Age.25>
Conscientiousness
AIC Age.1-5 + Age.5-30 + Age.30-70 + Age.70-75 + Age.75> Age.1-5 + Age.5-25 + Age.25-75 + Age.75> Age.1-5 + Age.5-25 + Age.25-70 + Age.70-75 + Age.75>
BIC Age.1-40 + Age.40> Age.1-30 + Age.30> Age.1-35 + Age.35>
Extraversion
AIC Age.1-25 + Age.25-75 + Age.75> Age.1-25 + Age.25-70 + Age.70> Age.1-25 + Age.25-65 + Age.65>
BIC Age.1-55 + Age.55> Age.1-50 + Age.50> Age.1-25 + Age.25-75 + Age.75>
Neuroticism
AIC Age.1-15 + Age.15-20 + Age.20-75 + Age.75> Age.1-5 + Age.5-15 + Age.15-20 + Age.20-75 + Age.75> Age.1-10 + Age.10-15 + Age.15-20 + Age.20-75 + Age.75>
BIC Age.1-25 + Age.25-75 + Age.75> Age.1-15 + Age.15-20 + Age.20-75 + Age.75> Age.1-20 + Age.20-75 + Age.75>
Openness
AIC Age.1-15 + Age.15-20 + Age.20-70 + Age.70> Age.1-15 + Age.15-20 + Age.20-65 + Age.65> Age.1-15 + Age.15-25 + Age.25-75 + Age.75>
BIC Age.1-30 + Age.30> Age.1-25 + Age.25> Age.1-15 + Age.15-25 + Age.25>

We selected the two best-fitting models for the following analyses based on the following considerations:

  • We preferred models that fitted best according to AIC and BIC
  • We preferred similar models across traits
  • We preferred models without separate splines for the edges of the age distribution (Age1-5 and Age75+) because less effect sizes were available for these age bins.

Agreeableness

Best Model

Model with two age-related variables: Age 1-30 and Age 30>

Table

## Create age bins
data_agree$abin_1  <- ifelse(data_agree$T1_AgeM <= 30, data_agree$T1_AgeM, 30)
data_agree$abin_2  <- ifelse(data_agree$T1_AgeM > 30, data_agree$T1_AgeM - 30, 0)  
    

## Spline approach of best-fitting model
meta.spline1 <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 + T2_lag.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_agree, sparse = TRUE)
sigma_spline1.level1_agree <- meta.spline1$sigma2[1]
sigma_spline1.level2_agree <- meta.spline1$sigma2[2]

results.spline1 <- robust(meta.spline1, cluster = StudyID, clubSandwich = TRUE) 

spline1.agree <- as.data.frame(round(cbind(results.spline1$b, results.spline1$se, results.spline1$zval, 
  results.spline1$pval),3))

names(spline1.agree) <- c("*b*", "*SE*", "*z*", "*p*")
row.names(spline1.agree) <- c("Intercept", "Age.1-30", 
                              "Age.30>", "Time lag")

kable(spline1.agree
      , caption="**Best-fitting model with age and time lag for agreeableness**"
      , escape=FALSE
      , label = NA) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Best-fitting model with age and time lag for agreeableness
b SE z p
Intercept -1.702 0.070 -24.273 0.000
Age.1-30 -0.023 0.004 -5.445 0.000
Age.30> 0.001 0.002 0.250 0.827
Time lag 0.027 0.007 3.801 0.009
## Compute models with age only (for separate R2 values)
meta.spline1_age <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2,
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_agree, sparse = TRUE)
sigma_spline1.level1_agree_age <- meta.spline1_age$sigma2[1]
sigma_spline1.level2_agree_age <- meta.spline1_age$sigma2[2]

## Compute models with time lag only (for separate R2 values)
meta.spline1_lag <- rma.mv(yi = ES, V = V_agree, mods = ~ T2_lag.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_agree, sparse = TRUE)
sigma_spline1.level1_agree_lag <- meta.spline1_lag$sigma2[1]
sigma_spline1.level2_agree_lag <- meta.spline1_lag$sigma2[2]

## R2 in model with time lag and age
r2.level1 <- round((sigma_base.level1_agree - sigma_spline1.level1_agree)/sigma_base.level1_agree,2)
r2.level1 <- ifelse(r2.level1 < 0, 0, r2.level1)

r2.level2 <- round((sigma_base.level2_agree - sigma_spline1.level2_agree)/sigma_base.level2_agree,2)
r2.level2 <- ifelse(r2.level2 < 0, 0, r2.level2)

r2 <- round(as.data.frame(rbind(c(sigma_spline1.level1_agree, sigma_base.level1_agree, r2.level1), c(sigma_spline1.level2_agree, sigma_base.level2_agree, r2.level2))),5)

## R2 in model with age only
r2.level1_age <- round((sigma_base.level1_agree - sigma_spline1.level1_agree_age)/sigma_base.level1_agree,2)
r2.level1_age <- ifelse(r2.level1_age < 0, 0, r2.level1_age)

r2.level2_age <- round((sigma_base.level2_agree - sigma_spline1.level2_agree_age)/sigma_base.level2_agree,2)
r2.level2_age <- ifelse(r2.level2_age < 0, 0, r2.level2_age)

r2_age <- round(as.data.frame(rbind(c(sigma_spline1.level1_agree_age, sigma_base.level1_agree, r2.level1_age), c(sigma_spline1.level2_agree_age, sigma_base.level2_agree, r2.level2_age))),5)

## R2 in model with time lag only
r2.level1_lag <- round((sigma_base.level1_agree - sigma_spline1.level1_agree_lag)/sigma_base.level1_agree,2)
r2.level1_lag <- ifelse(r2.level1_lag < 0, 0, r2.level1_lag)

r2.level2_lag <- round((sigma_base.level2_agree - sigma_spline1.level2_agree_lag)/sigma_base.level2_agree,2)
r2.level2_lag <- ifelse(r2.level2_lag < 0, 0, r2.level2_lag)

r2_lag <- round(as.data.frame(rbind(c(sigma_spline1.level1_agree_lag, sigma_base.level1_agree, r2.level1_lag), c(sigma_spline1.level2_agree_lag, sigma_base.level2_agree, r2.level2_lag))),5)

## Combine values in one table
r2_all <- rbind(r2, r2_age, r2_lag)
r2_all$Level <- rep(c("Level 1", "Level 2"), 3)
names(r2_all) <- c("Sigma Moderator", "Sigma Baseline", "R^2^", "Level")

r2_all <- select(r2_all, Level, everything())

kable(r2_all
      , caption="**R^2^ of models**"
      , escape=FALSE
      , label = NA
      , digits = 3) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left") %>% 
  pack_rows(index = c("Age and time lag" = 2, "Age only" = 2, "Time lag only" = 2))
R2 of models
Level Sigma Moderator Sigma Baseline R2
Age and time lag
Level 1 0.026 0.03 0.14
Level 2 0.093 0.12 0.23
Age only
Level 1 0.028 0.03 0.07
Level 2 0.103 0.12 0.14
Time lag only
Level 1 0.029 0.03 0.05
Level 2 0.119 0.12 0.01

Plot: Age

Note: You can hover over the data points to receive more information.

pred <- data.frame(Age = 1:80,
                   SD = NA, 
                   CI.lower = NA,
                   CI.upper = NA) 

for (i in 1:80) {
  pred$SD[i] <- predict(results.spline1, 
                   newmods=c(ifelse(i <= 30, i, 30), 
                             ifelse(i > 30,i - 30, 0),0), 
                   transf=exp, addx=TRUE)$pred
  pred$CI.lower[i] <- predict(results.spline1, 
                   newmods=c(ifelse(i <= 30, i, 30), 
                             ifelse(i > 30,i - 30, 0),0), 
                        transf=exp, addx=TRUE)$ci.lb
  pred$CI.upper[i] <- predict(results.spline1, 
                   newmods=c(ifelse(i <= 30, i, 30), 
                             ifelse(i > 30,i - 30, 0),0), 
                              transf=exp, addx=TRUE)$ci.ub
}

pred$Type <- "pred"
observed <- select(data_agree, Age = T1_AgeM, ES = ES, N = T1_N) %>% ungroup() %>% 
  mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)

plot <- ggplot(data = total, aes(x = Age, y = SD)) +
  geom_point_interactive(data = subset(total, Type == "observed"), 
                         aes(size = N, tooltip = paste0("SD = ", round(SD,3), 
                                                        ", N = ", N, 
                                                        ", StudyID = ", StudyID), 
                             data_id = ID), 
                         shape = 5, color = "grey") +
  geom_errorbar(data = subset(total, Type == "pred"), 
                aes(ymin = CI.lower, ymax = CI.upper),
                color = "black", width = 0) +
  geom_point_interactive(data = subset(total, Type == "pred"), 
                         aes(tooltip = 
                               paste0("SD = ", round(SD,3), 
                                      ", 95% CI = [", round(CI.lower,3),
                                      ", ", round(CI.upper,3), "]"), 
                             data_id = ID)) +
  scale_y_continuous(limits = c(0, 0.40)) +
  scale_x_continuous(limits = c(0, 80), breaks = c(0,10,20,30,40,50,60,70,80)) +
  labs(y = expression(bold("SD"[POMP])), title = "Agreeableness") +
  theme_pub() +
  theme(legend.position = "none")


girafe(ggobj = plot)

Plot: Time

Note: You can hover over the data points to receive more information.

pred <- data.frame(Time = seq(from = 0.5, to = 10, by = 0.25),
                   SD = NA, 
                   CI.lower = NA,
                   CI.upper = NA) 

for (i in 1:nrow(pred)) {
  pred$SD[i] <- predict(results.spline1, 
                   newmods=c(20, 0 , pred$Time[i]), 
                   transf=exp, addx=TRUE)$pred
  pred$CI.lower[i] <- predict(results.spline1, 
                              newmods=c(20, 0 , pred$Time[i]), 
                        transf=exp, addx=TRUE)$ci.lb
  pred$CI.upper[i] <- predict(results.spline1, 
                              newmods=c(20, 0 , pred$Time[i]), 
                              transf=exp, addx=TRUE)$ci.ub
}

pred$Type <- "pred"
observed <- select(data_agree, Time = T2_lag, ES = ES, N = T1_N) %>% ungroup() %>% 
  mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)

plot <- ggplot(data = total, aes(x = Time, y = SD)) +
  geom_point_interactive(data = subset(total, Type == "observed"), 
                         aes(size = N, tooltip = paste0("SD = ", round(SD,3), 
                                                        ", N = ", N, 
                                                        ", StudyID = ", StudyID), 
                             data_id = ID), 
                         shape = 5, color = "grey") +
  geom_errorbar(data = subset(total, Type == "pred"), 
                aes(ymin = CI.lower, ymax = CI.upper),
                color = "black", width = 0) +
  geom_point_interactive(data = subset(total, Type == "pred"), 
                         aes(tooltip = 
                               paste0("SD = ", round(SD,3), 
                                      ", 95% CI = [", round(CI.lower,3),
                                      ", ", round(CI.upper,3), "]"), 
                             data_id = ID)) +
  scale_y_continuous(limits = c(0, 0.40)) +
  scale_x_continuous(limits = c(0, 10), breaks = c(0,1,2,3,4,5,6,7,8,9,10)) +
  labs(y = expression(bold("SD"[POMP])), title = "Agreeableness") +
  theme_pub() +
  theme(legend.position = "none")


girafe(ggobj = plot)

Second-Best

Model with four age-related variables: Age 1-15, Age 15-20, Age 20-65, and Age 65>

Table

## Create age bins
data_agree$abin_1  <- ifelse(data_agree$T1_AgeM <= 15, data_agree$T1_AgeM, 15)
data_agree$abin_2  <- ifelse(data_agree$T1_AgeM <= 20 & data_agree$T1_AgeM > 15, 
                             data_agree$T1_AgeM - 15, 
                             ifelse(data_agree$T1_AgeM <= 15, 0, 20 - 15))
data_agree$abin_3  <- ifelse(data_agree$T1_AgeM <= 65 & data_agree$T1_AgeM > 20, 
                             data_agree$T1_AgeM - 20, 
                             ifelse(data_agree$T1_AgeM <= 20, 0, 65 - 20))
data_agree$abin_4  <- ifelse(data_agree$T1_AgeM > 65, data_agree$T1_AgeM - 65, 0) 

## Spline approach of best-fitting model
meta.spline2 <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 + abin_3 + abin_4 + T2_lag.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_agree, sparse = TRUE)
sigma_spline2.level1_agree <- meta.spline2$sigma2[1]
sigma_spline2.level2_agree <- meta.spline2$sigma2[2]
results.spline2 <- robust(meta.spline2, cluster = StudyID, clubSandwich = TRUE) 

spline2.agree <- as.data.frame(round(cbind(results.spline2$b, results.spline2$se, results.spline2$zval, 
  results.spline2$pval),3))

names(spline2.agree) <- c("*b*", "*SE*", "*z*", "*p*")
row.names(spline2.agree) <- c("Intercept", "Age.1-15", "Age.15-20", 
                              "Age.20-65", "Age.65>", "Time lag")

kable(spline2.agree
      , caption="**Second-best model with age and time lag for agreeableness**"
      , escape=FALSE
      , label = NA) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Second-best model with age and time lag for agreeableness
b SE z p
Intercept -1.716 0.075 -22.975 0.000
Age.1-15 -0.020 0.006 -3.647 0.002
Age.15-20 -0.048 0.013 -3.665 0.002
Age.20-65 -0.004 0.001 -3.036 0.067
Age.65> 0.008 0.003 2.872 0.144
Time lag 0.027 0.007 3.695 0.011
## Compute models with age only (for separate R2 values)
meta.spline2_age <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 + abin_3 + abin_4,
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_agree, sparse = TRUE)
sigma_spline2.level1_agree_age <- meta.spline2_age$sigma2[1]
sigma_spline2.level2_agree_age <- meta.spline2_age$sigma2[2]

## Compute models with time lag only (for separate R2 values)
meta.spline2_lag <- rma.mv(yi = ES, V = V_agree, mods = ~ T2_lag.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_agree, sparse = TRUE)
sigma_spline2.level1_agree_lag <- meta.spline2_lag$sigma2[1]
sigma_spline2.level2_agree_lag <- meta.spline2_lag$sigma2[2]

## R2 in model with time lag and age
r2.level1 <- round((sigma_base.level1_agree - sigma_spline2.level1_agree)/sigma_base.level1_agree,2)
r2.level1 <- ifelse(r2.level1 < 0, 0, r2.level1)

r2.level2 <- round((sigma_base.level2_agree - sigma_spline2.level2_agree)/sigma_base.level2_agree,2)
r2.level2 <- ifelse(r2.level2 < 0, 0, r2.level2)

r2 <- round(as.data.frame(rbind(c(sigma_spline2.level1_agree, sigma_base.level1_agree, r2.level1), c(sigma_spline2.level2_agree, sigma_base.level2_agree, r2.level2))),5)

## R2 in model with age only
r2.level1_age <- round((sigma_base.level1_agree - sigma_spline2.level1_agree_age)/sigma_base.level1_agree,2)
r2.level1_age <- ifelse(r2.level1_age < 0, 0, r2.level1_age)

r2.level2_age <- round((sigma_base.level2_agree - sigma_spline2.level2_agree_age)/sigma_base.level2_agree,2)
r2.level2_age <- ifelse(r2.level2_age < 0, 0, r2.level2_age)

r2_age <- round(as.data.frame(rbind(c(sigma_spline2.level1_agree_age, sigma_base.level1_agree, r2.level1_age), c(sigma_spline2.level2_agree_age, sigma_base.level2_agree, r2.level2_age))),5)

## R2 in model with time lag only
r2.level1_lag <- round((sigma_base.level1_agree - sigma_spline2.level1_agree_lag)/sigma_base.level1_agree,2)
r2.level1_lag <- ifelse(r2.level1_lag < 0, 0, r2.level1_lag)

r2.level2_lag <- round((sigma_base.level2_agree - sigma_spline2.level2_agree_lag)/sigma_base.level2_agree,2)
r2.level2_lag <- ifelse(r2.level2_lag < 0, 0, r2.level2_lag)

r2_lag <- round(as.data.frame(rbind(c(sigma_spline2.level1_agree_lag, sigma_base.level1_agree, r2.level1_lag), c(sigma_spline2.level2_agree_lag, sigma_base.level2_agree, r2.level2_lag))),5)

## Combine values in one table
r2_all <- rbind(r2, r2_age, r2_lag)
r2_all$Level <- rep(c("Level 1", "Level 2"), 3)
names(r2_all) <- c("Sigma Moderator", "Sigma Baseline", "R^2^", "Level")

r2_all <- select(r2_all, Level, everything())

kable(r2_all
      , caption="**R^2^ of models**"
      , escape=FALSE
      , label = NA
      , digits = 3) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left") %>% 
  pack_rows(index = c("Age and time lag" = 2, "Age only" = 2, "Time lag only" = 2))
R2 of models
Level Sigma Moderator Sigma Baseline R2
Age and time lag
Level 1 0.026 0.03 0.15
Level 2 0.093 0.12 0.22
Age only
Level 1 0.028 0.03 0.09
Level 2 0.103 0.12 0.15
Time lag only
Level 1 0.029 0.03 0.05
Level 2 0.119 0.12 0.01

Plot: Age

Note: You can hover over the data points to receive more information.

pred <- data.frame(Age = 1:80,
                   SD = NA, 
                   CI.lower = NA,
                   CI.upper = NA) 

for (i in 1:80) {
  pred$SD[i] <- predict(results.spline2, 
                   newmods=c(ifelse(i <= 15, i, 15), 
                             ifelse(i <= 20 & i > 15, i - 15, ifelse(i <= 15, 0, 20 - 15)), 
                             ifelse(i <= 65 & i > 20, i - 20, ifelse(i <= 20, 0, 65 - 20)), 
                             ifelse(i > 65,i - 65, 0),0), 
                   transf=exp, addx=TRUE)$pred
  pred$CI.lower[i] <- predict(results.spline2, 
                   newmods=c(ifelse(i <= 15, i, 15), 
                             ifelse(i <= 20 & i > 15, i - 15, ifelse(i <= 15, 0, 20 - 15)), 
                             ifelse(i <= 65 & i > 20, i - 20, ifelse(i <= 20, 0, 65 - 20)), 
                             ifelse(i > 65,i - 65, 0),0), 
                        transf=exp, addx=TRUE)$ci.lb
  pred$CI.upper[i] <- predict(results.spline2, 
                   newmods=c(ifelse(i <= 15, i, 15), 
                             ifelse(i <= 20 & i > 15, i - 15, ifelse(i <= 15, 0, 20 - 15)), 
                             ifelse(i <= 65 & i > 20, i - 20, ifelse(i <= 20, 0, 65 - 20)), 
                             ifelse(i > 65,i - 65, 0),0), 
                              transf=exp, addx=TRUE)$ci.ub
}

pred$Type <- "pred"
observed <- select(data_agree, Age = T1_AgeM, ES = ES, N = T1_N) %>% ungroup() %>% 
  mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)

plot <- ggplot(data = total, aes(x = Age, y = SD)) +
  geom_point_interactive(data = subset(total, Type == "observed"), 
                         aes(size = N, tooltip = paste0("SD = ", round(SD,3), 
                                                        ", N = ", N, 
                                                        ", StudyID = ", StudyID), 
                             data_id = ID), 
                         shape = 5, color = "grey") +
  geom_errorbar(data = subset(total, Type == "pred"), 
                aes(ymin = CI.lower, ymax = CI.upper),
                color = "black", width = 0) +
  geom_point_interactive(data = subset(total, Type == "pred"), 
                         aes(tooltip = 
                               paste0("SD = ", round(SD,3), 
                                      ", 95% CI = [", round(CI.lower,3),
                                      ", ", round(CI.upper,3), "]"), 
                             data_id = ID)) +
  scale_y_continuous(limits = c(0, 0.40)) +
  scale_x_continuous(limits = c(0, 80), breaks = c(0,10,20,30,40,50,60,70,80)) +
  labs(y = expression(bold("SD"[POMP])), title = "Agreeableness") +
  theme_pub() +
  theme(legend.position = "none")


girafe(ggobj = plot)

Plot: Time

Note: You can hover over the data points to receive more information.

pred <- data.frame(Time = seq(from = 0.5, to = 10, by = 0.25),
                   SD = NA, 
                   CI.lower = NA,
                   CI.upper = NA) 

for (i in 1:nrow(pred)) {
  pred$SD[i] <- predict(results.spline2, 
                   newmods=c(15, 5, 0, 0, pred$Time[i]), 
                   transf=exp, addx=TRUE)$pred
  pred$CI.lower[i] <- predict(results.spline2, 
                              newmods=c(15, 5, 0, 0, pred$Time[i]), 
                        transf=exp, addx=TRUE)$ci.lb
  pred$CI.upper[i] <- predict(results.spline2, 
                         newmods=c(15, 5, 0, 0, pred$Time[i]), 
                              transf=exp, addx=TRUE)$ci.ub
}

pred$Type <- "pred"
observed <- select(data_agree, Time = T2_lag, ES = ES, N = T1_N) %>% ungroup() %>% 
  mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)

plot <- ggplot(data = total, aes(x = Time, y = SD)) +
  geom_point_interactive(data = subset(total, Type == "observed"), 
                         aes(size = N, tooltip = paste0("SD = ", round(SD,3), 
                                                        ", N = ", N, 
                                                        ", StudyID = ", StudyID), 
                             data_id = ID), 
                         shape = 5, color = "grey") +
  geom_errorbar(data = subset(total, Type == "pred"), 
                aes(ymin = CI.lower, ymax = CI.upper),
                color = "black", width = 0) +
  geom_point_interactive(data = subset(total, Type == "pred"), 
                         aes(tooltip = 
                               paste0("SD = ", round(SD,3), 
                                      ", 95% CI = [", round(CI.lower,3),
                                      ", ", round(CI.upper,3), "]"), 
                             data_id = ID)) +
  scale_y_continuous(limits = c(0, 0.40)) +
  scale_x_continuous(limits = c(0, 10), breaks = c(0,1,2,3,4,5,6,7,8,9,10)) +
  labs(y = expression(bold("SD"[POMP])), title = "Agreeableness") +
  theme_pub() +
  theme(legend.position = "none")


girafe(ggobj = plot)

Conscientiousness

Best Model

Model with two age-related variables: Age 1-40, and Age 40>

Table

## Create age bins
data_consc$abin_1  <- ifelse(data_consc$T1_AgeM <= 40, data_consc$T1_AgeM, 40)
data_consc$abin_2  <- ifelse(data_consc$T1_AgeM > 40, data_consc$T1_AgeM - 40, 0) 

## Spline approach of best-fitting model
meta.spline1 <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 + T2_lag.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_consc, sparse = TRUE)
sigma_spline1.level1_consc <- meta.spline1$sigma2[1]
sigma_spline1.level2_consc <- meta.spline1$sigma2[2]
results.spline1 <- robust(meta.spline1, cluster = StudyID, clubSandwich = TRUE) 

spline1.consc <- as.data.frame(round(cbind(results.spline1$b, results.spline1$se, results.spline1$zval, 
  results.spline1$pval),3))

names(spline1.consc) <- c("*b*", "*SE*", "*z*", "*p*")
row.names(spline1.consc) <- c("Intercept", "Age.1-40", 
                              "Age.40>", "Time lag")

kable(spline1.consc
      , caption="**Best-fitting model with age and time lag for conscientiousness**"
      , escape=FALSE
      , label = NA) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Best-fitting model with age and time lag for conscientiousness
b SE z p
Intercept -1.760 0.047 -37.785 0.000
Age.1-40 -0.013 0.002 -6.252 0.001
Age.40> -0.001 0.002 -0.250 0.826
Time lag 0.020 0.008 2.578 0.071
## Compute models with age only (for separate R2 values)
meta.spline1_age <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2,
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_consc, sparse = TRUE)
sigma_spline1.level1_consc_age <- meta.spline1_age$sigma2[1]
sigma_spline1.level2_consc_age <- meta.spline1_age$sigma2[2]

## Compute models with time lag only (for separate R2 values)
meta.spline1_lag <- rma.mv(yi = ES, V = V_consc, mods = ~ T2_lag.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_consc, sparse = TRUE)
sigma_spline1.level1_consc_lag <- meta.spline1_lag$sigma2[1]
sigma_spline1.level2_consc_lag <- meta.spline1_lag$sigma2[2]

## R2 in model with time lag and age
r2.level1 <- round((sigma_base.level1_consc - sigma_spline1.level1_consc)/sigma_base.level1_consc,2)
r2.level1 <- ifelse(r2.level1 < 0, 0, r2.level1)

r2.level2 <- round((sigma_base.level2_consc - sigma_spline1.level2_consc)/sigma_base.level2_consc,2)
r2.level2 <- ifelse(r2.level2 < 0, 0, r2.level2)

r2 <- round(as.data.frame(rbind(c(sigma_spline1.level1_consc, sigma_base.level1_consc, r2.level1), c(sigma_spline1.level2_consc, sigma_base.level2_consc, r2.level2))),5)

## R2 in model with age only
r2.level1_age <- round((sigma_base.level1_consc - sigma_spline1.level1_consc_age)/sigma_base.level1_consc,2)
r2.level1_age <- ifelse(r2.level1_age < 0, 0, r2.level1_age)

r2.level2_age <- round((sigma_base.level2_consc - sigma_spline1.level2_consc_age)/sigma_base.level2_consc,2)
r2.level2_age <- ifelse(r2.level2_age < 0, 0, r2.level2_age)

r2_age <- round(as.data.frame(rbind(c(sigma_spline1.level1_consc_age, sigma_base.level1_consc, r2.level1_age), c(sigma_spline1.level2_consc_age, sigma_base.level2_consc, r2.level2_age))),5)

## R2 in model with time lag only
r2.level1_lag <- round((sigma_base.level1_consc - sigma_spline1.level1_consc_lag)/sigma_base.level1_consc,2)
r2.level1_lag <- ifelse(r2.level1_lag < 0, 0, r2.level1_lag)

r2.level2_lag <- round((sigma_base.level2_consc - sigma_spline1.level2_consc_lag)/sigma_base.level2_consc,2)
r2.level2_lag <- ifelse(r2.level2_lag < 0, 0, r2.level2_lag)

r2_lag <- round(as.data.frame(rbind(c(sigma_spline1.level1_consc_lag, sigma_base.level1_consc, r2.level1_lag), c(sigma_spline1.level2_consc_lag, sigma_base.level2_consc, r2.level2_lag))),5)

## Combine values in one table
r2_all <- rbind(r2, r2_age, r2_lag)
r2_all$Level <- rep(c("Level 1", "Level 2"), 3)
names(r2_all) <- c("Sigma Moderator", "Sigma Baseline", "R^2^", "Level")

r2_all <- select(r2_all, Level, everything())

kable(r2_all
      , caption="**R^2^ of models**"
      , escape=FALSE
      , label = NA
      , digits = 3) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left") %>% 
  pack_rows(index = c("Age and time lag" = 2, "Age only" = 2, "Time lag only" = 2))
R2 of models
Level Sigma Moderator Sigma Baseline R2
Age and time lag
Level 1 0.032 0.035 0.06
Level 2 0.090 0.112 0.20
Age only
Level 1 0.033 0.035 0.04
Level 2 0.096 0.112 0.14
Time lag only
Level 1 0.034 0.035 0.02
Level 2 0.108 0.112 0.03

Plot: Age

Note: You can hover over the data points to receive more information.

pred <- data.frame(Age = 1:80,
                   SD = NA, 
                   CI.lower = NA,
                   CI.upper = NA) 

for (i in 1:80) {
  pred$SD[i] <- predict(results.spline1, 
                   newmods=c(ifelse(i <= 40, i, 40), 
                             ifelse(i > 40,i - 40, 0),0), 
                   transf=exp, addx=TRUE)$pred
  pred$CI.lower[i] <- predict(results.spline1, 
                   newmods=c(ifelse(i <= 40, i, 40), 
                             ifelse(i > 40,i - 40, 0),0), 
                        transf=exp, addx=TRUE)$ci.lb
  pred$CI.upper[i] <- predict(results.spline1, 
                   newmods=c(ifelse(i <= 40, i, 40), 
                             ifelse(i > 40,i - 40, 0),0), 
                              transf=exp, addx=TRUE)$ci.ub
}

pred$Type <- "pred"
observed <- select(data_consc, Age = T1_AgeM, ES = ES, N = T1_N) %>% ungroup() %>% 
  mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)

plot <- ggplot(data = total, aes(x = Age, y = SD)) +
  geom_point_interactive(data = subset(total, Type == "observed"), 
                         aes(size = N, tooltip = paste0("SD = ", round(SD,3), 
                                                        ", N = ", N, 
                                                        ", StudyID = ", StudyID), 
                             data_id = ID), 
                         shape = 5, color = "grey") +
  geom_errorbar(data = subset(total, Type == "pred"), 
                aes(ymin = CI.lower, ymax = CI.upper),
                color = "black", width = 0) +
  geom_point_interactive(data = subset(total, Type == "pred"), 
                         aes(tooltip = 
                               paste0("SD = ", round(SD,3), 
                                      ", 95% CI = [", round(CI.lower,3),
                                      ", ", round(CI.upper,3), "]"), 
                             data_id = ID)) +
  scale_y_continuous(limits = c(0, 0.40)) +
  scale_x_continuous(limits = c(0, 80), breaks = c(0,10,20,30,40,50,60,70,80)) +
  labs(y = expression(bold("SD"[POMP])), title = "Conscientiousness") +
  theme_pub() +
  theme(legend.position = "none")


girafe(ggobj = plot)

Plot: Time

Note: You can hover over the data points to receive more information.

pred <- data.frame(Time = seq(from = 0.5, to = 10, by = 0.25),
                   SD = NA, 
                   CI.lower = NA,
                   CI.upper = NA) 

for (i in 1:nrow(pred)) {
  pred$SD[i] <- predict(results.spline1, 
                   newmods=c(20, 0 , pred$Time[i]), 
                   transf=exp, addx=TRUE)$pred
  pred$CI.lower[i] <- predict(results.spline1, 
                              newmods=c(20, 0 , pred$Time[i]), 
                        transf=exp, addx=TRUE)$ci.lb
  pred$CI.upper[i] <- predict(results.spline1, 
                              newmods=c(20, 0 , pred$Time[i]), 
                              transf=exp, addx=TRUE)$ci.ub
}

pred$Type <- "pred"
observed <- select(data_agree, Time = T2_lag, ES = ES, N = T1_N) %>% ungroup() %>% 
  mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)

plot <- ggplot(data = total, aes(x = Time, y = SD)) +
  geom_point_interactive(data = subset(total, Type == "observed"), 
                         aes(size = N, tooltip = paste0("SD = ", round(SD,3), 
                                                        ", N = ", N, 
                                                        ", StudyID = ", StudyID), 
                             data_id = ID), 
                         shape = 5, color = "grey") +
  geom_errorbar(data = subset(total, Type == "pred"), 
                aes(ymin = CI.lower, ymax = CI.upper),
                color = "black", width = 0) +
  geom_point_interactive(data = subset(total, Type == "pred"), 
                         aes(tooltip = 
                               paste0("SD = ", round(SD,3), 
                                      ", 95% CI = [", round(CI.lower,3),
                                      ", ", round(CI.upper,3), "]"), 
                             data_id = ID)) +
  scale_y_continuous(limits = c(0, 0.40)) +
  scale_x_continuous(limits = c(0, 10), breaks = c(0,1,2,3,4,5,6,7,8,9,10)) +
  labs(y = expression(bold("SD"[POMP])), title = "Conscientiousness") +
  theme_pub() +
  theme(legend.position = "none")


girafe(ggobj = plot)

Second-Best

Model with two age-related variables: Age 1-30 and Age 30>

Table

## Create age bins
data_consc$abin_1  <- ifelse(data_consc$T1_AgeM <= 30, data_consc$T1_AgeM, 30)
data_consc$abin_2  <- ifelse(data_consc$T1_AgeM > 30, data_consc$T1_AgeM - 30, 0)  

## Spline approach of best-fitting model
meta.spline2 <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 + T2_lag.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_consc, sparse = TRUE)
sigma_spline2.level1_consc <- meta.spline2$sigma2[1]
sigma_spline2.level2_consc <- meta.spline2$sigma2[2]
results.spline2 <- robust(meta.spline2, cluster = StudyID, clubSandwich = TRUE) 

spline2.consc <- as.data.frame(round(cbind(results.spline2$b, results.spline2$se, results.spline2$zval, 
  results.spline2$pval),3))

names(spline2.consc) <- c("*b*", "*SE*", "*z*", "*p*")
row.names(spline2.consc) <- c("Intercept", "Age.1-30",
                              "Age.30>", "Time lag")

kable(spline2.consc
      , caption="**Second-best model with age and time lag for conscientiousness**"
      , escape=FALSE
      , label = NA) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Second-best model with age and time lag for conscientiousness
b SE z p
Intercept -1.717 0.057 -30.352 0.000
Age.1-30 -0.016 0.003 -5.526 0.000
Age.30> -0.002 0.002 -1.594 0.246
Time lag 0.020 0.008 2.578 0.070
## Compute models with age only (for separate R2 values)
meta.spline2_age <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2,
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_consc, sparse = TRUE)
sigma_spline2.level1_consc_age <- meta.spline2_age$sigma2[1]
sigma_spline2.level2_consc_age <- meta.spline2_age$sigma2[2]

## Compute models with time lag only (for separate R2 values)
meta.spline2_lag <- rma.mv(yi = ES, V = V_consc, mods = ~ T2_lag.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_consc, sparse = TRUE)
sigma_spline2.level1_consc_lag <- meta.spline2_lag$sigma2[1]
sigma_spline2.level2_consc_lag <- meta.spline2_lag$sigma2[2]

## R2 in model with time lag and age
r2.level1 <- round((sigma_base.level1_consc - sigma_spline2.level1_consc)/sigma_base.level1_consc,2)
r2.level1 <- ifelse(r2.level1 < 0, 0, r2.level1)

r2.level2 <- round((sigma_base.level2_consc - sigma_spline2.level2_consc)/sigma_base.level2_consc,2)
r2.level2 <- ifelse(r2.level2 < 0, 0, r2.level2)

r2 <- round(as.data.frame(rbind(c(sigma_spline2.level1_consc, sigma_base.level1_consc, r2.level1), c(sigma_spline2.level2_consc, sigma_base.level2_consc, r2.level2))),5)

## R2 in model with age only
r2.level1_age <- round((sigma_base.level1_consc - sigma_spline2.level1_consc_age)/sigma_base.level1_consc,2)
r2.level1_age <- ifelse(r2.level1_age < 0, 0, r2.level1_age)

r2.level2_age <- round((sigma_base.level2_consc - sigma_spline2.level2_consc_age)/sigma_base.level2_consc,2)
r2.level2_age <- ifelse(r2.level2_age < 0, 0, r2.level2_age)

r2_age <- round(as.data.frame(rbind(c(sigma_spline2.level1_consc_age, sigma_base.level1_consc, r2.level1_age), c(sigma_spline2.level2_consc_age, sigma_base.level2_consc, r2.level2_age))),5)

## R2 in model with time lag only
r2.level1_lag <- round((sigma_base.level1_consc - sigma_spline2.level1_consc_lag)/sigma_base.level1_consc,2)
r2.level1_lag <- ifelse(r2.level1_lag < 0, 0, r2.level1_lag)

r2.level2_lag <- round((sigma_base.level2_consc - sigma_spline2.level2_consc_lag)/sigma_base.level2_consc,2)
r2.level2_lag <- ifelse(r2.level2_lag < 0, 0, r2.level2_lag)

r2_lag <- round(as.data.frame(rbind(c(sigma_spline2.level1_consc_lag, sigma_base.level1_consc, r2.level1_lag), c(sigma_spline2.level2_consc_lag, sigma_base.level2_consc, r2.level2_lag))),5)

## Combine values in one table
r2_all <- rbind(r2, r2_age, r2_lag)
r2_all$Level <- rep(c("Level 1", "Level 2"), 3)
names(r2_all) <- c("Sigma Moderator", "Sigma Baseline", "R^2^", "Level")

r2_all <- select(r2_all, Level, everything())

kable(r2_all
      , caption="**R^2^ of models**"
      , escape=FALSE
      , label = NA
      , digits = 3) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left") %>% 
  pack_rows(index = c("Age and time lag" = 2, "Age only" = 2, "Time lag only" = 2))
R2 of models
Level Sigma Moderator Sigma Baseline R2
Age and time lag
Level 1 0.032 0.035 0.07
Level 2 0.092 0.112 0.18
Age only
Level 1 0.033 0.035 0.04
Level 2 0.098 0.112 0.12
Time lag only
Level 1 0.034 0.035 0.02
Level 2 0.108 0.112 0.03

Plot: Age

Note: You can hover over the data points to receive more information.

pred <- data.frame(Age = 1:80,
                   SD = NA, 
                   CI.lower = NA,
                   CI.upper = NA) 

for (i in 1:80) {
  pred$SD[i] <- predict(results.spline2, 
                   newmods=c(ifelse(i <= 30, i, 30), 
                             ifelse(i > 30,i - 30, 0),0), 
                   transf=exp, addx=TRUE)$pred
  pred$CI.lower[i] <- predict(results.spline2, 
                   newmods=c(ifelse(i <= 30, i, 30), 
                             ifelse(i > 30,i - 30, 0),0), 
                        transf=exp, addx=TRUE)$ci.lb
  pred$CI.upper[i] <- predict(results.spline2, 
                   newmods=c(ifelse(i <= 30, i, 30), 
                             ifelse(i > 30,i - 30, 0),0), 
                              transf=exp, addx=TRUE)$ci.ub
}

pred$Type <- "pred"
observed <- select(data_consc, Age = T1_AgeM, ES = ES, N = T1_N) %>% ungroup() %>% 
  mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)

plot <- ggplot(data = total, aes(x = Age, y = SD)) +
  geom_point_interactive(data = subset(total, Type == "observed"), 
                         aes(size = N, tooltip = paste0("SD = ", round(SD,3), 
                                                        ", N = ", N, 
                                                        ", StudyID = ", StudyID), 
                             data_id = ID), 
                         shape = 5, color = "grey") +
  geom_errorbar(data = subset(total, Type == "pred"), 
                aes(ymin = CI.lower, ymax = CI.upper),
                color = "black", width = 0) +
  geom_point_interactive(data = subset(total, Type == "pred"), 
                         aes(tooltip = 
                               paste0("SD = ", round(SD,3), 
                                      ", 95% CI = [", round(CI.lower,3),
                                      ", ", round(CI.upper,3), "]"), 
                             data_id = ID)) +
  scale_y_continuous(limits = c(0, 0.40)) +
  scale_x_continuous(limits = c(0, 80), breaks = c(0,10,20,30,40,50,60,70,80)) +
  labs(y = expression(bold("SD"[POMP])), title = "Conscientiousness") +
  theme_pub() +
  theme(legend.position = "none")


girafe(ggobj = plot)

Plot: Time

Note: You can hover over the data points to receive more information.

pred <- data.frame(Time = seq(from = 0.5, to = 10, by = 0.25),
                   SD = NA, 
                   CI.lower = NA,
                   CI.upper = NA) 

for (i in 1:nrow(pred)) {
  pred$SD[i] <- predict(results.spline2, 
                   newmods=c(20, 0 , pred$Time[i]), 
                   transf=exp, addx=TRUE)$pred
  pred$CI.lower[i] <- predict(results.spline2, 
                              newmods=c(20, 0 , pred$Time[i]), 
                        transf=exp, addx=TRUE)$ci.lb
  pred$CI.upper[i] <- predict(results.spline2, 
                              newmods=c(20, 0 , pred$Time[i]), 
                              transf=exp, addx=TRUE)$ci.ub
}

pred$Type <- "pred"
observed <- select(data_agree, Time = T2_lag, ES = ES, N = T1_N) %>% ungroup() %>% 
  mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)

plot <- ggplot(data = total, aes(x = Time, y = SD)) +
  geom_point_interactive(data = subset(total, Type == "observed"), 
                         aes(size = N, tooltip = paste0("SD = ", round(SD,3), 
                                                        ", N = ", N, 
                                                        ", StudyID = ", StudyID), 
                             data_id = ID), 
                         shape = 5, color = "grey") +
  geom_errorbar(data = subset(total, Type == "pred"), 
                aes(ymin = CI.lower, ymax = CI.upper),
                color = "black", width = 0) +
  geom_point_interactive(data = subset(total, Type == "pred"), 
                         aes(tooltip = 
                               paste0("SD = ", round(SD,3), 
                                      ", 95% CI = [", round(CI.lower,3),
                                      ", ", round(CI.upper,3), "]"), 
                             data_id = ID)) +
  scale_y_continuous(limits = c(0, 0.40)) +
  scale_x_continuous(limits = c(0, 10), breaks = c(0,1,2,3,4,5,6,7,8,9,10)) +
  labs(y = expression(bold("SD"[POMP])), title = "Conscientiousness") +
  theme_pub() +
  theme(legend.position = "none")


girafe(ggobj = plot)

Extraversion

Best Model

Model with two age-related variables: Age 1-55 and Age 55>

Table

## Create age bins
data_extra$abin_1  <- ifelse(data_extra$T1_AgeM <= 55, data_extra$T1_AgeM, 55)
data_extra$abin_2  <- ifelse(data_extra$T1_AgeM > 55, data_extra$T1_AgeM - 55, 0) 

## Spline approach of best-fitting model
meta.spline1 <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 + T2_lag.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_extra, sparse = TRUE)
sigma_spline1.level1_extra <- meta.spline1$sigma2[1]
sigma_spline1.level2_extra <- meta.spline1$sigma2[2]
results.spline1 <- robust(meta.spline1, cluster = StudyID, clubSandwich = TRUE) 

spline1.extra <- as.data.frame(round(cbind(results.spline1$b, results.spline1$se, results.spline1$zval, 
  results.spline1$pval),3))

names(spline1.extra) <- c("*b*", "*SE*", "*z*", "*p*")
row.names(spline1.extra) <- c("Intercept", "Age.1-55", 
                              "Age.55>", "Time lag")

kable(spline1.extra
      , caption="**Best-fitting model with age and time lag for extraversion**"
      , escape=FALSE
      , label = NA) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Best-fitting model with age and time lag for extraversion
b SE z p
Intercept -1.853 0.038 -49.159 0.000
Age.1-55 -0.008 0.001 -7.859 0.000
Age.55> 0.004 0.003 1.407 0.284
Time lag 0.018 0.002 8.479 0.001
## Compute models with age only (for separate R2 values)
meta.spline1_age <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2,
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_extra, sparse = TRUE)
sigma_spline1.level1_extra_age <- meta.spline1_age$sigma2[1]
sigma_spline1.level2_extra_age <- meta.spline1_age$sigma2[2]

## Compute models with time lag only (for separate R2 values)
meta.spline1_lag <- rma.mv(yi = ES, V = V_extra, mods = ~ T2_lag.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_extra, sparse = TRUE)
sigma_spline1.level1_extra_lag <- meta.spline1_lag$sigma2[1]
sigma_spline1.level2_extra_lag <- meta.spline1_lag$sigma2[2]

## R2 in model with time lag and age
r2.level1 <- round((sigma_base.level1_extra - sigma_spline1.level1_extra)/sigma_base.level1_extra,2)
r2.level1 <- ifelse(r2.level1 < 0, 0, r2.level1)

r2.level2 <- round((sigma_base.level2_extra - sigma_spline1.level2_extra)/sigma_base.level2_extra,2)
r2.level2 <- ifelse(r2.level2 < 0, 0, r2.level2)

r2 <- round(as.data.frame(rbind(c(sigma_spline1.level1_extra, sigma_base.level1_extra, r2.level1), c(sigma_spline1.level2_extra, sigma_base.level2_extra, r2.level2))),5)

## R2 in model with age only
r2.level1_age <- round((sigma_base.level1_extra - sigma_spline1.level1_extra_age)/sigma_base.level1_extra,2)
r2.level1_age <- ifelse(r2.level1_age < 0, 0, r2.level1_age)

r2.level2_age <- round((sigma_base.level2_extra - sigma_spline1.level2_extra_age)/sigma_base.level2_extra,2)
r2.level2_age <- ifelse(r2.level2_age < 0, 0, r2.level2_age)

r2_age <- round(as.data.frame(rbind(c(sigma_spline1.level1_extra_age, sigma_base.level1_extra, r2.level1_age), c(sigma_spline1.level2_extra_age, sigma_base.level2_extra, r2.level2_age))),5)

## R2 in model with time lag only
r2.level1_lag <- round((sigma_base.level1_extra - sigma_spline1.level1_extra_lag)/sigma_base.level1_extra,2)
r2.level1_lag <- ifelse(r2.level1_lag < 0, 0, r2.level1_lag)

r2.level2_lag <- round((sigma_base.level2_extra - sigma_spline1.level2_extra_lag)/sigma_base.level2_extra,2)
r2.level2_lag <- ifelse(r2.level2_lag < 0, 0, r2.level2_lag)

r2_lag <- round(as.data.frame(rbind(c(sigma_spline1.level1_extra_lag, sigma_base.level1_extra, r2.level1_lag), c(sigma_spline1.level2_extra_lag, sigma_base.level2_extra, r2.level2_lag))),5)

## Combine values in one table
r2_all <- rbind(r2, r2_age, r2_lag)
r2_all$Level <- rep(c("Level 1", "Level 2"), 3)
names(r2_all) <- c("Sigma Moderator", "Sigma Baseline", "R^2^", "Level")

r2_all <- select(r2_all, Level, everything())

kable(r2_all
      , caption="**R^2^ of models**"
      , escape=FALSE
      , label = NA
      , digits = 3) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left") %>% 
  pack_rows(index = c("Age and time lag" = 2, "Age only" = 2, "Time lag only" = 2))
R2 of models
Level Sigma Moderator Sigma Baseline R2
Age and time lag
Level 1 0.023 0.024 0.06
Level 2 0.081 0.110 0.26
Age only
Level 1 0.023 0.024 0.06
Level 2 0.098 0.110 0.10
Time lag only
Level 1 0.024 0.024 0.00
Level 2 0.097 0.110 0.11

Plot: Age

Note: You can hover over the data points to receive more information.

pred <- data.frame(Age = 1:80,
                   SD = NA, 
                   CI.lower = NA,
                   CI.upper = NA) 

for (i in 1:80) {
  pred$SD[i] <- predict(results.spline1, 
                   newmods=c(ifelse(i <= 55, i, 55), 
                             ifelse(i > 55,i - 55, 0),0), 
                   transf=exp, addx=TRUE)$pred
  pred$CI.lower[i] <- predict(results.spline1, 
                   newmods=c(ifelse(i <= 55, i, 55), 
                             ifelse(i > 55,i - 55, 0),0), 
                        transf=exp, addx=TRUE)$ci.lb
  pred$CI.upper[i] <- predict(results.spline1, 
                   newmods=c(ifelse(i <= 55, i, 55), 
                             ifelse(i > 55,i - 55, 0),0), 
                              transf=exp, addx=TRUE)$ci.ub
}

pred$Type <- "pred"
observed <- select(data_extra, Age = T1_AgeM, ES = ES, N = T1_N) %>% ungroup() %>% 
  mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)

plot <- ggplot(data = total, aes(x = Age, y = SD)) +
  geom_point_interactive(data = subset(total, Type == "observed"), 
                         aes(size = N, tooltip = paste0("SD = ", round(SD,3), 
                                                        ", N = ", N, 
                                                        ", StudyID = ", StudyID), 
                             data_id = ID), 
                         shape = 5, color = "grey") +
  geom_errorbar(data = subset(total, Type == "pred"), 
                aes(ymin = CI.lower, ymax = CI.upper),
                color = "black", width = 0) +
  geom_point_interactive(data = subset(total, Type == "pred"), 
                         aes(tooltip = 
                               paste0("SD = ", round(SD,3), 
                                      ", 95% CI = [", round(CI.lower,3),
                                      ", ", round(CI.upper,3), "]"), 
                             data_id = ID)) +
  scale_y_continuous(limits = c(0, 0.40)) +
  scale_x_continuous(limits = c(0, 80), breaks = c(0,10,20,30,40,50,60,70,80)) +
  labs(y = expression(bold("SD"[POMP])), title = "Extraversion") +
  theme_pub() +
  theme(legend.position = "none")


girafe(ggobj = plot)

Plot: Time

Note: You can hover over the data points to receive more information.

pred <- data.frame(Time = seq(from = 0.5, to = 10, by = 0.25),
                   SD = NA, 
                   CI.lower = NA,
                   CI.upper = NA) 

for (i in 1:nrow(pred)) {
  pred$SD[i] <- predict(results.spline1, 
                   newmods=c(20, 0 , pred$Time[i]), 
                   transf=exp, addx=TRUE)$pred
  pred$CI.lower[i] <- predict(results.spline1, 
                              newmods=c(20, 0 , pred$Time[i]), 
                        transf=exp, addx=TRUE)$ci.lb
  pred$CI.upper[i] <- predict(results.spline1, 
                              newmods=c(20, 0 , pred$Time[i]), 
                              transf=exp, addx=TRUE)$ci.ub
}

pred$Type <- "pred"
observed <- select(data_agree, Time = T2_lag, ES = ES, N = T1_N) %>% ungroup() %>% 
  mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)

plot <- ggplot(data = total, aes(x = Time, y = SD)) +
  geom_point_interactive(data = subset(total, Type == "observed"), 
                         aes(size = N, tooltip = paste0("SD = ", round(SD,3), 
                                                        ", N = ", N, 
                                                        ", StudyID = ", StudyID), 
                             data_id = ID), 
                         shape = 5, color = "grey") +
  geom_errorbar(data = subset(total, Type == "pred"), 
                aes(ymin = CI.lower, ymax = CI.upper),
                color = "black", width = 0) +
  geom_point_interactive(data = subset(total, Type == "pred"), 
                         aes(tooltip = 
                               paste0("SD = ", round(SD,3), 
                                      ", 95% CI = [", round(CI.lower,3),
                                      ", ", round(CI.upper,3), "]"), 
                             data_id = ID)) +
  scale_y_continuous(limits = c(0, 0.40)) +
  scale_x_continuous(limits = c(0, 10), breaks = c(0,1,2,3,4,5,6,7,8,9,10)) +
  labs(y = expression(bold("SD"[POMP])), title = "Extraversion") +
  theme_pub() +
  theme(legend.position = "none")


girafe(ggobj = plot)

Second-Best

Model with three age-related variables: Age 1-25, Age 25-75, and Age 75>

Table

## Create age bins
data_extra$abin_1  <- ifelse(data_extra$T1_AgeM <= 25, data_extra$T1_AgeM, 25)
data_extra$abin_2  <- ifelse(data_extra$T1_AgeM <= 75 & data_extra$T1_AgeM > 25, 
                             data_extra$T1_AgeM - 25, 
                             ifelse(data_extra$T1_AgeM <= 25, 0, 75 - 25))
data_extra$abin_3  <- ifelse(data_extra$T1_AgeM > 75, data_extra$T1_AgeM - 75, 0)  
    

## Spline approach of best-fitting model
meta.spline2 <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 + abin_3 + T2_lag.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_extra, sparse = TRUE)
sigma_spline2.level1_extra <- meta.spline2$sigma2[1]
sigma_spline2.level2_extra <- meta.spline2$sigma2[2]
results.spline2 <- robust(meta.spline2, cluster = StudyID, clubSandwich = TRUE) 

spline2.extra <- as.data.frame(round(cbind(results.spline2$b, results.spline2$se, results.spline2$zval, 
  results.spline2$pval),3))

names(spline2.extra) <- c("*b*", "*SE*", "*z*", "*p*")
row.names(spline2.extra) <- c("Intercept", "Age.1-25", "Age.25-75", 
                              "Age.75>", "Time lag")

kable(spline2.extra
      , caption="**Best-fitting model with age and time lag for extraversion**"
      , escape=FALSE
      , label = NA) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Best-fitting model with age and time lag for extraversion
b SE z p
Intercept -1.740 0.061 -28.321 0.000
Age.1-25 -0.016 0.003 -5.393 0.000
Age.25-75 -0.004 0.001 -4.128 0.034
Age.75> 0.011 0.002 5.579 0.101
Time lag 0.020 0.002 9.920 0.000
## Compute models with age only (for separate R2 values)
meta.spline2_age <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 + abin_3,
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_extra, sparse = TRUE)
sigma_spline2.level1_extra_age <- meta.spline2_age$sigma2[1]
sigma_spline2.level2_extra_age <- meta.spline2_age$sigma2[2]

## Compute models with time lag only (for separate R2 values)
meta.spline2_lag <- rma.mv(yi = ES, V = V_extra, mods = ~ T2_lag.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_extra, sparse = TRUE)
sigma_spline2.level1_extra_lag <- meta.spline2_lag$sigma2[1]
sigma_spline2.level2_extra_lag <- meta.spline2_lag$sigma2[2]

## R2 in model with time lag and age
r2.level1 <- round((sigma_base.level1_extra - sigma_spline2.level1_extra)/sigma_base.level1_extra,2)
r2.level1 <- ifelse(r2.level1 < 0, 0, r2.level1)

r2.level2 <- round((sigma_base.level2_extra - sigma_spline2.level2_extra)/sigma_base.level2_extra,2)
r2.level2 <- ifelse(r2.level2 < 0, 0, r2.level2)

r2 <- round(as.data.frame(rbind(c(sigma_spline2.level1_extra, sigma_base.level1_extra, r2.level1), c(sigma_spline2.level2_extra, sigma_base.level2_extra, r2.level2))),5)

## R2 in model with age only
r2.level1_age <- round((sigma_base.level1_extra - sigma_spline2.level1_extra_age)/sigma_base.level1_extra,2)
r2.level1_age <- ifelse(r2.level1_age < 0, 0, r2.level1_age)

r2.level2_age <- round((sigma_base.level2_extra - sigma_spline2.level2_extra_age)/sigma_base.level2_extra,2)
r2.level2_age <- ifelse(r2.level2_age < 0, 0, r2.level2_age)

r2_age <- round(as.data.frame(rbind(c(sigma_spline2.level1_extra_age, sigma_base.level1_extra, r2.level1_age), c(sigma_spline2.level2_extra_age, sigma_base.level2_extra, r2.level2_age))),5)

## R2 in model with time lag only
r2.level1_lag <- round((sigma_base.level1_extra - sigma_spline2.level1_extra_lag)/sigma_base.level1_extra,2)
r2.level1_lag <- ifelse(r2.level1_lag < 0, 0, r2.level1_lag)

r2.level2_lag <- round((sigma_base.level2_extra - sigma_spline2.level2_extra_lag)/sigma_base.level2_extra,2)
r2.level2_lag <- ifelse(r2.level2_lag < 0, 0, r2.level2_lag)

r2_lag <- round(as.data.frame(rbind(c(sigma_spline2.level1_extra_lag, sigma_base.level1_extra, r2.level1_lag), c(sigma_spline2.level2_extra_lag, sigma_base.level2_extra, r2.level2_lag))),5)

## Combine values in one table
r2_all <- rbind(r2, r2_age, r2_lag)
r2_all$Level <- rep(c("Level 1", "Level 2"), 3)
names(r2_all) <- c("Sigma Moderator", "Sigma Baseline", "R^2^", "Level")

r2_all <- select(r2_all, Level, everything())

kable(r2_all
      , caption="**R^2^ of models**"
      , escape=FALSE
      , label = NA
      , digits = 3) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left") %>% 
  pack_rows(index = c("Age and time lag" = 2, "Age only" = 2, "Time lag only" = 2))
R2 of models
Level Sigma Moderator Sigma Baseline R2
Age and time lag
Level 1 0.022 0.024 0.08
Level 2 0.082 0.110 0.25
Age only
Level 1 0.022 0.024 0.07
Level 2 0.100 0.110 0.09
Time lag only
Level 1 0.024 0.024 0.00
Level 2 0.097 0.110 0.11

Plot: Age

Note: You can hover over the data points to receive more information.

pred <- data.frame(Age = 1:80,
                   SD = NA, 
                   CI.lower = NA,
                   CI.upper = NA) 

for (i in 1:80) {
  pred$SD[i] <- predict(results.spline2, 
                   newmods=c(ifelse(i <= 25, i, 25), 
                             ifelse(i <= 75 & i > 25, i - 25, ifelse(i <= 25, 0, 75 - 25)), 
                             ifelse(i > 75,i - 75, 0),0), 
                   transf=exp, addx=TRUE)$pred
  pred$CI.lower[i] <- predict(results.spline2, 
                   newmods=c(ifelse(i <= 25, i, 25), 
                             ifelse(i <= 75 & i > 25, i - 25, ifelse(i <= 25, 0, 75 - 25)), 
                             ifelse(i > 75,i - 75, 0),0), 
                        transf=exp, addx=TRUE)$ci.lb
  pred$CI.upper[i] <- predict(results.spline2, 
                   newmods=c(ifelse(i <= 25, i, 25), 
                             ifelse(i <= 75 & i > 25, i - 25, ifelse(i <= 25, 0, 75 - 25)), 
                             ifelse(i > 75,i - 75, 0),0), 
                              transf=exp, addx=TRUE)$ci.ub
}

pred$Type <- "pred"
observed <- select(data_extra, Age = T1_AgeM, ES = ES, N = T1_N) %>% ungroup() %>% 
  mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)

plot <- ggplot(data = total, aes(x = Age, y = SD)) +
  geom_point_interactive(data = subset(total, Type == "observed"), 
                         aes(size = N, tooltip = paste0("SD = ", round(SD,3), 
                                                        ", N = ", N, 
                                                        ", StudyID = ", StudyID), 
                             data_id = ID), 
                         shape = 5, color = "grey") +
  geom_errorbar(data = subset(total, Type == "pred"), 
                aes(ymin = CI.lower, ymax = CI.upper),
                color = "black", width = 0) +
  geom_point_interactive(data = subset(total, Type == "pred"), 
                         aes(tooltip = 
                               paste0("SD = ", round(SD,3), 
                                      ", 95% CI = [", round(CI.lower,3),
                                      ", ", round(CI.upper,3), "]"), 
                             data_id = ID)) +
  scale_y_continuous(limits = c(0, 0.40)) +
  scale_x_continuous(limits = c(0, 80), breaks = c(0,10,20,30,40,50,60,70,80)) +
  labs(y = expression(bold("SD"[POMP])), title = "Extraversion") +
  theme_pub() +
  theme(legend.position = "none")


girafe(ggobj = plot)

Plot: Time

Note: You can hover over the data points to receive more information.

pred <- data.frame(Time = seq(from = 0.5, to = 10, by = 0.25),
                   SD = NA, 
                   CI.lower = NA,
                   CI.upper = NA) 

for (i in 1:nrow(pred)) {
  pred$SD[i] <- predict(results.spline2, 
                   newmods=c(20, 0 , 0, pred$Time[i]), 
                   transf=exp, addx=TRUE)$pred
  pred$CI.lower[i] <- predict(results.spline2, 
                              newmods=c(20, 0 , 0, pred$Time[i]), 
                        transf=exp, addx=TRUE)$ci.lb
  pred$CI.upper[i] <- predict(results.spline2, 
                              newmods=c(20, 0 , 0, pred$Time[i]), 
                              transf=exp, addx=TRUE)$ci.ub
}

pred$Type <- "pred"
observed <- select(data_agree, Time = T2_lag, ES = ES, N = T1_N) %>% ungroup() %>% 
  mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)

plot <- ggplot(data = total, aes(x = Time, y = SD)) +
  geom_point_interactive(data = subset(total, Type == "observed"), 
                         aes(size = N, tooltip = paste0("SD = ", round(SD,3), 
                                                        ", N = ", N, 
                                                        ", StudyID = ", StudyID), 
                             data_id = ID), 
                         shape = 5, color = "grey") +
  geom_errorbar(data = subset(total, Type == "pred"), 
                aes(ymin = CI.lower, ymax = CI.upper),
                color = "black", width = 0) +
  geom_point_interactive(data = subset(total, Type == "pred"), 
                         aes(tooltip = 
                               paste0("SD = ", round(SD,3), 
                                      ", 95% CI = [", round(CI.lower,3),
                                      ", ", round(CI.upper,3), "]"), 
                             data_id = ID)) +
  scale_y_continuous(limits = c(0, 0.40)) +
  scale_x_continuous(limits = c(0, 10), breaks = c(0,1,2,3,4,5,6,7,8,9,10)) +
  labs(y = expression(bold("SD"[POMP])), title = "Extraversion") +
  theme_pub() +
  theme(legend.position = "none")


girafe(ggobj = plot)

Neuroticism

Best Model

Model with three age-related variables: Age 1-25, Age 25-75, and Age 75>

Table

## Create age bins
data_neuro$abin_1  <- ifelse(data_neuro$T1_AgeM <= 25, data_neuro$T1_AgeM, 25)
data_neuro$abin_2  <- ifelse(data_neuro$T1_AgeM <= 75 & data_neuro$T1_AgeM > 25, 
                             data_neuro$T1_AgeM - 25, 
                             ifelse(data_neuro$T1_AgeM <= 25, 0, 75 - 25))
data_neuro$abin_3  <- ifelse(data_neuro$T1_AgeM > 75, data_neuro$T1_AgeM - 75, 0)   
    

## Spline approach of best-fitting model
meta.spline1 <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 + T2_lag.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_neuro, sparse = TRUE)
sigma_spline1.level1_neuro <- meta.spline1$sigma2[1]
sigma_spline1.level2_neuro <- meta.spline1$sigma2[2]
results.spline1 <- robust(meta.spline1, cluster = StudyID, clubSandwich = TRUE) 

spline1.neuro <- as.data.frame(round(cbind(results.spline1$b, results.spline1$se, results.spline1$zval, 
  results.spline1$pval),3))

names(spline1.neuro) <- c("*b*", "*SE*", "*z*", "*p*")
row.names(spline1.neuro) <- c("Intercept", "Age.1-25", "Age.25-75", 
                              "Age.75>", "Time lag")

kable(spline1.neuro
      , caption="**Best-fitting model with age and time lag for neuroticism**"
      , escape=FALSE
      , label = NA) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Best-fitting model with age and time lag for neuroticism
b SE z p
Intercept -1.667 0.054 -30.778 0.000
Age.1-25 -0.016 0.003 -4.996 0.000
Age.25-75 -0.004 0.001 -3.471 0.044
Age.75> 0.017 0.005 3.177 0.180
Time lag 0.017 0.002 8.957 0.000
## Compute models with age only (for separate R2 values)
meta.spline1_age <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3,
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_neuro, sparse = TRUE)
sigma_spline1.level1_neuro_age <- meta.spline1_age$sigma2[1]
sigma_spline1.level2_neuro_age <- meta.spline1_age$sigma2[2]

## Compute models with time lag only (for separate R2 values)
meta.spline1_lag <- rma.mv(yi = ES, V = V_neuro, mods = ~ T2_lag.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_neuro, sparse = TRUE)
sigma_spline1.level1_neuro_lag <- meta.spline1_lag$sigma2[1]
sigma_spline1.level2_neuro_lag <- meta.spline1_lag$sigma2[2]

## R2 in model with time lag and age
r2.level1 <- round((sigma_base.level1_neuro - sigma_spline1.level1_neuro)/sigma_base.level1_neuro,2)
r2.level1 <- ifelse(r2.level1 < 0, 0, r2.level1)

r2.level2 <- round((sigma_base.level2_neuro - sigma_spline1.level2_neuro)/sigma_base.level2_neuro,2)
r2.level2 <- ifelse(r2.level2 < 0, 0, r2.level2)

r2 <- round(as.data.frame(rbind(c(sigma_spline1.level1_neuro, sigma_base.level1_neuro, r2.level1), c(sigma_spline1.level2_neuro, sigma_base.level2_neuro, r2.level2))),5)

## R2 in model with age only
r2.level1_age <- round((sigma_base.level1_neuro - sigma_spline1.level1_neuro_age)/sigma_base.level1_neuro,2)
r2.level1_age <- ifelse(r2.level1_age < 0, 0, r2.level1_age)

r2.level2_age <- round((sigma_base.level2_neuro - sigma_spline1.level2_neuro_age)/sigma_base.level2_neuro,2)
r2.level2_age <- ifelse(r2.level2_age < 0, 0, r2.level2_age)

r2_age <- round(as.data.frame(rbind(c(sigma_spline1.level1_neuro_age, sigma_base.level1_neuro, r2.level1_age), c(sigma_spline1.level2_neuro_age, sigma_base.level2_neuro, r2.level2_age))),5)

## R2 in model with time lag only
r2.level1_lag <- round((sigma_base.level1_neuro - sigma_spline1.level1_neuro_lag)/sigma_base.level1_neuro,2)
r2.level1_lag <- ifelse(r2.level1_lag < 0, 0, r2.level1_lag)

r2.level2_lag <- round((sigma_base.level2_neuro - sigma_spline1.level2_neuro_lag)/sigma_base.level2_neuro,2)
r2.level2_lag <- ifelse(r2.level2_lag < 0, 0, r2.level2_lag)

r2_lag <- round(as.data.frame(rbind(c(sigma_spline1.level1_neuro_lag, sigma_base.level1_neuro, r2.level1_lag), c(sigma_spline1.level2_neuro_lag, sigma_base.level2_neuro, r2.level2_lag))),5)

## Combine values in one table
r2_all <- rbind(r2, r2_age, r2_lag)
r2_all$Level <- rep(c("Level 1", "Level 2"), 3)
names(r2_all) <- c("Sigma Moderator", "Sigma Baseline", "R^2^", "Level")

r2_all <- select(r2_all, Level, everything())

kable(r2_all
      , caption="**R^2^ of models**"
      , escape=FALSE
      , label = NA
      , digits = 3) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left") %>% 
  pack_rows(index = c("Age and time lag" = 2, "Age only" = 2, "Time lag only" = 2))
R2 of models
Level Sigma Moderator Sigma Baseline R2
Age and time lag
Level 1 0.032 0.034 0.06
Level 2 0.075 0.088 0.15
Age only
Level 1 0.032 0.034 0.05
Level 2 0.081 0.088 0.08
Time lag only
Level 1 0.033 0.034 0.00
Level 2 0.085 0.088 0.04

Plot: Age

Note: You can hover over the data points to receive more information.

pred <- data.frame(Age = 1:80,
                   SD = NA, 
                   CI.lower = NA,
                   CI.upper = NA) 

for (i in 1:80) {
  pred$SD[i] <- predict(results.spline1, 
                   newmods=c(ifelse(i <= 25, i, 25), 
                             ifelse(i <= 75 & i > 25, i - 25, ifelse(i <= 25, 0, 75 - 25)), 
                             ifelse(i > 75,i - 75, 0),0), 
                   transf=exp, addx=TRUE)$pred
  pred$CI.lower[i] <- predict(results.spline1, 
                   newmods=c(ifelse(i <= 25, i, 25), 
                             ifelse(i <= 75 & i > 25, i - 25, ifelse(i <= 25, 0, 75 - 25)), 
                             ifelse(i > 75,i - 75, 0),0), 
                        transf=exp, addx=TRUE)$ci.lb
  pred$CI.upper[i] <- predict(results.spline1, 
                   newmods=c(ifelse(i <= 25, i, 25), 
                             ifelse(i <= 75 & i > 25, i - 25, ifelse(i <= 25, 0, 75 - 25)), 
                             ifelse(i > 75,i - 75, 0),0), 
                              transf=exp, addx=TRUE)$ci.ub
}

pred$Type <- "pred"
observed <- select(data_neuro, Age = T1_AgeM, ES = ES, N = T1_N) %>% ungroup() %>% 
  mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)

plot <- ggplot(data = total, aes(x = Age, y = SD)) +
  geom_point_interactive(data = subset(total, Type == "observed"), 
                         aes(size = N, tooltip = paste0("SD = ", round(SD,3), 
                                                        ", N = ", N, 
                                                        ", StudyID = ", StudyID), 
                             data_id = ID), 
                         shape = 5, color = "grey") +
  geom_errorbar(data = subset(total, Type == "pred"), 
                aes(ymin = CI.lower, ymax = CI.upper),
                color = "black", width = 0) +
  geom_point_interactive(data = subset(total, Type == "pred"), 
                         aes(tooltip = 
                               paste0("SD = ", round(SD,3), 
                                      ", 95% CI = [", round(CI.lower,3),
                                      ", ", round(CI.upper,3), "]"), 
                             data_id = ID)) +
  scale_y_continuous(limits = c(0, 0.40)) +
  scale_x_continuous(limits = c(0, 80), breaks = c(0,10,20,30,40,50,60,70,80)) +
  labs(y = expression(bold("SD"[POMP])), title = "Neuroticism") +
  theme_pub() +
  theme(legend.position = "none")


girafe(ggobj = plot)

Plot: Time

Note: You can hover over the data points to receive more information.

pred <- data.frame(Time = seq(from = 0.5, to = 10, by = 0.25),
                   SD = NA, 
                   CI.lower = NA,
                   CI.upper = NA) 

for (i in 1:nrow(pred)) {
  pred$SD[i] <- predict(results.spline1, 
                   newmods=c(20, 0 , 0, pred$Time[i]), 
                   transf=exp, addx=TRUE)$pred
  pred$CI.lower[i] <- predict(results.spline1, 
                              newmods=c(20, 0 , 0, pred$Time[i]), 
                        transf=exp, addx=TRUE)$ci.lb
  pred$CI.upper[i] <- predict(results.spline1, 
                              newmods=c(20, 0 , 0, pred$Time[i]), 
                              transf=exp, addx=TRUE)$ci.ub
}

pred$Type <- "pred"
observed <- select(data_agree, Time = T2_lag, ES = ES, N = T1_N) %>% ungroup() %>% 
  mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)

plot <- ggplot(data = total, aes(x = Time, y = SD)) +
  geom_point_interactive(data = subset(total, Type == "observed"), 
                         aes(size = N, tooltip = paste0("SD = ", round(SD,3), 
                                                        ", N = ", N, 
                                                        ", StudyID = ", StudyID), 
                             data_id = ID), 
                         shape = 5, color = "grey") +
  geom_errorbar(data = subset(total, Type == "pred"), 
                aes(ymin = CI.lower, ymax = CI.upper),
                color = "black", width = 0) +
  geom_point_interactive(data = subset(total, Type == "pred"), 
                         aes(tooltip = 
                               paste0("SD = ", round(SD,3), 
                                      ", 95% CI = [", round(CI.lower,3),
                                      ", ", round(CI.upper,3), "]"), 
                             data_id = ID)) +
  scale_y_continuous(limits = c(0, 0.40)) +
  scale_x_continuous(limits = c(0, 10), breaks = c(0,1,2,3,4,5,6,7,8,9,10)) +
  labs(y = expression(bold("SD"[POMP])), title = "Neuroticism") +
  theme_pub() +
  theme(legend.position = "none")


girafe(ggobj = plot)

Second-Best

Model with four age-related variables: Age 1-15, Age 15-20, Age 20-75, and Age 75+

Table

## Create age bins
data_neuro$abin_1  <- ifelse(data_neuro$T1_AgeM <= 15, data_neuro$T1_AgeM, 15)
data_neuro$abin_2  <- ifelse(data_neuro$T1_AgeM <= 20 & data_neuro$T1_AgeM > 15, 
                             data_neuro$T1_AgeM - 15, 
                             ifelse(data_neuro$T1_AgeM <= 15, 0, 20 - 15))
data_neuro$abin_3  <- ifelse(data_neuro$T1_AgeM <= 75 & data_neuro$T1_AgeM > 20, 
                             data_neuro$T1_AgeM - 20, 
                             ifelse(data_neuro$T1_AgeM <= 20, 0, 75 - 20))
data_neuro$abin_4  <- ifelse(data_neuro$T1_AgeM > 75, data_neuro$T1_AgeM - 75, 0) 

## Spline approach of best-fitting model
meta.spline2 <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 + abin_4 + T2_lag.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_neuro, sparse = TRUE)
sigma_spline2.level1_neuro <- meta.spline2$sigma2[1]
sigma_spline2.level2_neuro <- meta.spline2$sigma2[2]
results.spline2 <- robust(meta.spline2, cluster = StudyID, clubSandwich = TRUE) 

spline2.neuro <- as.data.frame(round(cbind(results.spline2$b, results.spline2$se, results.spline2$zval, 
  results.spline2$pval),3))

names(spline2.neuro) <- c("*b*", "*SE*", "*z*", "*p*")
row.names(spline2.neuro) <- c("Intercept", "Age.1-15", "Age.15-20", 
                              "Age.20-75", 
                              "Age.75>", "Time lag")

kable(spline2.neuro
      , caption="**Second-best model with age and time lag for neuroticism**"
      , escape=FALSE
      , label = NA) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Second-best model with age and time lag for neuroticism
b SE z p
Intercept -1.739 0.064 -27.391 0.000
Age.1-15 -0.008 0.005 -1.684 0.102
Age.15-20 -0.039 0.009 -4.112 0.000
Age.20-75 -0.004 0.001 -3.659 0.034
Age.75> 0.017 0.005 3.192 0.179
Time lag 0.018 0.002 8.389 0.000
## Compute models with age only (for separate R2 values)
meta.spline2_age <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 + abin_4,
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_neuro, sparse = TRUE)
sigma_spline2.level1_neuro_age <- meta.spline2_age$sigma2[1]
sigma_spline2.level2_neuro_age <- meta.spline2_age$sigma2[2]

## Compute models with time lag only (for separate R2 values)
meta.spline2_lag <- rma.mv(yi = ES, V = V_neuro, mods = ~ T2_lag.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_neuro, sparse = TRUE)
sigma_spline2.level1_neuro_lag <- meta.spline2_lag$sigma2[1]
sigma_spline2.level2_neuro_lag <- meta.spline2_lag$sigma2[2]

## R2 in model with time lag and age
r2.level1 <- round((sigma_base.level1_neuro - sigma_spline2.level1_neuro)/sigma_base.level1_neuro,2)
r2.level1 <- ifelse(r2.level1 < 0, 0, r2.level1)

r2.level2 <- round((sigma_base.level2_neuro - sigma_spline2.level2_neuro)/sigma_base.level2_neuro,2)
r2.level2 <- ifelse(r2.level2 < 0, 0, r2.level2)

r2 <- round(as.data.frame(rbind(c(sigma_spline2.level1_neuro, sigma_base.level1_neuro, r2.level1), c(sigma_spline2.level2_neuro, sigma_base.level2_neuro, r2.level2))),5)

## R2 in model with age only
r2.level1_age <- round((sigma_base.level1_neuro - sigma_spline2.level1_neuro_age)/sigma_base.level1_neuro,2)
r2.level1_age <- ifelse(r2.level1_age < 0, 0, r2.level1_age)

r2.level2_age <- round((sigma_base.level2_neuro - sigma_spline2.level2_neuro_age)/sigma_base.level2_neuro,2)
r2.level2_age <- ifelse(r2.level2_age < 0, 0, r2.level2_age)

r2_age <- round(as.data.frame(rbind(c(sigma_spline2.level1_neuro_age, sigma_base.level1_neuro, r2.level1_age), c(sigma_spline2.level2_neuro_age, sigma_base.level2_neuro, r2.level2_age))),5)

## R2 in model with time lag only
r2.level1_lag <- round((sigma_base.level1_neuro - sigma_spline2.level1_neuro_lag)/sigma_base.level1_neuro,2)
r2.level1_lag <- ifelse(r2.level1_lag < 0, 0, r2.level1_lag)

r2.level2_lag <- round((sigma_base.level2_neuro - sigma_spline2.level2_neuro_lag)/sigma_base.level2_neuro,2)
r2.level2_lag <- ifelse(r2.level2_lag < 0, 0, r2.level2_lag)

r2_lag <- round(as.data.frame(rbind(c(sigma_spline2.level1_neuro_lag, sigma_base.level1_neuro, r2.level1_lag), c(sigma_spline2.level2_neuro_lag, sigma_base.level2_neuro, r2.level2_lag))),5)

## Combine values in one table
r2_all <- rbind(r2, r2_age, r2_lag)
r2_all$Level <- rep(c("Level 1", "Level 2"), 3)
names(r2_all) <- c("Sigma Moderator", "Sigma Baseline", "R^2^", "Level")

r2_all <- select(r2_all, Level, everything())

kable(r2_all
      , caption="**R^2^ of models**"
      , escape=FALSE
      , label = NA
      , digits = 3) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left") %>% 
  pack_rows(index = c("Age and time lag" = 2, "Age only" = 2, "Time lag only" = 2))
R2 of models
Level Sigma Moderator Sigma Baseline R2
Age and time lag
Level 1 0.032 0.034 0.06
Level 2 0.072 0.088 0.18
Age only
Level 1 0.032 0.034 0.05
Level 2 0.079 0.088 0.10
Time lag only
Level 1 0.033 0.034 0.00
Level 2 0.085 0.088 0.04

Plot: Age

Note: You can hover over the data points to receive more information.

pred <- data.frame(Age = 1:80,
                   SD = NA, 
                   CI.lower = NA,
                   CI.upper = NA) 

for (i in 1:80) {
  pred$SD[i] <- predict(results.spline2, 
                   newmods=c(ifelse(i <= 15, i, 15), 
                             ifelse(i <= 20 & i > 15, i - 15, ifelse(i <= 15, 0, 20 - 15)), 
                             ifelse(i <= 75 & i > 20, i - 20, ifelse(i <= 20, 0, 75 - 20)), 
                             ifelse(i > 75,i - 75, 0),0), 
                   transf=exp, addx=TRUE)$pred
  pred$CI.lower[i] <- predict(results.spline2, 
                   newmods=c(ifelse(i <= 15, i, 15), 
                             ifelse(i <= 20 & i > 15, i - 15, ifelse(i <= 15, 0, 20 - 15)), 
                             ifelse(i <= 75 & i > 20, i - 20, ifelse(i <= 20, 0, 75 - 20)), 
                             ifelse(i > 75,i - 75, 0),0), 
                        transf=exp, addx=TRUE)$ci.lb
  pred$CI.upper[i] <- predict(results.spline2, 
                   newmods=c(ifelse(i <= 15, i, 15), 
                             ifelse(i <= 20 & i > 15, i - 15, ifelse(i <= 15, 0, 20 - 15)), 
                             ifelse(i <= 75 & i > 20, i - 20, ifelse(i <= 20, 0, 75 - 20)), 
                             ifelse(i > 75,i - 75, 0),0), 
                              transf=exp, addx=TRUE)$ci.ub
}

pred$Type <- "pred"
observed <- select(data_neuro, Age = T1_AgeM, ES = ES, N = T1_N) %>% ungroup() %>% 
  mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)

plot <- ggplot(data = total, aes(x = Age, y = SD)) +
  geom_point_interactive(data = subset(total, Type == "observed"), 
                         aes(size = N, tooltip = paste0("SD = ", round(SD,3), 
                                                        ", N = ", N, 
                                                        ", StudyID = ", StudyID), 
                             data_id = ID), 
                         shape = 5, color = "grey") +
  geom_errorbar(data = subset(total, Type == "pred"), 
                aes(ymin = CI.lower, ymax = CI.upper),
                color = "black", width = 0) +
  geom_point_interactive(data = subset(total, Type == "pred"), 
                         aes(tooltip = 
                               paste0("SD = ", round(SD,3), 
                                      ", 95% CI = [", round(CI.lower,3),
                                      ", ", round(CI.upper,3), "]"), 
                             data_id = ID)) +
  scale_y_continuous(limits = c(0, 0.40)) +
  scale_x_continuous(limits = c(0, 80), breaks = c(0,10,20,30,40,50,60,70,80)) +
  labs(y = expression(bold("SD"[POMP])), title = "Neuroticism") +
  theme_pub() +
  theme(legend.position = "none")


girafe(ggobj = plot)

Plot: Time

Note: You can hover over the data points to receive more information.

pred <- data.frame(Time = seq(from = 0.5, to = 10, by = 0.25),
                   SD = NA, 
                   CI.lower = NA,
                   CI.upper = NA) 

for (i in 1:nrow(pred)) {
  pred$SD[i] <- predict(results.spline2, 
                   newmods=c(15, 5, 0, 0, pred$Time[i]), 
                   transf=exp, addx=TRUE)$pred
  pred$CI.lower[i] <- predict(results.spline2, 
                newmods=c(15, 5, 0, 0, pred$Time[i]), 
                        transf=exp, addx=TRUE)$ci.lb
  pred$CI.upper[i] <- predict(results.spline2, 
                 newmods=c(15, 5, 0, 0, pred$Time[i]), 
                              transf=exp, addx=TRUE)$ci.ub
}

pred$Type <- "pred"
observed <- select(data_agree, Time = T2_lag, ES = ES, N = T1_N) %>% ungroup() %>% 
  mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)

plot <- ggplot(data = total, aes(x = Time, y = SD)) +
  geom_point_interactive(data = subset(total, Type == "observed"), 
                         aes(size = N, tooltip = paste0("SD = ", round(SD,3), 
                                                        ", N = ", N, 
                                                        ", StudyID = ", StudyID), 
                             data_id = ID), 
                         shape = 5, color = "grey") +
  geom_errorbar(data = subset(total, Type == "pred"), 
                aes(ymin = CI.lower, ymax = CI.upper),
                color = "black", width = 0) +
  geom_point_interactive(data = subset(total, Type == "pred"), 
                         aes(tooltip = 
                               paste0("SD = ", round(SD,3), 
                                      ", 95% CI = [", round(CI.lower,3),
                                      ", ", round(CI.upper,3), "]"), 
                             data_id = ID)) +
  scale_y_continuous(limits = c(0, 0.40)) +
  scale_x_continuous(limits = c(0, 10), breaks = c(0,1,2,3,4,5,6,7,8,9,10)) +
  labs(y = expression(bold("SD"[POMP])), title = "Neuroticism") +
  theme_pub() +
  theme(legend.position = "none")


girafe(ggobj = plot)

Openness

Best Model

Model with two age-related variables: Age 1-30 and Age 30>

Table

## Create age bins
data_open$abin_1  <- ifelse(data_open$T1_AgeM <= 30, data_open$T1_AgeM, 30)
data_open$abin_2  <- ifelse(data_open$T1_AgeM > 30, data_open$T1_AgeM - 30, 0)  
    

## Spline approach of best-fitting model
meta.spline1 <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 + T2_lag.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_open, sparse = TRUE)
sigma_spline1.level1_open <- meta.spline1$sigma2[1]
sigma_spline1.level2_open <- meta.spline1$sigma2[2]
results.spline1 <- robust(meta.spline1, cluster = StudyID, clubSandwich = TRUE) 

spline1.open <- as.data.frame(round(cbind(results.spline1$b, results.spline1$se, results.spline1$zval, 
  results.spline1$pval),3))

names(spline1.open) <- c("*b*", "*SE*", "*z*", "*p*")
row.names(spline1.open) <- c("Intercept", "Age.1-30", 
                              "Age.30>", "Time lag")

kable(spline1.open
      , caption="**Best-fitting model with age and time lag for openness**"
      , escape=FALSE
      , label = NA) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Best-fitting model with age and time lag for openness
b SE z p
Intercept -1.826 0.090 -20.357 0.000
Age.1-30 -0.015 0.004 -3.831 0.014
Age.30> 0.001 0.002 0.391 0.740
Time lag 0.012 0.004 3.223 0.024
## Compute models with age only (for separate R2 values)
meta.spline1_age <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2,
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_open, sparse = TRUE)
sigma_spline1.level1_open_age <- meta.spline1_age$sigma2[1]
sigma_spline1.level2_open_age <- meta.spline1_age$sigma2[2]

## Compute models with time lag only (for separate R2 values)
meta.spline1_lag <- rma.mv(yi = ES, V = V_open, mods = ~ T2_lag.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_open, sparse = TRUE)
sigma_spline1.level1_open_lag <- meta.spline1_lag$sigma2[1]
sigma_spline1.level2_open_lag <- meta.spline1_lag$sigma2[2]

## R2 in model with time lag and age
r2.level1 <- round((sigma_base.level1_open - sigma_spline1.level1_open)/sigma_base.level1_open,2)
r2.level1 <- ifelse(r2.level1 < 0, 0, r2.level1)

r2.level2 <- round((sigma_base.level2_open - sigma_spline1.level2_open)/sigma_base.level2_open,2)
r2.level2 <- ifelse(r2.level2 < 0, 0, r2.level2)

r2 <- round(as.data.frame(rbind(c(sigma_spline1.level1_open, sigma_base.level1_open, r2.level1), c(sigma_spline1.level2_open, sigma_base.level2_open, r2.level2))),5)

## R2 in model with age only
r2.level1_age <- round((sigma_base.level1_open - sigma_spline1.level1_open_age)/sigma_base.level1_open,2)
r2.level1_age <- ifelse(r2.level1_age < 0, 0, r2.level1_age)

r2.level2_age <- round((sigma_base.level2_open - sigma_spline1.level2_open_age)/sigma_base.level2_open,2)
r2.level2_age <- ifelse(r2.level2_age < 0, 0, r2.level2_age)

r2_age <- round(as.data.frame(rbind(c(sigma_spline1.level1_open_age, sigma_base.level1_open, r2.level1_age), c(sigma_spline1.level2_open_age, sigma_base.level2_open, r2.level2_age))),5)

## R2 in model with time lag only
r2.level1_lag <- round((sigma_base.level1_open - sigma_spline1.level1_open_lag)/sigma_base.level1_open,2)
r2.level1_lag <- ifelse(r2.level1_lag < 0, 0, r2.level1_lag)

r2.level2_lag <- round((sigma_base.level2_open - sigma_spline1.level2_open_lag)/sigma_base.level2_open,2)
r2.level2_lag <- ifelse(r2.level2_lag < 0, 0, r2.level2_lag)

r2_lag <- round(as.data.frame(rbind(c(sigma_spline1.level1_open_lag, sigma_base.level1_open, r2.level1_lag), c(sigma_spline1.level2_open_lag, sigma_base.level2_open, r2.level2_lag))),5)

## Combine values in one table
r2_all <- rbind(r2, r2_age, r2_lag)
r2_all$Level <- rep(c("Level 1", "Level 2"), 3)
names(r2_all) <- c("Sigma Moderator", "Sigma Baseline", "R^2^", "Level")

r2_all <- select(r2_all, Level, everything())

kable(r2_all
      , caption="**R^2^ of models**"
      , escape=FALSE
      , label = NA
      , digits = 3) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left") %>% 
  pack_rows(index = c("Age and time lag" = 2, "Age only" = 2, "Time lag only" = 2))
R2 of models
Level Sigma Moderator Sigma Baseline R2
Age and time lag
Level 1 0.015 0.016 0.04
Level 2 0.123 0.158 0.22
Age only
Level 1 0.015 0.016 0.05
Level 2 0.146 0.158 0.07
Time lag only
Level 1 0.016 0.016 0.00
Level 2 0.143 0.158 0.10

Plot: Age

Note: You can hover over the data points to receive more information.

pred <- data.frame(Age = 1:80,
                   SD = NA, 
                   CI.lower = NA,
                   CI.upper = NA) 

for (i in 1:80) {
  pred$SD[i] <- predict(results.spline1, 
                   newmods=c(ifelse(i <= 30, i, 30), 
                             ifelse(i > 30,i - 30, 0),0), 
                   transf=exp, addx=TRUE)$pred
  pred$CI.lower[i] <- predict(results.spline1, 
                   newmods=c(ifelse(i <= 30, i, 30), 
                             ifelse(i > 30,i - 30, 0),0), 
                        transf=exp, addx=TRUE)$ci.lb
  pred$CI.upper[i] <- predict(results.spline1, 
                   newmods=c(ifelse(i <= 30, i, 30), 
                             ifelse(i > 30,i - 30, 0),0), 
                              transf=exp, addx=TRUE)$ci.ub
}

pred$Type <- "pred"
observed <- select(data_open, Age = T1_AgeM, ES = ES, N = T1_N) %>% ungroup() %>% 
  mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)

plot <- ggplot(data = total, aes(x = Age, y = SD)) +
  geom_point_interactive(data = subset(total, Type == "observed"), 
                         aes(size = N, tooltip = paste0("SD = ", round(SD,3), 
                                                        ", N = ", N, 
                                                        ", StudyID = ", StudyID), 
                             data_id = ID), 
                         shape = 5, color = "grey") +
  geom_errorbar(data = subset(total, Type == "pred"), 
                aes(ymin = CI.lower, ymax = CI.upper),
                color = "black", width = 0) +
  geom_point_interactive(data = subset(total, Type == "pred"), 
                         aes(tooltip = 
                               paste0("SD = ", round(SD,3), 
                                      ", 95% CI = [", round(CI.lower,3),
                                      ", ", round(CI.upper,3), "]"), 
                             data_id = ID)) +
  scale_y_continuous(limits = c(0, 0.40)) +
  scale_x_continuous(limits = c(0, 80), breaks = c(0,10,20,30,40,50,60,70,80)) +
  labs(y = expression(bold("SD"[POMP])), title = "Openness") +
  theme_pub() +
  theme(legend.position = "none")


girafe(ggobj = plot)

Plot: Age

Note: You can hover over the data points to receive more information.

pred <- data.frame(Time = seq(from = 0.5, to = 10, by = 0.25),
                   SD = NA, 
                   CI.lower = NA,
                   CI.upper = NA) 

for (i in 1:nrow(pred)) {
  pred$SD[i] <- predict(results.spline1, 
                   newmods=c(20, 0, pred$Time[i]), 
                   transf=exp, addx=TRUE)$pred
  pred$CI.lower[i] <- predict(results.spline1, 
                newmods=c(20, 0, pred$Time[i]), 
                        transf=exp, addx=TRUE)$ci.lb
  pred$CI.upper[i] <- predict(results.spline1, 
                 newmods=c(20, 0, pred$Time[i]), 
                              transf=exp, addx=TRUE)$ci.ub
}

pred$Type <- "pred"
observed <- select(data_agree, Time = T2_lag, ES = ES, N = T1_N) %>% ungroup() %>% 
  mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)

plot <- ggplot(data = total, aes(x = Time, y = SD)) +
  geom_point_interactive(data = subset(total, Type == "observed"), 
                         aes(size = N, tooltip = paste0("SD = ", round(SD,3), 
                                                        ", N = ", N, 
                                                        ", StudyID = ", StudyID), 
                             data_id = ID), 
                         shape = 5, color = "grey") +
  geom_errorbar(data = subset(total, Type == "pred"), 
                aes(ymin = CI.lower, ymax = CI.upper),
                color = "black", width = 0) +
  geom_point_interactive(data = subset(total, Type == "pred"), 
                         aes(tooltip = 
                               paste0("SD = ", round(SD,3), 
                                      ", 95% CI = [", round(CI.lower,3),
                                      ", ", round(CI.upper,3), "]"), 
                             data_id = ID)) +
  scale_y_continuous(limits = c(0, 0.40)) +
  scale_x_continuous(limits = c(0, 10), breaks = c(0,1,2,3,4,5,6,7,8,9,10)) +
  labs(y = expression(bold("SD"[POMP])), title = "Openness") +
  theme_pub() +
  theme(legend.position = "none")


girafe(ggobj = plot)

Second-Best

Model with four age-related variables: Age 1-15, Age 15-20, Age 20-65, and Age 65>

Table

## Create age bins
data_open$abin_1  <- ifelse(data_open$T1_AgeM <= 15, data_open$T1_AgeM, 15)
data_open$abin_2  <- ifelse(data_open$T1_AgeM <= 20 & data_open$T1_AgeM > 15, 
                             data_open$T1_AgeM - 15, 
                             ifelse(data_open$T1_AgeM <= 15, 0, 20 - 15))
data_open$abin_3  <- ifelse(data_open$T1_AgeM <= 65 & data_open$T1_AgeM > 20, 
                             data_open$T1_AgeM - 20, 
                             ifelse(data_open$T1_AgeM <= 20, 0, 65 - 20))
data_open$abin_4  <- ifelse(data_open$T1_AgeM > 65, data_open$T1_AgeM - 65, 0) 

## Spline approach of best-fitting model
meta.spline2 <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 + abin_3 + abin_4 + T2_lag.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_open, sparse = TRUE)
sigma_spline2.level1_open <- meta.spline2$sigma2[1]
sigma_spline2.level2_open <- meta.spline2$sigma2[2]
results.spline2 <- robust(meta.spline2, cluster = StudyID, clubSandwich = TRUE) 

spline2.open <- as.data.frame(round(cbind(results.spline2$b, results.spline2$se, results.spline2$zval, 
  results.spline2$pval),3))

names(spline2.open) <- c("*b*", "*SE*", "*z*", "*p*")
row.names(spline2.open) <- c("Intercept", "Age.1-15", 
                             "Age.15-20", "Age.20-65",  
                              "Age.65>", "Time lag")

kable(spline2.open
      , caption="**Second-best model with age and time lag for openness**"
      , escape=FALSE
      , label = NA) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Second-best model with age and time lag for openness
b SE z p
Intercept -1.963 0.134 -14.654 0.000
Age.1-15 -0.002 0.008 -0.294 0.786
Age.15-20 -0.040 0.011 -3.680 0.005
Age.20-65 -0.002 0.001 -2.650 0.126
Age.65> 0.007 0.003 2.337 0.237
Time lag 0.014 0.003 3.920 0.011
## Compute models with age only (for separate R2 values)
meta.spline2_age <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 + abin_3 + abin_4,
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_open, sparse = TRUE)
sigma_spline2.level1_open_age <- meta.spline2_age$sigma2[1]
sigma_spline2.level2_open_age <- meta.spline2_age$sigma2[2]

## Compute models with time lag only (for separate R2 values)
meta.spline2_lag <- rma.mv(yi = ES, V = V_open, mods = ~ T2_lag.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_open, sparse = TRUE)
sigma_spline2.level1_open_lag <- meta.spline2_lag$sigma2[1]
sigma_spline2.level2_open_lag <- meta.spline2_lag$sigma2[2]

## R2 in model with time lag and age
r2.level1 <- round((sigma_base.level1_open - sigma_spline2.level1_open)/sigma_base.level1_open,2)
r2.level1 <- ifelse(r2.level1 < 0, 0, r2.level1)

r2.level2 <- round((sigma_base.level2_open - sigma_spline2.level2_open)/sigma_base.level2_open,2)
r2.level2 <- ifelse(r2.level2 < 0, 0, r2.level2)

r2 <- round(as.data.frame(rbind(c(sigma_spline2.level1_open, sigma_base.level1_open, r2.level1), c(sigma_spline2.level2_open, sigma_base.level2_open, r2.level2))),5)

## R2 in model with age only
r2.level1_age <- round((sigma_base.level1_open - sigma_spline2.level1_open_age)/sigma_base.level1_open,2)
r2.level1_age <- ifelse(r2.level1_age < 0, 0, r2.level1_age)

r2.level2_age <- round((sigma_base.level2_open - sigma_spline2.level2_open_age)/sigma_base.level2_open,2)
r2.level2_age <- ifelse(r2.level2_age < 0, 0, r2.level2_age)

r2_age <- round(as.data.frame(rbind(c(sigma_spline2.level1_open_age, sigma_base.level1_open, r2.level1_age), c(sigma_spline2.level2_open_age, sigma_base.level2_open, r2.level2_age))),5)

## R2 in model with time lag only
r2.level1_lag <- round((sigma_base.level1_open - sigma_spline2.level1_open_lag)/sigma_base.level1_open,2)
r2.level1_lag <- ifelse(r2.level1_lag < 0, 0, r2.level1_lag)

r2.level2_lag <- round((sigma_base.level2_open - sigma_spline2.level2_open_lag)/sigma_base.level2_open,2)
r2.level2_lag <- ifelse(r2.level2_lag < 0, 0, r2.level2_lag)

r2_lag <- round(as.data.frame(rbind(c(sigma_spline2.level1_open_lag, sigma_base.level1_open, r2.level1_lag), c(sigma_spline2.level2_open_lag, sigma_base.level2_open, r2.level2_lag))),5)

## Combine values in one table
r2_all <- rbind(r2, r2_age, r2_lag)
r2_all$Level <- rep(c("Level 1", "Level 2"), 3)
names(r2_all) <- c("Sigma Moderator", "Sigma Baseline", "R^2^", "Level")

r2_all <- select(r2_all, Level, everything())

kable(r2_all
      , caption="**R^2^ of models**"
      , escape=FALSE
      , label = NA
      , digits = 3) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left") %>% 
  pack_rows(index = c("Age and time lag" = 2, "Age only" = 2, "Time lag only" = 2))
R2 of models
Level Sigma Moderator Sigma Baseline R2
Age and time lag
Level 1 0.015 0.016 0.04
Level 2 0.114 0.158 0.28
Age only
Level 1 0.015 0.016 0.05
Level 2 0.139 0.158 0.12
Time lag only
Level 1 0.016 0.016 0.00
Level 2 0.143 0.158 0.10

Plot: Age

Note: You can hover over the data points to receive more information.

pred <- data.frame(Age = 1:80,
                   SD = NA, 
                   CI.lower = NA,
                   CI.upper = NA) 

for (i in 1:80) {
  pred$SD[i] <- predict(results.spline2, 
                   newmods=c(ifelse(i <= 15, i, 15), 
                             ifelse(i <= 20 & i > 15, i - 15, ifelse(i <= 15, 0, 20 - 15)), 
                             ifelse(i <= 65 & i > 20, i - 20, ifelse(i <= 20, 0, 65 - 20)), 
                             ifelse(i > 65,i - 65, 0),0), 
                   transf=exp, addx=TRUE)$pred
  pred$CI.lower[i] <- predict(results.spline2, 
                   newmods=c(ifelse(i <= 15, i, 15), 
                             ifelse(i <= 20 & i > 15, i - 15, ifelse(i <= 15, 0, 20 - 15)), 
                             ifelse(i <= 65 & i > 20, i - 20, ifelse(i <= 20, 0, 65 - 20)), 
                             ifelse(i > 65,i - 65, 0),0), 
                        transf=exp, addx=TRUE)$ci.lb
  pred$CI.upper[i] <- predict(results.spline2, 
                   newmods=c(ifelse(i <= 15, i, 15), 
                             ifelse(i <= 20 & i > 15, i - 15, ifelse(i <= 15, 0, 20 - 15)), 
                             ifelse(i <= 65 & i > 20, i - 20, ifelse(i <= 20, 0, 65 - 20)), 
                             ifelse(i > 65,i - 65, 0),0), 
                              transf=exp, addx=TRUE)$ci.ub
}

pred$Type <- "pred"
observed <- select(data_open, Age = T1_AgeM, ES = ES, N = T1_N) %>% ungroup() %>% 
  mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)

plot <- ggplot(data = total, aes(x = Age, y = SD)) +
  geom_point_interactive(data = subset(total, Type == "observed"), 
                         aes(size = N, tooltip = paste0("SD = ", round(SD,3), 
                                                        ", N = ", N, 
                                                        ", StudyID = ", StudyID), 
                             data_id = ID), 
                         shape = 5, color = "grey") +
  geom_errorbar(data = subset(total, Type == "pred"), 
                aes(ymin = CI.lower, ymax = CI.upper),
                color = "black", width = 0) +
  geom_point_interactive(data = subset(total, Type == "pred"), 
                         aes(tooltip = 
                               paste0("SD = ", round(SD,3), 
                                      ", 95% CI = [", round(CI.lower,3),
                                      ", ", round(CI.upper,3), "]"), 
                             data_id = ID)) +
  scale_y_continuous(limits = c(0, 0.40)) +
  scale_x_continuous(limits = c(0, 80), breaks = c(0,10,20,30,40,50,60,70,80)) +
  labs(y = expression(bold("SD"[POMP])), title = "Openness") +
  theme_pub() +
  theme(legend.position = "none")


girafe(ggobj = plot)

Plot: Time

Note: You can hover over the data points to receive more information.

pred <- data.frame(Time = seq(from = 0.5, to = 10, by = 0.25),
                   SD = NA, 
                   CI.lower = NA,
                   CI.upper = NA) 

for (i in 1:nrow(pred)) {
  pred$SD[i] <- predict(results.spline2, 
                   newmods=c(15, 5, 0, 0, pred$Time[i]), 
                   transf=exp, addx=TRUE)$pred
  pred$CI.lower[i] <- predict(results.spline2, 
                newmods=c(15, 5, 0, 0, pred$Time[i]), 
                        transf=exp, addx=TRUE)$ci.lb
  pred$CI.upper[i] <- predict(results.spline2, 
                 newmods=c(15, 5, 0, 0, pred$Time[i]), 
                              transf=exp, addx=TRUE)$ci.ub
}

pred$Type <- "pred"
observed <- select(data_agree, Time = T2_lag, ES = ES, N = T1_N) %>% ungroup() %>% 
  mutate(SD = exp(ES))
observed$Type <- "observed"
total <- bind_rows(observed, pred)
total$ID <- 1:nrow(total)

plot <- ggplot(data = total, aes(x = Time, y = SD)) +
  geom_point_interactive(data = subset(total, Type == "observed"), 
                         aes(size = N, tooltip = paste0("SD = ", round(SD,3), 
                                                        ", N = ", N, 
                                                        ", StudyID = ", StudyID), 
                             data_id = ID), 
                         shape = 5, color = "grey") +
  geom_errorbar(data = subset(total, Type == "pred"), 
                aes(ymin = CI.lower, ymax = CI.upper),
                color = "black", width = 0) +
  geom_point_interactive(data = subset(total, Type == "pred"), 
                         aes(tooltip = 
                               paste0("SD = ", round(SD,3), 
                                      ", 95% CI = [", round(CI.lower,3),
                                      ", ", round(CI.upper,3), "]"), 
                             data_id = ID)) +
  scale_y_continuous(limits = c(0, 0.40)) +
  scale_x_continuous(limits = c(0, 10), breaks = c(0,1,2,3,4,5,6,7,8,9,10)) +
  labs(y = expression(bold("SD"[POMP])), title = "Openness") +
  theme_pub() +
  theme(legend.position = "none")


girafe(ggobj = plot)

Section 5: Moderation Analysis

Moderators in Separate Models

Across Traits (Exploratory)

For the analyses across traits, we used a model with Age 1-30 and Age 30> as age-related variables because this model was among the best-fitting models for most traits.

Table

## Create age bins
data_all$abin_1  <- ifelse(data_all$T1_AgeM <= 30, data_all$T1_AgeM, 30)
data_all$abin_2  <- ifelse(data_all$T1_AgeM > 30, data_all$T1_AgeM - 30, 0)  

## Compute baseline R2
meta.comp <- rma.mv(yi = ES, V = V, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c,
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_all, sparse = TRUE)
sigma_spline1.level1_all <- meta.comp$sigma2[1]
sigma_spline1.level2_all <- meta.comp$sigma2[2]

## Publication Year (Moderator 1)
meta.mod1 <- rma.mv(yi = ES, V = V, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Year.c,
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_all, sparse = TRUE)

results.mod1 <- robust(meta.mod1, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod1.level1_all <- meta.mod1$sigma2[1]
sigma_mod1.level2_all <- meta.mod1$sigma2[2]

r2.level1.mod1 <- round((sigma_spline1.level1_all - sigma_mod1.level1_all)/sigma_spline1.level1_all,2)
r2.level1.mod1 <- ifelse(r2.level1.mod1 < 0, 0, r2.level1.mod1)
r2.level2.mod1 <- round((sigma_spline1.level2_all - sigma_mod1.level2_all)/sigma_spline1.level2_all,2)
r2.level2.mod1 <- ifelse(r2.level2.mod1 < 0, 0, r2.level2.mod1)

mod1.all <- as.data.frame(round(
  cbind(results.mod1$n, results.mod1$b[5], results.mod1$se[5], results.mod1$zval[5], 
  results.mod1$pval[5], r2.level1 = r2.level1.mod1, r2.level2 = r2.level2.mod1),3))


## Reliability (Moderator 2)
meta.mod2 <- rma.mv(yi = ES, V = V, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Alpha_T1.c,
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_all, sparse = TRUE)

results.mod2 <- robust(meta.mod2, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod2.level1_all <- meta.mod2$sigma2[1]
sigma_mod2.level2_all <- meta.mod2$sigma2[2]

r2.level1.mod2 <- round((sigma_spline1.level1_all - sigma_mod2.level1_all)/sigma_spline1.level1_all,2)
r2.level1.mod2 <- ifelse(r2.level1.mod2 < 0, 0, r2.level1.mod2)
r2.level2.mod2 <- round((sigma_spline1.level2_all - sigma_mod2.level2_all)/sigma_spline1.level2_all,2)
r2.level2.mod2 <- ifelse(r2.level2.mod2 < 0, 0, r2.level2.mod2)

mod2.all <- as.data.frame(round(
  cbind(results.mod2$n, results.mod2$b[5], results.mod2$se[5], results.mod2$zval[5], 
  results.mod2$pval[5], r2.level1 = r2.level1.mod2, r2.level2 = r2.level2.mod2),3))


## Other report (Moderator 3)
meta.mod3 <- rma.mv(yi = ES, V = V, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + OtherReport,
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_all, sparse = TRUE)

results.mod3 <- robust(meta.mod3, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod3.level1_all <- meta.mod3$sigma2[1]
sigma_mod3.level2_all <- meta.mod3$sigma2[2]

r2.level1.mod3 <- round((sigma_spline1.level1_all - sigma_mod3.level1_all)/sigma_spline1.level1_all,2)
r2.level1.mod3 <- ifelse(r2.level1.mod3 < 0, 0, r2.level1.mod3)
r2.level2.mod3 <- round((sigma_spline1.level2_all - sigma_mod3.level2_all)/sigma_spline1.level2_all,2)
r2.level2.mod3 <- ifelse(r2.level2.mod3 < 0, 0, r2.level2.mod3)

mod3.all <- as.data.frame(round(
  cbind(results.mod3$n, results.mod3$b[5], results.mod3$se[5], results.mod3$zval[5], 
  results.mod3$pval[5], r2.level1 = r2.level1.mod3, r2.level2 = r2.level2.mod3),3))


## Facet (Moderator 4)
meta.mod4 <- rma.mv(yi = ES, V = V, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Facet,
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_all, sparse = TRUE)

results.mod4 <- robust(meta.mod4, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod4.level1_all <- meta.mod4$sigma2[1]
sigma_mod4.level2_all <- meta.mod4$sigma2[2]

r2.level1.mod4 <- round((sigma_spline1.level1_all - sigma_mod4.level1_all)/sigma_spline1.level1_all,2)
r2.level1.mod4 <- ifelse(r2.level1.mod4 < 0, 0, r2.level1.mod4)
r2.level2.mod4 <- round((sigma_spline1.level2_all - sigma_mod4.level2_all)/sigma_spline1.level2_all,2)
r2.level2.mod4 <- ifelse(r2.level2.mod4 < 0, 0, r2.level2.mod4)

mod4.all <- as.data.frame(round(
  cbind(results.mod4$n, results.mod4$b[5], results.mod4$se[5], results.mod4$zval[5], 
  results.mod4$pval[5], r2.level1 = r2.level1.mod4, r2.level2 = r2.level2.mod4),3))


## Maladaptive (Moderator 5)
meta.mod5 <- rma.mv(yi = ES, V = V, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Maladaptive,
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_all, sparse = TRUE)

results.mod5 <- robust(meta.mod5, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod5.level1_all <- meta.mod5$sigma2[1]
sigma_mod5.level2_all <- meta.mod5$sigma2[2]

r2.level1.mod5 <- round((sigma_spline1.level1_all - sigma_mod5.level1_all)/sigma_spline1.level1_all,2)
r2.level1.mod5 <- ifelse(r2.level1.mod5 < 0, 0, r2.level1.mod5)
r2.level2.mod5 <- round((sigma_spline1.level2_all - sigma_mod5.level2_all)/sigma_spline1.level2_all,2)
r2.level2.mod5 <- ifelse(r2.level2.mod5 < 0, 0, r2.level2.mod5)

mod5.all <- as.data.frame(round(
  cbind(results.mod5$n, results.mod5$b[5], results.mod5$se[5], results.mod5$zval[5], 
  results.mod5$pval[5], r2.level1 = r2.level1.mod5, r2.level2 = r2.level2.mod5),3))


## Big Five taxonomy (Moderator 6)
meta.mod6 <- rma.mv(yi = ES, V = V, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + BigFive,
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_all, sparse = TRUE)

results.mod6 <- robust(meta.mod6, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod6.level1_all <- meta.mod6$sigma2[1]
sigma_mod6.level2_all <- meta.mod6$sigma2[2]

r2.level1.mod6 <- round((sigma_spline1.level1_all - sigma_mod6.level1_all)/sigma_spline1.level1_all,2)
r2.level1.mod6 <- ifelse(r2.level1.mod6 < 0, 0, r2.level1.mod6)
r2.level2.mod6 <- round((sigma_spline1.level2_all - sigma_mod6.level2_all)/sigma_spline1.level2_all,2)
r2.level2.mod6 <- ifelse(r2.level2.mod6 < 0, 0, r2.level2.mod6)

mod6.all <- as.data.frame(round(
  cbind(results.mod6$n, results.mod6$b[5], results.mod6$se[5], results.mod6$zval[5], 
  results.mod6$pval[5], r2.level1 = r2.level1.mod6, r2.level2 = r2.level2.mod6),3))


## Representative sample (Moderator 8)
meta.mod8 <- rma.mv(yi = ES, V = V, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Represent,
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_all, sparse = TRUE)

results.mod8 <- robust(meta.mod8, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod8.level1_all <- meta.mod8$sigma2[1]
sigma_mod8.level2_all <- meta.mod8$sigma2[2]

r2.level1.mod8 <- round((sigma_spline1.level1_all - sigma_mod8.level1_all)/sigma_spline1.level1_all,2)
r2.level1.mod8 <- ifelse(r2.level1.mod8 < 0, 0, r2.level1.mod8)
r2.level2.mod8 <- round((sigma_spline1.level2_all - sigma_mod8.level2_all)/sigma_spline1.level2_all,2)
r2.level2.mod8 <- ifelse(r2.level2.mod8 < 0, 0, r2.level2.mod8)

mod8.all <- as.data.frame(round(
  cbind(results.mod8$n, results.mod8$b[5], results.mod8$se[5], results.mod8$zval[5], 
  results.mod8$pval[5], r2.level1 = r2.level1.mod8, r2.level2 = r2.level2.mod8),3))

## Percentage Female (Moderator 9)
meta.mod9 <- rma.mv(yi = ES, V = V, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Female.c,
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_all, sparse = TRUE)

results.mod9 <- robust(meta.mod9, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod9.level1_all <- meta.mod9$sigma2[1]
sigma_mod9.level2_all <- meta.mod9$sigma2[2]

r2.level1.mod9 <- round((sigma_spline1.level1_all - sigma_mod9.level1_all)/sigma_spline1.level1_all,2)
r2.level1.mod9 <- ifelse(r2.level1.mod9 < 0, 0, r2.level1.mod9)
r2.level2.mod9 <- round((sigma_spline1.level2_all - sigma_mod9.level2_all)/sigma_spline1.level2_all,2)
r2.level2.mod9 <- ifelse(r2.level2.mod9 < 0, 0, r2.level2.mod9)

mod9.all <- as.data.frame(round(
  cbind(results.mod9$n, results.mod9$b[5], results.mod9$se[5], results.mod9$zval[5], 
  results.mod9$pval[5], r2.level1 = r2.level1.mod9, r2.level2 = r2.level2.mod9),3))



## Region of data collection (Moderator 10)
meta.mod10 <- rma.mv(yi = ES, V = V, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Region,
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_all, sparse = TRUE)

results.mod10 <- robust(meta.mod10, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod10.level1_all <- meta.mod10$sigma2[1]
sigma_mod10.level2_all <- meta.mod10$sigma2[2]

r2.level1.mod10 <- round((sigma_spline1.level1_all - sigma_mod10.level1_all)/sigma_spline1.level1_all,2)
r2.level1.mod10 <- ifelse(r2.level1.mod10 < 0, 0, r2.level1.mod10)
r2.level2.mod10 <- round((sigma_spline1.level2_all - sigma_mod10.level2_all)/sigma_spline1.level2_all,2)
r2.level2.mod10 <- ifelse(r2.level2.mod10 < 0, 0, r2.level2.mod10)

mod10.all <- as.data.frame(round(
  cbind(results.mod10$n, results.mod10$b[5:8], results.mod10$se[5:8], results.mod10$zval[5:8], 
  results.mod10$pval[5:8], r2.level1 = r2.level1.mod10, r2.level2 = r2.level2.mod10),3))


mod.all <- rbind(mod1.all, mod2.all, mod3.all, mod4.all, mod5.all, mod6.all, mod8.all, mod9.all, mod10.all)

names(mod.all) <- c("Studies", "*b*", "*SE*", "*z*", "*p*", "R^2^~Level1~","R^2^~Level2~")
row.names(mod.all) <- c("Publication year", 
                          "Reliability", "Other report", "Facet", 
                          "Maladaptive", "Big Five", 
                          "Representative", "Percentage female", 
                          "Asia", "Global South", 
                          "Nothern Europe", "Southern Europe")

kable(mod.all
      , caption="**Moderator analyses across all traits (separate models)**"
      , escape=FALSE
      , label = NA) %>% 
  pack_rows("Region", 9, 12) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Moderator analyses across all traits (separate models)
Studies b SE z p R2Level1 R2Level2
Publication year 229 0.002 0.003 0.724 0.474 0.00 0.00
Reliability 179 0.127 0.154 0.823 0.425 0.00 0.02
Other report 229 -0.026 0.040 -0.654 0.529 0.00 0.01
Facet 229 0.126 0.060 2.106 0.052 0.02 0.05
Maladaptive 228 0.012 0.072 0.168 0.868 0.00 0.00
Big Five 229 -0.138 0.045 -3.054 0.005 0.01 0.04
Representative 226 -0.119 0.055 -2.179 0.035 0.00 0.02
Percentage female 225 0.000 0.000 -1.428 0.174 0.00 0.00
Region
Asia 224 -0.027 0.072 -0.368 0.715 0.00 0.00
Global South 224 0.118 0.058 2.023 0.076 0.00 0.00
Nothern Europe 224 -0.072 0.047 -1.535 0.127 0.00 0.00
Southern Europe 224 -0.017 0.086 -0.202 0.842 0.00 0.00

Note. These Pseudo-R2 values should be interpreted with caution as the included studies slightly differed across moderators (e.g., due to missing values) making a comparison more difficult.

Plot

You can hover over the points in this graph to receive more information.

## Run alternative model for Region
data_all$Region.d <- as.factor(ifelse(data_all$Region == "North America", 0, 1))
meta.mod10b <- rma.mv(yi = ES, V = V, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Region.d, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_all, sparse = TRUE)

## Prepare loop
plot_data <- data.frame(Moderator = factor(c("Publication year", "Publication year", 
                                      "Reliability", "Reliability", 
                                      "Other report", "Other report", 
                                      "Facet", "Facet", 
                                      "Maladaptive", "Maladaptive", 
                                      "Big Five", "Big Five", 
                                      "Representative", "Representative",
                                      "Percentage female", "Percentage female", 
                                      "Region", "Region"), 
                                      levels = c("Region", "Percentage female", 
                                                 "Representative", 
                                                 "Big Five", "Maladaptive", 
                                                 "Facet", "Other report", 
                                                 "Reliability", "Publication year"), 
                                      ordered = TRUE), 
                        Score = c(0, 5,
                                  0, 0.10, 
                                  0, 1,
                                  0, 1,
                                  0, 1,
                                  0, 1,
                                  0, 1,
                                  0, 10, 
                                  0, 1), 
                        SD = NA, 
                        CI.lower = NA,
                        CI.upper = NA, 
                        Sig = factor(c(0, 0, 
                                       0, 0,
                                       0, 0,
                                       0, 0,
                                       0, 0,
                                       1, 1,
                                       1, 1,
                                       0, 0, 
                                       0, 0)),
                        label = c("2015", "2020", 
                                  "0.78", "0.88", 
                                  "Self", "Other", 
                                  "No", "Yes", 
                                  "No", "Yes", 
                                  "No", "Yes", 
                                  "No", "Yes", 
                                  "53%", "63%", 
                                  "North America", "Other"))
plot_data$ID <- 1:nrow(plot_data)

meta.models <- list(meta.mod1, meta.mod1, meta.mod2, meta.mod2, 
                    meta.mod3, meta.mod3, meta.mod4, meta.mod4, 
                    meta.mod5, meta.mod5, meta.mod6, meta.mod6,
                    meta.mod8, meta.mod8, 
                    meta.mod9, meta.mod9, meta.mod10b, meta.mod10b)                

## Loop to create plot data
for (i in 1:nrow(plot_data)) {                       
  plot_data$SD[i] <- predict(meta.models[[i]], 
                             newmods=c(20, 0, 0, plot_data$Score[i]), 
                             transf=exp, addx=TRUE)$pred
  plot_data$CI.lower[i] <- predict(meta.models[[i]], 
                                   newmods=c(20, 0, 0, plot_data$Score[i]), 
                                   transf=exp, addx=TRUE)$ci.lb
  plot_data$CI.upper[i] <- predict(meta.models[[i]], 
                                   newmods=c(20, 0, 0, plot_data$Score[i]), 
                                   transf=exp, addx=TRUE)$ci.ub
} 

## Plot
plot <- ggplot(data = plot_data, aes(x = SD, y = Moderator, group = Score)) +
  geom_errorbar(aes(xmin=CI.lower, xmax=CI.upper, group = Score, colour = Sig), 
                position=position_dodge(0.75), width = 0) + 
  geom_point_interactive(aes(group = Score, colour = Sig, 
                             tooltip = 
                               paste0("SD = ", round(SD,3), 
                                      ", 95% CI = [", round(CI.lower,3),
                                      ", ", round(CI.upper,3), "]"), 
                             data_id = ID), 
             size = 1.8, position=position_dodge(0.75)) + 
  geom_text(aes(label = label, x = CI.upper + 0.001, y = Moderator, group = Score),
            position=position_dodge(0.75),
            hjust = 0, size = 4.5) +
  theme_pub() +
  scale_x_continuous(limits = c(0,0.3)) +
  scale_colour_manual(values = c("0" = "grey", "1" = "black")) +
  theme(legend.position = "none", 
        axis.text.y = element_text(hjust = 1)) +
  labs(y = "Moderators", x = expression(bold("SD"[POMP])), title = "Across traits")

girafe(ggobj = plot)

Note. To allow a better graphical depiction, we dummy-coded the moderator “Region” for the illustration in this graph (0 = “North America”, 1 = “Other”). However, in the main analyses, a polytomous categorical predictor was used. Significant moderation effects are depicted in black, non-significant moderations are in grey. The point estimates are calculated for 20 year old participants that are assessed over a time interval of one year.

Agreeableness

Table

## Create age bins
data_agree$abin_1  <- ifelse(data_agree$T1_AgeM <= 30, data_agree$T1_AgeM, 30)
data_agree$abin_2  <- ifelse(data_agree$T1_AgeM > 30, data_agree$T1_AgeM - 30, 0)  

## Publication Year (Moderator 1)
meta.mod1 <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Year.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_agree, sparse = TRUE)

results.mod1 <- robust(meta.mod1, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod1.level1_agree <- meta.mod1$sigma2[1]
sigma_mod1.level2_agree <- meta.mod1$sigma2[2]

r2.level1.mod1 <- round((sigma_spline1.level1_agree - sigma_mod1.level1_agree)/sigma_spline1.level1_agree,2)
r2.level1.mod1 <- ifelse(r2.level1.mod1 < 0, 0, r2.level1.mod1)
r2.level2.mod1 <- round((sigma_spline1.level2_agree - sigma_mod1.level2_agree)/sigma_spline1.level2_agree,2)
r2.level2.mod1 <- ifelse(r2.level2.mod1 < 0, 0, r2.level2.mod1)

mod1.agree <- as.data.frame(round(
  cbind(results.mod1$n, results.mod1$b[5], results.mod1$se[5], results.mod1$zval[5], 
  results.mod1$pval[5], r2.level1 = r2.level1.mod1, r2.level2 = r2.level2.mod1),3))


## Reliability (Moderator 2)
meta.mod2 <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Alpha_T1.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_agree, sparse = TRUE)

results.mod2 <- robust(meta.mod2, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod2.level1_agree <- meta.mod2$sigma2[1]
sigma_mod2.level2_agree <- meta.mod2$sigma2[2]

r2.level1.mod2 <- round((sigma_spline1.level1_agree - sigma_mod2.level1_agree)/sigma_spline1.level1_agree,2)
r2.level1.mod2 <- ifelse(r2.level1.mod2 < 0, 0, r2.level1.mod2)
r2.level2.mod2 <- round((sigma_spline1.level2_agree - sigma_mod2.level2_agree)/sigma_spline1.level2_agree,2)
r2.level2.mod2 <- ifelse(r2.level2.mod2 < 0, 0, r2.level2.mod2)

mod2.agree <- as.data.frame(round(
  cbind(results.mod2$n, results.mod2$b[5], results.mod2$se[5], results.mod2$zval[5], 
  results.mod2$pval[5], r2.level1 = r2.level1.mod2, r2.level2 = r2.level2.mod2),3))


## Other report (Moderator 3)
meta.mod3 <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + OtherReport, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_agree, sparse = TRUE)

results.mod3 <- robust(meta.mod3, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod3.level1_agree <- meta.mod3$sigma2[1]
sigma_mod3.level2_agree <- meta.mod3$sigma2[2]

r2.level1.mod3 <- round((sigma_spline1.level1_agree - sigma_mod3.level1_agree)/sigma_spline1.level1_agree,2)
r2.level1.mod3 <- ifelse(r2.level1.mod3 < 0, 0, r2.level1.mod3)
r2.level2.mod3 <- round((sigma_spline1.level2_agree - sigma_mod3.level2_agree)/sigma_spline1.level2_agree,2)
r2.level2.mod3 <- ifelse(r2.level2.mod3 < 0, 0, r2.level2.mod3)

mod3.agree <- as.data.frame(round(
  cbind(results.mod3$n, results.mod3$b[5], results.mod3$se[5], results.mod3$zval[5], 
  results.mod3$pval[5], r2.level1 = r2.level1.mod3, r2.level2 = r2.level2.mod3),3))


## Facet (Moderator 4)
meta.mod4 <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Facet, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_agree, sparse = TRUE)

results.mod4 <- robust(meta.mod4, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod4.level1_agree <- meta.mod4$sigma2[1]
sigma_mod4.level2_agree <- meta.mod4$sigma2[2]

r2.level1.mod4 <- round((sigma_spline1.level1_agree - sigma_mod4.level1_agree)/sigma_spline1.level1_agree,2)
r2.level1.mod4 <- ifelse(r2.level1.mod4 < 0, 0, r2.level1.mod4)
r2.level2.mod4 <- round((sigma_spline1.level2_agree - sigma_mod4.level2_agree)/sigma_spline1.level2_agree,2)
r2.level2.mod4 <- ifelse(r2.level2.mod4 < 0, 0, r2.level2.mod4)

mod4.agree <- as.data.frame(round(
  cbind(results.mod4$n, results.mod4$b[5], results.mod4$se[5], results.mod4$zval[5], 
  results.mod4$pval[5], r2.level1 = r2.level1.mod4, r2.level2 = r2.level2.mod4),3))


## Maladaptive (Moderator 5)
meta.mod5 <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Maladaptive, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_agree, sparse = TRUE)

results.mod5 <- robust(meta.mod5, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod5.level1_agree <- meta.mod5$sigma2[1]
sigma_mod5.level2_agree <- meta.mod5$sigma2[2]

r2.level1.mod5 <- round((sigma_spline1.level1_agree - sigma_mod5.level1_agree)/sigma_spline1.level1_agree,2)
r2.level1.mod5 <- ifelse(r2.level1.mod5 < 0, 0, r2.level1.mod5)
r2.level2.mod5 <- round((sigma_spline1.level2_agree - sigma_mod5.level2_agree)/sigma_spline1.level2_agree,2)
r2.level2.mod5 <- ifelse(r2.level2.mod5 < 0, 0, r2.level2.mod5)

mod5.agree <- as.data.frame(round(
  cbind(results.mod5$n, results.mod5$b[5], results.mod5$se[5], results.mod5$zval[5], 
  results.mod5$pval[5], r2.level1 = r2.level1.mod5, r2.level2 = r2.level2.mod5),3))


## Big Five taxonomy (Moderator 6)
meta.mod6 <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + BigFive, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_agree, sparse = TRUE)

results.mod6 <- robust(meta.mod6, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod6.level1_agree <- meta.mod6$sigma2[1]
sigma_mod6.level2_agree <- meta.mod6$sigma2[2]

r2.level1.mod6 <- round((sigma_spline1.level1_agree - sigma_mod6.level1_agree)/sigma_spline1.level1_agree,2)
r2.level1.mod6 <- ifelse(r2.level1.mod6 < 0, 0, r2.level1.mod6)
r2.level2.mod6 <- round((sigma_spline1.level2_agree - sigma_mod6.level2_agree)/sigma_spline1.level2_agree,2)
r2.level2.mod6 <- ifelse(r2.level2.mod6 < 0, 0, r2.level2.mod6)

mod6.agree <- as.data.frame(round(
  cbind(results.mod6$n, results.mod6$b[5], results.mod6$se[5], results.mod6$zval[5], 
  results.mod6$pval[5], r2.level1 = r2.level1.mod6, r2.level2 = r2.level2.mod6),3))


## Inverse Coded (Moderator 7)
meta.mod7 <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Inverse, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_agree, sparse = TRUE)

results.mod7 <- robust(meta.mod7, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod7.level1_agree <- meta.mod7$sigma2[1]
sigma_mod7.level2_agree <- meta.mod7$sigma2[2]

r2.level1.mod7 <- round((sigma_spline1.level1_agree - sigma_mod7.level1_agree)/sigma_spline1.level1_agree,2)
r2.level1.mod7 <- ifelse(r2.level1.mod7 < 0, 0, r2.level1.mod7)
r2.level2.mod7 <- round((sigma_spline1.level2_agree - sigma_mod7.level2_agree)/sigma_spline1.level2_agree,2)
r2.level2.mod7 <- ifelse(r2.level2.mod7 < 0, 0, r2.level2.mod7)

mod7.agree <- as.data.frame(round(
  cbind(results.mod7$n, results.mod7$b[5], results.mod7$se[5], results.mod7$zval[5], 
  results.mod7$pval[5], r2.level1 = r2.level1.mod7, r2.level2 = r2.level2.mod7),3))


## Representative sample (Moderator 8)
meta.mod8 <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Represent, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_agree, sparse = TRUE)

results.mod8 <- robust(meta.mod8, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod8.level1_agree <- meta.mod8$sigma2[1]
sigma_mod8.level2_agree <- meta.mod8$sigma2[2]

r2.level1.mod8 <- round((sigma_spline1.level1_agree - sigma_mod8.level1_agree)/sigma_spline1.level1_agree,2)
r2.level1.mod8 <- ifelse(r2.level1.mod8 < 0, 0, r2.level1.mod8)
r2.level2.mod8 <- round((sigma_spline1.level2_agree - sigma_mod8.level2_agree)/sigma_spline1.level2_agree,2)
r2.level2.mod8 <- ifelse(r2.level2.mod8 < 0, 0, r2.level2.mod8)

mod8.agree <- as.data.frame(round(
  cbind(results.mod8$n, results.mod8$b[5], results.mod8$se[5], results.mod8$zval[5], 
  results.mod8$pval[5], r2.level1 = r2.level1.mod8, r2.level2 = r2.level2.mod8),3))

## Percentage Female (Moderator 9)
meta.mod9 <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Female.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_agree, sparse = TRUE)

results.mod9 <- robust(meta.mod9, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod9.level1_agree <- meta.mod9$sigma2[1]
sigma_mod9.level2_agree <- meta.mod9$sigma2[2]

r2.level1.mod9 <- round((sigma_spline1.level1_agree - sigma_mod9.level1_agree)/sigma_spline1.level1_agree,2)
r2.level1.mod9 <- ifelse(r2.level1.mod9 < 0, 0, r2.level1.mod9)
r2.level2.mod9 <- round((sigma_spline1.level2_agree - sigma_mod9.level2_agree)/sigma_spline1.level2_agree,2)
r2.level2.mod9 <- ifelse(r2.level2.mod9 < 0, 0, r2.level2.mod9)

mod9.agree <- as.data.frame(round(
  cbind(results.mod9$n, results.mod9$b[5], results.mod9$se[5], results.mod9$zval[5], 
  results.mod9$pval[5], r2.level1 = r2.level1.mod9, r2.level2 = r2.level2.mod9),3))




## Region of data collection (Moderator 10)
meta.mod10 <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Region, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_agree, sparse = TRUE)

results.mod10 <- robust(meta.mod10, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod10.level1_agree <- meta.mod10$sigma2[1]
sigma_mod10.level2_agree <- meta.mod10$sigma2[2]

r2.level1.mod10 <- round((sigma_spline1.level1_agree - sigma_mod10.level1_agree)/sigma_spline1.level1_agree,2)
r2.level1.mod10 <- ifelse(r2.level1.mod10 < 0, 0, r2.level1.mod10)
r2.level2.mod10 <- round((sigma_spline1.level2_agree - sigma_mod10.level2_agree)/sigma_spline1.level2_agree,2)
r2.level2.mod10 <- ifelse(r2.level2.mod10 < 0, 0, r2.level2.mod10)

mod10.agree <- as.data.frame(round(
  cbind(results.mod10$n, results.mod10$b[5:8], results.mod10$se[5:8], results.mod10$zval[5:8], 
  results.mod10$pval[5:8], r2.level1 = r2.level1.mod10, r2.level2 = r2.level2.mod10),3))


mod.agree <- rbind(mod1.agree, mod2.agree, mod3.agree, mod4.agree, mod5.agree, mod6.agree, mod7.agree, mod8.agree, mod9.agree, mod10.agree)

names(mod.agree) <- c("Studies", "*b*", "*SE*", "*z*", "*p*", "R^2^~Level1~","R^2^~Level2~")
row.names(mod.agree) <- c("Publication year", 
                          "Reliability", "Other report", "Facet", 
                          "Maladaptive", "Big Five", "Inverse coded", 
                          "Representative", "Percentage female", 
                          "Asia", "Global South", 
                          "Nothern Europe", "Southern Europe")

kable(mod.agree
      , caption="**Moderator analyses for agreeableness (separate models)**"
      , escape=FALSE
      , label = NA) %>% 
  pack_rows("Region", 10, 13) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Moderator analyses for agreeableness (separate models)
Studies b SE z p R2Level1 R2Level2
Publication year 138 0.004 0.004 0.998 0.327 0.00 0.00
Reliability 110 -0.139 0.276 -0.505 0.623 0.25 0.00
Other report 138 -0.002 0.056 -0.038 0.970 0.00 0.00
Facet 138 0.109 0.066 1.656 0.121 0.02 0.03
Maladaptive 137 0.102 0.069 1.463 0.159 0.01 0.00
Big Five 138 -0.183 0.050 -3.671 0.001 0.02 0.04
Inverse coded 138 -0.001 0.063 -0.015 0.988 0.00 0.00
Representative 135 -0.056 0.092 -0.604 0.550 0.00 0.02
Percentage female 135 -0.001 0.001 -2.162 0.053 0.07 0.00
Region
Asia 137 0.098 0.091 1.078 0.295 0.00 0.07
Global South 137 0.441 0.269 1.641 0.162 0.00 0.07
Nothern Europe 137 -0.057 0.063 -0.899 0.371 0.00 0.07
Southern Europe 137 -0.085 0.117 -0.730 0.473 0.00 0.07

Note. These Pseudo-R2 values should be interpreted with caution as the included studies slightly differed across moderators (e.g., due to missing values) making a comparison more difficult.

Plot

You can hover over the points in this graph to receive more information.

## Run alternative model for Region
data_agree$Region.d <- as.factor(ifelse(data_agree$Region == "North America", 0, 1))
meta.mod10b <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Region.d, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_agree, sparse = TRUE)

## Prepare loop
plot_data <- data.frame(Moderator = factor(c("Publication year", "Publication year", 
                                      "Reliability", "Reliability", 
                                      "Other report", "Other report", 
                                      "Facet", "Facet", 
                                      "Maladaptive", "Maladaptive", 
                                      "Big Five", "Big Five", 
                                      "Inverse coded", "Inverse coded",
                                      "Representative", "Representative",
                                      "Percentage female", "Percentage female", 
                                      "Region", "Region"), 
                                      levels = c("Region", "Percentage female", 
                                                 "Representative", "Inverse coded", 
                                                 "Big Five", "Maladaptive", 
                                                 "Facet", "Other report", 
                                                 "Reliability", "Publication year"), 
                                      ordered = TRUE), 
                        Score = c(0, 5,
                                  0, 0.10, 
                                  0, 1,
                                  0, 1,
                                  0, 1,
                                  0, 1,
                                  0, 1,
                                  0, 1,
                                  0, 10, 
                                  0, 1), 
                        SD = NA, 
                        CI.lower = NA,
                        CI.upper = NA, 
                        Sig = factor(c(0, 0, 
                                       0, 0,
                                       0, 0,
                                       0, 0,
                                       0, 0,
                                       1, 1,
                                       0, 0,
                                       0, 0,
                                       0, 0, 
                                       0, 0)),
                        label = c("2015", "2020", 
                                  "0.78", "0.88", 
                                  "Self", "Other", 
                                  "No", "Yes", 
                                  "No", "Yes", 
                                  "No", "Yes", 
                                  "No", "Yes", 
                                  "No", "Yes", 
                                  "53%", "63%", 
                                  "North America", "Other"))
plot_data$ID <- 1:nrow(plot_data)

meta.models <- list(meta.mod1, meta.mod1, meta.mod2, meta.mod2, 
                    meta.mod3, meta.mod3, meta.mod4, meta.mod4, 
                    meta.mod5, meta.mod5, meta.mod6, meta.mod6,
                    meta.mod7, meta.mod7, meta.mod8, meta.mod8, 
                    meta.mod9, meta.mod9, meta.mod10b, meta.mod10b)                

## Loop to create plot data
for (i in 1:nrow(plot_data)) {                       
  plot_data$SD[i] <- predict(meta.models[[i]], 
                             newmods=c(20, 0, 0, plot_data$Score[i]), 
                             transf=exp, addx=TRUE)$pred
  plot_data$CI.lower[i] <- predict(meta.models[[i]], 
                                   newmods=c(20, 0, 0, plot_data$Score[i]), 
                                   transf=exp, addx=TRUE)$ci.lb
  plot_data$CI.upper[i] <- predict(meta.models[[i]], 
                                   newmods=c(20, 0, 0, plot_data$Score[i]), 
                                   transf=exp, addx=TRUE)$ci.ub
} 

## Plot
plot <- ggplot(data = plot_data, aes(x = SD, y = Moderator, group = Score)) +
  geom_errorbar(aes(xmin=CI.lower, xmax=CI.upper, group = Score, colour = Sig), 
                position=position_dodge(0.75), width = 0) + 
  geom_point_interactive(aes(group = Score, colour = Sig, 
                             tooltip = 
                               paste0("SD = ", round(SD,3), 
                                      ", 95% CI = [", round(CI.lower,3),
                                      ", ", round(CI.upper,3), "]"), 
                             data_id = ID), 
             size = 1.8, position=position_dodge(0.75)) + 
  geom_text(aes(label = label, x = CI.upper + 0.001, y = Moderator, group = Score),
            position=position_dodge(0.75),
            hjust = 0, size = 4.5) +
  theme_pub() +
  scale_x_continuous(limits = c(0,0.3)) +
  scale_colour_manual(values = c("0" = "grey", "1" = "black")) +
  theme(legend.position = "none", 
        axis.text.y = element_text(hjust = 1)) +
  labs(y = "Moderators", x = expression(bold("SD"[POMP])), title = "Agreeableness")

girafe(ggobj = plot)

Note. To allow a better graphical depiction, we dummy-coded the moderator “Region” for the illustration in this graph (0 = “North America”, 1 = “Other”). However, in the main analyses, a polytomous categorical predictor was used. Significant moderation effects are depicted in black, non-significant moderations are in grey. The point estimates are calculated for 20 year old participants that are assessed over a time interval of one year.

Conscientiousness

Table

## Create age bins
data_consc$abin_1  <- ifelse(data_consc$T1_AgeM <= 40, data_consc$T1_AgeM, 40)
data_consc$abin_2  <- ifelse(data_consc$T1_AgeM > 40, data_consc$T1_AgeM - 40, 0) 

## Publication Year (Moderator 1)
meta.mod1 <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Year.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_consc, sparse = TRUE)

results.mod1 <- robust(meta.mod1, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod1.level1_consc <- meta.mod1$sigma2[1]
sigma_mod1.level2_consc <- meta.mod1$sigma2[2]

r2.level1.mod1 <- round((sigma_spline1.level1_consc - sigma_mod1.level1_consc)/sigma_spline1.level1_consc,2)
r2.level1.mod1 <- ifelse(r2.level1.mod1 < 0, 0, r2.level1.mod1)
r2.level2.mod1 <- round((sigma_spline1.level2_consc - sigma_mod1.level2_consc)/sigma_spline1.level2_consc,2)
r2.level2.mod1 <- ifelse(r2.level2.mod1 < 0, 0, r2.level2.mod1)

mod1.consc <- as.data.frame(round(
  cbind(results.mod1$n, results.mod1$b[5], results.mod1$se[5], results.mod1$zval[5], 
  results.mod1$pval[5], r2.level1 = r2.level1.mod1, r2.level2 = r2.level2.mod1),3))


## Reliability (Moderator 2)
meta.mod2 <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Alpha_T1.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_consc, sparse = TRUE)

results.mod2 <- robust(meta.mod2, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod2.level1_consc <- meta.mod2$sigma2[1]
sigma_mod2.level2_consc <- meta.mod2$sigma2[2]

r2.level1.mod2 <- round((sigma_spline1.level1_consc - sigma_mod2.level1_consc)/sigma_spline1.level1_consc,2)
r2.level1.mod2 <- ifelse(r2.level1.mod2 < 0, 0, r2.level1.mod2)
r2.level2.mod2 <- round((sigma_spline1.level2_consc - sigma_mod2.level2_consc)/sigma_spline1.level2_consc,2)
r2.level2.mod2 <- ifelse(r2.level2.mod2 < 0, 0, r2.level2.mod2)

mod2.consc <- as.data.frame(round(
  cbind(results.mod2$n, results.mod2$b[5], results.mod2$se[5], results.mod2$zval[5], 
  results.mod2$pval[5], r2.level1 = r2.level1.mod2, r2.level2 = r2.level2.mod2),3))


## Other report (Moderator 3)
meta.mod3 <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 +
                      T2_lag.c + OtherReport, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_consc, sparse = TRUE)

results.mod3 <- robust(meta.mod3, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod3.level1_consc <- meta.mod3$sigma2[1]
sigma_mod3.level2_consc <- meta.mod3$sigma2[2]

r2.level1.mod3 <- round((sigma_spline1.level1_consc - sigma_mod3.level1_consc)/sigma_spline1.level1_consc,2)
r2.level1.mod3 <- ifelse(r2.level1.mod3 < 0, 0, r2.level1.mod3)
r2.level2.mod3 <- round((sigma_spline1.level2_consc - sigma_mod3.level2_consc)/sigma_spline1.level2_consc,2)
r2.level2.mod3 <- ifelse(r2.level2.mod3 < 0, 0, r2.level2.mod3)

mod3.consc <- as.data.frame(round(
  cbind(results.mod3$n, results.mod3$b[5], results.mod3$se[5], results.mod3$zval[5], 
  results.mod3$pval[5], r2.level1 = r2.level1.mod3, r2.level2 = r2.level2.mod3),3))


## Facet (Moderator 4)
meta.mod4 <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Facet, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_consc, sparse = TRUE)

results.mod4 <- robust(meta.mod4, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod4.level1_consc <- meta.mod4$sigma2[1]
sigma_mod4.level2_consc <- meta.mod4$sigma2[2]

r2.level1.mod4 <- round((sigma_spline1.level1_consc - sigma_mod4.level1_consc)/sigma_spline1.level1_consc,2)
r2.level1.mod4 <- ifelse(r2.level1.mod4 < 0, 0, r2.level1.mod4)
r2.level2.mod4 <- round((sigma_spline1.level2_consc - sigma_mod4.level2_consc)/sigma_spline1.level2_consc,2)
r2.level2.mod4 <- ifelse(r2.level2.mod4 < 0, 0, r2.level2.mod4)

mod4.consc <- as.data.frame(round(
  cbind(results.mod4$n, results.mod4$b[5], results.mod4$se[5], results.mod4$zval[5], 
  results.mod4$pval[5], r2.level1 = r2.level1.mod4, r2.level2 = r2.level2.mod4),3))


## Maladaptive (Moderator 5)
meta.mod5 <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Maladaptive, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_consc, sparse = TRUE)

results.mod5 <- robust(meta.mod5, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod5.level1_consc <- meta.mod5$sigma2[1]
sigma_mod5.level2_consc <- meta.mod5$sigma2[2]

r2.level1.mod5 <- round((sigma_spline1.level1_consc - sigma_mod5.level1_consc)/sigma_spline1.level1_consc,2)
r2.level1.mod5 <- ifelse(r2.level1.mod5 < 0, 0, r2.level1.mod5)
r2.level2.mod5 <- round((sigma_spline1.level2_consc - sigma_mod5.level2_consc)/sigma_spline1.level2_consc,2)
r2.level2.mod5 <- ifelse(r2.level2.mod5 < 0, 0, r2.level2.mod5)

mod5.consc <- as.data.frame(round(
  cbind(results.mod5$n, results.mod5$b[5], results.mod5$se[5], results.mod5$zval[5], 
  results.mod5$pval[5], r2.level1 = r2.level1.mod5, r2.level2 = r2.level2.mod5),3))


## Big Five taxonomy (Moderator 6)
meta.mod6 <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + BigFive, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_consc, sparse = TRUE)

results.mod6 <- robust(meta.mod6, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod6.level1_consc <- meta.mod6$sigma2[1]
sigma_mod6.level2_consc <- meta.mod6$sigma2[2]

r2.level1.mod6 <- round((sigma_spline1.level1_consc - sigma_mod6.level1_consc)/sigma_spline1.level1_consc,2)
r2.level1.mod6 <- ifelse(r2.level1.mod6 < 0, 0, r2.level1.mod6)
r2.level2.mod6 <- round((sigma_spline1.level2_consc - sigma_mod6.level2_consc)/sigma_spline1.level2_consc,2)
r2.level2.mod6 <- ifelse(r2.level2.mod6 < 0, 0, r2.level2.mod6)

mod6.consc <- as.data.frame(round(
  cbind(results.mod6$n, results.mod6$b[5], results.mod6$se[5], results.mod6$zval[5], 
  results.mod6$pval[5], r2.level1 = r2.level1.mod6, r2.level2 = r2.level2.mod6),3))


## Inverse Coded (Moderator 7)
meta.mod7 <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Inverse, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_consc, sparse = TRUE)

results.mod7 <- robust(meta.mod7, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod7.level1_consc <- meta.mod7$sigma2[1]
sigma_mod7.level2_consc <- meta.mod7$sigma2[2]

r2.level1.mod7 <- round((sigma_spline1.level1_consc - sigma_mod7.level1_consc)/sigma_spline1.level1_consc,2)
r2.level1.mod7 <- ifelse(r2.level1.mod7 < 0, 0, r2.level1.mod7)
r2.level2.mod7 <- round((sigma_spline1.level2_consc - sigma_mod7.level2_consc)/sigma_spline1.level2_consc,2)
r2.level2.mod7 <- ifelse(r2.level2.mod7 < 0, 0, r2.level2.mod7)

mod7.consc <- as.data.frame(round(
  cbind(results.mod7$n, results.mod7$b[5], results.mod7$se[5], results.mod7$zval[5], 
  results.mod7$pval[5], r2.level1 = r2.level1.mod7, r2.level2 = r2.level2.mod7),3))


## Representative sample (Moderator 8)
meta.mod8 <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Represent, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_consc, sparse = TRUE)

results.mod8 <- robust(meta.mod8, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod8.level1_consc <- meta.mod8$sigma2[1]
sigma_mod8.level2_consc <- meta.mod8$sigma2[2]

r2.level1.mod8 <- round((sigma_spline1.level1_consc - sigma_mod8.level1_consc)/sigma_spline1.level1_consc,2)
r2.level1.mod8 <- ifelse(r2.level1.mod8 < 0, 0, r2.level1.mod8)
r2.level2.mod8 <- round((sigma_spline1.level2_consc - sigma_mod8.level2_consc)/sigma_spline1.level2_consc,2)
r2.level2.mod8 <- ifelse(r2.level2.mod8 < 0, 0, r2.level2.mod8)

mod8.consc <- as.data.frame(round(
  cbind(results.mod8$n, results.mod8$b[5], results.mod8$se[5], results.mod8$zval[5], 
  results.mod8$pval[5], r2.level1 = r2.level1.mod8, r2.level2 = r2.level2.mod8),3))

## Percentage Female (Moderator 9)
meta.mod9 <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Female.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_consc, sparse = TRUE)

results.mod9 <- robust(meta.mod9, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod9.level1_consc <- meta.mod9$sigma2[1]
sigma_mod9.level2_consc <- meta.mod9$sigma2[2]

r2.level1.mod9 <- round((sigma_spline1.level1_consc - sigma_mod9.level1_consc)/sigma_spline1.level1_consc,2)
r2.level1.mod9 <- ifelse(r2.level1.mod9 < 0, 0, r2.level1.mod9)
r2.level2.mod9 <- round((sigma_spline1.level2_consc - sigma_mod9.level2_consc)/sigma_spline1.level2_consc,2)
r2.level2.mod9 <- ifelse(r2.level2.mod9 < 0, 0, r2.level2.mod9)

mod9.consc <- as.data.frame(round(
  cbind(results.mod9$n, results.mod9$b[5], results.mod9$se[5], results.mod9$zval[5], 
  results.mod9$pval[5], r2.level1 = r2.level1.mod9, r2.level2 = r2.level2.mod9),3))




## Region of data collection (Moderator 10)
meta.mod10 <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Region, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_consc, sparse = TRUE)

results.mod10 <- robust(meta.mod10, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod10.level1_consc <- meta.mod10$sigma2[1]
sigma_mod10.level2_consc <- meta.mod10$sigma2[2]

r2.level1.mod10 <- round((sigma_spline1.level1_consc - sigma_mod10.level1_consc)/sigma_spline1.level1_consc,2)
r2.level1.mod10 <- ifelse(r2.level1.mod10 < 0, 0, r2.level1.mod10)
r2.level2.mod10 <- round((sigma_spline1.level2_consc - sigma_mod10.level2_consc)/sigma_spline1.level2_consc,2)
r2.level2.mod10 <- ifelse(r2.level2.mod10 < 0, 0, r2.level2.mod10)

mod10.consc <- as.data.frame(round(
  cbind(results.mod10$n, results.mod10$b[5:8], results.mod10$se[5:8], results.mod10$zval[5:8], 
  results.mod10$pval[5:8], r2.level1 = r2.level1.mod10, r2.level2 = r2.level2.mod10),3))


mod.consc <- rbind(mod1.consc, mod2.consc, mod3.consc, mod4.consc, mod5.consc, mod6.consc, mod7.consc, mod8.consc, mod9.consc, mod10.consc)

names(mod.consc) <- c("Studies", "*b*", "*SE*", "*z*", "*p*", "R^2^~Level1~","R^2^~Level2~")
row.names(mod.consc) <- c("Publication year", 
                          "Reliability", "Other report", "Facet", 
                          "Maladaptive", "Big Five", "Inverse coded", 
                          "Representative", "Percentage female", 
                          "Asia", "Global South", 
                          "Nothern Europe", "Southern Europe")

kable(mod.consc
      , caption="**Moderator analyses for conscientiousness (separate models)**"
      , escape=FALSE
      , label = NA) %>% 
  pack_rows("Region", 10, 13) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Moderator analyses for conscientiousness (separate models)
Studies b SE z p R2Level1 R2Level2
Publication year 127 0.006 0.004 1.484 0.151 0.00 0.01
Reliability 100 -0.766 0.280 -2.738 0.017 0.04 0.14
Other report 127 -0.087 0.064 -1.369 0.191 0.00 0.02
Facet 127 0.184 0.042 4.370 0.001 0.05 0.02
Maladaptive 127 0.134 0.151 0.889 0.382 0.02 0.00
Big Five 127 -0.164 0.051 -3.218 0.003 0.01 0.05
Inverse coded 127 -0.104 0.075 -1.374 0.193 0.04 0.00
Representative 125 -0.101 0.082 -1.233 0.227 0.00 0.00
Percentage female 123 0.000 0.000 0.156 0.880 0.00 0.03
Region
Asia 124 -0.073 0.114 -0.637 0.534 0.03 0.00
Global South 124 0.109 0.078 1.402 0.198 0.03 0.00
Nothern Europe 124 -0.078 0.072 -1.079 0.284 0.03 0.00
Southern Europe 124 -0.109 0.102 -1.071 0.297 0.03 0.00

Note. These Pseudo-R2 values should be interpreted with caution as the included studies slightly differed across moderators (e.g., due to missing values) making a comparison more difficult.

Plot

You can hover over the points in this graph to receive more information.

## Run alternative model for Region
data_consc$Region.d <- as.factor(ifelse(data_consc$Region == "North America", 0, 1))
meta.mod10b <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Region.d, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_consc, sparse = TRUE)

## Prepare loop
plot_data <- data.frame(Moderator = factor(c("Publication year", "Publication year", 
                                      "Reliability", "Reliability", 
                                      "Other report", "Other report", 
                                      "Facet", "Facet", 
                                      "Maladaptive", "Maladaptive", 
                                      "Big Five", "Big Five", 
                                      "Inverse coded", "Inverse coded",
                                      "Representative", "Representative",
                                      "Percentage female", "Percentage female", 
                                      "Region", "Region"), 
                                      levels = c("Region", "Percentage female", 
                                                 "Representative", "Inverse coded", 
                                                 "Big Five", "Maladaptive", 
                                                 "Facet", "Other report", 
                                                 "Reliability", "Publication year"), 
                                      ordered = TRUE), 
                        Score = c(0, 5,
                                  0, 0.10, 
                                  0, 1,
                                  0, 1,
                                  0, 1,
                                  0, 1,
                                  0, 1,
                                  0, 1,
                                  0, 10, 
                                  0, 1), 
                        SD = NA, 
                        CI.lower = NA,
                        CI.upper = NA, 
                        Sig = factor(c(0, 0, 
                                       1, 1,
                                       0, 0,
                                       1, 1,
                                       0, 0,
                                       1, 1,
                                       0, 0,
                                       0, 0,
                                       0, 0, 
                                       0, 0)),
                        label = c("2015", "2020", 
                                  "0.78", "0.88", 
                                  "Self", "Other", 
                                  "No", "Yes", 
                                  "No", "Yes", 
                                  "No", "Yes", 
                                  "No", "Yes", 
                                  "No", "Yes", 
                                  "53%", "63%", 
                                  "North America", "Other"))
plot_data$ID <- 1:nrow(plot_data)

meta.models <- list(meta.mod1, meta.mod1, meta.mod2, meta.mod2, 
                    meta.mod3, meta.mod3, meta.mod4, meta.mod4, 
                    meta.mod5, meta.mod5, meta.mod6, meta.mod6,
                    meta.mod7, meta.mod7, meta.mod8, meta.mod8, 
                    meta.mod9, meta.mod9, meta.mod10b, meta.mod10b)                

## Loop to create plot data
for (i in 1:nrow(plot_data)) {                       
  plot_data$SD[i] <- predict(meta.models[[i]], 
                             newmods=c(20, 0, 0, plot_data$Score[i]), 
                             transf=exp, addx=TRUE)$pred
  plot_data$CI.lower[i] <- predict(meta.models[[i]], 
                             newmods=c(20, 0, 0, plot_data$Score[i]), 
                                   transf=exp, addx=TRUE)$ci.lb
  plot_data$CI.upper[i] <- predict(meta.models[[i]], 
                             newmods=c(20, 0, 0, plot_data$Score[i]), 
                                   transf=exp, addx=TRUE)$ci.ub
} 

## Plot
plot <- ggplot(data = plot_data, aes(x = SD, y = Moderator, group = Score)) +
  geom_errorbar(aes(xmin=CI.lower, xmax=CI.upper, group = Score, colour = Sig), 
                position=position_dodge(0.75), width = 0) + 
  geom_point_interactive(aes(group = Score, colour = Sig, 
                             tooltip = 
                               paste0("SD = ", round(SD,3), 
                                      ", 95% CI = [", round(CI.lower,3),
                                      ", ", round(CI.upper,3), "]"), 
                             data_id = ID), 
             size = 1.8, position=position_dodge(0.75)) + 
  geom_text(aes(label = label, x = CI.upper + 0.001, y = Moderator, group = Score),
            position=position_dodge(0.75),
            hjust = 0, size = 4.5) +
  theme_pub() +
  scale_x_continuous(limits = c(0,0.3)) +
  scale_colour_manual(values = c("0" = "grey", "1" = "black")) +
  theme(legend.position = "none", 
        axis.text.y = element_text(hjust = 1)) +
  labs(y = "Moderators", x = expression(bold("SD"[POMP])), title = "Conscientiousness")

girafe(ggobj = plot)

Note. To allow a better graphical depiction, we dummy-coded the moderator “Region” for the illustration in this graph (0 = “North America”, 1 = “Other”). However, in the main analyses, a polytomous categorical predictor was used. Significant moderation effects are depicted in black, non-significant moderations are in grey. The point estimates are calculated for 20 year old participants that are assessed over a time interval of one year.

Extraversion

Table

## Create age bins
data_extra$abin_1  <- ifelse(data_extra$T1_AgeM <= 55, data_extra$T1_AgeM, 55)
data_extra$abin_2  <- ifelse(data_extra$T1_AgeM > 55, data_extra$T1_AgeM - 55, 0) 

## Publication Year (Moderator 1)
meta.mod1 <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Year.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_extra, sparse = TRUE)

results.mod1 <- robust(meta.mod1, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod1.level1_extra <- meta.mod1$sigma2[1]
sigma_mod1.level2_extra <- meta.mod1$sigma2[2]

r2.level1.mod1 <- round((sigma_spline1.level1_extra - sigma_mod1.level1_extra)/sigma_spline1.level1_extra,2)
r2.level1.mod1 <- ifelse(r2.level1.mod1 < 0, 0, r2.level1.mod1)
r2.level2.mod1 <- round((sigma_spline1.level2_extra - sigma_mod1.level2_extra)/sigma_spline1.level2_extra,2)
r2.level2.mod1 <- ifelse(r2.level2.mod1 < 0, 0, r2.level2.mod1)

mod1.extra <- as.data.frame(round(
  cbind(results.mod1$n, results.mod1$b[5], results.mod1$se[5], results.mod1$zval[5], 
  results.mod1$pval[5], r2.level1 = r2.level1.mod1, r2.level2 = r2.level2.mod1),3))


## Reliability (Moderator 2)
meta.mod2 <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Alpha_T1.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_extra, sparse = TRUE)

results.mod2 <- robust(meta.mod2, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod2.level1_extra <- meta.mod2$sigma2[1]
sigma_mod2.level2_extra <- meta.mod2$sigma2[2]

r2.level1.mod2 <- round((sigma_spline1.level1_extra - sigma_mod2.level1_extra)/sigma_spline1.level1_extra,2)
r2.level1.mod2 <- ifelse(r2.level1.mod2 < 0, 0, r2.level1.mod2)
r2.level2.mod2 <- round((sigma_spline1.level2_extra - sigma_mod2.level2_extra)/sigma_spline1.level2_extra,2)
r2.level2.mod2 <- ifelse(r2.level2.mod2 < 0, 0, r2.level2.mod2)

mod2.extra <- as.data.frame(round(
  cbind(results.mod2$n, results.mod2$b[5], results.mod2$se[5], results.mod2$zval[5], 
  results.mod2$pval[5], r2.level1 = r2.level1.mod2, r2.level2 = r2.level2.mod2),3))


## Other report (Moderator 3)
meta.mod3 <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + OtherReport, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_extra, sparse = TRUE)

results.mod3 <- robust(meta.mod3, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod3.level1_extra <- meta.mod3$sigma2[1]
sigma_mod3.level2_extra <- meta.mod3$sigma2[2]

r2.level1.mod3 <- round((sigma_spline1.level1_extra - sigma_mod3.level1_extra)/sigma_spline1.level1_extra,2)
r2.level1.mod3 <- ifelse(r2.level1.mod3 < 0, 0, r2.level1.mod3)
r2.level2.mod3 <- round((sigma_spline1.level2_extra - sigma_mod3.level2_extra)/sigma_spline1.level2_extra,2)
r2.level2.mod3 <- ifelse(r2.level2.mod3 < 0, 0, r2.level2.mod3)

mod3.extra <- as.data.frame(round(
  cbind(results.mod3$n, results.mod3$b[5], results.mod3$se[5], results.mod3$zval[5], 
  results.mod3$pval[5], r2.level1 = r2.level1.mod3, r2.level2 = r2.level2.mod3),3))


## Facet (Moderator 4)
meta.mod4 <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Facet, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_extra, sparse = TRUE)

results.mod4 <- robust(meta.mod4, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod4.level1_extra <- meta.mod4$sigma2[1]
sigma_mod4.level2_extra <- meta.mod4$sigma2[2]

r2.level1.mod4 <- round((sigma_spline1.level1_extra - sigma_mod4.level1_extra)/sigma_spline1.level1_extra,2)
r2.level1.mod4 <- ifelse(r2.level1.mod4 < 0, 0, r2.level1.mod4)
r2.level2.mod4 <- round((sigma_spline1.level2_extra - sigma_mod4.level2_extra)/sigma_spline1.level2_extra,2)
r2.level2.mod4 <- ifelse(r2.level2.mod4 < 0, 0, r2.level2.mod4)

mod4.extra <- as.data.frame(round(
  cbind(results.mod4$n, results.mod4$b[5], results.mod4$se[5], results.mod4$zval[5], 
  results.mod4$pval[5], r2.level1 = r2.level1.mod4, r2.level2 = r2.level2.mod4),3))


## Maladaptive (Moderator 5)
meta.mod5 <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Maladaptive, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_extra, sparse = TRUE)

results.mod5 <- robust(meta.mod5, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod5.level1_extra <- meta.mod5$sigma2[1]
sigma_mod5.level2_extra <- meta.mod5$sigma2[2]

r2.level1.mod5 <- round((sigma_spline1.level1_extra - sigma_mod5.level1_extra)/sigma_spline1.level1_extra,2)
r2.level1.mod5 <- ifelse(r2.level1.mod5 < 0, 0, r2.level1.mod5)
r2.level2.mod5 <- round((sigma_spline1.level2_extra - sigma_mod5.level2_extra)/sigma_spline1.level2_extra,2)
r2.level2.mod5 <- ifelse(r2.level2.mod5 < 0, 0, r2.level2.mod5)

mod5.extra <- as.data.frame(round(
  cbind(results.mod5$n, results.mod5$b[5], results.mod5$se[5], results.mod5$zval[5], 
  results.mod5$pval[5], r2.level1 = r2.level1.mod5, r2.level2 = r2.level2.mod5),3))


## Big Five taxonomy (Moderator 6)
meta.mod6 <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + BigFive, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_extra, sparse = TRUE)

results.mod6 <- robust(meta.mod6, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod6.level1_extra <- meta.mod6$sigma2[1]
sigma_mod6.level2_extra <- meta.mod6$sigma2[2]

r2.level1.mod6 <- round((sigma_spline1.level1_extra - sigma_mod6.level1_extra)/sigma_spline1.level1_extra,2)
r2.level1.mod6 <- ifelse(r2.level1.mod6 < 0, 0, r2.level1.mod6)
r2.level2.mod6 <- round((sigma_spline1.level2_extra - sigma_mod6.level2_extra)/sigma_spline1.level2_extra,2)
r2.level2.mod6 <- ifelse(r2.level2.mod6 < 0, 0, r2.level2.mod6)

mod6.extra <- as.data.frame(round(
  cbind(results.mod6$n, results.mod6$b[5], results.mod6$se[5], results.mod6$zval[5], 
  results.mod6$pval[5], r2.level1 = r2.level1.mod6, r2.level2 = r2.level2.mod6),3))


## Inverse Coded (Moderator 7)
meta.mod7 <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Inverse, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_extra, sparse = TRUE)

results.mod7 <- robust(meta.mod7, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod7.level1_extra <- meta.mod7$sigma2[1]
sigma_mod7.level2_extra <- meta.mod7$sigma2[2]

r2.level1.mod7 <- round((sigma_spline1.level1_extra - sigma_mod7.level1_extra)/sigma_spline1.level1_extra,2)
r2.level1.mod7 <- ifelse(r2.level1.mod7 < 0, 0, r2.level1.mod7)
r2.level2.mod7 <- round((sigma_spline1.level2_extra - sigma_mod7.level2_extra)/sigma_spline1.level2_extra,2)
r2.level2.mod7 <- ifelse(r2.level2.mod7 < 0, 0, r2.level2.mod7)

mod7.extra <- as.data.frame(round(
  cbind(results.mod7$n, results.mod7$b[5], results.mod7$se[5], results.mod7$zval[5], 
  results.mod7$pval[5], r2.level1 = r2.level1.mod7, r2.level2 = r2.level2.mod7),3))


## Representative sample (Moderator 8)
meta.mod8 <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 +
                      T2_lag.c + Represent, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_extra, sparse = TRUE)

results.mod8 <- robust(meta.mod8, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod8.level1_extra <- meta.mod8$sigma2[1]
sigma_mod8.level2_extra <- meta.mod8$sigma2[2]

r2.level1.mod8 <- round((sigma_spline1.level1_extra - sigma_mod8.level1_extra)/sigma_spline1.level1_extra,2)
r2.level1.mod8 <- ifelse(r2.level1.mod8 < 0, 0, r2.level1.mod8)
r2.level2.mod8 <- round((sigma_spline1.level2_extra - sigma_mod8.level2_extra)/sigma_spline1.level2_extra,2)
r2.level2.mod8 <- ifelse(r2.level2.mod8 < 0, 0, r2.level2.mod8)

mod8.extra <- as.data.frame(round(
  cbind(results.mod8$n, results.mod8$b[5], results.mod8$se[5], results.mod8$zval[5], 
  results.mod8$pval[5], r2.level1 = r2.level1.mod8, r2.level2 = r2.level2.mod8),3))

## Percentage Female (Moderator 9)
meta.mod9 <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Female.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_extra, sparse = TRUE)

results.mod9 <- robust(meta.mod9, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod9.level1_extra <- meta.mod9$sigma2[1]
sigma_mod9.level2_extra <- meta.mod9$sigma2[2]

r2.level1.mod9 <- round((sigma_spline1.level1_extra - sigma_mod9.level1_extra)/sigma_spline1.level1_extra,2)
r2.level1.mod9 <- ifelse(r2.level1.mod9 < 0, 0, r2.level1.mod9)
r2.level2.mod9 <- round((sigma_spline1.level2_extra - sigma_mod9.level2_extra)/sigma_spline1.level2_extra,2)
r2.level2.mod9 <- ifelse(r2.level2.mod9 < 0, 0, r2.level2.mod9)

mod9.extra <- as.data.frame(round(
  cbind(results.mod9$n, results.mod9$b[5], results.mod9$se[5], results.mod9$zval[5], 
  results.mod9$pval[5], r2.level1 = r2.level1.mod9, r2.level2 = r2.level2.mod9),3))




## Region of data collection (Moderator 10)
meta.mod10 <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Region, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_extra, sparse = TRUE)

results.mod10 <- robust(meta.mod10, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod10.level1_extra <- meta.mod10$sigma2[1]
sigma_mod10.level2_extra <- meta.mod10$sigma2[2]

r2.level1.mod10 <- round((sigma_spline1.level1_extra - sigma_mod10.level1_extra)/sigma_spline1.level1_extra,2)
r2.level1.mod10 <- ifelse(r2.level1.mod10 < 0, 0, r2.level1.mod10)
r2.level2.mod10 <- round((sigma_spline1.level2_extra - sigma_mod10.level2_extra)/sigma_spline1.level2_extra,2)
r2.level2.mod10 <- ifelse(r2.level2.mod10 < 0, 0, r2.level2.mod10)

mod10.extra <- as.data.frame(round(
  cbind(results.mod10$n, results.mod10$b[5:8], results.mod10$se[5:8], results.mod10$zval[5:8], 
  results.mod10$pval[5:8], r2.level1 = r2.level1.mod10, r2.level2 = r2.level2.mod10),3))


mod.extra <- rbind(mod1.extra, mod2.extra, mod3.extra, mod4.extra, mod5.extra, mod6.extra, mod7.extra, mod8.extra, mod9.extra, mod10.extra)

names(mod.extra) <- c("Studies", "*b*", "*SE*", "*z*", "*p*", "R^2^~Level1~","R^2^~Level2~")
row.names(mod.extra) <- c("Publication year", 
                          "Reliability", "Other report", "Facet", 
                          "Maladaptive", "Big Five", "Inverse coded", 
                          "Representative", "Percentage female", 
                          "Asia", "Global South", 
                          "Nothern Europe", "Southern Europe")

kable(mod.extra
      , caption="**Moderator analyses for extraversion (separate models)**"
      , escape=FALSE
      , label = NA) %>% 
  pack_rows("Region", 10, 13) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Moderator analyses for extraversion (separate models)
Studies b SE z p R2Level1 R2Level2
Publication year 117 0.002 0.004 0.456 0.652 0.00 0.00
Reliability 91 -0.100 0.258 -0.389 0.709 0.25 0.00
Other report 117 0.005 0.036 0.144 0.888 0.00 0.00
Facet 117 0.212 0.047 4.554 0.001 0.06 0.09
Maladaptive 117 0.335 0.202 1.657 0.133 0.09 0.00
Big Five 117 -0.183 0.055 -3.338 0.002 0.00 0.13
Inverse coded 117 -0.060 0.076 -0.800 0.440 0.02 0.00
Representative 116 -0.109 0.063 -1.727 0.093 0.05 0.01
Percentage female 114 0.000 0.000 -0.211 0.840 0.04 0.01
Region
Asia 114 -0.260 0.148 -1.759 0.103 0.00 0.00
Global South 114 -0.029 0.066 -0.442 0.672 0.00 0.00
Nothern Europe 114 -0.096 0.065 -1.477 0.144 0.00 0.00
Southern Europe 114 -0.035 0.155 -0.227 0.824 0.00 0.00

Note. These Pseudo-R2 values should be interpreted with caution as the included studies slightly differed across moderators (e.g., due to missing values) making a comparison more difficult.

Plot

You can hover over the points in this graph to receive more information.

## Run alternative model for Region
data_extra$Region.d <- as.factor(ifelse(data_extra$Region == "North America", 0, 1))
meta.mod10b <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Region.d, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_extra, sparse = TRUE)

## Prepare loop
plot_data <- data.frame(Moderator = factor(c("Publication year", "Publication year", 
                                      "Reliability", "Reliability", 
                                      "Other report", "Other report", 
                                      "Facet", "Facet", 
                                      "Maladaptive", "Maladaptive", 
                                      "Big Five", "Big Five", 
                                      "Inverse coded", "Inverse coded",
                                      "Representative", "Representative",
                                      "Percentage female", "Percentage female", 
                                      "Region", "Region"), 
                                      levels = c("Region", "Percentage female", 
                                                 "Representative", "Inverse coded", 
                                                 "Big Five", "Maladaptive", 
                                                 "Facet", "Other report", 
                                                 "Reliability", "Publication year"), 
                                      ordered = TRUE), 
                        Score = c(0, 5,
                                  0, 0.10, 
                                  0, 1,
                                  0, 1,
                                  0, 1,
                                  0, 1,
                                  0, 1,
                                  0, 1,
                                  0, 10, 
                                  0, 1), 
                        SD = NA, 
                        CI.lower = NA,
                        CI.upper = NA, 
                        Sig = factor(c(0, 0, 
                                       0, 0,
                                       0, 0,
                                       1, 1,
                                       0, 0,
                                       1, 1,
                                       0, 0,
                                       0, 0,
                                       0, 0, 
                                       0, 0)),
                        label = c("2015", "2020", 
                                  "0.78", "0.88", 
                                  "Self", "Other", 
                                  "No", "Yes", 
                                  "No", "Yes", 
                                  "No", "Yes", 
                                  "No", "Yes", 
                                  "No", "Yes", 
                                  "53%", "63%", 
                                  "North America", "Other"))
plot_data$ID <- 1:nrow(plot_data)

meta.models <- list(meta.mod1, meta.mod1, meta.mod2, meta.mod2, 
                    meta.mod3, meta.mod3, meta.mod4, meta.mod4, 
                    meta.mod5, meta.mod5, meta.mod6, meta.mod6,
                    meta.mod7, meta.mod7, meta.mod8, meta.mod8, 
                    meta.mod9, meta.mod9, meta.mod10b, meta.mod10b)                

## Loop to create plot data
for (i in 1:nrow(plot_data)) {                       
  plot_data$SD[i] <- predict(meta.models[[i]], 
                             newmods=c(20, 0, 0, plot_data$Score[i]), 
                             transf=exp, addx=TRUE)$pred
  plot_data$CI.lower[i] <- predict(meta.models[[i]], 
                                   newmods=c(20, 0, 0, plot_data$Score[i]), 
                                   transf=exp, addx=TRUE)$ci.lb
  plot_data$CI.upper[i] <- predict(meta.models[[i]], 
                                   newmods=c(20, 0, 0, plot_data$Score[i]), 
                                   transf=exp, addx=TRUE)$ci.ub
} 

## Plot
plot <- ggplot(data = plot_data, aes(x = SD, y = Moderator, group = Score)) +
  geom_errorbar(aes(xmin=CI.lower, xmax=CI.upper, group = Score, colour = Sig), 
                position=position_dodge(0.75), width = 0) + 
  geom_point_interactive(aes(group = Score, colour = Sig, 
                             tooltip = 
                               paste0("SD = ", round(SD,3), 
                                      ", 95% CI = [", round(CI.lower,3),
                                      ", ", round(CI.upper,3), "]"), 
                             data_id = ID), 
             size = 1.8, position=position_dodge(0.75)) + 
  geom_text(aes(label = label, x = CI.upper + 0.001, y = Moderator, group = Score),
            position=position_dodge(0.75),
            hjust = 0, size = 4.5) +
  theme_pub() +
  scale_x_continuous(limits = c(0,0.3)) +
  scale_colour_manual(values = c("0" = "grey", "1" = "black")) +
  theme(legend.position = "none", 
        axis.text.y = element_text(hjust = 1)) +
  labs(y = "Moderators", x = expression(bold("SD"[POMP])), title = "Extraversion")

girafe(ggobj = plot)

Note. To allow a better graphical depiction, we dummy-coded the moderator “Region” for the illustration in this graph (0 = “North America”, 1 = “Other”). However, in the main analyses, a polytomous categorical predictor was used. Significant moderation effects are depicted in black, non-significant moderations are in grey. The point estimates are calculated for 20 year old participants that are assessed over a time interval of one year.

Neuroticism

Table

## Create age bins
data_neuro$abin_1  <- ifelse(data_neuro$T1_AgeM <= 25, data_neuro$T1_AgeM, 25)
data_neuro$abin_2  <- ifelse(data_neuro$T1_AgeM <= 75 & data_neuro$T1_AgeM > 25, 
                             data_neuro$T1_AgeM - 25, 
                             ifelse(data_neuro$T1_AgeM <= 25, 0, 75 - 25))
data_neuro$abin_3  <- ifelse(data_neuro$T1_AgeM > 75, data_neuro$T1_AgeM - 75, 0)  

## Publication Year (Moderator 1)
meta.mod1 <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 +
                      T2_lag.c + Year.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_neuro, sparse = TRUE)

results.mod1 <- robust(meta.mod1, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod1.level1_neuro <- meta.mod1$sigma2[1]
sigma_mod1.level2_neuro <- meta.mod1$sigma2[2]

r2.level1.mod1 <- round((sigma_spline1.level1_neuro - sigma_mod1.level1_neuro)/sigma_spline1.level1_neuro,2)
r2.level1.mod1 <- ifelse(r2.level1.mod1 < 0, 0, r2.level1.mod1)
r2.level2.mod1 <- round((sigma_spline1.level2_neuro - sigma_mod1.level2_neuro)/sigma_spline1.level2_neuro,2)
r2.level2.mod1 <- ifelse(r2.level2.mod1 < 0, 0, r2.level2.mod1)

mod1.neuro <- as.data.frame(round(
  cbind(results.mod1$n, results.mod1$b[6], results.mod1$se[6], results.mod1$zval[6], 
  results.mod1$pval[6], r2.level1 = r2.level1.mod1, r2.level2 = r2.level2.mod1),3))


## Reliability (Moderator 2)
meta.mod2 <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 +
                      T2_lag.c + Alpha_T1.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_neuro, sparse = TRUE)

results.mod2 <- robust(meta.mod2, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod2.level1_neuro <- meta.mod2$sigma2[1]
sigma_mod2.level2_neuro <- meta.mod2$sigma2[2]

r2.level1.mod2 <- round((sigma_spline1.level1_neuro - sigma_mod2.level1_neuro)/sigma_spline1.level1_neuro,2)
r2.level1.mod2 <- ifelse(r2.level1.mod2 < 0, 0, r2.level1.mod2)
r2.level2.mod2 <- round((sigma_spline1.level2_neuro - sigma_mod2.level2_neuro)/sigma_spline1.level2_neuro,2)
r2.level2.mod2 <- ifelse(r2.level2.mod2 < 0, 0, r2.level2.mod2)

mod2.neuro <- as.data.frame(round(
  cbind(results.mod2$n, results.mod2$b[6], results.mod2$se[6], results.mod2$zval[6], 
  results.mod2$pval[6], r2.level1 = r2.level1.mod2, r2.level2 = r2.level2.mod2),3))


## Other report (Moderator 3)
meta.mod3 <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 +
                      T2_lag.c + OtherReport, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_neuro, sparse = TRUE)

results.mod3 <- robust(meta.mod3, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod3.level1_neuro <- meta.mod3$sigma2[1]
sigma_mod3.level2_neuro <- meta.mod3$sigma2[2]

r2.level1.mod3 <- round((sigma_spline1.level1_neuro - sigma_mod3.level1_neuro)/sigma_spline1.level1_neuro,2)
r2.level1.mod3 <- ifelse(r2.level1.mod3 < 0, 0, r2.level1.mod3)
r2.level2.mod3 <- round((sigma_spline1.level2_neuro - sigma_mod3.level2_neuro)/sigma_spline1.level2_neuro,2)
r2.level2.mod3 <- ifelse(r2.level2.mod3 < 0, 0, r2.level2.mod3)

mod3.neuro <- as.data.frame(round(
  cbind(results.mod3$n, results.mod3$b[6], results.mod3$se[6], results.mod3$zval[6], 
  results.mod3$pval[6], r2.level1 = r2.level1.mod3, r2.level2 = r2.level2.mod3),3))


## Facet (Moderator 4)
meta.mod4 <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 +
                      T2_lag.c + Facet, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_neuro, sparse = TRUE)

results.mod4 <- robust(meta.mod4, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod4.level1_neuro <- meta.mod4$sigma2[1]
sigma_mod4.level2_neuro <- meta.mod4$sigma2[2]

r2.level1.mod4 <- round((sigma_spline1.level1_neuro - sigma_mod4.level1_neuro)/sigma_spline1.level1_neuro,2)
r2.level1.mod4 <- ifelse(r2.level1.mod4 < 0, 0, r2.level1.mod4)
r2.level2.mod4 <- round((sigma_spline1.level2_neuro - sigma_mod4.level2_neuro)/sigma_spline1.level2_neuro,2)
r2.level2.mod4 <- ifelse(r2.level2.mod4 < 0, 0, r2.level2.mod4)

mod4.neuro <- as.data.frame(round(
  cbind(results.mod4$n, results.mod4$b[6], results.mod4$se[6], results.mod4$zval[6], 
  results.mod4$pval[6], r2.level1 = r2.level1.mod4, r2.level2 = r2.level2.mod4),3))


## Maladaptive (Moderator 5)
meta.mod5 <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 +
                      T2_lag.c + Maladaptive, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_neuro, sparse = TRUE)

results.mod5 <- robust(meta.mod5, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod5.level1_neuro <- meta.mod5$sigma2[1]
sigma_mod5.level2_neuro <- meta.mod5$sigma2[2]

r2.level1.mod5 <- round((sigma_spline1.level1_neuro - sigma_mod5.level1_neuro)/sigma_spline1.level1_neuro,2)
r2.level1.mod5 <- ifelse(r2.level1.mod5 < 0, 0, r2.level1.mod5)
r2.level2.mod5 <- round((sigma_spline1.level2_neuro - sigma_mod5.level2_neuro)/sigma_spline1.level2_neuro,2)
r2.level2.mod5 <- ifelse(r2.level2.mod5 < 0, 0, r2.level2.mod5)

mod5.neuro <- as.data.frame(round(
  cbind(results.mod5$n, results.mod5$b[6], results.mod5$se[6], results.mod5$zval[6], 
  results.mod5$pval[6], r2.level1 = r2.level1.mod5, r2.level2 = r2.level2.mod5),3))


## Big Five taxonomy (Moderator 6)
meta.mod6 <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 +
                      T2_lag.c + BigFive, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_neuro, sparse = TRUE)

results.mod6 <- robust(meta.mod6, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod6.level1_neuro <- meta.mod6$sigma2[1]
sigma_mod6.level2_neuro <- meta.mod6$sigma2[2]

r2.level1.mod6 <- round((sigma_spline1.level1_neuro - sigma_mod6.level1_neuro)/sigma_spline1.level1_neuro,2)
r2.level1.mod6 <- ifelse(r2.level1.mod6 < 0, 0, r2.level1.mod6)
r2.level2.mod6 <- round((sigma_spline1.level2_neuro - sigma_mod6.level2_neuro)/sigma_spline1.level2_neuro,2)
r2.level2.mod6 <- ifelse(r2.level2.mod6 < 0, 0, r2.level2.mod6)

mod6.neuro <- as.data.frame(round(
  cbind(results.mod6$n, results.mod6$b[6], results.mod6$se[6], results.mod6$zval[6], 
  results.mod6$pval[6], r2.level1 = r2.level1.mod6, r2.level2 = r2.level2.mod6),3))


## Inverse Coded (Moderator 7)
meta.mod7 <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 +
                      T2_lag.c + Inverse, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_neuro, sparse = TRUE)

results.mod7 <- robust(meta.mod7, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod7.level1_neuro <- meta.mod7$sigma2[1]
sigma_mod7.level2_neuro <- meta.mod7$sigma2[2]

r2.level1.mod7 <- round((sigma_spline1.level1_neuro - sigma_mod7.level1_neuro)/sigma_spline1.level1_neuro,2)
r2.level1.mod7 <- ifelse(r2.level1.mod7 < 0, 0, r2.level1.mod7)
r2.level2.mod7 <- round((sigma_spline1.level2_neuro - sigma_mod7.level2_neuro)/sigma_spline1.level2_neuro,2)
r2.level2.mod7 <- ifelse(r2.level2.mod7 < 0, 0, r2.level2.mod7)

mod7.neuro <- as.data.frame(round(
  cbind(results.mod7$n, results.mod7$b[6], results.mod7$se[6], results.mod7$zval[6], 
  results.mod7$pval[6], r2.level1 = r2.level1.mod7, r2.level2 = r2.level2.mod7),3))


## Representative sample (Moderator 8)
meta.mod8 <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 +
                      T2_lag.c + Represent, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_neuro, sparse = TRUE)

results.mod8 <- robust(meta.mod8, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod8.level1_neuro <- meta.mod8$sigma2[1]
sigma_mod8.level2_neuro <- meta.mod8$sigma2[2]

r2.level1.mod8 <- round((sigma_spline1.level1_neuro - sigma_mod8.level1_neuro)/sigma_spline1.level1_neuro,2)
r2.level1.mod8 <- ifelse(r2.level1.mod8 < 0, 0, r2.level1.mod8)
r2.level2.mod8 <- round((sigma_spline1.level2_neuro - sigma_mod8.level2_neuro)/sigma_spline1.level2_neuro,2)
r2.level2.mod8 <- ifelse(r2.level2.mod8 < 0, 0, r2.level2.mod8)

mod8.neuro <- as.data.frame(round(
  cbind(results.mod8$n, results.mod8$b[6], results.mod8$se[6], results.mod8$zval[6], 
  results.mod8$pval[6], r2.level1 = r2.level1.mod8, r2.level2 = r2.level2.mod8),3))

## Percentage Female (Moderator 9)
meta.mod9 <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 +
                      T2_lag.c + Female.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_neuro, sparse = TRUE)

results.mod9 <- robust(meta.mod9, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod9.level1_neuro <- meta.mod9$sigma2[1]
sigma_mod9.level2_neuro <- meta.mod9$sigma2[2]

r2.level1.mod9 <- round((sigma_spline1.level1_neuro - sigma_mod9.level1_neuro)/sigma_spline1.level1_neuro,2)
r2.level1.mod9 <- ifelse(r2.level1.mod9 < 0, 0, r2.level1.mod9)
r2.level2.mod9 <- round((sigma_spline1.level2_neuro - sigma_mod9.level2_neuro)/sigma_spline1.level2_neuro,2)
r2.level2.mod9 <- ifelse(r2.level2.mod9 < 0, 0, r2.level2.mod9)

mod9.neuro <- as.data.frame(round(
  cbind(results.mod9$n, results.mod9$b[6], results.mod9$se[6], results.mod9$zval[6], 
  results.mod9$pval[6], r2.level1 = r2.level1.mod9, r2.level2 = r2.level2.mod9),3))




## Region of data collection (Moderator 10)
meta.mod10 <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 +
                      T2_lag.c + Region, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_neuro, sparse = TRUE)

results.mod10 <- robust(meta.mod10, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod10.level1_neuro <- meta.mod10$sigma2[1]
sigma_mod10.level2_neuro <- meta.mod10$sigma2[2]

r2.level1.mod10 <- round((sigma_spline1.level1_neuro - sigma_mod10.level1_neuro)/sigma_spline1.level1_neuro,2)
r2.level1.mod10 <- ifelse(r2.level1.mod10 < 0, 0, r2.level1.mod10)
r2.level2.mod10 <- round((sigma_spline1.level2_neuro - sigma_mod10.level2_neuro)/sigma_spline1.level2_neuro,2)
r2.level2.mod10 <- ifelse(r2.level2.mod10 < 0, 0, r2.level2.mod10)

mod10.neuro <- as.data.frame(round(
  cbind(results.mod10$n, results.mod10$b[6:9], results.mod10$se[6:9], results.mod10$zval[6:9], 
  results.mod10$pval[6:9], r2.level1 = r2.level1.mod10, r2.level2 = r2.level2.mod10),3))


mod.neuro <- rbind(mod1.neuro, mod2.neuro, mod3.neuro, mod4.neuro, mod5.neuro, mod6.neuro, mod7.neuro, mod8.neuro, mod9.neuro, mod10.neuro)

names(mod.neuro) <- c("Studies", "*b*", "*SE*", "*z*", "*p*", "R^2^~Level1~","R^2^~Level2~")
row.names(mod.neuro) <- c("Publication year", 
                          "Reliability", "Other report", "Facet", 
                          "Maladaptive", "Big Five", "Inverse coded", 
                          "Representative", "Percentage female", 
                          "Asia", "Global South", 
                          "Nothern Europe", "Southern Europe")

kable(mod.neuro
      , caption="**Moderator analyses for neuroticism (separate models)**"
      , escape=FALSE
      , label = NA) %>% 
  pack_rows("Region", 10, 13) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Moderator analyses for neuroticism (separate models)
Studies b SE z p R2Level1 R2Level2
Publication year 185 0.003 0.003 0.886 0.380 0.00 0.00
Reliability 147 -0.350 0.162 -2.164 0.054 0.16 0.00
Other report 185 -0.052 0.043 -1.213 0.239 0.00 0.02
Facet 185 0.029 0.060 0.472 0.642 0.00 0.01
Maladaptive 184 -0.088 0.069 -1.285 0.216 0.01 0.00
Big Five 185 -0.030 0.055 -0.544 0.589 0.00 0.00
Inverse coded 185 0.000 0.042 -0.002 0.998 0.00 0.00
Representative 183 -0.097 0.054 -1.806 0.079 0.00 0.02
Percentage female 180 -0.001 0.001 -0.798 0.440 0.02 0.03
Region
Asia 181 -0.015 0.067 -0.218 0.829 0.00 0.00
Global South 181 0.131 0.094 1.390 0.204 0.00 0.00
Nothern Europe 181 -0.031 0.054 -0.583 0.561 0.00 0.00
Southern Europe 181 0.033 0.101 0.327 0.746 0.00 0.00

Note. These Pseudo-R2 values should be interpreted with caution as the included studies slightly differed across moderators (e.g., due to missing values) making a comparison more difficult.

Plot

You can hover over the points in this graph to receive more information.

## Run alternative model for Region
data_neuro$Region.d <- as.factor(ifelse(data_neuro$Region == "North America", 0, 1))
meta.mod10b <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 +
                      T2_lag.c + Region.d, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_neuro, sparse = TRUE)

## Prepare loop
plot_data <- data.frame(Moderator = factor(c("Publication year", "Publication year", 
                                      "Reliability", "Reliability", 
                                      "Other report", "Other report", 
                                      "Facet", "Facet", 
                                      "Maladaptive", "Maladaptive", 
                                      "Big Five", "Big Five", 
                                      "Inverse coded", "Inverse coded",
                                      "Representative", "Representative",
                                      "Percentage female", "Percentage female", 
                                      "Region", "Region"), 
                                      levels = c("Region", "Percentage female", 
                                                 "Representative", "Inverse coded", 
                                                 "Big Five", "Maladaptive", 
                                                 "Facet", "Other report", 
                                                 "Reliability", "Publication year"), 
                                      ordered = TRUE), 
                        Score = c(0, 5,
                                  0, 0.10, 
                                  0, 1,
                                  0, 1,
                                  0, 1,
                                  0, 1,
                                  0, 1,
                                  0, 1,
                                  0, 10, 
                                  0, 1), 
                        SD = NA, 
                        CI.lower = NA,
                        CI.upper = NA, 
                        Sig = factor(c(0, 0, 
                                       0, 0,
                                       0, 0,
                                       0, 0,
                                       0, 0,
                                       0, 0,
                                       0, 0,
                                       0, 0,
                                       0, 0, 
                                       0, 0)),
                        label = c("2015", "2020", 
                                  "0.78", "0.88", 
                                  "Self", "Other", 
                                  "No", "Yes", 
                                  "No", "Yes", 
                                  "No", "Yes", 
                                  "No", "Yes", 
                                  "No", "Yes", 
                                  "53%", "63%", 
                                  "North America", "Other"))
plot_data$ID <- 1:nrow(plot_data)

meta.models <- list(meta.mod1, meta.mod1, meta.mod2, meta.mod2, 
                    meta.mod3, meta.mod3, meta.mod4, meta.mod4, 
                    meta.mod5, meta.mod5, meta.mod6, meta.mod6,
                    meta.mod7, meta.mod7, meta.mod8, meta.mod8, 
                    meta.mod9, meta.mod9, meta.mod10b, meta.mod10b)                

## Loop to create plot data
for (i in 1:nrow(plot_data)) {                       
  plot_data$SD[i] <- predict(meta.models[[i]], 
                             newmods=c(20, 0, 0, 0, plot_data$Score[i]), 
                             transf=exp, addx=TRUE)$pred
  plot_data$CI.lower[i] <- predict(meta.models[[i]], 
                                   newmods=c(20, 0, 0, 0, plot_data$Score[i]), 
                                   transf=exp, addx=TRUE)$ci.lb
  plot_data$CI.upper[i] <- predict(meta.models[[i]], 
                                   newmods=c(20, 0, 0, 0, plot_data$Score[i]), 
                                   transf=exp, addx=TRUE)$ci.ub
} 

## Plot
plot <- ggplot(data = plot_data, aes(x = SD, y = Moderator, group = Score)) +
  geom_errorbar(aes(xmin=CI.lower, xmax=CI.upper, group = Score, colour = Sig), 
                position=position_dodge(0.75), width = 0) + 
  geom_point_interactive(aes(group = Score, colour = Sig, 
                             tooltip = 
                               paste0("SD = ", round(SD,3), 
                                      ", 95% CI = [", round(CI.lower,3),
                                      ", ", round(CI.upper,3), "]"), 
                             data_id = ID), 
             size = 1.8, position=position_dodge(0.75)) + 
  geom_text(aes(label = label, x = CI.upper + 0.001, y = Moderator, group = Score),
            position=position_dodge(0.75),
            hjust = 0, size = 4.5) +
  theme_pub() +
  scale_x_continuous(limits = c(0,0.3)) +
  scale_colour_manual(values = c("0" = "grey", "1" = "black")) +
  theme(legend.position = "none", 
        axis.text.y = element_text(hjust = 1)) +
  labs(y = "Moderators", x = expression(bold("SD"[POMP])), title = "Neuroticism")

girafe(ggobj = plot)

Note. To allow a better graphical depiction, we dummy-coded the moderator “Region” for the illustration in this graph (0 = “North America”, 1 = “Other”). However, in the main analyses, a polytomous categorical predictor was used. Significant moderation effects are depicted in black, non-significant moderations are in grey. The point estimates are calculated for 20 year old participants that are assessed over a time interval of one year.

Openness

Table

## Create age bins
data_open$abin_1  <- ifelse(data_open$T1_AgeM <= 30, data_open$T1_AgeM, 30)
data_open$abin_2  <- ifelse(data_open$T1_AgeM > 30, data_open$T1_AgeM - 30, 0) 

## Publication Year (Moderator 1)
meta.mod1 <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Year.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_open, sparse = TRUE)

results.mod1 <- robust(meta.mod1, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod1.level1_open <- meta.mod1$sigma2[1]
sigma_mod1.level2_open <- meta.mod1$sigma2[2]

r2.level1.mod1 <- round((sigma_spline1.level1_open - sigma_mod1.level1_open)/sigma_spline1.level1_open,2)
r2.level1.mod1 <- ifelse(r2.level1.mod1 < 0, 0, r2.level1.mod1)
r2.level2.mod1 <- round((sigma_spline1.level2_open - sigma_mod1.level2_open)/sigma_spline1.level2_open,2)
r2.level2.mod1 <- ifelse(r2.level2.mod1 < 0, 0, r2.level2.mod1)

mod1.open <- as.data.frame(round(
  cbind(results.mod1$n, results.mod1$b[5], results.mod1$se[5], results.mod1$zval[5], 
  results.mod1$pval[5], r2.level1 = r2.level1.mod1, r2.level2 = r2.level2.mod1),3))


## Reliability (Moderator 2)
meta.mod2 <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Alpha_T1.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_open, sparse = TRUE)

results.mod2 <- robust(meta.mod2, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod2.level1_open <- meta.mod2$sigma2[1]
sigma_mod2.level2_open <- meta.mod2$sigma2[2]

r2.level1.mod2 <- round((sigma_spline1.level1_open - sigma_mod2.level1_open)/sigma_spline1.level1_open,2)
r2.level1.mod2 <- ifelse(r2.level1.mod2 < 0, 0, r2.level1.mod2)
r2.level2.mod2 <- round((sigma_spline1.level2_open - sigma_mod2.level2_open)/sigma_spline1.level2_open,2)
r2.level2.mod2 <- ifelse(r2.level2.mod2 < 0, 0, r2.level2.mod2)

mod2.open <- as.data.frame(round(
  cbind(results.mod2$n, results.mod2$b[5], results.mod2$se[5], results.mod2$zval[5], 
  results.mod2$pval[5], r2.level1 = r2.level1.mod2, r2.level2 = r2.level2.mod2),3))


## Other report (Moderator 3)
meta.mod3 <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + OtherReport, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_open, sparse = TRUE)

results.mod3 <- robust(meta.mod3, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod3.level1_open <- meta.mod3$sigma2[1]
sigma_mod3.level2_open <- meta.mod3$sigma2[2]

r2.level1.mod3 <- round((sigma_spline1.level1_open - sigma_mod3.level1_open)/sigma_spline1.level1_open,2)
r2.level1.mod3 <- ifelse(r2.level1.mod3 < 0, 0, r2.level1.mod3)
r2.level2.mod3 <- round((sigma_spline1.level2_open - sigma_mod3.level2_open)/sigma_spline1.level2_open,2)
r2.level2.mod3 <- ifelse(r2.level2.mod3 < 0, 0, r2.level2.mod3)

mod3.open <- as.data.frame(round(
  cbind(results.mod3$n, results.mod3$b[5], results.mod3$se[5], results.mod3$zval[5], 
  results.mod3$pval[5], r2.level1 = r2.level1.mod3, r2.level2 = r2.level2.mod3),3))


## Facet (Moderator 4)
meta.mod4 <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 +
                      T2_lag.c + Facet, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_open, sparse = TRUE)

results.mod4 <- robust(meta.mod4, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod4.level1_open <- meta.mod4$sigma2[1]
sigma_mod4.level2_open <- meta.mod4$sigma2[2]

r2.level1.mod4 <- round((sigma_spline1.level1_open - sigma_mod4.level1_open)/sigma_spline1.level1_open,2)
r2.level1.mod4 <- ifelse(r2.level1.mod4 < 0, 0, r2.level1.mod4)
r2.level2.mod4 <- round((sigma_spline1.level2_open - sigma_mod4.level2_open)/sigma_spline1.level2_open,2)
r2.level2.mod4 <- ifelse(r2.level2.mod4 < 0, 0, r2.level2.mod4)

mod4.open <- as.data.frame(round(
  cbind(results.mod4$n, results.mod4$b[5], results.mod4$se[5], results.mod4$zval[5], 
  results.mod4$pval[5], r2.level1 = r2.level1.mod4, r2.level2 = r2.level2.mod4),3))


## Maladaptive (Moderator 5)
meta.mod5 <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Maladaptive, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_open, sparse = TRUE)

results.mod5 <- robust(meta.mod5, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod5.level1_open <- meta.mod5$sigma2[1]
sigma_mod5.level2_open <- meta.mod5$sigma2[2]

r2.level1.mod5 <- round((sigma_spline1.level1_open - sigma_mod5.level1_open)/sigma_spline1.level1_open,2)
r2.level1.mod5 <- ifelse(r2.level1.mod5 < 0, 0, r2.level1.mod5)
r2.level2.mod5 <- round((sigma_spline1.level2_open - sigma_mod5.level2_open)/sigma_spline1.level2_open,2)
r2.level2.mod5 <- ifelse(r2.level2.mod5 < 0, 0, r2.level2.mod5)

mod5.open <- as.data.frame(round(
  cbind(results.mod5$n, results.mod5$b[5], results.mod5$se[5], results.mod5$zval[5], 
  results.mod5$pval[5], r2.level1 = r2.level1.mod5, r2.level2 = r2.level2.mod5),3))


## Big Five taxonomy (Moderator 6)
meta.mod6 <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + BigFive, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_open, sparse = TRUE)

results.mod6 <- robust(meta.mod6, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod6.level1_open <- meta.mod6$sigma2[1]
sigma_mod6.level2_open <- meta.mod6$sigma2[2]

r2.level1.mod6 <- round((sigma_spline1.level1_open - sigma_mod6.level1_open)/sigma_spline1.level1_open,2)
r2.level1.mod6 <- ifelse(r2.level1.mod6 < 0, 0, r2.level1.mod6)
r2.level2.mod6 <- round((sigma_spline1.level2_open - sigma_mod6.level2_open)/sigma_spline1.level2_open,2)
r2.level2.mod6 <- ifelse(r2.level2.mod6 < 0, 0, r2.level2.mod6)

mod6.open <- as.data.frame(round(
  cbind(results.mod6$n, results.mod6$b[5], results.mod6$se[5], results.mod6$zval[5], 
  results.mod6$pval[5], r2.level1 = r2.level1.mod6, r2.level2 = r2.level2.mod6),3))


## Inverse Coded (Moderator 7)
meta.mod7 <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Inverse, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_open, sparse = TRUE)

results.mod7 <- robust(meta.mod7, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod7.level1_open <- meta.mod7$sigma2[1]
sigma_mod7.level2_open <- meta.mod7$sigma2[2]

r2.level1.mod7 <- round((sigma_spline1.level1_open - sigma_mod7.level1_open)/sigma_spline1.level1_open,2)
r2.level1.mod7 <- ifelse(r2.level1.mod7 < 0, 0, r2.level1.mod7)
r2.level2.mod7 <- round((sigma_spline1.level2_open - sigma_mod7.level2_open)/sigma_spline1.level2_open,2)
r2.level2.mod7 <- ifelse(r2.level2.mod7 < 0, 0, r2.level2.mod7)

mod7.open <- as.data.frame(round(
  cbind(results.mod7$n, results.mod7$b[5], results.mod7$se[5], results.mod7$zval[5], 
  results.mod7$pval[5], r2.level1 = r2.level1.mod7, r2.level2 = r2.level2.mod7),3))


## Representative sample (Moderator 8)
meta.mod8 <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Represent, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_open, sparse = TRUE)

results.mod8 <- robust(meta.mod8, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod8.level1_open <- meta.mod8$sigma2[1]
sigma_mod8.level2_open <- meta.mod8$sigma2[2]

r2.level1.mod8 <- round((sigma_spline1.level1_open - sigma_mod8.level1_open)/sigma_spline1.level1_open,2)
r2.level1.mod8 <- ifelse(r2.level1.mod8 < 0, 0, r2.level1.mod8)
r2.level2.mod8 <- round((sigma_spline1.level2_open - sigma_mod8.level2_open)/sigma_spline1.level2_open,2)
r2.level2.mod8 <- ifelse(r2.level2.mod8 < 0, 0, r2.level2.mod8)

mod8.open <- as.data.frame(round(
  cbind(results.mod8$n, results.mod8$b[5], results.mod8$se[5], results.mod8$zval[5], 
  results.mod8$pval[5], r2.level1 = r2.level1.mod8, r2.level2 = r2.level2.mod8),3))

## Percentage Female (Moderator 9)
meta.mod9 <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Female.c, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_open, sparse = TRUE)

results.mod9 <- robust(meta.mod9, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod9.level1_open <- meta.mod9$sigma2[1]
sigma_mod9.level2_open <- meta.mod9$sigma2[2]

r2.level1.mod9 <- round((sigma_spline1.level1_open - sigma_mod9.level1_open)/sigma_spline1.level1_open,2)
r2.level1.mod9 <- ifelse(r2.level1.mod9 < 0, 0, r2.level1.mod9)
r2.level2.mod9 <- round((sigma_spline1.level2_open - sigma_mod9.level2_open)/sigma_spline1.level2_open,2)
r2.level2.mod9 <- ifelse(r2.level2.mod9 < 0, 0, r2.level2.mod9)

mod9.open <- as.data.frame(round(
  cbind(results.mod9$n, results.mod9$b[5], results.mod9$se[5], results.mod9$zval[5], 
  results.mod9$pval[5], r2.level1 = r2.level1.mod9, r2.level2 = r2.level2.mod9),3))




## Region of data collection (Moderator 10)
meta.mod10 <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Region, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_open, sparse = TRUE)

results.mod10 <- robust(meta.mod10, cluster = StudyID, clubSandwich = TRUE) 
sigma_mod10.level1_open <- meta.mod10$sigma2[1]
sigma_mod10.level2_open <- meta.mod10$sigma2[2]

r2.level1.mod10 <- round((sigma_spline1.level1_open - sigma_mod10.level1_open)/sigma_spline1.level1_open,2)
r2.level1.mod10 <- ifelse(r2.level1.mod10 < 0, 0, r2.level1.mod10)
r2.level2.mod10 <- round((sigma_spline1.level2_open - sigma_mod10.level2_open)/sigma_spline1.level2_open,2)
r2.level2.mod10 <- ifelse(r2.level2.mod10 < 0, 0, r2.level2.mod10)

mod10.open <- as.data.frame(round(
  cbind(results.mod10$n, results.mod10$b[5:8], results.mod10$se[5:8], results.mod10$zval[5:8], 
  results.mod10$pval[5:8], r2.level1 = r2.level1.mod10, r2.level2 = r2.level2.mod10),3))


mod.open <- rbind(mod1.open, mod2.open, mod3.open, mod4.open, mod5.open, mod6.open, mod7.open, mod8.open, mod9.open, mod10.open)

names(mod.open) <- c("Studies", "*b*", "*SE*", "*z*", "*p*", "R^2^~Level1~","R^2^~Level2~")
row.names(mod.open) <- c("Publication year", 
                          "Reliability", "Other report", "Facet", 
                          "Maladaptive", "Big Five", "Inverse coded", 
                          "Representative", "Percentage female", 
                          "Asia", "Global South", 
                          "Nothern Europe", "Southern Europe")

kable(mod.open
      , caption="**Moderator analyses for openness (separate models)**"
      , escape=FALSE
      , label = NA) %>% 
  pack_rows("Region", 10, 13) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Moderator analyses for openness (separate models)
Studies b SE z p R2Level1 R2Level2
Publication year 73 0.000 0.006 0.062 0.951 0.00 0.00
Reliability 57 0.159 0.135 1.178 0.353 0.00 0.01
Other report 73 -0.052 0.050 -1.049 0.359 0.00 0.01
Facet 73 0.400 0.054 7.479 0.010 0.43 0.00
Maladaptive 72 0.045 0.184 0.246 0.812 0.00 0.00
Big Five 73 -0.177 0.094 -1.896 0.074 0.02 0.00
Inverse coded 73 -0.190 0.063 -3.000 0.038 0.05 0.00
Representative 73 -0.123 0.134 -0.918 0.374 0.00 0.00
Percentage female 72 0.000 0.001 -0.738 0.510 0.00 0.00
Region
Asia 73 -0.167 0.196 -0.852 0.440 0.00 0.04
Global South 73 0.385 0.126 3.043 0.068 0.00 0.04
Nothern Europe 73 -0.010 0.105 -0.093 0.926 0.00 0.04
Southern Europe 73 0.203 0.149 1.367 0.196 0.00 0.04

Note. These Pseudo-R2 values should be interpreted with caution as the included studies slightly differed across moderators (e.g., due to missing values) making a comparison more difficult.

Plot

You can hover over the points in this graph to receive more information.

## Run alternative model for Region
data_open$Region.d <- as.factor(ifelse(data_open$Region == "North America", 0, 1))
meta.mod10b <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Region.d, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_open, sparse = TRUE)

## Prepare loop
plot_data <- data.frame(Moderator = factor(c("Publication year", "Publication year", 
                                      "Reliability", "Reliability", 
                                      "Other report", "Other report", 
                                      "Facet", "Facet", 
                                      "Maladaptive", "Maladaptive", 
                                      "Big Five", "Big Five", 
                                      "Inverse coded", "Inverse coded",
                                      "Representative", "Representative",
                                      "Percentage female", "Percentage female", 
                                      "Region", "Region"), 
                                      levels = c("Region", "Percentage female", 
                                                 "Representative", "Inverse coded", 
                                                 "Big Five", "Maladaptive", 
                                                 "Facet", "Other report", 
                                                 "Reliability", "Publication year"), 
                                      ordered = TRUE), 
                        Score = c(0, 5,
                                  0, 0.10, 
                                  0, 1,
                                  0, 1,
                                  0, 1,
                                  0, 1,
                                  0, 1,
                                  0, 1,
                                  0, 10, 
                                  0, 1), 
                        SD = NA, 
                        CI.lower = NA,
                        CI.upper = NA, 
                        Sig = factor(c(0, 0, 
                                       0, 0,
                                       0, 0,
                                       1, 1,
                                       0, 0,
                                       0, 0,
                                       1, 1,
                                       0, 0,
                                       0, 0, 
                                       0, 0)),
                        label = c("2015", "2020", 
                                  "0.78", "0.88", 
                                  "Self", "Other", 
                                  "No", "Yes", 
                                  "No", "Yes", 
                                  "No", "Yes", 
                                  "No", "Yes", 
                                  "No", "Yes", 
                                  "53%", "63%", 
                                  "North America", "Other"))
plot_data$ID <- 1:nrow(plot_data)

meta.models <- list(meta.mod1, meta.mod1, meta.mod2, meta.mod2, 
                    meta.mod3, meta.mod3, meta.mod4, meta.mod4, 
                    meta.mod5, meta.mod5, meta.mod6, meta.mod6,
                    meta.mod7, meta.mod7, meta.mod8, meta.mod8, 
                    meta.mod9, meta.mod9, meta.mod10b, meta.mod10b)                

## Loop to create plot data
for (i in 1:nrow(plot_data)) {                       
  plot_data$SD[i] <- predict(meta.models[[i]], 
                             newmods=c(20, 0, 0, plot_data$Score[i]), 
                             transf=exp, addx=TRUE)$pred
  plot_data$CI.lower[i] <- predict(meta.models[[i]], 
                                   newmods=c(20, 0, 0, plot_data$Score[i]), 
                                   transf=exp, addx=TRUE)$ci.lb
  plot_data$CI.upper[i] <- predict(meta.models[[i]], 
                                   newmods=c(20, 0, 0, plot_data$Score[i]), 
                                   transf=exp, addx=TRUE)$ci.ub
} 

## Plot
plot <- ggplot(data = plot_data, aes(x = SD, y = Moderator, group = Score)) +
  geom_errorbar(aes(xmin=CI.lower, xmax=CI.upper, group = Score, colour = Sig), 
                position=position_dodge(0.75), width = 0) + 
  geom_point_interactive(aes(group = Score, colour = Sig, 
                             tooltip = 
                               paste0("SD = ", round(SD,3), 
                                      ", 95% CI = [", round(CI.lower,3),
                                      ", ", round(CI.upper,3), "]"), 
                             data_id = ID), 
             size = 1.8, position=position_dodge(0.75)) + 
  geom_text(aes(label = label, x = CI.upper + 0.001, y = Moderator, group = Score),
            position=position_dodge(0.75),
            hjust = 0, size = 4.5) +
  theme_pub() +
  scale_x_continuous(limits = c(0,0.3)) +
  scale_colour_manual(values = c("0" = "grey", "1" = "black")) +
  theme(legend.position = "none", 
        axis.text.y = element_text(hjust = 1)) +
  labs(y = "Moderators", x = expression(bold("SD"[POMP])), title = "Openness")

girafe(ggobj = plot)

Note. To allow a better graphical depiction, we dummy-coded the moderator “Region” for the illustration in this graph (0 = “North America”, 1 = “Other”). However, in the main analyses, a polytomous categorical predictor was used. Significant moderation effects are depicted in black, non-significant moderations are in grey. The point estimates are calculated for 20 year old participants that are assessed over a time interval of one year.

Moderators in Combined Models

Across Traits (Exploratory)

For the analyses across traits, we used a model with Age 1-30 and Age 30> as age-related variables because this model was among the best-fitting models for most traits.

## Create age bins
data_all$abin_1  <- ifelse(data_all$T1_AgeM <= 30, data_all$T1_AgeM, 30)
data_all$abin_2  <- ifelse(data_all$T1_AgeM > 30, data_all$T1_AgeM - 30, 0)  

## All
meta.modcom <- rma.mv(yi = ES, V = V, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Year.c + Alpha_T1.c +
                       OtherReport + Facet + Maladaptive + BigFive + 
                       Represent + Female.c +  Region, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_all, sparse = TRUE)

results.modcom <- robust(meta.modcom, cluster = StudyID, clubSandwich = TRUE) 
sigma_modcom.level1_all <- meta.modcom$sigma2[1]
sigma_modcom.level2_all <- meta.modcom$sigma2[2]

r2.level1.modcom <- round((sigma_spline1.level1_all - sigma_modcom.level1_all)/sigma_spline1.level1_all,2)
r2.level1.modcom <- ifelse(r2.level1.modcom < 0, 0, r2.level1.modcom)
r2.level2.modcom <- round((sigma_spline1.level2_all - sigma_modcom.level2_all)/sigma_spline1.level2_all,2)
r2.level2.modcom <- ifelse(r2.level2.modcom < 0, 0, r2.level2.modcom)

modcom.all <- as.data.frame(round(
  cbind(results.modcom$n, results.modcom$b[5:16], results.modcom$se[5:16], results.modcom$zval[5:16], 
  results.modcom$pval[5:16], r2.level1 = r2.level1.modcom, r2.level2 = r2.level2.modcom),3))


## Create table
names(modcom.all) <- c("Studies", "*b*", "*SE*", "*z*", "*p*", "R^2^~Level1~","R^2^~Level2~")
row.names(modcom.all) <- c("Publication year", 
                          "Reliability", "Other report", "Facet", 
                          "Maladaptive", "Big Five", 
                          "Representative", "Percentage female", 
                          "Asia", "Global South", 
                          "Nothern Europe", "Southern Europe")


kable(modcom.all
      , caption="**Moderator analyses across traits (combined model)**"
      , escape=FALSE
      , label = NA) %>% 
  pack_rows("Region", 9, 12) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Moderator analyses across traits (combined model)
Studies b SE z p R2Level1 R2Level2
Publication year 171 0.006 0.004 1.418 0.165 0.02 0.09
Reliability 171 0.158 0.195 0.812 0.431 0.02 0.09
Other report 171 -0.028 0.048 -0.587 0.579 0.02 0.09
Facet 171 0.115 0.102 1.129 0.288 0.02 0.09
Maladaptive 171 -0.018 0.082 -0.216 0.831 0.02 0.09
Big Five 171 -0.070 0.095 -0.740 0.466 0.02 0.09
Representative 171 -0.142 0.070 -2.033 0.051 0.02 0.09
Percentage female 171 0.000 0.000 -0.979 0.347 0.02 0.09
Region
Asia 171 -0.061 0.074 -0.823 0.416 0.02 0.09
Global South 171 0.181 0.080 2.270 0.059 0.02 0.09
Nothern Europe 171 0.019 0.055 0.341 0.734 0.02 0.09
Southern Europe 171 0.016 0.090 0.173 0.864 0.02 0.09

Note. These Pseudo-R2 values should be interpreted with caution as some studies that were include in the baseline model were not included in the moderator model due to missing values in some moderators.

Agreeableness

## Create age bins
data_agree$abin_1  <- ifelse(data_agree$T1_AgeM <= 30, data_agree$T1_AgeM, 30)
data_agree$abin_2  <- ifelse(data_agree$T1_AgeM > 30, data_agree$T1_AgeM - 30, 0)  

## All
meta.modcom <- rma.mv(yi = ES, V = V_agree, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Year.c + Alpha_T1.c +
                       OtherReport + Facet + Maladaptive + BigFive + Inverse +
                       Represent + Female.c +  Region, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_agree, sparse = TRUE)

results.modcom <- robust(meta.modcom, cluster = StudyID, clubSandwich = TRUE) 
sigma_modcom.level1_agree <- meta.modcom$sigma2[1]
sigma_modcom.level2_agree <- meta.modcom$sigma2[2]

r2.level1.modcom <- round((sigma_spline1.level1_agree - sigma_modcom.level1_agree)/sigma_spline1.level1_agree,2)
r2.level1.modcom <- ifelse(r2.level1.modcom < 0, 0, r2.level1.modcom)
r2.level2.modcom <- round((sigma_spline1.level2_agree - sigma_modcom.level2_agree)/sigma_spline1.level2_agree,2)
r2.level2.modcom <- ifelse(r2.level2.modcom < 0, 0, r2.level2.modcom)

modcom.agree <- as.data.frame(round(
  cbind(results.modcom$n, results.modcom$b[5:17], results.modcom$se[5:17], results.modcom$zval[5:17], 
  results.modcom$pval[5:17], r2.level1 = r2.level1.modcom, r2.level2 = r2.level2.modcom),3))


## Create table
names(modcom.agree) <- c("Studies", "*b*", "*SE*", "*z*", "*p*", "R^2^~Level1~","R^2^~Level2~")
row.names(modcom.agree) <- c("Publication year", 
                          "Reliability", "Other report", "Facet", 
                          "Maladaptive", "Big Five", "Inverse coded", 
                          "Representative", "Percentage female", 
                          "Asia", "Global South", 
                          "Nothern Europe", "Southern Europe")


kable(modcom.agree
      , caption="**Moderator analyses for agreeableness (combined model)**"
      , escape=FALSE
      , label = NA) %>% 
  pack_rows("Region", 10, 13) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Moderator analyses for agreeableness (combined model)
Studies b SE z p R2Level1 R2Level2
Publication year 106 0.005 0.004 1.051 0.304 0.36 0.11
Reliability 106 -0.349 0.281 -1.239 0.235 0.36 0.11
Other report 106 0.087 0.066 1.312 0.230 0.36 0.11
Facet 106 0.021 0.085 0.245 0.812 0.36 0.11
Maladaptive 106 0.077 0.087 0.881 0.396 0.36 0.11
Big Five 106 -0.210 0.101 -2.088 0.049 0.36 0.11
Inverse coded 106 -0.062 0.081 -0.770 0.464 0.36 0.11
Representative 106 -0.032 0.107 -0.302 0.765 0.36 0.11
Percentage female 106 -0.001 0.000 -2.317 0.046 0.36 0.11
Region
Asia 106 0.038 0.090 0.419 0.681 0.36 0.11
Global South 106 0.639 0.431 1.484 0.248 0.36 0.11
Nothern Europe 106 0.007 0.074 0.098 0.922 0.36 0.11
Southern Europe 106 -0.057 0.119 -0.479 0.636 0.36 0.11

Note. These Pseudo-R2 values should be interpreted with caution as some studies that were include in the baseline model were not included in the moderator model due to missing values in some moderators.

Conscientiousness

## Create age bins
data_consc$abin_1  <- ifelse(data_consc$T1_AgeM <= 40, data_consc$T1_AgeM, 40)
data_consc$abin_2  <- ifelse(data_consc$T1_AgeM > 40, data_consc$T1_AgeM - 40, 0) 
## All
meta.modcom <- rma.mv(yi = ES, V = V_consc, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Year.c + Alpha_T1.c +
                       OtherReport + Facet + Maladaptive + BigFive + Inverse +
                       Represent + Female.c +  Region, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_consc, sparse = TRUE)

results.modcom <- robust(meta.modcom, cluster = StudyID, clubSandwich = TRUE) 
sigma_modcom.level1_consc <- meta.modcom$sigma2[1]
sigma_modcom.level2_consc <- meta.modcom$sigma2[2]

r2.level1.modcom <- round((sigma_spline1.level1_consc - sigma_modcom.level1_consc)/sigma_spline1.level1_consc,2)
r2.level1.modcom <- ifelse(r2.level1.modcom < 0, 0, r2.level1.modcom)
r2.level2.modcom <- round((sigma_spline1.level2_consc - sigma_modcom.level2_consc)/sigma_spline1.level2_consc,2)
r2.level2.modcom <- ifelse(r2.level2.modcom < 0, 0, r2.level2.modcom)

modcom.consc <- as.data.frame(round(
  cbind(results.modcom$n, results.modcom$b[5:17], results.modcom$se[5:17], results.modcom$zval[5:17], 
  results.modcom$pval[5:17], r2.level1 = r2.level1.modcom, r2.level2 = r2.level2.modcom),3))


## Create table
names(modcom.consc) <- c("Studies", "*b*", "*SE*", "*z*", "*p*", "R^2^~Level1~","R^2^~Level2~")
row.names(modcom.consc) <- c("Publication year", 
                          "Reliability", "Other report", "Facet", 
                          "Maladaptive", "Big Five", "Inverse coded", 
                          "Representative", "Percentage female", 
                          "Asia", "Global South", 
                          "Nothern Europe", "Southern Europe")


kable(modcom.consc
      , caption="**Moderator analyses for conscientiousness (combined model)**"
      , escape=FALSE
      , label = NA) %>% 
  pack_rows("Region", 10, 13) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Moderator analyses for conscientiousness (combined model)
Studies b SE z p R2Level1 R2Level2
Publication year 94 0.010 0.005 2.095 0.047 0.17 0.17
Reliability 94 -0.502 0.231 -2.170 0.044 0.17 0.17
Other report 94 -0.051 0.096 -0.531 0.607 0.17 0.17
Facet 94 0.136 0.067 2.013 0.086 0.17 0.17
Maladaptive 94 0.101 0.124 0.816 0.421 0.17 0.17
Big Five 94 -0.141 0.093 -1.519 0.144 0.17 0.17
Inverse coded 94 -0.191 0.073 -2.610 0.037 0.17 0.17
Representative 94 -0.197 0.114 -1.732 0.098 0.17 0.17
Percentage female 94 0.000 0.000 -0.108 0.917 0.17 0.17
Region
Asia 94 -0.140 0.105 -1.331 0.201 0.17 0.17
Global South 94 0.189 0.133 1.423 0.203 0.17 0.17
Nothern Europe 94 0.120 0.083 1.453 0.153 0.17 0.17
Southern Europe 94 -0.113 0.106 -1.068 0.297 0.17 0.17

Note. These Pseudo-R2 values should be interpreted with caution as some studies that were include in the baseline model were not included in the moderator model due to missing values in some moderators.

Extraversion

## Create age bins
data_extra$abin_1  <- ifelse(data_extra$T1_AgeM <= 55, data_extra$T1_AgeM, 55)
data_extra$abin_2  <- ifelse(data_extra$T1_AgeM > 55, data_extra$T1_AgeM - 55, 0) 

## All
meta.modcom <- rma.mv(yi = ES, V = V_extra, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Year.c + Alpha_T1.c +
                       OtherReport + Facet + Maladaptive + BigFive + Inverse +
                       Represent + Female.c +  Region, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_extra, sparse = TRUE)

results.modcom <- robust(meta.modcom, cluster = StudyID, clubSandwich = TRUE) 
sigma_modcom.level1_extra <- meta.modcom$sigma2[1]
sigma_modcom.level2_extra <- meta.modcom$sigma2[2]

r2.level1.modcom <- round((sigma_spline1.level1_extra - sigma_modcom.level1_extra)/sigma_spline1.level1_extra,2)
r2.level1.modcom <- ifelse(r2.level1.modcom < 0, 0, r2.level1.modcom)
r2.level2.modcom <- round((sigma_spline1.level2_extra - sigma_modcom.level2_extra)/sigma_spline1.level2_extra,2)
r2.level2.modcom <- ifelse(r2.level2.modcom < 0, 0, r2.level2.modcom)

modcom.extra <- as.data.frame(round(
  cbind(results.modcom$n, results.modcom$b[5:17], results.modcom$se[5:17], results.modcom$zval[5:17], 
  results.modcom$pval[5:17], r2.level1 = r2.level1.modcom, r2.level2 = r2.level2.modcom),3))


## Create table
names(modcom.extra) <- c("Studies", "*b*", "*SE*", "*z*", "*p*", "R^2^~Level1~","R^2^~Level2~")
row.names(modcom.extra) <- c("Publication year", 
                          "Reliability", "Other report", "Facet", 
                          "Maladaptive", "Big Five", "Inverse coded", 
                          "Representative", "Percentage female", 
                          "Asia", "Global South", 
                          "Nothern Europe", "Southern Europe")


kable(modcom.extra
      , caption="**Moderator analyses for extraversion (combined model)**"
      , escape=FALSE
      , label = NA) %>% 
  pack_rows("Region", 10, 13) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Moderator analyses for extraversion (combined model)
Studies b SE z p R2Level1 R2Level2
Publication year 87 0.008 0.006 1.296 0.207 0.32 0.06
Reliability 87 0.091 0.234 0.390 0.706 0.32 0.06
Other report 87 0.001 0.038 0.019 0.985 0.32 0.06
Facet 87 0.209 0.080 2.605 0.049 0.32 0.06
Maladaptive 87 0.077 0.118 0.650 0.529 0.32 0.06
Big Five 87 -0.059 0.076 -0.773 0.455 0.32 0.06
Inverse coded 87 -0.094 0.084 -1.113 0.302 0.32 0.06
Representative 87 -0.155 0.081 -1.918 0.067 0.32 0.06
Percentage female 87 0.000 0.000 0.288 0.785 0.32 0.06
Region
Asia 87 -0.184 0.141 -1.313 0.208 0.32 0.06
Global South 87 0.059 0.099 0.601 0.566 0.32 0.06
Nothern Europe 87 0.059 0.079 0.749 0.458 0.32 0.06
Southern Europe 87 0.100 0.148 0.678 0.512 0.32 0.06

Note. These Pseudo-R2 values should be interpreted with caution as some studies that were include in the baseline model were not included in the moderator model due to missing values in some moderators.

Neuroticism

## Create age bins
data_neuro$abin_1  <- ifelse(data_neuro$T1_AgeM <= 25, data_neuro$T1_AgeM, 25)
data_neuro$abin_2  <- ifelse(data_neuro$T1_AgeM <= 75 & data_neuro$T1_AgeM > 25, 
                             data_neuro$T1_AgeM - 25, 
                             ifelse(data_neuro$T1_AgeM <= 25, 0, 75 - 25))
data_neuro$abin_3  <- ifelse(data_neuro$T1_AgeM > 75, data_neuro$T1_AgeM - 75, 0)  

## All
meta.modcom <- rma.mv(yi = ES, V = V_neuro, mods = ~ abin_1 + abin_2 + abin_3 +
                      T2_lag.c + Year.c + Alpha_T1.c +
                       OtherReport + Facet + Maladaptive + BigFive + Inverse +
                       Represent + Female.c +  Region, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_neuro, sparse = TRUE)

results.modcom <- robust(meta.modcom, cluster = StudyID, clubSandwich = TRUE) 
sigma_modcom.level1_neuro <- meta.modcom$sigma2[1]
sigma_modcom.level2_neuro <- meta.modcom$sigma2[2]

r2.level1.modcom <- round((sigma_spline1.level1_neuro - sigma_modcom.level1_neuro)/sigma_spline1.level1_neuro,2)
r2.level1.modcom <- ifelse(r2.level1.modcom < 0, 0, r2.level1.modcom)
r2.level2.modcom <- round((sigma_spline1.level2_neuro - sigma_modcom.level2_neuro)/sigma_spline1.level2_neuro,2)
r2.level2.modcom <- ifelse(r2.level2.modcom < 0, 0, r2.level2.modcom)

modcom.neuro <- as.data.frame(round(
  cbind(results.modcom$n, results.modcom$b[6:18], results.modcom$se[6:18], results.modcom$zval[6:18], 
  results.modcom$pval[6:18], r2.level1 = r2.level1.modcom, r2.level2 = r2.level2.modcom),3))


## Create table
names(modcom.neuro) <- c("Studies", "*b*", "*SE*", "*z*", "*p*", "R^2^~Level1~","R^2^~Level2~")
row.names(modcom.neuro) <- c("Publication year", 
                          "Reliability", "Other report", "Facet", 
                          "Maladaptive", "Big Five", "Inverse coded", 
                          "Representative", "Percentage female", 
                          "Asia", "Global South", 
                          "Nothern Europe", "Southern Europe")


kable(modcom.neuro
      , caption="**Moderator analyses for neuroticisim (combined model)**"
      , escape=FALSE
      , label = NA) %>% 
  pack_rows("Region", 10, 13) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Moderator analyses for neuroticisim (combined model)
Studies b SE z p R2Level1 R2Level2
Publication year 140 0.006 0.004 1.527 0.137 0.15 0.09
Reliability 140 -0.453 0.182 -2.489 0.027 0.15 0.09
Other report 140 -0.007 0.048 -0.157 0.878 0.15 0.09
Facet 140 0.042 0.078 0.538 0.600 0.15 0.09
Maladaptive 140 -0.063 0.070 -0.900 0.388 0.15 0.09
Big Five 140 -0.049 0.105 -0.460 0.649 0.15 0.09
Inverse coded 140 -0.012 0.045 -0.277 0.784 0.15 0.09
Representative 140 -0.129 0.069 -1.864 0.072 0.15 0.09
Percentage female 140 0.000 0.000 0.104 0.919 0.15 0.09
Region
Asia 140 -0.088 0.078 -1.130 0.265 0.15 0.09
Global South 140 0.190 0.095 1.997 0.084 0.15 0.09
Nothern Europe 140 -0.005 0.065 -0.084 0.934 0.15 0.09
Southern Europe 140 0.035 0.099 0.350 0.728 0.15 0.09

Note. These Pseudo-R2 values should be interpreted with caution as some studies that were include in the baseline model were not included in the moderator model due to missing values in some moderators.

Openness

## Create age bins
data_open$abin_1  <- ifelse(data_open$T1_AgeM <= 30, data_open$T1_AgeM, 30)
data_open$abin_2  <- ifelse(data_open$T1_AgeM > 30, data_open$T1_AgeM - 30, 0) 


## All
meta.modcom <- rma.mv(yi = ES, V = V_open, mods = ~ abin_1 + abin_2 + 
                      T2_lag.c + Year.c + Alpha_T1.c +
                       OtherReport + Facet + Maladaptive + BigFive + Inverse +
                       Represent + Female.c +  Region, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_open, sparse = TRUE)

results.modcom <- robust(meta.modcom, cluster = StudyID, clubSandwich = TRUE) 
sigma_modcom.level1_open <- meta.modcom$sigma2[1]
sigma_modcom.level2_open <- meta.modcom$sigma2[2]

r2.level1.modcom <- round((sigma_spline1.level1_open - sigma_modcom.level1_open)/sigma_spline1.level1_open,2)
r2.level1.modcom <- ifelse(r2.level1.modcom < 0, 0, r2.level1.modcom)
r2.level2.modcom <- round((sigma_spline1.level2_open - sigma_modcom.level2_open)/sigma_spline1.level2_open,2)
r2.level2.modcom <- ifelse(r2.level2.modcom < 0, 0, r2.level2.modcom)

modcom.open <- as.data.frame(round(
  cbind(results.modcom$n, results.modcom$b[5:17], results.modcom$se[5:17], results.modcom$zval[5:17], 
  results.modcom$pval[5:17], r2.level1 = r2.level1.modcom, r2.level2 = r2.level2.modcom),3))


## Create table
names(modcom.open) <- c("Studies", "*b*", "*SE*", "*z*", "*p*", "R^2^~Level1~","R^2^~Level2~")
row.names(modcom.open) <- c("Publication year", 
                          "Reliability", "Other report", "Facet", 
                          "Maladaptive", "Big Five", "Inverse coded", 
                          "Representative", "Percentage female", 
                          "Asia", "Global South", 
                          "Nothern Europe", "Southern Europe")


kable(modcom.open
      , caption="**Moderator analyses for openness (combined model)**"
      , escape=FALSE
      , label = NA) %>% 
  pack_rows("Region", 10, 13) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Moderator analyses for openness (combined model)
Studies b SE z p R2Level1 R2Level2
Publication year 55 0.007 0.008 0.829 0.418 0.67 0
Reliability 55 0.613 0.175 3.499 0.083 0.67 0
Other report 55 -0.088 0.056 -1.561 0.253 0.67 0
Facet 55 0.546 0.043 12.653 0.028 0.67 0
Maladaptive 55 0.172 0.248 0.693 0.507 0.67 0
Big Five 55 0.261 0.081 3.231 0.045 0.67 0
Inverse coded 55 -0.234 0.052 -4.485 0.053 0.67 0
Representative 55 0.014 0.194 0.072 0.944 0.67 0
Percentage female 55 0.000 0.001 -0.399 0.716 0.67 0
Region
Asia 55 0.184 0.266 0.693 0.515 0.67 0
Global South 55 0.535 0.213 2.507 0.084 0.67 0
Nothern Europe 55 0.181 0.143 1.268 0.218 0.67 0
Southern Europe 55 0.487 0.195 2.500 0.024 0.67 0

Note. These Pseudo-R2 values should be interpreted with caution as some studies that were include in the baseline model were not included in the moderator model due to missing values in some moderators.

Section 6: Publication Bias

Funnel Plots

## Agreeableness
meta.base <- rma.mv(yi = ES, V = V_agree, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_agree, sparse = TRUE)

funnel_agree <- funnel(meta.base, refline=meta.base$b[1], 
       level=c(90, 95, 99), shade=c("white", "red", "orange"), 
       main="Agreeableness", 
       xlab = "Residual Value", ylab = "Standard error")

## Conscientiousness
meta.base <- rma.mv(yi = ES, V = V_consc, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_consc, sparse = TRUE)

funnel_consc <- funnel(meta.base, refline=meta.base$b[1], 
       level=c(90, 95, 99), shade=c("white", "red", "orange"), 
       main="Conscientiousness", 
       xlab = "Residual Value", ylab = "Standard error")

## Extraversion
meta.base <- rma.mv(yi = ES, V = V_extra, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_extra, sparse = TRUE)

funnel_extra <- funnel(meta.base, refline=meta.base$b[1], 
       level=c(90, 95, 99), shade=c("white", "red", "orange"), 
       main="Extraversion", 
       xlab = "Residual Value", ylab = "Standard error")

## Neuroticism
meta.base <- rma.mv(yi = ES, V = V_neuro, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_neuro, sparse = TRUE)

funnel_neuro <- funnel(meta.base, refline=meta.base$b[1], 
       level=c(90, 95, 99), shade=c("white", "red", "orange"), 
       main="Neuroticism", 
       xlab = "Residual Value", ylab = "Standard error")

## Openness
meta.base <- rma.mv(yi = ES, V = V_open, 
                    random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                    data = data_open, sparse = TRUE)

funnel_open <- funnel(meta.base, refline=meta.base$b[1], 
       level=c(90, 95, 99), shade=c("white", "red", "orange"), 
       main="Openness", 
       xlab = "Residual Value", ylab = "Standard error")

Regression Test

## Agreeableness
meta.agree.peese <- rma.mv(yi = ES, V = V_agree, mods =  ~ sqrt(SamVar), 
                         random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                         data = data_agree, sparse = TRUE)
results.agree.peese <- robust(meta.agree.peese, cluster = StudyID, clubSandwich = TRUE)

peese.agree <- as.data.frame(round(cbind(results.agree.peese$b[2], results.agree.peese$se[2], results.agree.peese$zval[2], 
  results.agree.peese$pval[2]),3))

## Conscientiousness
meta.consc.peese <- rma.mv(yi = ES, V = V_consc, mods =  ~ sqrt(SamVar), 
                         random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                         data = data_consc, sparse = TRUE)
results.consc.peese <- robust(meta.consc.peese, cluster = StudyID, clubSandwich = TRUE)

peese.consc <- as.data.frame(round(cbind(results.consc.peese$b[2], results.consc.peese$se[2], results.consc.peese$zval[2], 
  results.consc.peese$pval[2]),3))

## Extraversion
meta.extra.peese <- rma.mv(yi = ES, V = V_extra, mods =  ~ sqrt(SamVar), 
                         random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                         data = data_extra, sparse = TRUE)
results.extra.peese <- robust(meta.extra.peese, cluster = StudyID, clubSandwich = TRUE)

peese.extra <- as.data.frame(round(cbind(results.extra.peese$b[2], results.extra.peese$se[2], results.extra.peese$zval[2], 
  results.extra.peese$pval[2]),3))

## Neuroticism
meta.neuro.peese <- rma.mv(yi = ES, V = V_neuro, mods =  ~ sqrt(SamVar), 
                         random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                         data = data_neuro, sparse = TRUE)
results.neuro.peese <- robust(meta.neuro.peese, cluster = StudyID, clubSandwich = TRUE)

peese.neuro <- as.data.frame(round(cbind(results.neuro.peese$b[2], results.neuro.peese$se[2], results.neuro.peese$zval[2], 
  results.neuro.peese$pval[2]),3))

## Openness
meta.open.peese <- rma.mv(yi = ES, V = V_open, mods =  ~ sqrt(SamVar), 
                         random = list(~ 1 | EffsizeID, ~ 1 | StudyID), 
                         data = data_open, sparse = TRUE)
results.open.peese <- robust(meta.open.peese, cluster = StudyID, clubSandwich = TRUE)

peese.open <- as.data.frame(round(cbind(results.open.peese$b[2], results.open.peese$se[2], results.open.peese$zval[2], 
  results.open.peese$pval[2]),3))

## Combine to table
peese.results <- as.data.frame(rbind(peese.agree, peese.consc, peese.extra, peese.neuro, peese.open))
names(peese.results) <- c("*b*", "*SE*", "*z*", "*p*")
row.names(peese.results) <- c("Agreeableness", "Conscientiousness", "Extraversion",  "Neuroticism", "Openness")


kable(peese.results
      , caption="**Regression test of publication bias**"
      , escape=FALSE
      , label = NA) %>% 
  kable_styling(bootstrap_options = c("striped", "hover", "condensed"), 
                fixed_thead = T, full_width = TRUE, position="left")
Regression test of publication bias
b SE z p
Agreeableness 0.461 1.394 0.331 0.745
Conscientiousness -0.505 1.593 -0.317 0.756
Extraversion 0.130 1.343 0.097 0.924
Neuroticism 0.343 1.263 0.271 0.788
Openness -0.164 1.361 -0.120 0.908