23
Rejoinder to Bargh and Shalev (2014) 1 Warm Water and Loneliness Redux: Rejoinder to Bargh and Shalev (2014) M. Brent Donnellan, Richard E. Lucas, Joseph Cesario Michigan State University Draft Date: 11 November 2014 Address correspondence to: M. Brent Donnellan Department of Psychology Texas A & M University 4235 TAMU College Station, TX 77843 Note: Ryne Sherman and Eric-Jan Wagenmakers provided helpful comments. This acknowledgement does not mean that they agree with our interpretations or analytic strategy. Brent Donnellan is now at Texas A & M University. This was recently just accepted for publication by Emotion (http://www.apa.org/pubs/journals/emo/). Once we sign all of the papers APA will own the copyright. This article may not exactly replicate the final version published in the APA journal. It is not the copy of record.

Warm Water and Loneliness Redux: Rejoinder to Bargh … to Bargh and Shalev (2014) 2 Abstract Bargh and Shalev (2014) replied to our work and summarized results from three new studies

Embed Size (px)

Citation preview

Rejoinder to Bargh and Shalev (2014) 1

Warm Water and Loneliness Redux: Rejoinder to Bargh and Shalev (2014)

M. Brent Donnellan, Richard E. Lucas, Joseph Cesario

Michigan State University

Draft Date: 11 November 2014

Address correspondence to:

M. Brent Donnellan

Department of Psychology

Texas A & M University

4235 TAMU

College Station, TX 77843

Note: Ryne Sherman and Eric-Jan Wagenmakers provided helpful comments. This acknowledgement does not mean that they agree with our interpretations or analytic strategy. Brent Donnellan is now at Texas A & M University. This was recently just accepted for publication by Emotion (http://www.apa.org/pubs/journals/emo/). Once we sign all of the papers APA will own the copyright. This article may not exactly replicate the final version published in the APA journal. It is not the copy of record.

Rejoinder to Bargh and Shalev (2014) 2

Abstract

Bargh and Shalev (2014) replied to our work and summarized results from three new

studies concerning the associations between trait loneliness and showering/bathing habits. We

clarify a few issues and provide a foundation for future work by conducting a meta-analysis of

the relevant studies. The inclusion of new data does little to change our basic conclusions. There

are no indications of strong connections between trait loneliness and showering/bathing habits.

Additional studies are needed to test moderators of these associations and to evaluate possible

cross-cultural differences in the connection between loneliness and physical warmth extraction

from baths and showers.

Word Count: 98

Key words: Loneliness, Effect Sizes, Statistical Precision, Replication, Meta-Analysis

Rejoinder to Bargh and Shalev (2014) 3

Do lonely individuals use warm showers and baths to compensate for a lack of social

connection? This provocative question has now generated a surprising number of empirical

investigations. Bargh and Shalev (2014) replied to our paper and summarized results from three

new studies. An inspection of the size of the correlations from these new studies suggests their

new effect size estimates are closer to our estimates than to those reported in their 2012 paper.

Thus, their reply reinforces the concerns motivating our replication studies and does little to

answer questions about the anomalies in their Study 1a. In this rejoinder, we respond to a few

issues and quantitatively summarize the results from the existing studies in this exchange.

Is the Physical Warmth Extraction Index Variable the Most Valid Test of the

Substitutability Hypothesis?

Bargh and Shalev (2012) created a physical warmth extraction variable by taking the

average of the standardized frequency, warmth, and duration items. They argue that this

summary variable captures how much net warmth participants extract from bathing activity (see

their p. 156). Bargh and Shalev (2014) justified this index by suggesting that their composite

measure is akin to a snacking index. However, we believe their snacking index analogy breaks

down in this context. Pies, candy bars, and ice cream all contain calories and they all belong to a

superordinate snack category. In contrast, the frequency and duration items refer to different

aspects of showering/bathing activity and they are conceptually unrelated to warmth. Moreover,

these items are not strongly correlated with the temperature variable (Frequency: r = .04 in the

combined file for our Studies 1 to 4, r = .02 in the combined file for our Studies 5 to 9; Duration:

r = .23 in the combined file for our Studies 1 to 4, r = .14 in the combined file for our Studies 5

to 9). Participants who report taking longer showers/bath also report taking warmer

Rejoinder to Bargh and Shalev (2014) 4

showers/baths but it is not the case that participants who report taking more showers/baths also

report taking warmer showers/baths. The frequency and duration items are negatively correlated

(r = -.10 in our Studies 1 to 4, r = -.12 in the combined file for our Studies 5 to 9). Participants

who take longer shower/baths have a slight tendency to take fewer baths and showers per week.

Ultimately, their arguments did not change our perspective on the relative merits of the

warmth item versus the physical warmth extraction index when testing the relevant hypothesis.

As it stands, we believe it is reasonable to place more emphasis on the warmth item when

evaluating the evidence for the ideas presented in Bargh and Shalev (2012). The warmth item is

explicitly about water temperature and is therefore directly relevant to the substitutability

hypothesis. We found virtually no support for the idea that lonelier people take warmer showers

and baths using a straightforward approach for testing the underlying ideas in the Bargh and

Shalev paper. Likewise, frequency should be positively correlated with loneliness if one follows

the logic of the Bargh and Shalev arguments; however, there was no indication that frequency

was positively correlated with loneliness in our studies or in their Study 1b. At best, there

appears to be a small positive correlation between trait loneliness and the duration of showers

and baths.

On the other hand, it is possible that at least among those who take warm showers,

variability in frequency and duration are the primary means by which these individuals extract

warmth. This possibility suggests an interaction between temperature and the other two

variables: Among those who take warmer showers, duration and frequency should be positively

associated with loneliness. However, these interactions did not reach statistical significance in

Rejoinder to Bargh and Shalev (2014) 5

either of our combined files (the warmth by duration interaction: p = .497 for Studies 1 to 1, p =

.667 for Studies 5 to 9; the warmth by frequency interaction: p = .196 and p = .808, respectively).

What are the Effect Size Estimates in their New Data?

Bargh and Shalev graciously shared the raw data from their new studies. To facilitate

comparisons with the existing studies, we averaged the separate bathing and showering items in

each of their new studies to calculate overall frequency, warmth, and duration composite

variables. We then standardized these composite variables within each sample to create the

overall index composite variable in each sample. We also combined their data into a single file to

compute overall correlations across their new data (akin to the approach they used in Table 3 of

their online supplement). The correlations along with sample sizes are reported in Table 1. The

correlation between loneliness and the overall index variable was statistically significant at p <

.05 (r = .14) as was the correlation for the duration variable (r = .23). However, there was no

overall effect for the warmth variable (r = -.01, p = .806) or for the frequency variable (r = -.01,

p = .774). The near zero overall correlation for the physical warmth variable is particularly

striking and weakens support for the idea that lonely people prefer warm temperatures for baths

and showers using their own data.

In addition, we have concerns about their mTurk sample from India given differences in

the relative amount excluded data from the samples collected from the United States versus

India. Bargh and Shalev (2014) excluded 33.6% of the data collected from India compared to

9.6% of the data from the United States. As we noted in our original paper, we agree that it is

reasonable to try to identify attentive from non-attentive respondents when using mTurk samples

(see also Berinsky, Margolis, & Sances, 2014; Goodman, Cryder, & Cheema, 2013). However,

Rejoinder to Bargh and Shalev (2014) 6

we believe researchers should provide the explicit rationale for exclusions and report what

happens when all participants are included in the analyses (see also Berinsky et al., 2014, p.

751). Bargh and Shalev did not describe the precise criteria they used to discard participants and

they did not report key results with all participants included. In contrast, we were explicit about

our exclusion procedures and also reported results with all participants throughout our report. In

short, we believe the mTurk sample from India should be viewed with some caution until the

results are replicated and supplemented with additional cross-cultural samples beyond those

derived from mTurk. This is especially important given possible differences between mTurk

workers from the United States and India beyond just their country of origin (Ipeirotis,

2010). The potential for cross-cultural differences is intriguing and it would be ideal to have

more data on this issue.

What Happened with the Frequency Variable In Study 1a?

We are still perplexed by the frequency distribution reported for their Study 1a. Bargh

and Shalev (2012) asked participants “How often you usually take a bath/shower?” for both

studies and yet the resulting distributions are substantially different in their Studies 1a and 1b.

Bargh and Shalev explain this anomaly by suggesting that the participants in their first study

misunderstood the question that was being asked. It is difficult to understand how undergraduate

participants from an elite university could have misunderstood this item in such a way as to

produce a distribution whereby 90% of the participants take less than 1 shower/bath per week.

This was our biggest reservation with their Study 1a and none of the frequency distributions for

samples from the United States look anything like the distribution in their Study 1a. Moreover,

none of the available studies have been able to duplicate their initial correlation of .48 between

Rejoinder to Bargh and Shalev (2014) 7

trait loneliness and frequency of showering/bathing from Study 1a. In fact, the correlation

between loneliness and the frequency item composites was negative and consistently near zero in

all three of their new studies (see Table 1). Accordingly, we think it would be prudent to discard

Study 1a from the scientific record.

Are Our Studies Really That Different from Their Studies?

Bargh and Shalev (2014) suggest that differences in measures and procedures across our

nine studies are a concern that precludes taking a meta-analytically-informed perspective on the

existing literature. We disagree strongly with this perspective and we doubt that most experts in

meta-analysis would endorse this view. Moreover, we think the practice of embedding these

particular questions within larger surveys would actually mitigate their concerns about

participant awareness. Taking a step back, however, it is unclear why awareness of the purpose

of the study would systematically bias the results one way or the other. It is entirely possible that

participants would provide responses with an acceptable degree of fidelity to their actual

thoughts, feelings, and behaviors even if they were aware that researchers were truly interested in

testing whether there is an association between loneliness and showering/bathing habits.

Nonetheless, Bargh and Shalev (2014) correctly noted that we did not question our

participants about their awareness of the study hypothesis.1 To address this gap, we conducted an

additional study (see online supplement) to evaluate how removing any aware participants would

impact our results. As it turned out, removing any participant suspected of study awareness by at

1 We did not previously think this was an issue because no one in their 2012 paper expressed accurate awareness of the purpose of their questionnaire studies

Rejoinder to Bargh and Shalev (2014) 8

least one of the three authors did not change our effect size estimates to any appreciable degree.

Thus, we do not think participant awareness is a critical confound in our studies.

Ultimately, we believe that the any differences across our studies should be seen as a

virtue rather than a weakness especially as it concerns the generalizability of the basic findings.

We should also clarify a point about our procedures so readers can better understand our

decisions. Some of the differences in measures stem from the timing of our email exchanges.

We received an initial copy of their lifestyles questionnaire on 28 February 2012 but that survey

asked participants to respond to the warmth item using picture of a thermometer rather than a

survey item as described in the 2012 paper. Given the discrepancy, we asked for clarification but

the response time did not work for our research goals. We wanted to collect data before the end

of our Spring semester so we created an item modeled on the description in their published paper

(i.e., our warmth item was measured on a 7-point scale ranging from cold to very hot, p. 156).2

We received a copy of the correct survey on 30 May 2012 but this was after we had already

collected data for our Study 1. At that point we decided to keep using our survey questions given

the similarities across the measures (see the Appendix of Donnellan et al., 2014). To be sure,

there is no theoretical reason to expect that differences in the two sets of measures would impact

the ability of researchers to find a connection between showering/bathing habits and trait

loneliness.

2 The description of the items in the published paper does not consistently refer to showers/baths but we

assumed this was an oversight.

Rejoinder to Bargh and Shalev (2014) 9

What Happens When All Data Are Combined?

In light of our preference for meta-analytic approaches to research questions, we

combined the correlations from Table 1 with the 9 studies in our original article along with 3

more studies posted on the Psychology File Drawer (Donnellan & Lucas, 2014; Ferrell, Gosling,

& Donnellan, 2014; McDonald & Donnellan, 2014) and the new study described in the online

supplement for this rejoinder. The correlations and overall meta-analytic effects sizes are

displayed in Table 2. As seen in the bottom rows of Table 2, the aggregate effect size estimates

were very similar to the ones reported in our original paper. Lonely people appear to take longer

showers/baths but they also take fewer showers/baths per week. The most hypothesis relevant

estimate for the warmth item was not significantly different from zero. Thus, our original

conclusions about the connections between bathing habits and trait loneliness are essentially

unchanged when incorporating this new information.

There are at least two other aspects of Table 2 that are worth emphasizing. First, the .48

correlation between frequency and loneliness from Bargh and Shalev (2012) is a noticeable

outlier given that the next largest positive correlation is .08 (our Study 3). The Q-statistic is not

significant for the remaining 17 studies once this .48 effect is discarded (Q = 17.587, df = 16, p =

.349). These considerations reinforce our concerns about the anomalous results from Study 1a.

Second, the correlations from the University of Texas study are especially informative

because they were collected by outside researchers who administered surveys to a large live-

broadcast online course (Ferrell et al. 2014). There was an approximately 1-week gap between

the lifestyle questions and the loneliness measure. College students completed the surveys

simultaneously wherever they watched the broadcast lectures (i.e., they were not all in the same

Rejoinder to Bargh and Shalev (2014) 10

room when they answered the questions). Donnellan analyzed the data for the final write up for

the Psychology File Drawer. In other words, an independent research group obtained results

more in line with those reported in Donnellan et al. (2014) than those reported in Bargh and

Shalev (2012). Ultimately, we believe that independent inquiry into these questions from

additional labs is necessary to clarify the empirical relations between trait loneliness and

showering/bathing habits.

Summary and Conclusion

The new data presented by Bargh and Shalev (2014) does not change our conclusions

about the connections between loneliness and showering/bathing habits. Their new studies used

larger sample sizes compared to their original studies but yielded smaller effect size estimates.

When we combined the relevant data using meta-analytic procedures, the overall effect size

estimates for the correlation between loneliness and the warmth variable was trivial and not

statistically distinguishable from zero. Thus, we believe extreme caution is warranted before

asserting that lonely people take warm showers to compensate for a lack of social connection.

Lonelier people report taking fewer showers/baths but they also report taking longer showers and

baths. As is always the case, additional research by outside groups is needed. In particular, future

studies should evaluate cross-cultural differences and test theoretically-relevant potential

moderators of these relations.

Rejoinder to Bargh and Shalev (2014) 11

References

Bargh, J. A., & Shalev, I. (2012). The substitutability of physical and social warmth in daily life.

Emotion, 12, 154-162.

Berinsky, A. J., Margolis, M. F., & Sances, M. W. (2013). Separating the shirkers from the

workers? Making sure respondents pay attention on self‐administered surveys. American

Journal of Political Science,58, 739-753.

Donnellan, M. B. & Lucas, R. E. (2014). Showering and Loneliness Take 10. (2014, April 29).

Retrieved 12:58, July 01, 2014 from

http://www.PsychFileDrawer.org/replication.php?attempt=MTg2

Ferrell, J. D., Gosling, S. D., & Donnellan, M. B. (2014) Showering and Loneliness: U of T

Replication. (2014, April 30). Retrieved 12:58, July 01, 2014 from

http://www.PsychFileDrawer.org/replication.php?attempt=MTg3

Goodman, J. K., Cryder, C. E., & Cheema, A. (2013). Data collection in a flat world: The

strengths and weaknesses of Mechanical Turk samples. Journal of Behavioral Decision

Making, 26(3), 213-224.

Ipeirotis, P. (2010). Demographics of Mechanical Turk. CeDER-10-01 working paper. New

York University.

McDonald, M. & Donnellan, M. B. (2014). Showering and Loneliness: Participants from Israel.

Retrieved 10:10, October 07, 2014 from

http://www.PsychFileDrawer.org/replication.php?attempt=MTk5

Rejoinder to Bargh and Shalev (2014) 12

Russell, D. W. (1996). UCLA Loneliness Scale (Version 3): Reliability, validity, and factor

structure. Journal of Personality Assessment, 66, 20-40.

Rejoinder to Bargh and Shalev (2014) 13

Table 1: Correlations between Trait Loneliness and Bathing/Showering Items – Original and New Bargh and Shalev Studies

Frequency Temperature Duration Index N

Original Studies Study 1a .48* .26 .29* .57* 51 Study 1b .03 .34* .33* .37* 41

New Studies

Israel -.005 .046 .179* .121 148 India -.009 .207* .026 .136 199

United States -.028 .068 .254* .160* 206 Overall -.012 -.010 .230* .137* 553 95% CI -.089 to .064 -.106 to .077 .147 to .306 .056 to .215 Note: The overall correlation was based on an aggregate data file that combined the three new studies into a single file. 95% Confidence Intervals constructed with Biased-Corrected Bootstrapping Procedures with 1,000 resamples using the aggregated data file. * p < .05.

Rejoinder to Bargh and Shalev (2014) 14

Table 2: Meta-Analytic Results

Frequency Temperature Duration Index Bargh and Shalev

Studies Bargh and Shalev 1a .48 .26 .29 .57 Bargh and Shalev 1b .03 .34 .33 .37

Israel -.01 .05 .18 .12 India -.01 .21 .03 .14

United States -.03 .07 .25 .16 Donnellan et al. Studies

Study 1 -.15 -.03 .07 -.06 Study 2 -.11 .02 .08 -.01 Study 3 .08 -.02 .17 .13 Study 4 -.20 .01 .02 -.10 Study 5 -.07 .06 .18 .10 Study 6 -.13 .07 .16 .06 Study 7 -.10 .03 .11 .02 Study 8 -.08 .01 .10 .02 Study 9 -.08 -.12 -.01 -.13

MSU Spring 2014 -.06 .00 .13 .04 MSU Summer 2014 -.03 -.07 .01 -.05 University of Texas -.07 -.08 .09 -.03

Israel M & D -.15 -.05 .16 -.03 N 5,289 5,285 5,290 5,293

Random-Effects Model

Point Estimate -.067 .017 .115 .043 95% CI -.107 to -.027 -.020 to .055 .081 to .149 -.006 to .092

p .001* .356 .000* .086 Fixed-Effect Model

Point Estimate -.076 .015 .116 .031 95% CI -.103 to -.049 -.012 to .042 .089 to .142 .004 to .058

p .000* .273 .000* .026* Note: Sample sizes of 51 and 41 were used for Bargh and Shalev Studies 1a and 1b, respectively. Effect sizes for Study 6 and the MSU Summer 2014 study were calculated using the average of the z-scored UCLA Loneliness measure and the Bargh and Shalev Loneliness measure. University of Texas data are from Ferrell et al. (2014) and the Israel M & D data are from McDonald and Donnellan (2014).

Rejoinder to Bargh and Shalev (2014) 15

Supplemental Online Study

Testing the Impact of Participant Awareness and Lay Theories

Sample

Participants were 323 college students (66.6% women; M age = 20.66 years, SD = 2.27)

who received course credit as part of the Michigan State University Psychology Subject Pool

during the First and Second Summer Sessions of 2014 (12 May 2014 through 14 August 2014).

The majority of participants self-identified as white (71.2%). All data were collected online

throughout the entire summer session period.

Procedure

We randomly assigned participants to complete the lifestyle items first (n = 156) or the

Bargh and Shalev loneliness questions first (n = 167). Thus, the first part of the study was a

close replication of Study 1a in Bargh and Shalev (2012) using an online platform. Participants

also completed the 36-item Experiences in Close Relationships-Revised questionnaire (Fraley,

Waller, & Brennan, 2000) with items presented in a random order to each participant. This

measure was used to test whether attachment dimensions moderated connections between

loneliness and showering in line with recent findings that attachment styles moderate the impact

of temperature manipulations on prosocial outcomes in children (e.g., IJzerman, Karremans,

Thomsen, & Schubert, 2013; see also Ferrell et al., 2014). However, no interaction model

produced a significant overall F value at p < .05 out of the 12 models we estimated. Given the

number of analyses we conducted and the null results of Ferrell et al. (2014), we did not pursue

these interactions further

Rejoinder to Bargh and Shalev (2014) 16

After answering attachment questions, participants completed the UCLA Loneliness scale

(Russell, 1996) and demographic items. We included a directed response item embedded in the

demographics questionnaire that asked participants to select the “rarely” response option. We

also included the “I responded to this survey honestly” item right before the question about the

purpose of the study. Only those participants who passed both of these checks were included in

these analyses (approximately 85% of the data collected) following procedures in Donnellan et

al. (2014).

At the bottom of the demographic questions, participants were asked “What do you think

was the purpose of this study?” and presented with a text box to record their answers (34

participants left this box blank). Participants were then presented with a page break and asked

three closed ended question with Yes, Maybe, or No response options: “Do you think there is a

connection between loneliness and a preference for water temperature?”, “Do think lonely

people prefer cold temperatures for baths/showers?”, and “Do you think lonely people prefer

warm temperatures for bath/showers”. Participants were then asked a final open-ended question

“Why might there be a connection between showering/bathing habits and loneliness?” and

presented with a text box to record their answers (30 participants left this box blank).

Coding of Awareness

All three authors independently coded responses to the purpose question using a simple

three category system (Guessed Purpose; Unsure/Potential Awareness; No). The authors coded

these responses using a file stripped of responses to the quantitative questions. No awareness was

the most common code for all three raters (MBD: 93.8%, REL: 98.5%; JC: 91.0%). Agreement

was formally indexed using kappa across all three pairs (MBD and REL: .389; MBD and JC:

Rejoinder to Bargh and Shalev (2014) 17

.525; REL and JC: .220). Given that these kappas were not terribly impressive, we adopted the

most inclusive approach possible by flagging any participant suspected of awareness by at least

one coder (32 participants or 9.1% of the sample).

Results

There was no evidence for a statistically detectable association between loneliness as

assessed with the Bargh and Shalev measure (M = 2.02; SD = .59, alpha = .89) and the physical

warmth index (r = -.07, p = .234, n = 323). This was also the case evaluating the correlation for

the UCL A loneliness measure (M = 2.06; SD = .49, alpha = .93; r = -.03, p = .640, n = 323).

The same null results were obtained when we used all participants with relevant data (Bargh and

Shalev measure: r = -.10, p = .054, n = 374; UCLA measure: r = -.06, p = .251, n = 367).

Separate analyses with each shower/bath item also did not support the substitutability predictions

(see Supplemental Table 1). Thus, we did not replicate any of the results from Bargh and Shalev

(2012) in these data. The correlation between the two loneliness measures was .71 so we created

a composite loneliness measure for use in the meta-analysis.

The ordering of survey questions did not moderate the reported association between the

extraction index variable for the Bargh and Shalev loneliness measure (p = .833 for the

interaction term). Correlations for each condition are reported in Supplemental Table 1. There

was no evidence of moderation for any of the specific items (minimum p = .068 for duration) and

the same null results were obtained for the UCLA loneliness measure (minimum p = .077 for

duration) and the composite loneliness measure (minimum p = .052 for duration). Critical

readers may observe that the interaction for duration were close to the alpha of .05. However, an

Rejoinder to Bargh and Shalev (2014) 18

inspection of Table 1 indicates that although the direction of effect was different for the two

conditions, the correlations were not statistically significant in either condition.

Additional Analyses

We computed correlations for the 291 participants who were not suspected of any

awareness by any coder. The same null results for the overall sample were obtained for this

sample as show in Supplemental Table 1. The effect size estimates were quite similar to the

overall results. Thus, there were no indications that participant awareness distorted conclusions

drawn from this study.

We also considered the distributions for questions about participant intuitions regarding

connections between water temperature and loneliness. These are displayed in Supplemental

Table 2. Approximately 12% of these participants answered “Yes” to the question about a

connection between loneliness and a preference for water temperatures. Perhaps the most

informative distribution occurred for responses to the question about whether lonely people

prefer warm temperatures for showers/baths. This distribution was not significantly different

from a distribution that would be expected if participants responded at random to this question

(i.e., a data generating process whereby each category had a 1/3 chance of being endorsed; chi-

square value = 3.981, df = 2, p = .137). This is consistent with the idea that college students are

largely unaware of an explicit connection between warm water and loneliness as argued in Bargh

and Shalev (2012).

A critical question was whether intuitions about the underlying research topic would

impact the correlational findings. Accordingly, we examined the correlations between the

Rejoinder to Bargh and Shalev (2014) 19

aggregate loneliness measure and the frequency, temperature, duration, and index variables

separately by responses to the intuition questions. (We used the aggregate measure to reduce the

number of comparisons as a way to curb Type I errors.) For example, we computed the

correlation between the composite loneliness measure and the physical warmth index separately

for those who indicated “yes” to the question about a connection between loneliness and a

preference for water temperature (n = 38), those who indicated “maybe” (n = 154), and those

who indicated “no” (n = 131). Across all comparisons, there were two positive correlations that

reached statistical significance. Duration and loneliness were positively correlated (r = .65, p =

.002) within the sample of 21 people who answered yes to the question about whether lonely

people prefer cold temperatures. Likewise, duration and loneliness were positively correlated (r

= .22, p = .015) within the sample of 121 people who answered maybe to the question about

whether lonely people prefer warm temperatures. Both of these results are consistent with the

meta-analytic results albeit with exaggerated effect sizes. Accordingly, we concluded there was

little reason to worry that participant intuitions were a major confound. An excel file with these

correlations is available upon request.

Rejoinder to Bargh and Shalev (2014) 20

Supplemental Table 1: Correlations between Trait Loneliness and Bathing/Showering Items –MSU Summer Session 2014 Study

Frequency Temperature Duration Index

Overall Sample (n = 323)

Bargh and Shalev

-.034 -.054 -.023 -.066

UCLA -.017 -.067 .041 -.026

Composite

-.028

-.066

.010

-.050

Lifestyle First (n = 156) Bargh and Shalev

-.082 -.111 .090 -.064

UCLA .008 -.087 .151 .046

Composite -.039 -.106 .130 -.009

Bargh and Shalev Loneliness First (n = 167)

Bargh and Shalev

-.015 -.022 -.108 -.083

UCLA -.061 -.061 -.053 -.101

Composite -.041 -.045 -.088 -.100

No Awareness (n = 291)

Bargh and Shalev

-.049 -.037 -.021 -.064

UCLA

-.039 -.040 .056 -.013

Composite -.042 -.042 .019 -.042 Note: Bargh and Shalev refers to the loneliness measure created by Bargh and Shalev and UCLA refers to the Russell (1996) loneliness measure. * p < .05.

Rejoinder to Bargh and Shalev (2014) 21

Supplemental Table 2

Intuitions about Water Temperatures and Loneliness

Connection Cold Warm

Yes 11.8% 6.5% 28.5% Maybe 47.7% 31.9% 37.5%

No 40.6% 61.6% 34.1% Note: N = 323 Connection: Do you think there is a connection between loneliness and a preference for water temperatures? Cold: Do you think lonely people prefer cold temperatures for baths/showers? Warm: Do you think lonely people prefer warm temperatures for baths/showers?

Rejoinder to Bargh and Shalev (2014) 22

Distributions of Showering/Bathing Items

How often do you usually take a bath/shower?

Value Response Attentive All

1 More than 3 times a day 0.0% 0.3%

2 3 times a day 0.3% 1.1%

3 2 times a day 9.6% 10.7%

4 Once a day 68.1% 66.6%

5 Once every other day 18.6% 17.9%

6 2-3 times a week 3.1% 3.2%

7 Once a week 0.3% 0.3%

8 Less than once a week - -

Sample Size 323 374

What temperature do you use for the water when you take a bath/shower?

Value Response Attentive All

1 Very hot 7.4% 8.3%

2 Hot 50.8% 47.3%

3 Warm 36.2% 38.8%

4 Lukewarm 5.0% 5.1%

5 Cold 0.6% 0.5%

6 Very Cold 0.0% 0.0%

Sample Size 323 374

Rejoinder to Bargh and Shalev (2014) 23

About how much time do you spend in the bath/shower?

Value Response Attentive All

1 Less than 2 minutes 0.0% 0.3%

2 2-5 minutes 1.9% 1.9%

3 5-10 minutes 23.2% 23.0%

4 10-15 minutes 38.7% 39.6%

5 15-20 minutes 25.1% 23.8%

6 20-30 minutes 8.4% 8.0%

7 Over 30 minutes 2.8% 3.5%

Sample Size 323 374