Skip to main content
Open Access

Evaluating an Abbreviated Version of the Circumplex Team Scan Inventory of Within-Team Interpersonal Norms

Published Online:https://doi.org/10.1027/1015-5759/a000752

Abstract

Abstract. The Circumplex Team Scan (CTS) assesses the degree to which a team’s interaction/communication norms reflect each segment (16th) of the interpersonal circle/circumplex. We developed and evaluated an abbreviated 16-item CTS-16 that uses one CTS item to measure each segment. Undergraduates (n = 446) completing engineering course projects in 139 teams completed the CTS-16. CTS-16 items showed a good fit to confirmatory structural models (e.g., that expect greater positive covariation between items theoretically closer to the circumplex). Individuals’ ratings sufficiently reflected team-level norms to justify averaging team members’ ratings. However, individual items’ marginal reliabilities suggest using the CTS-16 to assess general circumplex-wide patterns rather than specific segments. CTS-16 ratings correlated with respondents’ and their teammates’ ratings of team climate (inclusion, justice, psychological safety). Teams with more extraverted (introverted) members were perceived as having more confident/engaged (timid/hesitant) cultures. Members predisposed to social alienation perceived their team’s culture as relatively disrespectful/unengaged, but their teammates did not corroborate those perceptions. The results overall support the validity and utility of the CTS-16 and of an interpersonal circumplex model of team culture more generally.

A team is a bounded set of two or more individuals who interact with and depend on each other to accomplish shared goals. Team culture refers to shared norms governing interactions within a team. Team culture matters because it influences consequential outcomes including satisfaction and performance (Boyce et al., 2015) and team climate, which encompasses members’ experiences of the general atmosphere (e.g., safety, inclusiveness) in the team.

The Circumplex Team Scan (CTS; Locke, 2019) is a measure of team interaction and communication norms (or culture) reflecting each segment of the interpersonal circumplex (see Figure 1). The circumplex is defined by a vertical agentic axis ranging from active, assertive stances (top) to passive, timid stances (bottom), and a horizontal communal axis ranging from warm, affiliative stances (right) to cool, hostile stances (left). Each segment progressively reflects a different blend of agency and communion: adjacent segments are more similar than non-adjacent segments; opposite interpersonal stances occupy antipodal segments. The circumplex has been successfully used to assess, analyze, and juxtapose various constructs related to social interactions (Gurtman, 2016). However, whereas other circumplex inventories assess individuals, the CTS is unique in being the only inventory to apply the circumplex to the assessment of teams.

Figure 1 The Interpersonal Circumplex.

The current research has three aims. The first aim was to evaluate whether an abbreviated CTS would show adequate psychometric properties. A valid short CTS would be valuable, given that the full 64-item CTS is too lengthy for intensive longitudinal data collection and time-constrained surveys.

Second, we aimed to better comprehend the construct validity and situational generalizability of the CTS and the circumplex model of team culture on which it is based. Regarding generalizability, the CTS was intended to be applicable to any group of interdependent task-oriented individuals but heretofore has only been tested in workplace teams where members have preassigned roles and statuses. The current study tested the CTS in a new context: leaderless student teams. Regarding criterion validity, we predicted that agentic and communal norms assessed by the CTS would be positively associated with three aspects of team climate: justice, inclusion, and psychological safety (henceforth safety). Justice encompasses providing individuals respect and voice (reflecting agentic norms) and treating them fairly and equally (reflecting communal norms) (Colquitt & Rodell, 2015). Inclusion encompasses individuals experiencing opportunities to authentically express their unique selves (reflecting agentic norms) and experiencing themselves as embraced and cared about (reflecting communal norms) (Jansen et al., 2014). Safety encompasses individuals feeling both respected and unafraid (reflecting agentic norms) and trusting that they can depend on their teammates for support (reflecting communal norms) (Edmondson, 1999).

Third, we wanted to explore whether team members’ personality traits – specifically, extraversion and alienation – influence their team’s interpersonal culture. The etiology of team interpersonal culture remains poorly understood. Clarifying how various personality traits do or do not influence team culture will help advance our understanding. Furthermore, in applied settings, knowledge about traits can also be used to inform team configuration. If, for instance, individuals prone to alienation tend to move team culture toward the dysfunctional (lower left) circumplex region, a leader might avoid placing many high-alienation individuals on the same team.

Extraverted individuals are gregarious and energetic rather than shy and withdrawn. At the individual level, extraversion-introversion has been repeatedly shown to align with the circumplex axis running from the high-agency-and-communion region to the low-agency-and-communal region (Barford et al., 2015). Analogously at the group level, work settings described as characteristically extraverted were also described as having more agentic and communal norms (Locke, 2019). Teams with more extraverted members exhibit more cohesiveness and effectiveness (Barrick et al., 1998), normative cooperation (Gonzalez-Mulé et al., 2014), and prosociality (Pletzer et al., 2021). Thus, extraverted members may promote more agentic and communal interpersonal norms.

Individuals high in alienation – sometimes called perceived victimization (Jockin et al., 2001) – describe themselves as feeling betrayed, undermined, and exploited (Tellegen & Waller, 2008). Alienation predicts subsequent self-reported workplace conflict and aggressiveness (Jockin et al., 2001); however, we could find no studies of alienation in team contexts. Given the association between alienation and sensitivity to maltreatment, alienated individuals may view their team’s norms more cynically and perhaps prod those norms towards being less engaged and more guarded.

Method

Participants and Procedure

We collected data from three samples of engineering undergraduates in the US. We excluded students who gave identical answers to every CTS item, completed < 50% of the assessment waves of the larger project that included this study, or were the only usable participant from their team. Sample 1 consisted of 135 students in 24 teams in a biomedical engineering course during the Fall 2020 semester. Sample 2 consisted of 92 students in 29 teams in the same course during Spring 2021. Sample 3 consisted of 219 students in 86 teams enrolled in a capstone course – mandatory for final-year engineering undergraduates – during Spring 2021. Sample sizes were determined by the class sizes rather than a priori. Exclusion criteria were established after data collection but prior to data analysis. In total, there were 446 participants (Mage = 20.9 years, SD = 1.9; 237 females, 194 males, 15 missing/other) working in 139 teams (Msize = 3.21 members, SD = 1.43, Mdn = 3, Range = 2–8). The racial/ethnic distribution was 41% Non-Hispanic White, 30% Asian or Asian-White biracial, 11% Hispanic, 8% Black, and 9% other or unknown.

Measures

Additional data were collected from each sample for course-related or research purposes, but the current study only includes the measures completed by all three samples – namely, those detailed below.

Circumplex Team Scan-16 (CTS-16)

In the 64-item CTS (Locke, 2019), four items assess each 16th of the circumplex (see Figure 1). The CTS-16 was created by selecting one item from each segment as follows. First, we computed item-total correlations within each segment (i.e., between each item and the average rating across the four items) in two previously collected datasets. One set was individual-level data from the 1,413 individuals in Locke’s (2019) Study 2. The other data set was team-level data from 67 teams from various Australian organizations (i.e., 38 teams from Locke’s Study 3 and 29 teams assessed after that study was completed). We used these two different data sets to increase confidence that the selected items would be relevant to both individual-level and group-level assessments. Next, the item-total correlations were z-scored (separately within each segment in each sample) and averaged across the two samples. Finally, the item with the highest average item-total correlation within each segment was selected for the CTS-16. Table 1 shows the items. Our current participants rated how much members of their team tended to engage in each of these 16 behaviors on 1 (= strongly disagree) to 5 (= strongly agree) scales.

Table 1 CTS-16 scale names, items, and Intraclass Correlation (ICC) reliability indices

Inclusion, Psychological Safety, Justice

Participants rated how much their experiences in the team were characterized by inclusion, safety, and justice on either 1 (= very inaccurate) to 7 (= very accurate) scales in Samples 1 and 2 or 1 (= strongly disagree) to 5 (= strongly agree) scales in Sample 3. Electronic Supplementary Material (ESM 1) Section 1 details the climate scales’ items and climate/personality scales’ reliabilities in each sample. Inclusion was assessed with items from Jansen et al.’s (2014) inclusion scale. Psychological safety was assessed with items from Edmondson’s (1999) safety scale. Justice was assessed with both novel and published items (Colquitt & Rodell, 2015; Molina et al., 2016) reflecting distributive, informational, interactional, and procedural justice.

Extraversion

Samples 1 and 2 used the HEXACO-100 16-item Extraversion scale (Lee & Ashton, 2018). Sample 3 used 15 items from the Faceted Inventory of the Five-Factor Model Extraversion scale (FI-FFM; Watson et al., 2019). Participants responded on 1 (= strongly disagree) to 5 (= strongly agree) scales.

Alienation

Participants completed seven items from the Alienation subscale of the Multifaceted Personality Questionnaire (Tellegen & Waller, 2008). The University of Minnesota Press granted us permission to use – but not reproduce – these items. Participants rated each statement “with regard to your life overall” on 1 (= not at all true) to 5 (= completely true) scales.

Participants completed the Extraversion and Alienation scales before starting their team projects. Participants completed the CTS, Inclusion, Safety, and Justice near the project’s midpoint (in Sample 1) or endpoint (in Samples 2 and 3). When completing the CTS, Inclusion, Safety, and Justice items, participants were asked to describe “your project team over the past 7 days” (Samples 1 and 2) or “all of your experiences with your team” (Sample 3). Our data and analysis syntax are posted at https://osf.io/4jsft.

Results

For simplicity, the samples were combined in all analyses. However, course formats and procedures (and the climate and extraversion measures) differed between samples. Therefore, to remove semester effects we standardized CTS-16, safety, justice, extraversion, and alienation scores within samples prior to conducting the analyses. Three participants did not respond to one CTS-16 item; we replaced those three missing values with zero (the mean of the standardized distributions).

Reliability of CTS-16 as a Measure of Team Norms

To the degree CTS ratings reflect team-level interactional norms, ratings should be more consistent within than across teams. Accordingly, to assess the scales’ reliabilities as indicators of team norms, we used one-way random-effects ANOVAs with team membership as the between-participants variable to compute two types of intraclass correlations (ICCs; see Table 1). ICC(1)s (aka ICC(1, 1)s) – the proportion of variance in CTS ratings explained by team membership – estimate the reliability of a single member’s rating of a team’s norms. The ICC(1)s show that group membership explained at least a marginally significant proportion of the variance in individuals’ ratings on 15 of the 16 CTS scales, but reliabilities were clearly lower in the ABC and IJK regions than the DEFGH and LMNOP regions. ICC(2)s (aka ICC(1, k)s) estimate the reliability of a team’s average rating across its members; averaging members’ ratings naturally improved reliability, but with such small teams the reliabilities of the team means were still low. Overall, the results supported averaging the CTS scores across team members, but the marginal reliabilities of some items suggest caution when interpreting a team’s results for each CTS-16 item individually.

Nonetheless, the observed ICC(1) values are comparable to those typically observed for single-item indicators of group-level constructs (Bliese et al., 2019). Indeed, they are comparable to those often observed for multi-item scales; for example, a review of hundreds of ICC(1)s reported in the literature found that over half were between 0.10 and 0.30 (Woehr et al., 2015). Moreover, because CTS-16 items form a circumplex, a respondent’s CTS-16 responses can be summarized as overall communal and agentic vector scores as follows: Communal = Σ(Si × cosθi)/8, Agentic = Σ(Si × sinθi)/8, where Si is the respondent’s score on item i and θi is that item’s angular location on the circumplex (Gurtman & Pincus, 2003). In the current study, the ICC(1)s for the multi-item CTS-16 communion and agency scores were 0.28 and 0.26. By comparison, the ICC(1)s for the inclusion, safety, and justice scales were, respectively, 0.17, 0.17, and 0.32. (The ICC(1)s for alienation and extraversion were 0.00 and 0.01, indicating as expected that they were independent of team membership).

Moreover, when using ICC(1)s as an index of the effect of the group on ratings, LeBreton and Senter (2008, p. 838) “encourage researchers to adopt traditional conventions used when interpreting effect sizes (i.e., percentage of variance explained). Specifically, a value of .01 might be considered a “small” effect, a value of .10 might be considered a “medium” effect, and a value of .25 might be considered a “large” effect”. Using these heuristics, a team’s “true” score exerted at least a medium effect on most items. Finally, for ICC(2)s traditional heuristics for evaluating reliability are applicable, but ICC(2)s depends on the number of raters; thus, for example, for a 12-person team, the Spearman-Brown formula predicts that the ICC(2)s for six of the segments would exceed the traditional 0.70 criteria for acceptable reliability.

CTS Circumplex Structure

To the degree that a set of scales form a circumplex, the intercorrelations among its scales should meet certain criteria (Fabrigar et al., 1997). The ideal circumplex or “circulant” model requires the observed correlations to fit the sinusoidal pattern of correlations expected if all scales have equal communalities and equal spacing along the circumference (see Figure 1). There are two less restrictive “quasi-circumplex” models: (a) only the spacings (and not the communalities) are equal and (b) only the communalities (and not the spacings) are equal. Finally, the least restrictive “circular” model only expects the scales to show a circular ordering (without requiring equal spacing and communalities).

We tested how well our team-level (averaged across members of each group) CTS-16 data fit each model using confirmatory circumplex structural analyses implemented by the R package CircE (Grassi et al., 2010). Adequate fit to each model is typically defined as a Root Mean Square Error of Approximation (RMSEA) < 0.13, a Goodness-of-Fit Index (GFI) > 0.90, and/or an Adjusted Goodness-of-Fit Index (AGFI) > .85 (Gurtman & Pincus, 2003; Rogoza et al., 2021). As Table 2 shows, the “Equal Communality” and “Circular” models had an excellent fit, while the “Equal Spacing” and “Circulant” models had an adequate fit (meeting RMSEA and AGFI but not GFI criteria). Likewise, the χ2 values indicated a much better fit for the “Equal Communality” model than the “Equal Spacing” model, further indicating that deviations from the ideal circulant model were mainly due to unequal spacing between scales.

Table 2 Fit of teams’ Circumplex Team Scan-16 scores to circular models

Circumplex Structural Summary Analyses

A signature asset of circumplex inventories is that another variable’s profile of correlations with each circumplex scale can be depicted by a smaller set of circumplex “summary parameters”. For example, consider justice: To the degree, CTS scales (a) conform to a circumplex and (b) correlate with justice, justice’s correlations with the CTS scales should conform to a sinusoidal wave functions which can be summarized via a few trigonometric parameters (Gurtman & Pincus, 2003; Zimmermann & Wright, 2017). Key parameters include a horizontal (X) vector averaging justice’s correlations with the communal axis; a vertical (Y) vector summarizing justice’s correlations with the agentic axis; and a summary vector (the vector sum of X and Y). The summary vector’s length or amplitude indicates how distinctly justice correlates with relatively high scores (strong team norms) in one circumplex region and relatively low scores in the opposite region. The summary vector’s angle indicates the circumplex region most associated with justice on average. However, justice’s summary vector will be meaningful only to the degree that its profile of correlations mirrors a cosine curve. How well-observed correlations fit a perfect cosine wave is summarized in a goodness-of-fit index, R2. By convention (e.g., Richardson, Hart, & Kinrade, 2021), the minimal criteria for an interpretable circumplex profile with a clear “wave peak” in one segment and “wave trough” in the opposite segment is having an amplitude > .1 (and preferably > .15) and R2 > .7 (and preferably > .8).

Do Teams’ CTS-16 Ratings Correlate With Their Personality and Climate Ratings?

As Table 3 (upper section) shows, though climate variables (inclusion, safety, justice) had clearer circumplex profiles than did personality variables (extraversion, alienation), all variables produced interpretable profiles with amplitudes > .15 and R2s > .80. Therefore, each variable’s profile of correlations with the CTS-16 items (reported in ESM 1, Section 2) can be effectively summarized by its communal vector, agentic vector, and overall vector amplitude and angle (reported in Table 3, upper section). Importantly, even when measures of each circumplex segment have marginal reliabilities, the structural summary (weighted average of correlations across segments) can be highly reliable to the degree the correlations with those segments fit a circumplex profile.

Table 3 Summary parameters for relations between CTS-16 and personality or climate ratings

All three climate scales showed positive correlations with both communal and agentic norms, thereby placing their summary vectors in the agentic-and-communal region of the circumplex. Specifically, because their correlations with communal norms exceeded their correlations with agentic norms, their summary vector angles ranged from 21° to 25° (“Open/Engaged” segments). A team’s average extraversion also showed positive – but in this case similar – correlations with communal and agentic norms, placing extraversion’s summary vector at 51° (“Confident” segment). Finally, a team’s average alienation negatively correlated with communal norms, placing its summary vector at 196° (“Evasive” segment). Figure 2 plots the summary vectors’ endpoints on the CTS circumplex. The figure highlights that the correlations with interpersonal norms were similar for the three climate scales and stronger than those for the personality scales.

Figure 2 Association between a team’s average CTS-16 ratings and a team’s average climate and personality ratings. The scale ranges from r = 0 (at the center) to r = 0.9 (at the circumference). Dots represent correlations averaged across segments and tinted regions represent bootstrapped 95% confidence intervals (computed/plotted using circumplex package for R; Girard et al., 2018).

One caveat is that given the small team sizes, individual members can meaningfully affect team averages, possibly confounding these team-level associations with individual-level associations (between individuals’ distinctive CTS and personality/climate ratings). We address this below by asking (a) do individuals’ CTS ratings correlate with their personality and climate ratings after removing their team’s averages from their ratings, and (b) do individuals’ CTS ratings correlate with their team’s average personality and climate ratings after removing their personality and climate ratings from their team’s averages?

But before proceeding we should recall that some of the personality and climate measures in Samples 1 and 2 differed from those in Sample 3. The most noteworthy difference was extraversion being measured with the HEXACO scale in Samples 1 and 2 and the FI-FFM scale in Sample 3. Although correlations between FFM and HEXACO extraversion scales typically exceed .70, some researchers suggest FFM and HEXACO extraversion scales measure slightly different constructs (Watson & Clark, 2020; David Watson, personal communication, 09/2021). Therefore, for each analysis reported in Table 3, we tested for differences between Sample 3 and Sample 1 and 2 results using bootstrapped 95% CIs calculated by the R circumplex package. As detailed in ESM 1, Section 5, there were no significant differences between samples.

Do Individuals’ CTS-16 Ratings Correlate With Their Own Personality and Climate Ratings?

First, we team-mean centered each individual’s score on each measure by subtracting the team’s average from the member’s raw score. Then, we correlated the individuals’ centered CTS-16 ratings with their centered personality or climate ratings (see ESM 1, Section 3). As Table 3 (middle) shows, the climate measures produced readily interpretable circumplex profiles (with amplitudes > .25 and R2s > .90). The personality measures showed less pronounced circumplex profiles. Figure 3A plots the endpoints of the vectors summarizing each measure’s correlations with CTS scales. Overall, these individual-level results mirror the results for team averages above but were weaker in magnitude because we removed covariation reflecting between-team covariation between measures.

Figure 3 Radar charts show the association of an individual’s CTS-16 ratings with the climate and personality ratings made by either that individual (A) or that individual’s teammates (B). The scale ranges from r = 0 (at the center) to r = 0.5 (at the circumference).

Do Individuals’ CTS-16 Ratings Correlate With Their Teammates’ Personality or Climate Ratings?

To check whether team-level associations were attributable solely to the individual-level associations, we next tested whether an individual’s CTS ratings correlated with ratings their teammates made on the personality and climate scales (i.e., the team’s average personality and climate ratings excluding that individual). ESM 1, Section 4 shows the results for each CTS segment. As Table 3 (bottom) shows, the climate measures produced readily interpretable circumplex profiles (with amplitudes > .20 and R2s > .90); thus, their summary vectors can effectively summarize their profiles of correlations. Extraversion yielded a less pronounced but still adequate circumplex profile. Alienation showed no clear pattern of correlations with the CTS scales.

Figure 3B plots the summary vectors’ endpoints. The results generally mirror those reported above for teams but were weaker in magnitude because we removed covariation reflecting within-rater covariation between measures. These results indicate that members’ impressions of team interpersonal norms partly reflect a consensually experienced team culture that is correlated with their teammates’ impressions of team climate and shaped to some degree by their teammates’ introverted-extraverted personalities. In contrast to extraversion, an individual’s trait of alienation did not influence other individuals’ impressions of the team’s culture.

Multilevel Analyses of Team-Level and Individual-Level Associations

Because existing software for conducting tests on structural summary parameters cannot accommodate multilevel data, the preceding analyses did not account for the nested (individuals-within-teams) data structure. To address this limitation, we condensed each individual’s profile of CTS-16 responses into two (i.e., agency and communion) vector scores. Next, we estimated multilevel models with the agency or communion scores as outcome variables and individual- and team-level personality or climate scores as predictor variables (using MPlus 8.7 with the Bayes estimator). Intercepts and slopes were allowed to vary across teams. When analyzing climate variables (where the referent is the team) we estimated multilevel latent covariate models (Lüdtke et al., 2008) which treat within-team “individual-level” variation in the predictor as measurement error and correct for this unreliability by estimating the “team-level” predictor as a latent mean. When analyzing personality variables (where within-team variation partly reflects true personality differences rather than measurement error) we estimated conventional multilevel manifest covariate models (Lüdtke et al., 2008) and entered team averages as manifest team-level predictors.

The models output three effects: between, within, and contextual. Between effects indicate the overall team-level associations – for example, between teams’ average extraversion and communal norms. Within effects indicate within-team associations between members’ CTS ratings and their (group-mean-centered) climate or personality ratings – for example, within teams, between members’ distinctive self-ratings of extraversion and perceptions of communal norms. Within effects tell us how individual differences contribute to team members reporting different experiences. Contextual effects indicate team-level associations absent any confounding individual-level associations – for example, between teams’ average extraversion and communal norms while controlling for unique effects of individual members. Contextual effects “tells how characteristics or actions of other individuals in the same context affect individual-level outcomes or, alternatively, how characteristics or actions of an individual affect the outcomes of others in the same context, or how the mean of the characteristic in the context affects individual-level outcomes” (Antonakis et al., 2021, p. 452). Computationally, the between effect is the sum of the within effect and the contextual effect.

Table 4 shows the results. The results can be compared with those in Table 3 (communal and agentic vector columns). The absolute values are not comparable across tables because the values in Table 3 reflect weighted averages of correlations across CTS-16 segments whereas the values in Table 4 values are unstandardized coefficients (unstandardized because computing contextual effects preclude re-standardizing team-level predictors). Nonetheless, we can check whether the corresponding coefficients differ from zero in both tables.

Table 4 Multilevel models predicting CTS-16 agentic and communal norms from individual and team personality and climate

Comparing the overall between-team results (Table 4’s between effects with Table 3’s top section) revealed no differences: All the associations significant in Table 3 were also significant in Table 4. Comparing the individual-level results (Table 4’s within effects with Table 3’s middle section) also revealed no differences. Comparing the contextual results (Table 4’s contextual effects with Table 3’s lower section) revealed three differences: Using multilevel modeling, the between-team associations between justice and agentic norms, justice, and communal norms, and extraversion and communal norms were no longer significant. However, even in these three cases the contextual effects estimated via multilevel models remained “marginally significant” (ps ≤ .1) and thus the differences between the results were minor. In sum, the multilevel analyses and structural summary analyses yielded similar findings.

Discussion

CTS-16 Psychometric and Circumplex Properties

Our first two aims involved evaluating the psychometric/circumplex properties of the CTS-16, an abbreviated 16-item inventory of team interpersonal norms. Group membership explained a significant proportion of the variance in members’ ratings of almost all items; thus, CTS-16 ratings reflected team-level norms (and not simply idiosyncratic impressions or random error). However, the low interrater reliabilities for most items argue against interpreting the results for individual items (i.e., 16th of the circumplex), especially in smaller teams. Instead, the CTS-16 can be most confidently used to assess overall patterns averaging across the entire circumplex.

Regarding circumplexity, the CTS-16 showed excellent fit to models requiring items to conform to a two-dimensional circular structure with equal communalities, and – by most but not all criteria – adequate fit to the most stringent model requiring items to also to show equidistant spacing along the circle’s circumference. Thus, the CTS-16 scales can be combined into agentic and communal dimension scores. The weaker fit to models requiring equal spacing may be partly attributable to using unreliable single-item measures of each segment. Yet, the original 64-item CTS also showed unequal spacing between segments when administered to specific teams in organizational settings where members knew others would see their group’s results, despite showing equal spacing when online respondents anonymously rated their workplaces which they knew could not be identified (Locke, 2019).

Therefore, another possible explanation is that the CTS scales conform to a circumplex when a team’s norms are dispassionately evaluated in low-stakes settings (e.g., the team being described cannot be identified), but not when other members plus outside evaluators (such as instructors, consultants, or supervisors) will see the results. Those higher-stakes situations may motivate teams with contented members to portray their team as blessed with desirable (LMN) norms and teams with discontented members to portray their team as cursed with undesirable (EFGH) norms. Indeed, visually examining CTS-16 item intercorrelations suggests that their unequal spacing around the circumplex was partly due to desirable norms being tightly intercorrelated and undesirable norms also being tightly intercorrelated. The common influence of desirability/undesirability may also help explain why members showed greater consensus about their team having clearly socially undesirable (EFG) or clearly socially desirable (LMN) norms than about their team having norms whose desirability is more equivocal (i.e., ABC and IJK norms).

The CTS-16 showed consistent, robust associations with measures of team climate. Specifically, both within and between teams, inclusion, and psychological safety were most positively correlated with the Open-Engaged (MN) region and most negatively correlated with the Rude-Guarded (DE) region of the circumplex. Perceptions of justice showed similar associations, but multilevel models suggested that these associations largely reflected members’ unique (rather than shared) perceptions of team climate and culture. Collectively, these results add evidence for the construct validity of the CTS and expand the nomological network of constructs that can be usefully organized within an interpersonal circumplex model of team culture. The results also demonstrate that the CTS (which heretofore has only been administered in organizational contexts) can be successfully applied to teams outside workplace settings – in this case, peer teams without preassigned leaders or roles.

Individual Personality and Team Culture

Individuals more prone to experience alienation were more apt to describe their team’s culture as disengaged, guarded, and rude. This may just reflect their generally cynical perspective (Tellegen & Waller, 2008) because their teammates did not share their negative impressions of the team’s culture. But alienated individuals may also genuinely experience more rejection from teammates, perhaps because they are more apt to be targets of social prejudice or exclusion or are more forthright in complaining about problematic interactions.

The evidence for personality influencing team cultures was stronger for extraversion. Within teams, the more extraverted individuals tended to describe their team as having more agentic norms. But more importantly, at the between-team level (independent of the rater’s level of extraversion) teams with more extraverted members were described as having more agentic and (to a lesser degree) communal norms. In other words, teams with higher average initial extraversion levels generally reported more engaged and open and less timid and hesitant cultures. Perhaps the behavior of relatively extraverted or introverted members shifts team norms towards more openness/expressiveness or towards more timidity/hesitancy. Or perhaps in small teams, the behavior of one extraverted or introverted member influences everyone’s impressions of team norms without actually changing others’ behavior. Future research could test these hypotheses.

Limitations and Future Directions

Three limitations and future directions merit highlighting. First, our results are based on teams at one engineering institution. On one hand, because the CTS was developed and validated in workplace contexts, it is reasonable to expect the CTS-16 to function as well in workplace contexts as in student teams. On the other hand, confidently establishing generalizability will require continuing to evaluate the CTS-16 in teams differing in, for example, their goals, sizes, and settings. Second, as with any subjective measure, response styles and personality styles (such as negativity and alienation) are potential sources of error; however, because these sources of error will typically vary unsystematically across raters, the impact of these sources should decrease as the number of individuals rating each team increases. Third, “halo/horns” effects (that could be shared across team members) may have partly shaped members’ ratings of specific aspects of culture and climate; accordingly, studies employing less subjective indicators of team performance (e.g., objective metrics or uninvolved observers) would be informative.

Conclusions

The CTS assesses team interaction and communication norms reflecting all segments of the interpersonal circumplex. The abbreviated CTS-16 version uses just one item to measure each 16th of that space. The CTS-16 items may not prove sufficiently reliable to measure specific segments, especially in smaller teams; however, they did show sufficiently robust circumplex fit and between-group differentiation to validate them as a measure of a team’s average inclinations across segments, which is useful for measuring change and comparing teams to each other. Indeed, contemporary studies using interpersonal circumplex inventories typically emphasize the aggregated “structural summary” findings and often do not bother reporting findings for individual segments (e.g., Du et al., 2020; Kehl et al., 2021; Mongrain & Shoikhedbrod, 2021). Individuals’ personality dispositions and feelings about their team may bias their CTS-16 responses (with more alienated or dissatisfied members tending to portray their team’s norms as less supportive/empowering); nonetheless, individuals’ responses showed sensible associations with their teammates’ average impressions of team climate and average extraversion levels. Thus, overall, the results align with prior evidence suggesting the interpersonal circumplex can offer a useful framework for assessing and understanding groups’ interpersonal norms. Being relatively quick to administer, CTS-16 may provide an effective tool for comparing teams and for assessing change due to interventions, leadership change, maturation, and other factors.

References

  • Antonakis, J., Bastardoz, N., & Rönkkö, M. (2021). On ignoring the random effects assumption in multilevel models: Review, critique, and recommendations. Organizational Research Methods, 24(2), 443–483. https://doi.org/10.1177/1094428119877457 First citation in articleCrossrefGoogle Scholar

  • Barford, K. A., Zhao, K., & Smillie, L. D. (2015). Mapping the interpersonal domain: Translating between the Big Five, HEXACO, and Interpersonal Circumplex. Personality and Individual Differences, 86, 232–237. https://doi.org/10.1016/j.paid.2015.05.038 First citation in articleCrossrefGoogle Scholar

  • Barrick, M. R., Stewart, G. L., Neubert, M. J., & Mount, M. K. (1998). Relating member ability and personality to work-team processes and team effectiveness. Journal of Applied Psychology, 83, 377–391. https://doi.org/10.1037/0021-9010.83.3.377 First citation in articleCrossrefGoogle Scholar

  • Bliese, P. D., Maltarich, M. A., Hendricks, J. L., Hofmann, D. A., & Adler, A. B. (2019). Improving the measurement of group-level constructs by optimizing between-group differentiation. Journal of Applied Psychology, 104, 293–302. https://doi.org/10.1037/apl0000349 First citation in articleCrossrefGoogle Scholar

  • Boyce, A. S., Nieminen, L. R., Gillespie, M. A., Ryan, A. M., & Denison, D. R. (2015). Which comes first, organizational culture or performance? A longitudinal study of causal priority with automobile dealerships. Journal of Organizational Behavior, 36, 339–359. https://www.jstor.org/stable/10.2307/26610988 First citation in articleCrossrefGoogle Scholar

  • Colquitt, J. A., & Rodell, J. B. (2015). Measuring justice and fairness. In R. S. CropanzanoM. L. AmbroseEds., The Oxford handbook of justice in the workplace (pp. 187–202). Oxford University Press. https://doi.org/10.1093/oxfordhb/9780199981410.013.8 First citation in articleCrossrefGoogle Scholar

  • Du, T. V., Yardley, A. E., & Thomas, K. M. (2020). Mapping big five personality traits within and across domains of interpersonal functioning. Assessment, 28, 1358–1375. https://doi.org/10.1177/1073191120913952 First citation in articleCrossrefGoogle Scholar

  • Edmondson, A. (1999). Psychological safety and learning behavior in work teams. Administrative Science Quarterly, 44, 350–383. https://doi.org/10.2307/2666999 First citation in articleCrossrefGoogle Scholar

  • Fabrigar, L. R., Visser, P. S., & Browne, M. W. (1997). Conceptual and methodological issues in testing the circumplex structure of data in personality and social psychology. Personality and Social Psychology Review, 1, 184–203. First citation in articleCrossrefGoogle Scholar

  • Girard, J. M., Zimmermann, J., & Wright, A. G. (2018, June). New tools for circumplex data analysis and visualization in R . Paper presented at the meeting of the Society for Interpersonal Theory and Research, Montreal, Canada. First citation in articleGoogle Scholar

  • Gonzalez-Mulé, E., DeGeest, D. S., McCormick, B. W., Seong, J. Y., & Brown, K. G. (2014). Can we get some cooperation around here? The mediating role of group norms on the relationship between team personality and individual helping behaviors. Journal of Applied Psychology, 99(5), 988–999. https://doi.org/10.1037/a0037278 First citation in articleCrossrefGoogle Scholar

  • Grassi, M., Luccio, R., & Di Blas, L. (2010). CircE: An R implementation of Browne’s circular stochastic process model. Behavior Research Methods, 42, 55–73. https://doi.org/10.3758/BRM.42.1.55 First citation in articleCrossrefGoogle Scholar

  • Gurtman, M. B. (2016). Interpersonal circumplex. In V. Zeigler-HillT. K. ShackelfordEds., Encyclopedia of personality and individual differences. Springer. https://doi.org/10.1007/978-3-319-28099-8_1233-1 First citation in articleCrossrefGoogle Scholar

  • Gurtman, M. B., & Pincus, A. L. (2003). The circumplex model: Methods and research applications. In J. SchinkaW. VelicerEds.. Handbook of Psychology: Vol. 2. Research Methods in Psychology. (pp. 407–428). Wiley. https://doi.org/10.1002/0471264385.wei0216 First citation in articleCrossrefGoogle Scholar

  • Jansen, W., Otten, S., Zee, K., Der, Van., Amsterdam, V. U., & Jans, L. (2014). Inclusion: Conceptualization and measurement. European Journal of Social Psychology, 44, 370–385. https://doi.org/10.1002/ejsp.2011 First citation in articleCrossrefGoogle Scholar

  • Jockin, V., Arvey, R. D., & McGue, M. (2001). Perceived victimization moderates self-reports of workplace aggression and conflict. Journal of Applied Psychology, 86, 1262–1269. https://doi.org/10.1037/0021-9010.86.6.1262 First citation in articleCrossrefGoogle Scholar

  • Kehl, M., Edershile, E. A., Hopwood, C. J., & Wright, A. G. (2021). A response surface analysis investigation of the effects of (mis)alignment between interpersonal values and efficacies on interpersonal problems. Journal of Personality, 89, 1143–1158. https://doi.org/10.1111/jopy.12641 First citation in articleCrossrefGoogle Scholar

  • LeBreton, J. M., & Senter, J. L. (2008). Answers to 20 questions about interrater reliability and interrater agreement. Organizational Research Methods, 11, 815–852. https://doi.org/10.1177/1094428106296642 First citation in articleCrossrefGoogle Scholar

  • Lee, K., & Ashton, M. C. (2018). Psychometric properties of HEXACO-100. Assessment, 25, 543–558. https://doi.org/10.1177/1073191116659134 First citation in articleCrossrefGoogle Scholar

  • Locke, K. D. (2019). Development and validation of a circumplex measure of the interpersonal culture in work teams and organizations. Frontiers in Psychology, 10, Article 850. https://doi.org/10.3389/fpsyg.2019.00850 First citation in articleCrossrefGoogle Scholar

  • Locke, K. D., & Martin, C. C. (2022). Evaluating an abbreviated version of the circumplex team scan inventory of within-team interpersonal norms. https://osf.io/4jsft First citation in articleGoogle Scholar

  • Lüdtke, O., Marsh, H. W., Robitzsch, A., Trautwein, U., Asparouhov, T., & Muthén, B. (2008). The multilevel latent covariate model: A new, more reliable approach to group-level effects in contextual studies. Psychological Methods, 13(3), 203–229. https://doi.org/10.1037/a0012869 First citation in articleCrossrefGoogle Scholar

  • Molina, A., Moliner, C., Martínez-Tur, V., Cropanzano, R., & Peiró, J. M. (2016). Validating justice climate and peer justice in a real work setting. Journal of Work and Organizational Psychology, 32(3), 191–205. https://doi.org/10.1016/j.rpto.2016.09.002 First citation in articleCrossrefGoogle Scholar

  • Mongrain, M., & Shoikhedbrod, A. (2021). When depression breeds rejection rather than compassion: Disagreeableness, stigma, and lack of empathic concern among support providers. Frontiers in Psychiatry, 12, Article 594229. https://doi.org/10.3389/fpsyt.2021.594229 First citation in articleCrossrefGoogle Scholar

  • Pletzer, J. L., Oostrom, J. K., & de Vries, R. E. (2021). HEXACO personality and organizational citizenship behavior: A domain-and facet-level meta-analysis. Human Performance, 34(2), 126–147. https://doi.org/10.1080/08959285.2021.1891072 First citation in articleCrossrefGoogle Scholar

  • Richardson, K., Hart, W., & Kinrade, C. (2021). Investigating how self‐esteem moderates grandiose narcissism’s interpersonal orientation. Journal of Personality, 89(4), 738–753. https://doi.org/10.1111/jopy.12612 First citation in articleCrossrefGoogle Scholar

  • Rogoza, R., Cieciuch, J., & Strus, W. (2021). A three-step procedure for analysis of circumplex models: An example of narcissism located within the circumplex of personality metatraits. Personality and Individual Differences, 169, Article 109775. https://doi.org/10.1016/j.paid.2019.109775 First citation in articleCrossrefGoogle Scholar

  • Tellegen, A., & Waller, N. G. (2008). Exploring personality through test construction: Development of the Multidimensional Personality Questionnaire. In G. J. BoyleG. MatthewsD. H. SaklofskeEds., The SAGE handbook of personality theory and assessment (Vol. 2, pp. 261–292). Sage Publications. First citation in articleCrossrefGoogle Scholar

  • Watson, D., & Clark, L. A. (2020). Extraversion in the HEXACO-PI-R. European Journal of Personality, 34, 556–557. https://doi.org/10.1002/per.2284 First citation in articleGoogle Scholar

  • Watson, D., Nus, E., & Wu, K. D. (2019). Development and validation of the Faceted Inventory of the Five-Factor Model (FI-FFM). Assessment, 26(1), 17–44. https://doi.org/10.1177/1073191117711022 First citation in articleCrossrefGoogle Scholar

  • Woehr, D. J., Loignon, A. C., Schmidt, P. B., Loughry, M. L., & Ohland, M. W. (2015). Justifying aggregation with consensus-based constructs: A review and examination of cutoff values for common aggregation indices. Organizational Research Methods, 18, 704–737. https://doi.org/10.1177/1094428115582090 First citation in articleCrossrefGoogle Scholar

  • Zimmermann, J., & Wright, A. G. C. (2017). Beyond description in interpersonal construct validation: Methodological advances in the circumplex structural summary approach. Assessment, 24, 3–23. https://doi.org/10.1177/1073191115621795 First citation in articleCrossrefGoogle Scholar