X-Culture was originally envisioned purely as an experiential learning project. Accordingly, we were first collecting only data on student performance that we needed for grading/marking purposes. However, in an attempt to better understand processes and outcomes in global virtual teams to develop better pre-project training programs for our students, we gradually started collecting more data that are not directly used for student evaluation purposes.
Additionally, we started experimenting with different learning conditions, team composition, assignments and evaluation systems to see which teaching approach gives the best learning outcome and student satisfaction.
Our database contains over 1,300 individual-level, 500 team-level, 200 instructor-level and 100 country-level variables.
X-Culture data are multi-source, multi-level and longitudinal in nature:
Multi-Source:
- Individual and team-consensus responses (various self-report surveys)
- Instructor evaluations
- Peer evaluations
- Deadline and other objective performance records
- Administrative records on participant background (e.g., country of studies, gender, etc.), team composition and the the like
- Data from external sources (e.g., time zone information, characteristics of the economic, cultural and institutional environment of each country, etc).[/servicebox]
Multi-Level:
- Individual
- Team
- Instructor
- National
Longitudinal:
- 12 waves of survey
- Starting with the pre-project survey of the student and instructors
- Weekly surveys and data records during the project
- Post-project surveys and evaluations
In terms of the specific measures, we have information about:
- Pre-project training and test performance.
- Team member background (demographics, international background, international experience, etc.).
- Knowledge and skills (cultural intelligence, skills with international virtual collaboration tools, etc.).
- Attitudes (values, various attitudes, beliefs, preferences, perceptions and biases, most measured before and then again after the project).
- Team composition and characteristics, including size, national, demographic, and skill composition, various inter-member distances, including time-zone, cultural, economic, perceptual and the like.
- Expectations about project challenges, communication mode, group interactions, dynamics and performance, measured before project start, and after the project end.
- Observations of project challenges, communication mode, group interaction, dynamics and performance, measured after project finish.
- Conflicts.
- Status and leadership.
- Open-ended question comments, feedback, suggestions, and other qualitative data.
- Various measures of team dynamics, including satisfaction, commitment, conflict, self-efficacy, etc.
- Various measures of team processes, including communication frequency and mode, workload distribution, coordination, leadership and more.
- Various measures of individual and team performance and outcomes, including multi-dimensional multi-rater assessment of the team report quality, ability to meet deadlines, satisfaction, peer evaluations and the like.
- Original team reports and other records suitable for qualitative and content analysis.
- Characteristics of the experimental conditions, including the specific task the teams have to complete, allocated time, deadlines, etc.
- Information about the participating instructors, their courses and universities, as well as the information course delivery mode (online/face-to-face), level of studies (UG, MBA, EMBA, etc.).
- Information about various experimental conditions.
Most variables are deliberately manipulated (e.g., team size, cultural diversity, time allocated to complete each task, etc.) to create enough variation along each variable needed for a meaningful analysis. Many factors vary naturally (different teams choose different communication modes, leadership structures, etc.).
We are constantly searching for better ways to evaluate the effects and effectiveness of project, as well as to further explore what shapes cross-cultural interactions and group dynamics. If interesting research ideas are put forth, we would also be happy to consider incorporating new measures and experimental conditions into our project for studies that may not be directly related to global virtual teams.