Building, Recruiting, and Inclusion for Diversity (BRAID)

The BRAID initiative (Building, Recruiting, and Inclusion for Diversity), founded in 2014 by Dr. Maria Klawe, President of Harvey Mudd College (HMC) and Dr. Telle Whitney, former President of AnitaB.org, aimed to increase the percentage of women and students of color majoring in computer science. Implemented from 2014 through 2021, the BRAID initiative included fifteen computer science departments across the U.S. that were committed to implementing changes to their introductory computer science courses, pathways into the major, departmental climate, and outreach efforts in hopes of diversifying their computer science majors. The Momentum team served as the research arm of BRAID and conducted a mixed-methods, longitudinal study of the initiative. Our team’s work included developing robust longitudinal databases, with major projects including: a study that tracked over 10,000 college students from introductory computer science courses through college and into graduate school and early careers; a longitudinal qualitative study of computer science department chairs as “change agents” in diversity efforts; and case studies of innovative diversity efforts. From these data, we conducted myriad analyses and published papers on topics including: factors that promote students’ sense of belonging in introductory courses, the role of external dynamics in department chairs’ BPC efforts, students’ post-baccalaureate computing aspirations and experiences, and many other salient factors and experiences that are related to successful outcomes in computing.

A photo of Dr. Kathleen Lehman (left) and Dr. Linda Sax (right) with BRAID co-founder, Dr. Maria Klawe (center) in front of a brown door inside of a room with white walls and a gray bulletin board.

Dr. Kathleen Lehman (left) and Dr. Linda Sax (right) with BRAID co-founder, Dr. Maria Klawe (center).

A photo of the BRAID research team, BRAID institution department chairs, and other BRAID collaborators during the 2018 BRAID Summit meeting. There are eleven people standing in the back row. The front two row consists of 23 people sitting on large concrete steps.

BRAID Research Team, Department Chairs, and Staff from the 2018 BRAID Summit

The BRAID Research project was a mixed-methods study that examined data from students, instructors, department chairs, and staff in undergraduate computing departments. The key components of the project included:

Quantitative Data Sources

  • Baseline student surveys: The student surveys targeted two populations: (1) computing majors/minors and (2) students enrolled in introductory computing courses. In the Fall 2015 and 2016, computing majors/minors at each BRAID institution received a survey on their experiences in computing. Additionally, during the 2015-16 and 2016-17 academic years, all students enrolled in introductory computing courses received a pre-test and a post-test survey to assess student change during the introductory computing experience. These surveys were similar to the survey of computing majors and minors, but also included questions on introductory computing experiences. The baseline student surveys were developed in collaboration with the CERP team at the Computing Research Association (CRA), allowing our teams to share data and conduct comparative analyses between our samples. Our team collected data on over 10,000 individuals through our baseline student survey and leveraged these data to learn more about students who enroll in introductory courses, including non-computing students, students who are undecided about their majors, and those who take introductory courses later in their academic careers. Additionally, our team examined how students’ experiences in the introductory course shape student outcomes.
  • Student follow-up surveys: Students who completed the introductory course surveys were followed up annually from 2016 until 2020. Annual follow-ups enabled the BRAID research team to track students’ major trajectories, long-term career aspirations, and perceptions of computing across time. Our team used these data to conduct studies on several key student outcomes, such as students’ persistence in computing majors and career and graduate school aspirations.
  • Survey of introductory course instructors: This survey was administered each term during the 2015-16 and 2016-17 academic years to instructors teaching introductory computing courses with the aim of learning more about introductory instructors’ pedagogical techniques, perceptions of computing, and teaching experiences. These data informed studies about the pedagogical practices of introductory course instructors and how their teaching practices are related to their perceptions of students in their courses and the departments in which they teach.
  • Enrollment & degree attainment data: The research team surveyed BRAID departments each year to collect up-to-date, intersectional enrollment and degree attainment, allowing us to track trends in who enrolled in and ultimately earned degrees both in computing fields broadly, as well as computer science majors, specifically. Recently, the team worked closely with the Center for Inclusive Computing (CIC) to align degree attainment data collection procedures to compare intersectional data on who earns computer science degrees across BRAID and CIC institutions.

Qualitative Data Sources

  • Department chair, faculty, and staff interviews: During the first five years of BRAID, the research team conducted annual interviews with department chairs and other key administrators to understand how they made meaning of their role as leaders in efforts to broaden participation in computing. Additionally, faculty and staff members were interviewed in Spring 2016. These data informed several studies about the role of department chairs in BPC work, as well as the process of changing computing departments to support diversity efforts.
  • Syllabi content analysis: We analyzed introductory course syllabi to examine curriculum and teaching practices, and identify the various programming languages and class formats offered at BRAID institutions.
  • Case studies: The research team conducted multi-institutional case studies with four BRAID institutions to explore how a broader range of stakeholders (e.g., students, faculty, staff) work to advance diversity efforts in the context of booming undergraduate enrollments in computing. We interviewed 55 department chairs, faculty, staff, and students across the four sites.

Publications

Presentations