Retention efforts in STEM have become a priority of colleges and universities. Two-year college STEM students are particularly affected by factors that contribute to low retention and persistence. To address STEM retention problems, a student support program was developed through National Science Foundation funding to support STEM student success. The program sought to enhance STEM identity, thereby increasing persistence. Participants were required to engage in STEM civic engagement, using their STEM knowledge and skills for community betterment. This study sought to examine the effects of these activities on students’ STEM identity and ultimate persistence. Data were collected over years from participant surveys and interviews. We found that students had cultivated a sense of STEM identity, and that graduation and transfer rates increased as a result of their increased civic engagement. Students who engage in their community develop cultural competency, communication skills, and critical thinking ability and have opportunities to apply their knowledge.
The Role of Two- year Colleges in STEM Education
Two-year colleges are an often overlooked but essential component in the pathway to Science, Technology, Engineering, and Mathematics (STEM) higher education (National Academies of Sciences, Engineering, and Medicine [NASEM] 2016; National Research Council [NRC] 2012). They play a unique role in STEM education, enrolling nearly half of the nation’s undergraduate students (American Association of Community Colleges [AACC] 2014). Community colleges in the United States enroll more than eight million students annually, including 43% of U.S. undergraduates (AACC 2011; Mullin 2012). Approximately 50% of all college students who eventually earn bachelor’s degrees in STEM begin their undergraduate education at two-year colleges (Tsapogas 2004; Starobin & Laanan 2010), and 20% of students who were awarded science and engineering doctoral degrees earned credits at a two-year college at some point in their academic careers (Chen 2013).
Community colleges provide a diverse student body (people of color, women, older students, veterans, international students, first-generation college students, low-income students, and working parents) with access to higher education. According to the American Association of Community Colleges, 52% percent of Hispanic students, 44% of African American students, 55% of Native American students, and 45% of Asian-Pacific Islander students attend two-year colleges (AACC 2011). Additional reports (Provasnik & Planty 2008) show the median age of two-year college students is 24, with 35% of the student population 30 or older. Further data show that 20% of two-year college students are married with children, and an additional 15% are single parents (Provasnik & Planty 2008; Li 2007). Almost half of college-going students attend community colleges at some point in their academic careers; low-income, first generation, and under-represented minority students are more likely to enroll in two-year institutions (NASEM 2016).
Two-year colleges attract many students by providing affordable tuition, flexible scheduling, small class sizes, and access to faculty. These institutional attributes accommodate those two-year college students who take a nonlinear path to degree completion due to family and work obligations (Pérez & Ceja 2009). On account of the rich diversity of their student population, two-year colleges have the potential to increase participation of non-traditional and underrepresented students in STEM.
Retention and Persistence for Community College STEM Students
Retention and persistence of all STEM students continue to be of significant concern as data reveal that more than half of freshman who initially declare STEM majors leave these fields before graduation (President’s Council of Advisors for Science and Technology [PCAST] 2012; Chen 2009; Chen 2013). Among all students who declared their intentions to pursue STEM majors, only 43% were still in a STEM major at the time of their last enrollment, with the others all transitioning to other majors. Even more problematic, only 7.3% of STEM students who began at a two-year college received a STEM bachelor’s degree after six years, compared with 45% of students who started in a four-year program (Chen 2013).
Factors influencing retention and persistence in STEM majors are diverse and often interconnected. Leading reasons for low STEM retention and persistence at both the two-year and four-year colleges are uninspiring introductory courses, lack of math preparation, and an academic culture not welcoming of women, minorities, and non-traditional students (PCAST 2012; Seymour and Hewett 2000; Griffith 2010; Huang, Taddese, & Walter 2000). Additionally, STEM students at the two-year college are affected by external circumstances such as work and family obligations and have fewer economic and social resources and fewer STEM role models than their four-year traditional student counterparts. For the two-year college STEM student, these external circumstances coupled with an unwelcoming STEM culture undermine their sense of identity, belonging, and self-efficacy, which are critical to their STEM retention and persistence.
The Culture of STEM
The explicit and implicit customs, behaviors, and values that are normative within STEM education make up the culture of STEM (NRC 2009). An examination of the culture of STEM education is important because the social, psychological, and structural dimensions of STEM education in two-year and four-year colleges influence student identity, belonging, self-efficacy, and encouragement. The experiences students gather during their interactions with the “STEM culture” of the department or institution drive student awareness and understanding of program standards, academic expectations, STEM identity, and their sense of belonging in the program. More importantly, student experiences within the STEM culture and the encouragement or lack thereof can have a profound impact on the student’s self-efficacy and desire to persist (Cabrera et al. 1999; Eccles, Wigfield, & Schiefele 1998; Reid & Radhakrishnan 2003; Pérez, Cromley, & Kaplan 2014).
Identity/Belongingness, Encouragement, and Self-efficacy
Self-perceptions regarding academic competence are framed by personal and collective identities. Each student has many such identities—racial, ethnic, socioeconomic, professional, sexual/gender, and family. These identities are framed by upbringing, experiences, and society at large and can shift across time either unconsciously or through deliberate effort (Good 2012). Students’ positive identification with their discipline can enhance academic engagement and belongingness and prove to be a great source of encouragement. However, more commonly the obverse is true, especially for non-traditional and underrepresented STEM students. These students often experience challenges such as isolation, invisibility, discrimination, and a sense of not belonging and disconnectedness from external social and cultural networks (Ong 2001; NRC 2012).
Belonging to valued social groups is a fundamental human need; a sense of inclusion is particularly important for underrepresented groups in STEM when stereotypes imply that they might be unsuited to certain settings, such as rigorous academic classes (Baumeister & Leary 1995; Dovidio, Major, & Crocker 2000; Walton & Cohen 2007; Cohen & Steele 2002). Feeling a sense of belonging and acceptance by others in STEM (faculty and peers) is crucial to retention and persistence for these STEM students (Johnson 2012; Palmer, Maramba, & Dancy 2011).
Stereotypical ideas about what constitute appropriate fields of study for two-year college students or comments regarding academic preparedness/achievement in math and science can serve as critical barriers to retention and persistence. According to Starobin & Laanan (2008), even when these students possess a strong math or science background, they often receive little encouragement or support from faculty. Creating a sense of encouragement and a support system for two-year college STEM students is paramount to increasing retention and persistence. Studies show non-traditional and underrepresented minorities need proactive personal encouragement and positive media messages to counteract the status quo “culture of STEM” (Hanover Research, 2014). Programs and activities that facilitate healthy positive relationships and offer encouragement among peers and from faculty promote student engagement and feelings of belonging.
Academic self-efficacy is commonly defined as the belief in one’s capabilities to achieve a goal or an outcome using one’s skills under certain circumstances, and that performance and motivation are determined by how effective people believe they can be. (Snyder & Lopez 2007; Bandura 1982). More specifically, for many two-year STEM students, academic self-efficacy is entangled with STEM identity as it refers to the belief or conviction that they can successfully obtain a STEM degree (Marra et al. 2009).
A major source of academic self-efficacy is simply having the raw knowledge, skills, and experience required to successfully reach a goal or to complete a task; this source of efficacy is commonly referred to as mastery experience (Bandura 1997). In the context of two-year STEM students, this means having a positive experience in completing a STEM task, specific course, and/or obtaining an associate’s degree.
STEM Civic Engagement through Peer Tutoring
STEM civic engagement covers a wide array of activities and learning outcomes in which students participate in the formal and informal STEM processes that address community needs and seek to improve the quality of life for individuals, groups, and entire communities. In this context, STEM civic engagement contributes to student growth by connecting authentic and meaningful service to communities with content and skills acquired in the classroom. Civic engagement activities, such as tutoring others in STEM content, present students with opportunities to reflect upon their own academic goals (also known as metacognition) (NRC, 2000), transform their communities, and identify and address social challenges that are specific to our society, i.e. the lack of STEM subject understanding, the lack of STEM role models, etc.
It is well documented that tutoring has beneficial effects on both the tutor and the tutee. In particular, many studies have shown that tutoring increases the content knowledge as well as the self-concept of the tutor (Britz, Dixon, & McLaughlin1989; Cohen, Kulik, & Kulik 1982; Early 1998). Students who tutor feel more positive towards themselves as students, and they display an improved academic self-concept. Through this enhanced self-concept, students identify themselves more strongly as students of their discipline (Early 1998). Furthermore, students in STEM disciplines who serve as leaders among their peers experience increased self-efficacy and retention, and studies have shown that this trend applies to both majority and underrepresented students. Thus, peer leadership may provide a path for improving retention of underrepresented groups in the field (Hug, Thiry, & Tedford 2011). Additional outcomes for STEM leaders (mentors or tutors) include increased participation in internships and higher GPAs (Monte, Sleeman, & Hein 2007). Other studies indicate that the opportunity to tutor or mentor others allows STEM students to develop a sense of belonging and social relationships that aid in student retention; to some extent, this can be attributed to improved experience with and understanding of STEM culture at the students’ institutions (Kiyama 2014; Kiyama et al. 2014).
Existing research provides a limited understanding of the relationship between identity/belonging, encouragement, self-efficacy, civic engagement, and retention rates for two-year college STEM students. Our study explored the effects of civic engagement volunteer activities on student identity/belonging, encouragement, and self-efficacy. The results show a relationship between these activities and STEM persistence and retention for two-year college STEM students.
Institution and Program
Perimeter College is part of Georgia State University, a diverse, multi-campus urban research university in metropolitan Atlanta. The college is the major provider of associate’s degrees and student transfer opportunities in Georgia and a gateway to higher education, easing students’ entry into college-level study. More than 21,000 students, representing all ages and backgrounds, are enrolled in Perimeter College. Through the college, Georgia State serves the largest number of dual enrollment, international, online, transfer, and first-time freshman students in the University System of Georgia.
Beginning in Spring 2012, through National Science Foundation funding, a Science, Technology, Engineering, and Mathematics Talent Expansion Program (STEP) was developed for two-year, full-time students, with a minimum 2.8 grade point average. To participate, students must have U.S. citizenship or status as permanent resident alien or refugee alien and be majoring in a STEM field of study, declared at any point but usually after the first year of coursework. The objectives of the program are two-fold: (a) to increase the number of students who persist in all STEM fields at the institution (chemistry, biology, math, geology, physics, computer science, and engineering) and (b) to increase the number of students who graduate and/or transfer to four-year colleges/universities to complete their STEM baccalaureate degrees. The demographic breakdown of the STEP participants throughout the lifetime of the program mirrored that of the STEM majors in the institution; the majority of STEP students are underrepresented minorities.
Students participate in the program for an average of three semesters (including a summer semester). Stipends are given to those participants who meet the following criteria each semester: (a) are enrolled as a full-time student (12 credit hours during the fall and spring semester); (b) maintain a cumulative minimum GPA of 2.8 and a minimum semester GPA of 2.5; (c) participate in a minimum of 10 hours of STEM civic engagement activities per semester; (d) participate in a minimum of six STEM–related activities (STEP-sponsored and others). Stipend amounts vary depending on the academic classification of the participant. Additional stipends are given for participation in the Summer Bridge I undergraduate research experience (three weeks), Summer Bridge II undergraduate research experience (eight weeks), and participation in the NSF’s Research Experiences for Undergraduates program. STEP sponsors multiple STEM activities each semester, including STEM industry visits and college visits.
STEM Civic Engagement Activities
Program participants are engaged in the STEM community in a number of ways, some of which are required elements and others that are optional. All program participants are required to attend a number of career workshops and to visit industry sites and four-year institutions. Additionally, throughout their tenure in the program, participants are required to complete a minimum of 10 hours of civic engagement per semester. Many of the students fulfill this requirement by serving as tutors in on-campus student support facilities or off campus in their communities. Additional civic engagement opportunities are available to the students through outreach activities (such as science festivals), environmental clean-ups, and other STEM-related events. Many students (73%) completed more than the required 10 hours per semester of service; the average contribution per semester is 12 hours of service.
In order to determine student outcomes, we tracked students through their program experience and after graduation and transfer to four-year institutions. During their tenure in the program, participants were asked to complete a number of surveys and focus group interviews to determine their reactions to and the perceived outcomes of the various student support activities. Surveys were retrospective in design: students were asked to think back to how they felt at the beginning of the program and compare that to how they felt at the time of taking the survey (usually after one year in the program). This approach maximizes ability to match responses and also eliminates pretest sensitivity and response shift bias, wherein students tend to underestimate or overestimate their attitudes towards the unknown prior to the start of an intervention (Howard 1980; Pratt, McGuigan, & Katzev 2000). In addition to surveys given during students’ tenure in the program, we also administered an alumni survey to those who had completed the program.
In particular, our 23-item student survey drew upon existing instruments designed to assess changes in STEM engagement (Fredricks et al. 2005), STEM identity and belonging, encouragement (Leonowich-Graham & Condley 2010), math and science anxiety (Bai et al. 2009; Glynn and Koballa 2006), commitment to research, and intent to persist (Tocker 2010). Further definition of these psychosocial constructs is presented in Table 1, along with example survey items. Students were asked to respond to survey items using a 5-point Likert scale of agreement (1=Strongly Disagree to 5=Strongly Agree).
To collect qualitative data, students were assembled in groups of 812 to participate in annual focus group interviews. During these interviews, students were asked probing questions regarding their experiences in the program and how they affected their identity, engagement, and intent to persist in STEM. The focus group interview protocol included questions such as the following:
- Describe civic engagement activities that you participated in.
- Did these activities change the way you think about yourself? About your intended career?
- Are you making different decisions because of participating in this program? Explain.
To further explore the link between persistence and gains made by students as a result of the program and civic engagement activities, a multiple regression analysis was conducted whereby the outcome variable was Intention To Persist and the predictor variables were STEM Engagement, STEM Identity and Belongingness, Math and Science Anxiety, Research, and Encouragement. To compute the outcome and predictor values for this analysis, items from the student survey were averaged for each corresponding construct.
Qualitative data gleaned from participants’ open-ended responses to surveys and during focus group interviews suggested that the STEP program positively impacted their motivation to pursue STEM education and careers by enhancing their sense of STEM identity and belonging and by providing social support and encouragement.
[STEP] helped me to be confident and to trust myself that I can do better things if I have the will. It also helped me make the decision that I belong to a STEM family.
STEP enhanced my vision of being a scientist.
I was about to give up on my school.…[A]fter meeting and getting help from different people, I was able to rethink my major and continue my studies.
Additionally, annual surveys completed by program participants demonstrated that they made significant gains in terms of STEM engagement, STEM identity and belongingness, comfort with math and science, encouragement, and intent to persist. Table 2 shows statistically significant gains in attitude measured by these surveys over the course of the program.
Figure 1 summarizes the results of the regression analysis, conducted using data from the alumni surveys administered in 2013 and 2015 (n=39). Students taking the alumni survey had all completed their program and/or transferred to a four-year institution. Alumni survey data were chosen for this regression analysis in order to limit the findings to that of a longer-term student perspective; these students had the benefit of looking back over their entire program experience, and these data represent a more complete picture. The regression model with all five predictors explained 95% of the variance in the outcome variable (R2=.948, F(5,33)= 119.18, p<.001). Controlling for other variables in the model, the results indicate that two variables statistically significantly predict intent to persist:
- STEM Identity and Belongingness (ß=.55, p<.001)
- Encouragement (ß=.56, p<.001)
This suggests that students’ motivations to pursue additional STEM education and/or careers is contingent on the degree to which the program was able to (a) improve their sense of belonging in STEM and (b) provide encouragement for attaining a STEM degree. This finding corroborates previous research which indicates that STEM persistence increases as students experience a greater sense of belonging and general social support from mentors and colleagues (London et al. 2011).
Quantitative data analysis was limited in that the response rate for the student surveys was not 100%. (Response rate was roughly 85% across all items and multiple administrations of the survey.) Thus, responses might demonstrate a bias towards the positive, as students who felt less compelled to respond to the program survey were often those who had left the program (and usually the institution). Additionally, due to the low sample size, we must use caution when interpreting the results of the regression analysis. Correlations among constructs suggest that multicollinearity may have impacted the results of the regression. To mitigate the effects of multicollinearity, each predictor variable in the regression model was standardized (e.g., converted to a z-score). Furthermore, the results provided in the current report are preliminary and should be replicated using a larger sample size. It is also important to note that disaggregation of data by gender or race/ethnicity did not reveal significant differences among the participating groups of students.
During annual interviews, students were asked about their experiences in program activities, and how they thought these experiences affected them. In particular, we explored which facets of the program led to increased STEM identity and encouragement. Students explained that the volunteer work they did to meet their civic engagement requirements helped them in many ways. Specifically, they were able to solidify their STEM content knowledge and improve their communication and leadership skills:
Being part of [tutoring]… helps you refresh your mind. When you are helping them it helps you refresh your mind. You refresh communication skills.
It improves your leadership skills. One thing that I’ve learned is that you’re more involved in the community and you’re more exposed to the problems of the community. I think that it really improves your communication skills, your leadership, and it helps you learn more about your community.
Participants also felt that civic engagement motivated them to work harder in STEM and gave them a broader perspective on their futures.
It opens your mind up to all that’s out here. It’s opened my mind to what’s out there and made me think that I want to help people. It’s an unselfish thing.
Even being around the other members, outside of class, you get to know them—being around people that are really smart, makes me want to be really smart.
You become more motivated. You want to learn as much as you can. You want to help as much as you can. You want to put things out there so that people can learn from you.
It’s not about improving myself, but improving other people’s lives. I started thinking about non-profits. I started thinking about things that I didn’t think about before.
In short, students explained that participation in civic engagement improved their STEM and soft skills and motivated them to consider a broader range of career options. Their sense of identity as part of a STEM community was solidified through exchanges with their peers as well as with those they were helping.
In order to examine the effect of programmatic activities on actual persistence, we tracked transfer and graduation rates of the scholars, and compared those to non-participant STEM students. Table 3 indicates that program participants were more than twice as likely to complete their program of study and /or transfer to a four-year institution to pursue a STEM degree. Furthermore, STEP students who completed at least 10 hours per semester of civic engagement activities were even more likely to graduate and/or transfer (Table 3).
The culture that students encounter when studying STEM has an effect on their interest, self-concept, sense of connectedness, and persistence in STEM. Students who persist often have to draw upon personal, cultural, and co-curricular resources to counter messages about the nature of ability and stereotypes that they encounter in interactions with faculty and that are embedded in organizational norms and practices.
Interventions aimed at improving participant identity and belonging have been shown to enhance achievement and persistence (Cohen & Garcia 2008). Not surprisingly, students in highly evaluative environments (such as STEM courses) are sensitive to stereotype threat when facing difficult coursework and feedback, suggesting that it is particularly important to focus on improving STEM identity in an effort to increase student success (Cohen & Steele 2002).
Despite limitations of the study discussed in the results section, we found that an increase in STEM identity and belongingness and encouragement predicted an increase in intent to persist, and that actual persistence was improved with civic engagement. We posit that opportunities to guide others through tutoring and other civic engagement activities enhanced STEM identity, as scholars explained to us during interviews. In concurrence with STEM achievement, improved identity and belongingness in STEM led to a substantially higher likelihood of graduation and or transfer, as evidenced by participant graduation and transfer rates in comparison to those of non-participant STEM students at the institution. Participating students still face a number of challenges, as do their non-participating counterparts; though the overall graduation and transfer rate for participants is still alarmingly low, the trend towards success is encouraging and suggests that interventions aimed at increasing STEM identity through civic engagement will increase overall STEM diversity in academe and the workforce
About the Authors
Dr. Pamela M. Leggett-Robinson is the Science Department associate chair and an associate professor of chemistry on the Decatur campus of Georgia State University-Perimeter College. Dr. Leggett-Robinson has served as a program director for several NSF and NIH initiatives and is currently the principal investigator of Georgia State University-Perimeter College’s NSF STEP grant. Her research and scientific presentations focus on natural product chemistry, surface chemistry, and student support programs in STEM education. She holds a BS in Chemistry from Georgia State University, an MS in Bio-Inorganic Chemistry from Tennessee Technological University, and a PhD in Physical Organic Chemistry from Georgia State University. As corresponding author, Dr. Leggett-Robinson can be reached at firstname.lastname@example.org.
Mrs. Naranja Davis is the NSF GSU-PC STEP coordinator. She has worked as a coordinator on several other NSF STEM initiatives over the past 10 years and is experienced in student data systems. Ms. Davis has a BS in Communication with a minor in Public Relations.
Dr. Brandi Villa did her graduate research in areas of applied and environmental microbiology as well as program evaluation of a science education outreach organization. She has been a science educator at middle school, high school, and undergraduate levels for more than a decade and thus brings an educator and researcher’s perspective to the design and implementation of education research and program evaluation. In addition to her passion for all aspects of STEM education, Dr. Villa particularly enjoys challenges related to evaluation design, reporting, and data visualization.
American Association of Community Colleges (AACC). (2011). Fast facts, 2011. Washington, DC: American Association of Community Colleges.
American Association of Community Colleges (AACC). (2014). Fact Sheet. Washington, DC: American Association of Community Colleges.
Bai, H., Wang, L., Pan, W., & Frey, M. (2009). Measuring mathematics anxiety: Psychometric analysis of a bi-dimensional affective scale. Journal of Instructional Psychology, 36(3), 185–193.
Bandura, A. (1997). Self-efficacy: The exercise of control. New York: W.H. Freeman and Company.
Baumeister, R. F., & Leary, M. (1995). The need to belong: Desire for interpersonal attachments as a fundamental human motivation. Psychological Bulletin, 117(3), 497–529.
Britz, M. W., Dixon, J., & McLaughlin, T. F. (1989). The effects of peer tutoring on mathematics performance: A recent review. B.C.J. Special Education, 13,17–33.
Cabrera, A. F., Nora, A., Terenzini, P. T., Pascarella, E. T., & Hagedorn, L. S. (1999). Campus racial climate and the adjustment of students to college: A comparison between white students and African-American students. Journal of Higher Education, 70, 134–160.
Chen, X. (2009). Students who study science, technology, engineering, and mathematics (STEM) in postsecondary education. Washington DC: U.S. Department of Education, National Center for Education Statistics, Institute of Education Sciences. Retrieved January 31, 2018 from https://nces.ed.gov/pubs2009/2009161.pdf.
Chen, X. (2013). STEM attrition: college students’ paths into and out of STEM fields (NCES 2014-001). Washington DC: U.S. Department of Education, National Center for Education Statistics, Institute of Education Sciences. Retrieved January 31, 2018 from https://nces.ed.gov/pubs2014/2014001rev.pdf.
Cohen, G. L., & Garcia, J. (2008). Identity, belonging and achievement: a model, interventions, implications. Current Directions in Psychological Science, 17, 365–369.
Cohen, G. L., & Steele, C. M. (2002). A barrier of mistrust: How negative stereotypes affect cross-race mentoring. In J. Aronson (Ed.), Improving academic achievement: Impact of psychological factors on education. San Diego, CA: Academic Press.
Cohen, P. A., Kulik, J. A., & Kulik, C. C. (1982). Educational outcomes of tutoring: A meta-analysis of findings. American Educational Research Journal, 19, 237–248.
Dovidio, J. F., Major, B., & Crocker, J. (2000). Stigma: Introduction and overview. In T. F. Heatherton (Ed.), The Social Psychology of Stigma (pp. 1–28). New York: Guilford Press.
Early, J. W. (1998). The impact of peer tutoring on self-esteem and Texas Assessment of Academic Skills mathematics performance of tenth grade students. Unpublished doctoral dissertation, Texas A&M University, College Station, TX.
Eccles, J., Wigfield, A., & Schiefele, U. (1998). Motivation to succeed. In W. Damon (Series Ed.) and N. Eisenberg (Volume Ed.), Handbook of Child Psychology. Vol. 3: Social, Emotional, and Personality Development (5th ed., pp. 1017–1095). New York: Wiley.
Fredricks, J. A., Blumenfeld, P. C., Friedel, J., & Paris, A. (2005). School engagement. In K. A. Moore and L. Lippman (Eds.), Conceptualizing and measuring indicators of positive development: what do children need to flourish? New York: Kluwer Academic/Plenum Press.
Glynn, S. M., & Koballa, T. R., Jr. (2006). Motivation to learn college science. In J. J. Mintzes & W. H. Leonard (Eds.), Handbook of college science teaching. Arlington, VA: National Science Teachers Association Press.
Good, C. (2012). Why do women opt out? Sense of belonging and women’s representation in mathematics. Journal of Personality and Social Psychology, 102(4), 700–717.
Griffith, A. L. (2010). Persistence of women and minorities in STEM field majors: Is it the school that matters? Retrieved January 31, 2018 from http://digitalcommons.ilr.cornell.edu/workingpapers/122/
Hanover Research (2014). Encouraging Students to Embrace STEM programs. Retrieved January 31, 2018 from http://mygaen.org/research/Encouraging%20Students%20to%20Embrace%20STEM%20Programs.pdf.
Howard, G. S. (1980). Response-shift bias: A problem in evaluating interventions with
pre/post self-reports. Evaluation Review, 4(1), 93–106.
Huang,G., Taddese, N., & Walter, E. (2000). Entry and persistence of women and minorities in college science and engineering education (NCES 2000–601). Washington, DC: U.S. Department of Education, National Center for Education Statistics.
Hug, S., Thiry, H., & Tedford, P. (2011, March). Learning to love computer science: Peer leaders gain teaching skill, communicative ability, and content knowledge in the CS classroom. SIGCSE: Proceedings of the 42nd ACM Technical Symposium on Computer Science Education, Dallas, TX (pp. 201–206).
Johnson, D. R. (2012). Campus racial climate perceptions and overall sense of belonging among racially diverse women in STEM majors. Journal of College Student Development, 53(2), 336–346.
Kiyama, J. M. (2014). Structured opportunities: Exploring the social and academic benefits for peer mentors in retention programs. Journal of College Student Retention: Research, Theory, & Practice, 15, 489–514.
Kiyama, J. M., Luca, S. G., Raucci, M., & Crump-Owens, S. (2014). A cycle of retention: Peer mentors’ accounts of active engagement and agency. College Student Affairs Journal. 32, 81–95.
Leonowich-Graham, P., & Condly, S. (2010). Encouragement may be the missing link in the pursuit of CS / IT Majors. Fall 2010 Mid-Atlantic ASEE Conference, Villanova University. Retrieved January 31, 2018 from https://www.asee.org/documents/sections/middle-atlantic/fall-2010/01-Encouragement-May-Be-the-Missing-Link-in-the-Pursuit-of-CS-I.pdf.
Li, X. (2007). Characteristics of minority-serving institutions and minority undergraduates enrolled in these institutions (NCES 2008-156). Washington, DC: U.S. Department of Education, National Center for Education Statistics.
London, B., Rosenthal, L., Levy, S., & Lobel, M. (2011). The influences of perceived identity compatibility and social support on women in nontraditional fields during the college transition. Basic and Applied Social Psychology, 33, 304–321.
Marra, R. M., Rodgers, K. A., Shen, D., & Bogue, B. (2009) Women engineering students and self-efficacy: A multi-year, multi-institution study of women engineering student self- efficacy. Journal of Engineering Education ,98(1), 27–38.
Monte, A. E., Sleeman, K. A., & Hein, G. L. (2007, October). Does peer mentoring increase retention of the mentor? 37th ASEE/IEEE Frontiers in Education Conference. Milwaukee, WI.
Mullin, C. M. (2012, February). Why access matters: The community college student body (Policy Brief 2012-01PBL). Washington, DC: American Association of Community Colleges
National Academies of Sciences, Engineering, and Medicine (NASEM). (2016). Barriers and opportunities for 2-year and 4-year STEM degrees: Systemic change to support students’ diverse pathways. Washington, DC: National Academies Press.
National Research Council (NRC). (2000). How people learn: Brain, mind, experience, and school.. Expanded Edition. Washington, DC: National Academies Press.
National Research Council (NRC). (2009). Learning Science in Informal Environments: People, Places, and Pursuits. Washington, DC: The National Academies Press.
National Research Council (NRC). (2012). Community colleges in the evolving stem education landscape: Summary of a summit. Washington, DC: National Academies Press.
Ong, M. (2001). Playing with in/visibility: How minority women gain power from the margins of science culture. Women in Higher Education, 10/11, 4–44.
Palmer, R. T., Maramba, D. C., & Dancy, T. E. (2011). A qualitative investigation of actors promoting the retention and persistence of students of color in STEM. Journal of Negro Education, 80(4), 491–504.
Pérez, P., & Ceja, M. (2009). Best practices and outcomes in transfer to universities. Journal of Hispanic Higher Education. 9(1), 6–21.
Pérez, T., Cromley, J. G., and Kaplan, A. (2014). The role of identity development, values, and costs in college STEM retention. Journal of Educational Psychology, 106(1), 315–329.
Pratt, C., McGuigan, W., & Katzev, A. (2000). Measuring program outcomes: Using retrospective pretest methodology. American Journal of Evaluation, 21(3), 34–349.
President’s Council of Advisors for Science and Technology (PCAST). (2012). Report to the President: Engage to excel: Producing one million additional college graduates with degrees in science, technology, engineering, and mathematics. Washington, DC: Executive Office of the President.
Provasnik, S., & Planty, M. (2008). Community colleges: Special supplement to the Condition of Education 2008 (NCES 2008-033). Washington, DC: U.S. Department of Education, National Center for Education Statistics.
Reid, L. D., & Radhakrishnan, P. (2003). How race still matters: The relation between race and general campus climate. Cultural Diversity and Ethnic Minority Psychology, 9, 263–275.
Snyder, C. R., & Lopez, S. J. (Eds.) (2002). Handbook of positive psychology. Oxford: Oxford University Press.
Starobin, S. & Laanan, F. S. (2008). Broadening female participation in science, technology, engineering, and mathematics: Experiences at community colleges. New Directions for Community Colleges, 142, 37–46.
Tocker, Y. (2010). Non-ability correlates of the science/math trait complex: Searching for personality characteristics and revising vocational interests. Doctoral dissertation: Georgia Institute of Technology, Atlanta, GA.
Tsapogas, J. (2004). The role of community colleges in the education of recent science and engineering graduates (InfoBrief 04-315.) Arlington, VA: Division of Science Resources Statistics, National Science Foundation.
Walton, G. M., & Cohen, G. L. (2007). A question of belonging: Race, social fit, and achievement. Journal of Personality and Social Psychology, 92(1), 82–96.