The purpose of this NSF-funded I3 project was to creatively provide evaluation capacity-building tools and strategies to NC State’s K-12 STEM outreach programs, particularly those funded by NSF, to help ensure the breadth and depth of the future U.S. STEM workforce. North Carolina State University had over 120 STEM outreach projects funded between 2003 and 2009. Among these are many funded by NSF, including the ITEST, MSP, Noyce, GSE, AGEP, CCLI, GK-12, and ERC programs. The vision for MISO is an integrated institutional structure that will allow pre-college programs to think and act strategically to meet the goals below. While the first two goals are new endeavors made possible through the proposed project, all four goals are shared among all participating K-12 STEM outreach programs:
- Provide an innovative network of support and communications among University-based outreach project directors and educational evaluation experts, creating a learning community to promote sharing of best practices and innovation that will deepen the impact of NC State’s pre-college STEM programs on students’ future academic and career choices.
- Develop and demonstrate a system of data-driven planning and analysis guided by best practices to facilitate longitudinal assessment of participant outcomes through development of a common STEM Outreach Evaluation Protocol as well as a database integrating records of NC State K-12 outreach participants with NC Department of Public Instruction records and university enrollment.
- Use the longitudinal assessment of outreach participant outcomes within the university-wide outreach learning community to support more seamless transitions across critical educational junctures.
- Broaden participation among underrepresented groups in pre-college STEM outreach activities through integrated recruitment and support strategies.
One important outcome of the project was the development of the S-STEM and T-STEM instruments. The S-STEM instrument emerged out of the project team’s conclusion that there did not exist a well validated, reliable instrument for measuring student attitudes (i.e., self-efficacy and goal orientation) towards STEM subjects, STEM career pathways, and 21st century skills—key outcomes for critical STEM education and workforce development programs. The T-STEM similarly measured teacher’s perceptions of their ability to teach STEM subjects and 21st century skills. While a few survey instruments measure related attitudinal dimensions, they do not systematically gather this data across all of the STEM subject areas. This data was central to the work of the MISO project and other projects being undertaken at the Friday Institute and thus spurred our efforts in this endeavor. In our work reporting on the development and validation of these instruments, we have received an enthusiastic response from the STEM education research and evaluation community, witnessed in part by the large number of requests we’ve had in the short time it has been publicly posted. To date, the T-STEM and S-STEM surveys have been requested for use by more than 1,000 potential users. The instruments have been reported on at major conferences (e.g., NARST, AERA, ASEE, AEA) and with NSF umbrella communities such as CADRE and the MSP Knowledge Management and Dissemination (KMD) group. Within the state of North Carolina, it has already been used by both state and district wide STEM education initiatives. We are continuing to use these instruments in our own research and evaluation; and in continuing to develop, validate, and disseminating these instruments.
Please feel free to contact us with any questions. While this project is no longer active, the project team will do it’s best to respond and answer your queries.
If you are an NC State K12 Outreach Provider, please see the NCSU Partners page for more information about survey participation and implementation. If you are a non-NC State group interested in using our surveys, please complete this form to request a copy of the instruments, and also visit the Survey Overview, T-STEM Survey and S-STEM Survey pages for more information.
The material on this website is based upon work supported by the National Science Foundation under Grant No. 1038154. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the view of the National Science Foundation.