Skip to main content

Building Evaluation Capacity in a Complex World: Practical Lessons for Organization and Project Leaders

Research study about evaluation capacity building in networks

DESCRIPTION

The Complex Adaptive Systems as a Model for Network Evaluations (CASNET) study was a four-year research project investigating evaluation capacity building within a network using a complexity theory lens. The study used a case study approach to examine and understand evaluation capacity building within the Nanoscale Informal Science Education Network (NISE Network). The intent of the CASNET project was to provide insights on (1) the implications of complexity theory for promoting widespread and systemic use of evaluation within a network, and (2) complex system conditions that foster or impede evaluation capacity building  within a network.

________________

Suggested citations:

Report:

Citation: Cardiel, C., Pattison, S., Bequette, M., Nelson, A. G., Kollmann, E. K., Cohn, S., Reich, C., & Eliou, G. A. (2016). Building evaluation capacity in a complex world: Practical lessons for organizations and project leaders, OMSI, Portland, OR.
https://www.nisenet.org/catalog/CASNETreport

Peer-reviewed publications:

Bequette, M., Cardiel, C. L. B., Cohn, S., Kollmann, E. K., & Lawrenz, F. (2019). Evaluation capacity building for informal STEM education: Working for success across the field. In A. C. Fu, A. Kannan, & R. J. Shavelson (Eds.), Evaluation in Informal Science, Technology, Engineering, and Mathematics Education. New Directions for Evaluation, 161, 107-123. 
https://doi.org/10.1002/ev.20351
https://onlinelibrary.wiley.com/doi/10.1002/ev.20351

Grack Nelson, A., King, J.A., Lawrenz, F., Reich, C., Bequette, M., Pattison, S., Kollmann, E.K., Illes, M., Cohn, S., Iacovelli, S., Cardiel, C.L.B., Ostgaard, G., Goss, J., Beyer, M., Causey, L., Sinkey, A., & Francisco, M. (2019). Using a complex adaptive systems perspective to illuminate the concept of evaluation capacity building in a network. American Journal of Evaluation, 40(2), 214-230. https://doi.org/10.1177%2F1098214018773877

Lawrenz, F., Kollmann, E.K., King, J.A., Bequette, M., Pattison, S., Nelson, A.G., Cohn, S., Cardiel, C.L.B., Iacovelli, S., Eliou, G.O., Goss, J., Causey, L., Sinkey, A., Beyer, M., & Francisco, M. (2018). Promoting evaluation capacity building in a complex adaptive system. Evaluation and Program Planning, 69, 53-60. 
https://doi.org/10.1016/j.evalprogplan.2018.04.005

JUMP TO BROWSE RELATED RESOURCES
  • research reports icon with a blue background and a buckyball illustration
  • research reports icon with a blue background and a buckyball illustration

DESCRIPTION

The Complex Adaptive Systems as a Model for Network Evaluations (CASNET) study was a four-year research project investigating evaluation capacity building within a network using a complexity theory lens. The study used a case study approach to examine and understand evaluation capacity building within the Nanoscale Informal Science Education Network (NISE Network). The intent of the CASNET project was to provide insights on (1) the implications of complexity theory for promoting widespread and systemic use of evaluation within a network, and (2) complex system conditions that foster or impede evaluation capacity building  within a network.

________________

Suggested citations:

Report:

Citation: Cardiel, C., Pattison, S., Bequette, M., Nelson, A. G., Kollmann, E. K., Cohn, S., Reich, C., & Eliou, G. A. (2016). Building evaluation capacity in a complex world: Practical lessons for organizations and project leaders, OMSI, Portland, OR.
https://www.nisenet.org/catalog/CASNETreport

Peer-reviewed publications:

Bequette, M., Cardiel, C. L. B., Cohn, S., Kollmann, E. K., & Lawrenz, F. (2019). Evaluation capacity building for informal STEM education: Working for success across the field. In A. C. Fu, A. Kannan, & R. J. Shavelson (Eds.), Evaluation in Informal Science, Technology, Engineering, and Mathematics Education. New Directions for Evaluation, 161, 107-123. 
https://doi.org/10.1002/ev.20351
https://onlinelibrary.wiley.com/doi/10.1002/ev.20351

Grack Nelson, A., King, J.A., Lawrenz, F., Reich, C., Bequette, M., Pattison, S., Kollmann, E.K., Illes, M., Cohn, S., Iacovelli, S., Cardiel, C.L.B., Ostgaard, G., Goss, J., Beyer, M., Causey, L., Sinkey, A., & Francisco, M. (2019). Using a complex adaptive systems perspective to illuminate the concept of evaluation capacity building in a network. American Journal of Evaluation, 40(2), 214-230. https://doi.org/10.1177%2F1098214018773877

Lawrenz, F., Kollmann, E.K., King, J.A., Bequette, M., Pattison, S., Nelson, A.G., Cohn, S., Cardiel, C.L.B., Iacovelli, S., Eliou, G.O., Goss, J., Causey, L., Sinkey, A., Beyer, M., & Francisco, M. (2018). Promoting evaluation capacity building in a complex adaptive system. Evaluation and Program Planning, 69, 53-60. 
https://doi.org/10.1016/j.evalprogplan.2018.04.005

JUMP TO BROWSE RELATED RESOURCES

Credits

YEAR CREATED
2016
OWNING INSTITUTION

Oregon Museum of Science and Industry, University of Minnesota, Science Museum of Minnesota, and Museum of Science, Boston

FUNDING

This material is based upon work supported by the National Science Foundation under Grant Number DRL 1228868. Any opinions, findings, and conclusions expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation. 

PERMISSIONS

Creative Commons Attribution Non-Commercial Share Alike 3.0 United States (CC BY-NC-SA 3.0 US).
View more details

DEVELOPMENT PROCESS

NISE Network products are developed through an iterative collaborative process that includes scientific review, peer review, and visitor evaluation in accordance with an inclusive audiences approach. Products are designed to be easily edited and adapted for different audiences under a Creative Commons Attribution Non-Commercial Share Alike license. To learn more, visit our Development Process page.