Digital Dark Age

Aligning to the International Principles of Social Value and conducted in accordance with the Social Return on Investment (SROI) framework published by the Cabinet Office of the UK Government, this analysis uses a stakeholder informed approach to show the social value generated over the calendar year of 2024 against all the investment relevant to those stakeholders involved in or affected by the program. Accordingly, it uses the views of people that are materially affected (staff, volunteers, and youth) to determine what outcomes FPS Community Projects creates and involves them to estimate their quantity, duration, value and causality. It is not an assessment of the savings to participating schools, environmental value or benefit to the economy.

The value of the Future Problem Solving Community Projects program goes far beyond what is captured in financial terms.

Projects delivered a $1:$33 Social Return on Investment (SROI)

Results conclude a total of $4.9 million of social value generated by FPS Community Projects in 2024 with an SROI ratio of $1: $33.09 ($1: $29.12 for youth not exposed to project management concepts plus an additional ratio of $1: $3.97 for youth trained in project management knowledge and skills) and a vast total positive impact on program participants and those people whose lives FPS Community Projects touch.

Student gains are almost 80% of the social impact

Through enabling people to give back, FPS Community Projects is making a difference to people’s lives in the local communities impacted by the group projects. A larger significance are the skills and attributes participants gain through their FPS Community Projects participation. It should be noted that nearly a third (29%) of the total social value found is through increasing individuals’ feeling of giving back to others and almost half (49%) of the total social value is about life (soft) skills acquisition. 

The highest social value per person was created for FPS Community Projects Volunteer Coaches (specifically regarding the use of scaffolding as a framework, i.e., recording of past efforts as a resource for present and future projects), while the highest total social value per stakeholder group was for the youth participants. It was shown that for youth participants who were not exposed to project management concepts, an increase in ‘self-esteem’ and ‘greater involvement in the community’ are the most important outcomes, and it is through enabling this, FPS Community Projects is making the most difference to people’s lives.

Project management training delivered important outcomes

For those youth participants receiving project management training, ‘organizational skills’ and ‘team collaboration’ were the most important outcomes in addition to those expressed by youth not having been exposed to project management. Other important outcomes for the former group also include:

• ‘Ability to reflect’
• ‘Ability to stay focused’
• ‘Transferability of new project management skill sets to other classes’

It is recommended that findings from this SROI analysis be used to:

• Evidence value: Help Future Problem Solving demonstrate its immense social value to our communities; and
• To be responsive: Through illustrating what outcomes are most important to stakeholders, this study can help Future Problem Solving to continue focusing its actions where it matters, to continue to increase and maximize the positive social value created.

This research was commissioned by Future Problem Solving (FPS) as a pro bono project to create an SROI report. The analysis, primary research, value map and report that forms the full SROI report was led, undertaken and written by the Project Management Institute. The overall project was overseen and supported by the Technical Director of Social Value International.

A Comparison of Reading and Mathematics Performance Between Students Participating in a Future Problem Solving Program and Nonparticipants

Data from the The Minnesota Comprehensive Assessment (MCA) was collected by Grandview Middle School and provided to Scholastic Testing Service, Inc. for statistical analysis.

Findings reported by Scholastic Testing Service, Inc. Performance data on the MCA was collected from 2010-2014 for students in grade 6 at Grandview Middle School in Mound, MN (Westonka Public School District). Students were identified as either FPS: students participating in a Future Problem Solving program, or Non-FPS: students not participating in the program. Summary statistics using Reading and Mathematics Scaled Scores were developed for each group of students by year and across years. To determine if the mean scores across the years were significantly different, t-tests were used. A Cohen’s d test was then performed to measure the effect of the size of the found differences.

In all cases, students participating in the Future Problem Solving Program performed significantly higher on the MCA in both areas of Mathematics and Reading.

The Journal of Creative Behavior (JCB) of the Creative Education Foundation

Seventy-five participants from one suburban high school formed 21 teams with 3–4 members each for Future Problem Solving (FPS). Students were selected to participate in either the regular FPS or an enhanced FPS, where multiple group training activities grounded in problem-solving style were incorporated into a 9-week treatment period.

An ANCOVA procedure was used to examine the difference in team responses to a creative problem-solving scenario for members of each group, after accounting for initial differences in creative problem-solving performance, years of experience in FPS, and creative thinking related to fluency, flexibility, and originality. The ANCOVA resulted in a significant difference in problem-solving performance in favor of students in the treatment group (F(1, 57) = 8.21, p = .006, partial eta squared = .126, medium), while there were no significant differences in years of experience or creativity scores. This result led researchers to conclude that students in both groups had equivalent creative ability and that participation in the group activities emphasizing problem-solving style significantly contributed to creative performance.

In the comparison group, a total of 47% had scores that qualified for entry to the state competition. In contrast, 89% of the students in the treatment group had scores that qualified them for the state bowl. None of the teams from the comparison group qualified for the international competition, while two teams from the treatment group were selected, with one earning sixth place.

The results of this study suggest that problem-solving performance by team members can be improved through direct instruction in problem-solving style, particularly when there is a focus on group dynamics.

The Journal of Creative Behavior, Vol. 0, Iss. 0, pp. 1–12 © 2017 by the Creative Education Foundation, Inc. DOI: 10.1002/jocb.176

“How important was Future Problem Solving in the development of your following skill sets?”

In 2011, a team of researchers from the University of Virginia submitted a report titled “Future Problem Solving Program International—Second Generation Study.” (Callahan, Alimin, & Uguz, 2012). The study, based on a survey, collected data from over 150 Future Problem Solving alumni to understand the impact of their participation in Future Problem Solving as students or volunteers.

Percentage of Alumni Rating Important and Extremely Important in Developing Skill Sets

• 96% Look at the “Big Picture”
• 93% Critical Thinking
• 93% Teamwork and Collaboration
• 93% Identify and Solve Problems
• 93% Time Management
• 90% Researching
• 90% Evaluation and Decision Making
• 86% Creativity and Innovation
• 86% Written Communication

The report captured alumni’s positive experiences as students in Future Problem Solving and documented that the alumni continued to utilize the FPS-structured approach to solving problems in their adult lives.

Data was obtained from 220 coaches, 633 students, 195 parents, and 34 affiliate directors nationally and internationally

The Center for Creative Learning, USA (Treffinger, Selby, and Crumel) completed an international evaluation of Future Problem Solving including three competitive programs (Global Issues, Community Projects, and Creative Writing). Surveys ascertained 1,082 respondents’ views of: the extent to which Future Problem Solving and its programs meet their stated goals, the strengths of the programs and areas for improvement, and the impact of the program on its participants.

All respondents with current experience participating in each program rated a comprehensive list of 11-12 skills using a 5-point Likert scale. The adult groups identified the impact on participating students’ learning and growth, and the students identified what skills their participation helped them with the most.

Top 5 Most Impactful Skills Identified by Program

GLOBAL ISSUES

Adults – Coaches and Affiliate Directors (151)

• Learning about complex issues that will shape the future (4.60)
• Developing teamwork and collaboration, working together and cooperating with each other (4.39)
• Fostering critical thinking (the ability to sort and sift information or to focus one’s thinking) (4.29)
• Developing an active interest in the future (4.29)
• Developing the skills needed to manage time effectively (4.02)

Students (242)

• Learning about topics that will have important effects on the future. (4.14)
• Working together and cooperating with others (4.13)
• Thinking of many different and unusual ideas (3.99)
• Helping become a better leader (3.90)
• Deciding on the best solution to a problem (3.87)

COMMUNITY PROJECTS

Adults – Coaches and Affiliate Directors (64)

• Enhancing the skills of preparing and delivering materials and/or presentations that communicate ideas effectively (4.76)
• Developing teamwork and collaboration (working together, cooperating with each other)(4.56)
• Developing leadership skills (4.56)
• Showing evidence that team members are able to apply FPS skills in other situations (4.30)
• Developing the skills needed to manage time effectively (4.27)

Students (107)

• Working together and cooperating with others (4.33)
• Feeling that I can make a difference in shaping the future (4.13)
• Deciding on the best solution to a problem (4.07)
• Helping me become a better leader (3.97)
• Thinking of many different and unusual ideas (3.96)

CREATIVE WRITING

Adults – Coaches and Affiliate Directors (82)

• Enhancing and expanding writing skills (4.39)
• Developing an active interest in the future (4.11)
• Learning about complex issues that will shape the future (4.10)
• Thinking and researching futuristically (4.06)
• Fostering creative thinking (the ability to generate many, varied, and unusual options (3.98)

Students (146)

• Thinking and researching futuristically (4.08)
• Developing better writing skills (4.05)
• Learning about topics that will have important effects on the future (3.99)
• Thinking of many different and unusual ideas (3.92)
• Finding information in many different places (3.69)

Note, 88% of parents were satisfied with the Future Problem Solving program their youngster(s) participated in and a majority of parents with eligible students anticipated a high level of interest in participating again next year (60.9%).

Alumni Top 5 Most Impactful Skills on Their Development

A group of 48 alumni also responded to surveys focused on their past experiences and the impact those experiences had on their development into adulthood. Approximately 8 in 10 reported Future Problem Solving was very helpful or extremely helpful in secondary school (81%), in academic work after high school (78%), and in other life experiences outside school or academic work (81%). Looking back on their experience, the aspects below were rated the five most important and valuable.

• Learning ways to think of many different and unusual ideas (4.75)
• Learning how to choose the best solution for a problem (4.42)
• Learning how to work or collaborate with others (4.41)
• Developing better writing skills (4.36)
• Learning a specific process for solving problems (4.35)

Results indicated strong overall satisfaction with Future Problem Solving among all stakeholder groups, as well as evidence of positive impact on academic and real-life accomplishments and personal relationships.

5-point Likert scale:
Adults: 1 = Little or no impact, 2 = Limited impact, 3 = Moderate impact, 4 = High impact, 5 = Exceptional impact
Students: 1= Hasn’t helped me at all, 2 = Helped me just a little, 3 = Helped me = “Okay”, 4 = Helped me quite a bit, 5= Really a great help to me
Alumni: 1=Not Important, 2=Of Little Importance, 3=Somewhat Important, 4=Very Important, 5=Extremely Important