Minna Anttila,1 Tella Lantta,1 Milla Ylitalo,1,2 Marjo Kurki,1,3 Marko Kuuskorpi,4 Maritta Välimäki1,5
1Department of Nursing Science, University of Turku, Turku, Southwest Finland, Finland; 2Laurea University of Applied Sciences, Vantaa, Uusimaa Region, Finland; 3Itla Children’s Foundation, Helsinki, Uusimaa Region, Finland; 4Piikkiö comprehensive school, Kaarina, Southwest Finland, Finland; 5Xiangya School of Nursing, Central South University, Changsha, Hunan, People’s Republic of China
Correspondence: Maritta Välimäki
Xiangya Nursing School, Central South University, 172 Tongzipo Road, Changsha, Hunan 410013, China; Department of Nursing Science, University of Turku, Turku, Southwest Finland, Finland
Tel +358 40 559 9235
Fax +358 29 450 5040
Email [email protected]
Purpose: Health-related behaviors that arise during adolescence can have important, sometimes lifelong, implications on a person’s health. Psychiatric and neurodevelopmental diagnoses among minors have increased, and the related depressive symptoms may negatively affect quality of life. There is great potential for information technology (IT) to benefit the area of mental health for adolescents, and schools can serve as a setting in which this can be done. We tested whether the IT-based program “DepisNet” could be used as a universal school-based program to support adolescents’ well-being and mental health.
Patients and Methods: We used a quasi-experimental, pre-post design with two preference arms (intervention and control groups). The study setting comprised two lower secondary schools (N=151 adolescents) in one city in Finland. To analyze the impact of the program, we compared the changes in the outcome measures between the two groups using T-tests and Mann–Whitney U-tests. We analyzed the changes within the groups using T-tests and Wilcoxon tests.
Results: Our analysis revealed no statistically significant differences between the groups in any of the outcomes (depression, quality of life, self-esteem, self-efficacy). Regarding adolescents’ quality of life, the observed change was more positive in the intervention group, compared to that of the control group (change mean 1.36 vs − 0.49), although statistical significance was not achieved (p=0.10). Our results indicated encouraging results related to the feasibility components: adherence and acceptance.
Conclusion: Universal interventions and programs that relate to adolescent well-being and mental health can be integrated into school curricula to promote the awareness of adolescents’ general well-being and mental health issues.
Keywords: teenaged, universal intervention, mental health support, IT-based program, pupils
Health-related behaviors that arise during adolescence can have important, sometimes lifelong, implications on a person’s health.1 The number of psychiatric and neurodevelopmental diagnoses among minors has increased.2,3 There are effective interventions in existence that show significant improvements in adolescents’ self-perceptions, values, cognitive skills, quality of life and mental health literacy.4 However, adolescents may experience barriers that prevent them from seeking information and supporting their mental health. It has been reported that adolescents lack knowledge about mental disorders.5 They often attach a sense of shame to mental health problems,5 and they generally lack insight on the subject and belief in their own capabilities.6,7
There is great potential for information technology (IT) in the area of mental health for adolescents.8–10 For example, gamiﬁcation, interactive exercises/modules, videos/animations, social media/messaging, and chatbots have all shown promise in mental health improvement.11 Technology provides opportunities to alleviate problematic situations in ways that traditional face-to-face methods cannot12 when it comes to improving well-being, increasing equality, and employing trustworthiness and self-monitoring.13 Technological interventions can also complement existing mental health care solutions.12
Schools are places where mental health can be promoted with the aim of enhancing well-being, and where mental health care can be provided. Mental health interventions have been developed for schools14–16 since adolescents spend a good bit of their time there,17 and schools are points of contact with adolescents.
Transforming IT-based treatment programs into universal interventions in school settings could be one solution for tackling latent mental health symptoms among youth and improving their quality of life. Even though systematic knowledge about interventions that have been delivered as universal prevention programs, those held in schools, those consisting of IT, and those focusing on mental health and depression have been gathered and synthetized,18,19 there is still a lack of knowledge about the combination of these. Many important outcomes related to adolescents’ lives have been previously explored, such as suicidality,20 depression attitudes,20,21 literacy and self-esteem,22 and coping strategies,23 but quality of life has not explicitly been measured. This is surprising, as quality of life has been defined to be among the core set of outcomes in clinical trials by various taxonomies and institutions, such as the Cochrane Community.24 Adding quality of life as an outcome in this area of research would provide a much-needed perspective in future comparative effectiveness research, outcomes research, and in clinical care.25
This paper focuses on the IT-based program “DepisNet”, a user-friendly and feasible support system developed for adolescents with depression. It was tailored to improve self-management skills and increase awareness of adolescents’ well-being and mental health.26 It is essential that mental health interventions are evidence-based, developmentally appropriate, and integrated into curricula.27 Therefore, in this study we tested whether this program could be used as a universal school-based program to support adolescents’ well-being and mental health. This was the first time the adolescents in our target schools had courses similar to the program’s topic. We hypothesized that our preventive intervention could decrease depressive symptoms and improve the quality of life of adolescents. Additionally, we evaluated the program’s impact on self-efficacy, self-esteem and feasibility components (acceptance, adherence). The results can provide guidance in addressing mental health in schools and serve as an essential component of adolescent-focused mental health policy.
IT-Based Mental Health Support Programs
We identified four previously reported universal programs (in 9 papers) in which IT was utilized and tested for adolescents around 14–15 years old. Such programs were related to mental health, or specifically depression, and used comparative study designs. The programs lasted 5 or 6 weeks and had their origins in positive psychology, for example, with “Bite Back”,28 or had elements from cognitive-behavioral therapy, for example with “MoodGym”,21,22,29,30 ‘e-couch Anxiety and Worry program,31,32 and SPARX-R.20,23 Results from these comparative studies were, however, mixed. Some found improvements in depression symptoms (for boys,29 for both genders,20 and for girls only)22 in emotional regulation,23 and anxiety,29 while others reported a lack of improvement.21,28,30–32 Feasibility components was reported in all studies, including mostly low completion rates. The programs are elaborated upon in Table 1.
Table 1 IT-Based Mental Health Support Programs in Schools
Materials and Methods
Study Design and Participants
We used a quasi-experimental, pre-post design with two preference arms (intervention and control groups). In this study, quasi-experimental means an experimental design without random assignment to intervention and control groups. In two preference arms, participants (schools) were allowed to choose whether they wanted to participate in the study as part of an intervention group or a control group. Preference arms are, in general, an attempt to add validity and adherence to a study by taking participants’ preferences regarding treatment or other aspects into account.33 The impact of the intervention is measured in this study with a pre-post design, meaning measurements were taken before the intervention and after the intervention. A quasi-experimental design suited our purposes as we preliminarily aimed to assess the impact and feasibility of the IT intervention in supporting adolescents’ well-being and mental health. A formal power calculation was not conducted as this small-scale study also focused on feasibility.34 According to a previous study carried out in a school setting,35 given the effect size of 0.64, with a statistical power of 0.8 and a confidence level of 0.05, a sample of about 138 subjects was needed. This is similar to other studies that have tested universal programs (n=146 adolescents;23 n=157 adolescents;22), although sample sizes have varied in previous studies from 7821 to 1767.31 The TREND statement (Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions) was followed.36
The setting for the study comprised two lower secondary schools in one city in Finland. In the Finnish education system, compulsory basic education includes elementary schools (grades 1 to 6) and lower secondary schools (grades 7 to 9).
The two schools were allocated either to be the intervention or the control setting, based on the schools’ preferences. The schools were selected to be distant from each other so that contamination and the possibility that adolescents from the control school would benefit from the activities in the intervention school would be minimal.37 Inside the schools, individual randomization for adolescents was not feasible given the possible information flow between the adolescents.
Our study targeted all adolescents in the 8th and 9th grades at our study schools (n=201 in the intervention school; n=157 in the control school). Adolescents were able to join the study if they were able to read, write and understand Finnish and were able to provide written, informed consent before any procedures. Exclusion criteria were inadequate Finnish skills, adolescents without written informed consent and adolescents under 15 without a written consent from their guardian. Moreover, adolescents were excluded if, according to their school physician, nurse or teacher, study participation would likely worsen their existing mental health problems or be otherwise unsuitable for them (eg, due to a developmental disorder).
Participant recruitment was carried out via a pre-existing IT system used for communication between the schools and homes, in a face-to-face information session for adolescents in the schools and through written information letters delivered to the adolescents. Adolescents willing to participate gave written consent before the study began. In addition, a guardian’s consent was sought from all the adolescents under 15 years old.38 Due to the type of the intervention, eg, in one school adolescents used the IT program for 6 weeks and in another they did not use it at all, it was not possible to mask it for the participants.
The flow diagram of the study is depicted in Figure 1.
Figure 1 Flow diagram.
At the intervention school, adolescents used the IT program for 6 weeks. The studied intervention is based on the previously developed26 and studied DepisNet program for adolescents.39–43 It was developed by searching the relevant literature on the topic, identifying the most useful theories guiding intervention development, conducting interviews with professionals to gain a better perspective on the world of adolescents and their needs and solutions to their problems, and cooperating with nursing staff to ensure that the intervention would be adopted as part of the existing treatment environment and procedures.26 It consists of health information, caters flexibly for the problems that adolescents commonly face in their daily lives, and a variety of self-reflective exercises. Even though it was previously used as a targeted intervention in adolescent psychiatry, it was developed to complement the current services in outpatient care. Therefore, the main content of the intervention was not modified in this universal psychoeducation intervention used in school settings, which also aimed to support adolescents’ self-management and increase their awareness of issues associated with well-being and mental health.
The program is based on innate basic needs that motivate human behavior: autonomy, ie, the feeling of having control over one’s own actions; competence, ie, the sense of mastery over one’s environment; and relatedness, ie, having meaningful relationships and interactions with other people.44,45 By adding these components of the self-determination theory (SDT) to our intervention,38 we promoted adolescents’ autonomy in seeking information from the program that would support their well-being and mental health by encouraging them to find out information relevant to their needs. We motivated adolescents to be competent in managing their well-being and mental health by encouraging them to do weekly exercises in the program, which have been developed to support them. We also supported their relatedness to their own well-being and mental health through the tutor feedback on their exercises. SDT is used extensively in fields of education and health, and focuses on the individuals’ motivation and the interplay between the extrinsic forces affecting a person and the intrinsic motives and needs inherent to human nature.46 The exercises in the modules included such tasks as writing a diary, taking a test related to internet use or health evaluation, and reflecting on the received test results in a diary. The intervention was elaborated by following TIDieR (template for intervention description and replication) checklist,47 presented in Table 2. At the control school, the adolescents did not have the possibility to use the DepisNet program; instead, they followed their regular curriculum planned according to local needs and interests.
Table 2 Universal School-Based IT-Program Described According to TIDieR Checklist47
Adolescents had individual user accounts and passwords to log in to the program, which were delivered to them by email. The program was available 24/7 during the study period. The adolescents were supposed to use the program during their school day once a week during a designated lesson, but they were also able to use it at home. According to previous literature on web-based interventions supporting adolescents and young people with depressive symptoms,48 completing one module per week is typical. The program was used independently on the adolescents’ individual iPads, but during the specified weekly lesson, tutors were present to provide support if needed. The adolescents did the exercises on their own and returned them via an online learning management system (Moodle). A detailed description of the program and exercises are presented in Supplementary Table 1. Table 3 shows the various roles of the intervention providers.
Table 3 Intervention Providers and Their Roles
Age, gender (male, female), grade (8, 9), computer and internet skills ranging from very good (1) to poor (5), and computer and internet attitude ranging from very positive (1) to very negative (5) were collected at baseline based on participant’s self-reporting.
The primary outcome was depression, which was measured with the Raitasalo Depression scale (RBDI49). The scale, originally developed by Beck et al (1961),50 measured experienced, and recognized and expressed depression, self-esteem and anxiety (13 items). The sum score of the scale ranges from 0 to 39; lower scores represent a better mental state related to depression. Cronbach’s α values in Finnish adolescent populations have been 0.87 (depressive symptoms) and 0.84 (self-esteem), indicating good reliability.51 In our study, internal consistency for the whole scale was good (α 0.85).
Quality of Life
The quality of life was measured using PQ-LES-Q,52 which consists of 15 self-assessing items regarding an adolescent’s own health and well-being (1=very poor–5=very well). Sum scores range from 14 to 70; higher scores represent better quality of life. For the analysis, the first 14 items were summed to form a total score. The internal consistency values have been found to be high (α 0.87–0.90).52 The Cronbach’s α for our study was 0.90.
Self-esteem was measured using the Rosenberg Self-Esteem Scale (RSES).53 It consists of 10 questions in which sum scores are counted, ranging from 10 to 40; higher scores represent better self-esteem. Internal consistency of the scale in the Finnish adolescent population has been reported to be good (α 0.88).54 In our study, however, the Cronbach’s α was below acceptable (0.55).
Self-efficacy was measured using the General Self-Efficacy Scale by Jerusalem and Schwarzer (GSES).55 The sum score ranges from 10 to 40; higher scores represent better reliability on oneself and capability to cope. Reliability has been found to be very good in the target population (α 0.89).56 The internal consistency was also high in this study (α 0.90).
Feasibility was measured by collecting information about adherence (number of adolescents in total at the study schools, number of refusals, dropouts, lost to follow-up) and acceptance of the program by means of logging activity.57 Activity information was collected from the learning management system, Moodle, and includes the total number of adolescents who logged in to the program, how many logged in to the program content, and the number of exercises done.
Baseline data was collected in November 2014 and the follow-up after the intervention in December 2014. Measures were delivered to each adolescent via their school emails using the Webropol system. The adolescents filled in the measures during a school lesson at baseline and immediately after the intervention.
All statistical analyses were performed using SPSS (version 26.0).58 Descriptive statistics were generated for baseline characteristics and outcome data. Baseline characteristics of the two groups were compared with T-tests and chi-square (X2) tests and outcome data (primary and secondary outcomes) with T-tests and Mann Whitney U-tests. To analyze the impact of the program, the change in the outcome measures were compared between the two groups by again using T-tests and Mann–Whitney U-tests. Changes within the groups were analyzed with T-tests and Wilcoxon tests. P values < 0.05 were considered indicative of statistically significant between-group differences.
Feasibility of the intervention was analyzed with descriptive statistics as follows: Adherence to the study was analyzed by calculating frequencies and percentages of adolescents willing to participate out of the whole study population, and adolescents filling in the baseline and follow-up measurements. This information was compared between the intervention and control schools. The data regarding program use (acceptance) was analyzed by calculating frequencies and percentages of adolescents logging in to the program out of the number of adolescents who provided the baseline measurement, adolescents logging in to the program contents, and the favorability of the modules (frequencies and percentage of adolescents returning to exercises per module in total and per exercise). This information was only collected from the intervention school.
The study was reviewed and approved by the Ethics Committee of the University of Turku (41/2014). The Ethics Committee approved the consent process, which allowed participants over 15 years of age to provide informed consent without parental consent.38 Permission to conduct the study (403/2014 – 441/2014) was received from the Head Principal of the city. Ethical guidelines and the World Medical Association Declaration of Helsinki were followed and any regulations addressing the conduct of a vulnerable population such as minors were taken into account.59 For example, adolescents decided for themselves whether to participate or not, and they were aware that refusal to participate would not in any way affect their studies. Tutors paid special attention to the concerns in adolescents’ depression scores or diary writings (eg, RBDI score ≥ 5, suicidal thoughts, self-harm), according to the protocol specifying the process of how to proceed in need of adolescent help. Adolescents were informed about this process when the study began. The tutor first contacted the adolescent if a concern arose and advised her/him to contact the nurse working at school. The school nurse registered the concern in the adolescents’ health records and proceeded according to the health care protocol used in Finland.60 Adolescents (n=22) were contacted because of RBDI scores at baseline, at follow-up, or because of their diary writings. Anonymity and confidentiality were emphasized in the learning management system, Moodle, which is SSL protected with usernames and passwords. Usernames were used instead of real names. Adolescents used the program individually, and there was always a tutor present in the classroom or on the Moodle platform as a moderator to protect the privacy of the participants. Only the tutors and researchers had access to the adolescents’ names, backgrounds and outcome data. All of the tutors and researchers had a professional background in health care, and were trained to handle ethically sensitive data.
Baseline Characteristics and Outcome Data
In the intervention group, participants were slightly older (p=0.009). There were fewer adolescents from the 8th grade in the intervention group (13% vs 33%, p=0.01). Computer and internet skills (p=0.16), and attitudes towards computers and the internet (p=0.19), indicated positive results in the intervention group, although the difference was not statistically significant. Comparison of the baseline information on the primary (depression, p=0.62) and secondary outcomes (quality of life, p=0.77; self-esteem, p=0.51; self-efficacy, p=0.34) showed no statistical differences between the study groups (Table 4).
Table 4 Baseline Demographic and Clinical Data
Impact of the Intervention on Adolescents’ Well-Being
Our analysis revealed no statistically significant differences between the groups regarding any of the outcomes, although the changes indicated positive results in the intervention group. Quality of life measured with the PQ-LES-Q indicated positive change in the intervention group, compared to the control group (Change mean 1.36 vs −0.49), although statistical significance was not achieved (p=0.10) (Table 5). There were no significant differences in any of the outcomes within the groups between baseline and follow-up (data not shown).
Table 5 Comparison of the Change in Primary and Secondary Outcomes in Intervention and Control Group
Out of 358 adolescents assessed for eligibility, 151 were willing to participate in the study (Figure 1). At the intervention school, 39% (78/201) of the 8th and 9th grade adolescents participated in our study, compared to the control school, in which 46% of adolescents participated (73/157). In the intervention group, 78% (56/78) participated in the baseline measurement, while in the control group, the corresponding number was 75% (55/73). In the intervention group, 70% (39/56) of those who participated in the baseline measurement continued the study to follow-up, versus 78% in the control group (43/55). There was no significant difference between the numbers of loss to follow-up between the groups.
At the intervention school, out of the adolescents who filled in the baseline measurement (N=56) and participated the first DepisNet session, 95% (n=53) logged in to the program. Figure 2 shows the frequencies and percentages of the adolescents who logged in to the different modules of the program. Logins decreased during the intervention. Favorability of the modules, measured by how many times adolescents returned to different types of exercises (tests, diaries), varied between 43% (n=23) and 68% (n=36). Based on returned diaries, the adolescents most highly favored the last module concerning support for depression, and they were least interested in the third module concerning their rights. In total, 18% (n=10) of the adolescents completed all the exercises in the program. In each module, approximately 58% (n=31) of the adolescents did at least one exercise, and this proportion ranged from 47% (n=25) up to 68% (n=36).
Figure 2 Realized logging in to modules and completed exercises per adolescent in the intervention group.
In the present quasi-experimental study, we assessed the preliminary impact and feasibility of the DepisNet program to support adolescents’ well-being and mental health as a universal school-based program. Based on our results, the program does not have an impact on the primary outcome, depressive symptoms. The change in adolescents’ quality of life indicated positive results in the intervention group, although the difference between groups or within groups was not statistically significant. However, we did achieve encouraging results related to the feasibility components of our study, adherence and acceptance.
Our analysis revealed no statistically significant differences between the groups in any of our outcomes, although the changes indicated positive results in the intervention group. This result is similar to those of some previous universal IT interventions realized at schools. For example, in Australia, Calear et al32 tested an e-couch Anxiety and Worry program in a large adolescent population and did not observe any significant differences between the intervention and control conditions. We found one similar intervention study that has been carried out in Finland since the time of our study (2014). Puolakanaho et al61 assessed the efficacy of a five-week web- and mobile-delivered intervention dealing with stress and coping skills. The program was called Youth COMPASS, and it was delivered among a general sample of ninth grade adolescents. The intervention group showed a small but significant decrease in overall stress, and the intervention gains were the largest among high-stressed participants.61 According to our knowledge, our study is still one of the first evaluating the impact of a universal IT intervention realized in schools with a focus on quality of life. Although less studied, this positive indication in adolescent quality of life that our program produced may have a significant role in preventing depressive symptoms.62 This finding warrants future studies to focus more on this aspect of well-being and mental health. Indeed, we located one registered trial (ClinicalTrials.gov) that is testing a transdiagnostic preventive program delivered in schools and consisting of IT, in which Păsărelu and Dobrean aimed to measure Health-Related Quality of Life.63
Feasibility evaluation of program adherence revealed that 42% volunteered to participate in our study. This is a piece of information that has not been reported very often in previous studies. In our study, participation in the intervention was voluntary for adolescents. We are quite surprised that in a study by O’Kearney et al22 the whole target population consents to participate. In our study, the adolescents in the intervention school were less interested in participating in the study compared to those in the control school. Numbers did even out at the baseline, but at the follow-up, there were fewer participants in our intervention group compared to in our control group. Importantly, although fewer than half of the adolescents were willing to participate in our study, those who did participate adhered to the study well. There have been previous studies in which entire schools have discontinued because the adolescents found the program “boring”,28 or the adolescents were simply not willing to continue.23
The findings of the present study revealed that the number of logins to the modules decreased during the course of the program. This result is similar to those of previous universal IT interventions run in school settings.29,30 Participant non-completion of the modules has been reported previously.20–22,28,29,31 It is difficult to establish real impacts of these interventions if adolescents do not complete the modules in them. Adolescents may not get involved in these types of interventions if they do not feel that the subject is intended for them or if the program seems to be designed for younger children, as a systematic review by Garrido et al points out.19 In our study, the number of adolescents who did at least one exercise during the module increased being the highest for the last module. This result may indicate that some exercises were more appealing for adolescents than others. Based on diaries returned by the adolescents, they were most favorable towards the module concerning support for depression. This is in line with a previous study in which adolescents lacked knowledge about mental disorders.6 On the other hand, the present study also revealed that one-fifth of the adolescents completed all the exercises in the program, which is less than in previous studies. For example, 56% of the adolescents returned all completed workbooks in a study entitled “Bite Back”,28 and 30% of the adolescents completed the entire SPARX-R intervention.23 In Finland, 75% of the adolescents did finish the Youth COMPASS program and were relatively satisfied with the intervention.61 In general, the rates of non-completion have been moderate to high across a number of online youth mental health promotion and prevention interventions.8 This may mean that the development of more focused interventions for specialized groups of users is needed. There is also a need for program developers to ensure that materials are presented in ways that build on the natural interests of adolescents, with a game-like feel and relatable, interactive content.19
Encouraging results in our study regarding the feasibility components may indicate that there is a need for IT-based interventions in school settings. Indeed, the COVID-19 pandemic has shown the need to strengthen our existing health services with technology-based innovations.64 DepisNet aims to support adolescents’ relatedness,44,45 and one explanation of our promising results may be that adolescents benefit from extra support from non-parental adults.65 Participant face-to-face and/or web-based support has been found to be an important feature in online youth mental health promotion and prevention interventions in terms of program outcomes and completion.8 On the other hand, self-directed interventions may not be as well accepted as those led by professionals.66 In the Finnish Youth COMPASS program, the non-completers were mostly male, and one reason for this could have been that the participants were expected to do the exercises in their own leisure time, as the program was not part of the regular school curriculum.61 Interventions should not be planned to be completed in participants’ own time, especially if hard work is involved in the learning modules, as adolescents have indicated disliking a strong educational focus in interventions.19 The amount of individual support provided for each participant is also crucial, as reported in a study by Topooco et al,67 in which a therapist spent an average of 47 minutes on each participant every week and sent over 30 messages to each participant. The high number of human resources needed should be taken into account to ensure the optimal support for all adolescents and especially for those who have poor self-reliance.68 To summarize, the DepisNet program carried out in a school setting seems to be a feasible universal intervention among adolescents, with promising results in promoting adolescents’ awareness of adolescents’ general well-being and mental health issues.
The study also yielded limitations. First, it is difficult to estimate how much adolescents spent time with the program separate from their regular school curriculum, which limit comparability to other similar interventions. Second, we were not able to perform analysis of non-participants which could have provided important information to whom such intervention is feasible. It is also possible that the participants that refused to participate were the adolescents that most needed the intervention. In the intervention group, participants were also slightly older than in the control group. Third, we aimed to increase motivation to complete the study by giving participants in both schools a voucher to the cinema. This was not revealed to the adolescents at the time of informed consent in order to not influence their decision to participate. However, this incentive likely increased the program use and study completion rate and limited the generalizability of the acceptance results. Fifth, the name of the program, DepisNet, might have deterred some adolescents from participating in the study because of stigma. Huang and Bashir found that apps with titles relating to symptoms have significantly lower installs, ratings, and reviews than those without symptom-related titles.69 Sixth, the internal consistency of our self-esteem measurement was poor, the Cronbach’s α was below acceptable Seventh, this study was not based on individual randomization, which may have caused biases. The characteristics of the adolescents could have been very different between the two schools. This could have potentially led to difficulties in recruiting participants to the control group.70 However, the comparison of the adolescents’ baseline characteristics showed no statistical differences between the study groups, and recruitment did not significantly differ between the groups. Therefore, we may assume that the degree of bias related to randomization was low. Eighth, as the schools were allocated based on their preferences, self-selection bias is possible. We may also question if we can actually talk about impact of our study as the sample size is small, we did not use a randomized control trial design, and only short-term outcomes were evaluated. Lastly, much has changed in the technological landscape as well as in society in general since this study was conducted in 2014. If the study were carried out today, there could be more interactive small groups and workshops, and more gaming and commercial features included in the program to engage a wider variety of users.
Universal interventions and programs that support adolescent well-being and mental health can be integrated into school curricula to promote their awareness of general well-being and mental health. The knowledge gained in this study can also be used when there is a need to include up-to-date content in school curricula to support adolescent well-being and mental health. Such needs occur when distance learning increases or during a sudden crisis, such as the COVID-19 pandemic, when adolescents are forced to cope and study in new ways. Moreover, future work needs to consider the changing face of IT, methods for how to engage a variety of user groups, information on how to support aspects of IT that complement traditional health care methods, and how to promote mental health literacy in school environments.
Gratitude is expressed to The Academy of Finland (8214245), Tekes (The Finnish Funding Agency for Technology and Innovation); the adolescents, personnel and principals of the schools of the city where the study was carried out; and course coordinator Virve Pekurinen from the University of Turku for her help in the study.
Dr Minna Anttila report personal fees from City of Kaarina, during the conduct of the study. The author reports no other conflicts of interest in this work.
1. World Health Organization. Adolescent and young adult health. Fact sheet; 2021. Available from: https://www.who.int/news-room/fact-sheets/detail/adolescents-health-risks-and-solutions. Accessed June 2, 2021.
2. Atladottir HO, Gyllenberg D, Langridge A, et al. The increasing prevalence of reported diagnoses of childhood psychiatric disorders: a descriptive multinational comparison. Eur Child Adolesc Psychiatry. 2015;24(2):173–183.
3. Olfson M, Blanco C, Wang S, Laje G, Correll CU. National trends in the mental health care of children, adolescents, and adults by office-based physicians. JAMA Psychiatry. 2014;71(1):81–90.
4. Salazar de Pablo G, De Micheli A, Dh N, et al. Universal and selective interventions to promote good mental health in young people: systematic review and meta-analysis. Eur Neuropsychopharmacol. 2020;41:28–39.
5. Radez J, Reardon T, Creswell C, Lawrence PJ, Evdoka-Burton G, Waite P. Why do children and adolescents (not) seek and access professional help for their mental health problems? A systematic review of quantitative and qualitative studies. Eur Child Adolesc Psychiatry. 2021;30(2):183–211.
6. Sylwestrzak A, Overholt CE, Ristau KI, Coker KL. Self-reported barriers to treatment engagement: adolescent perspectives from the National Comorbidity Survey-Adolescent Supplement (NCS-A). Community Ment Health J. 2015;51(7):775–781.
7. Sheppard R, Deane FP, Ciarrochi J. Unmet need for professional mental health care among adolescents with high psychological distress. Aust N Z J Psychiatry. 2018;52(1):59–67.
8. Clarke AM, Kuosmanen T, Barry MM. A systematic review of online youth mental health promotion and prevention interventions. J Youth Adolesc. 2015;44(1):90–113.
9. Ebert DD, Zarski AC, Christensen H, et al. Internet and computer-based cognitive behavioral therapy for anxiety and depression in youth: a meta-analysis of randomized controlled outcome trials. PLoS One. 2015;10(3):e0119895.
10. Pennant ME, Loucas CE, Whittington C, et al. Computerised therapies for anxiety and depression in children and young people: a systematic review and meta-analysis. Behav Res Ther. 2015;67:1–18.
11. Bevan Jones R, Stallard P, Agha SS, et al. Practitioner review: co-design of digital mental health technologies with children and young people. J Child Psychol Psychiatry. 2020;61(8):928–940.
12. Kolenik T, Gams M. Persuasive technology for mental health: one step closer to (mental health care) equality? IEEE Technol Soc Mag. 2021;40(1):80–86.
13. Oyebode O, Ndulue C, Alhasani M, Orji R. Persuasive mobile apps for health and wellness: a comparative systematic review. In: Gram-Hansen S, Jonasen T, Midden C, editors. Persuasive Technology. Designing for Future Change. PERSUASIVE 2020. Lecture Notes in Computer Science. Cham: Springer; 2020:163–181.
14. García-Carrión R, Villarejo-Carballido B, Villardón-Gallego L. Children and adolescents mental health: a systematic review of interaction-based interventions in schools and communities. Front Psychol. 2019;10:918.
15. Dowdy E, Furlong M, Raines TC, et al. Enhancing school-based mental health services with a preventive and promotive approach to universal screening for complete mental health. J Educ Psychol Consult. 2015;25(2–3):178–197.
16. Werner-Seidler A, Perry Y, Calear AL, Newby JM, Christensen H. School-based depression and anxiety prevention programs for young people: a systematic review and meta-analysis. Clin Psychol Rev. 2017;51:30–47.
17. Bohnenkamp JH, Stephan SH, Bobo N. Supporting student mental health: the role of the school nurse in coordinated school mental health care. Psychol Schs. 2015;52:714–727.
18. Das JK, Salam RA, Lassi ZS, et al. Interventions for adolescent mental health: an overview of systematic reviews. J Adolesc Health. 2016;59(4S):S49–S60.
19. Garrido S, Millington C, Cheers D, et al. What works and what doesn’t work? A systematic review of digital mental health interventions for depression and anxiety in young people. Front Psychiatry. 2019;10:759.
20. Perry Y, Werner-Seidler A, Calear A, et al. Preventing depression in final year secondary students: school-based randomized controlled trial. J Med Internet Res. 2017;19(11):e369.
21. O’Kearney R, Gibson M, Christensen H, Griffiths KM. Effects of a cognitive-behavioural internet program on depression, vulnerability to depression and stigma in adolescent males: a school-based controlled trial. Cogn Behav Ther. 2006;35(1):43–54.
22. O’Kearney R, Kang K, Christensen H, Griffiths K. A controlled trial of a school-based Internet program for reducing depressive symptoms in adolescent girls. Depress Anxiety. 2009;26(1):65–72.
23. Kuosmanen T, Fleming TM, Newell J, Barry MM. A pilot evaluation of the SPARX-R gaming intervention for preventing depression and improving wellbeing among adolescents in alternative education. Internet Interv. 2017;8:40–47.
24. Williamson PR, Altman DG, Bagley H, et al. The COMET Handbook: version 1.0. Trials. 2017;18(Suppl 3):280.
25. Revicki DA, Kleinman L, Cella D. A history of health-related quality of life outcomes in psychiatry. Dialogues Clin Neurosci. 2014;16(2):127–135.
26. Välimäki M, Kurki M, Hätönen H, et al. Developing an internet-based support system for adolescents with depression. JMIR Res Protoc. 2012;1(2):e22.
27. Kutcher S, Wei Y. School mental health: a necessary component of youth mental health policy and plans. World Psychiatry. 2020;19(2):174–175.
28. Burckhardt R, Manicavasagar V, Batterham PJ, et al. Positive psychology program in schools: randomized controlled trial. J Med Internet Res. 2015;17(7):e187.
29. Calear AL, Christensen H, Mackinnon A, Griffiths KM, O’Kearney R. The YouthMood Project: a cluster randomized controlled trial of an online cognitive behavioral program with adolescents. J Consult Clin Psychol. 2009;77(6):1021–1032.
30. Calear AL, Christensen H, Mackinnon A, Griffiths KM. Adherence to the MoodGYM program: outcomes and predictors for an adolescent school-based population. J Affect Disord. 2013;147(1–3):338–344.
31. Calear AL, Christensen H, Brewer J, Mackinnon A, Griffiths KM. A pilot randomized controlled trial of the e-couch anxiety and worry program in schools. Internet Interv. 2016;6:1–5.
32. Calear AL, Batterham PJ, Poyser CT, Mackinnon AJ, Griffiths KM, Christensen H. Cluster randomised controlled trial of the e-couch Anxiety and Worry program in schools. J Affect Disord. 2016;196:210–217.
33. Bowling A, Rowe G. “You decide doctor”. What do patient preference arms in clinical trials really mean? J Epidemiol Community Health. 2005;59(11):914–915.
34. Arain M, Campbell MJ, Cooper CL, Lancaster GA. What is a pilot or feasibility study? A review of current practice and editorial policy. BMC Med Res Methodol. 2010;10:67.
35. Anttila M, Sittichai R, Katajisto J, Välimäki M. Impact of a web program to support the mental wellbeing of high school students: a quasi experimental feasibility study. Int J Environ Res Public Health. 2019;16(14):2473.
36. Des Jarlais DC, Lyles C, Crepaz N; TREND Group. Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions: the TREND statement. Am J Public Health. 2004;94(3):361–366.
37. Pruitt SL, Leonard T, Murdoch J, Hughes A, McQueen A, Gupta S. Neighborhood effects in a behavioral randomized controlled trial. Health Place. 2014;30:293–300.
38. Finnish National Board on Research Integrity. Guidelines for ethical review in human sciences; 2019. Available from: https://tenk.fi/en/advice-and-materials/guidelines-ethical-review-human-sciences. Accessed 18 March, 2021.
39. Anttila K, Anttila M, Kurki M, Hätönen H, Marttunen M, Välimäki M. Concerns and hopes among adolescents attending adolescent psychiatric outpatient clinics. Child Adolesc Ment Health. 2015;20(2):81–88.
40. Anttila KI, Anttila MJ, Kurki MH, Välimäki MA. Social relationships among adolescents as described in an electronic diary: a mixed methods study. Patient Prefer Adherence. 2017;11:343–352.
41. Anttila M, Kurki M, Välimäki M. Sleeping behaviors of adolescents with depressive disorders: adolescent self-description of sleeping reported through a web-based support system. Inform Health Soc Care. 2019;44(4):338–350.
42. Metsäranta K, Kurki M, Valimaki M, Anttila M. How do adolescents use electronic diaries? A mixed-methods study among adolescents with depressive symptoms. J Med Internet Res. 2019;21(2):e11711.
43. Anttila K, Anttila M, Välimäki M. A web-based adolescent depression support system: feedback and implications for the future. Inform Health Soc Care. 2020;45(2):111–129.
44. Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol. 2000;55(1):68–78.
45. Ryan RM, Deci EL. From ego depletion to vitality: theory and findings concerning the facilitation of energy available to the self. Soc Personal Psychol Compass. 2008;2(2):702–717.
46. Center of Self-Determination Theory. The Theory; 2021. Available from: https://selfdeterminationtheory.org/the-theory/. Accessed June4, 2021.
47. Hoffmann TC, Glasziou PP, Boutron I, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.
48. Välimäki M, Anttila K, Anttila M, Web-Based Interventions LM. Supporting adolescents and young people with depressive symptoms: systematic review and meta-analysis. JMIR Mhealth Uhealth. 2017;5(12):e180.
49. Raitasalo R. 2007. Mood Questionnaire: Finnish Modification of the Short Form of the Beck Depression Inventory Measuring Depression Symptoms and Self-Esteem. [Mielialakysely. Suomen Oloihin Beckin Lyhyen Depressiokyselyn Pohjalta Kehitetty Masennusoireilun Ja Itsetunnon Kysely: Print Book in Finnish]. Sosiaali- Ja Terveysturvan Tutkimuksia 86. Vammala: Helsinki Kelan tutkimusosasto, Vammalan Kirjapaino Oy.
50. Beck AT, Ward CH, Mendelson M, Mock J, Erbaugh J. An inventory for measuring depression. Arch Gen Psychiatry. 1961;4:561–571.
51. Kaltiala-Heino R, Rimpelä M, Rantanen P, Laippala P. Finnish modification of the 13-item Beck Depression Inventory in screening an adolescent population for depressiveness and positive mood. Nord J Psychiatry. 1999;53(6):451–457.
52. Endicott J, Nee J, Yang R, Wohlberg C. Pediatric Quality of Life Enjoyment and Satisfaction Questionnaire (PQ-LES-Q): reliability and validity. J Am Acad Child Adolesc Psychiatry. 2006;45(4):401–407.
53. Rosenberg M. Society and the Adolescent Self-Image. Princeton, NJ: Princeton University Press; 1965.
54. Isomaa R, Väänänen JM, Fröjd S, Kaltiala-Heino R, Marttunen M. How low is low? Low self-esteem as an indicator of internalizing psychopathology in adolescence. Health Educ Behav. 2013;40(4):392–399.
55. Jerusalem M, Schwarzer R. Self-efficacy as a resource factor in stress appraisal processes. In: Schwarzer R, editor. Self-Efficacy: Thought Control of Action. Washington, DC: Hemisphere; 1992:195–213.
56. Tikkanen J. Concern or confidence? Adolescents’ identity capital and future worry in different school contexts. J Adolesc. 2016;46:14–24.
57. Radovic A, Gmelin T, Hua J, Long C, Stein BD, Miller E. Supporting Our Valued Adolescents (SOVA), a social media website for adolescents with depression and/or anxiety: technological feasibility, usability, and acceptability study. JMIR Ment Health. 2018;5(1):e17.
58. IBM Corp. Released. IBM SPSS Statistics for Windows, Version 26.0. Armonk, NY: IBM Corp; 2019.
59. World Medical Association. World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. JAMA. 2013;310(20):2191–2194.
60. Government Decree 338/2011. FINLEX; 2011. Available from: https://www.finlex.fi/fi/laki/kaannokset/2011/en20110338.pdf. AccessedMarch 18, 2021.
61. Puolakanaho A, Lappalainen R, Lappalainen P, et al. Reducing stress and enhancing academic buoyancy among adolescents using a brief web-based program based on acceptance and commitment therapy: a randomized controlled trial. J Youth Adolesc. 2019;48(2):287–305.
62. Goldbeck L, Schmitz TG, Besier T, Herschbach P, Henrich G. Life satisfaction decreases during adolescence. Qual Life Res. 2007;16(6):969–979.
63. Păsărelu CR, Dobrean A. A video-based transdiagnostic REBT universal prevention program for internalizing problems in adolescents: study protocol of a cluster randomized controlled trial. BMC Psychiatry. 2018;18(1):101.
64. Mahmood S, Hasan K, Colder Carras M, Labrique A. Global preparedness against COVID-19: we must leverage the power of digital health. JMIR Public Health Surveill. 2020;6(2):e18980.
65. Sterrett EM, Jones DJ, McKee LG, Kincaid C. Supportive non-parental adults and adolescent psychosocial functioning: using social support as a theoretical framework. Am J Community Psychol. 2011;48(3–4):284–295.
66. Breider S, de Bildt A, Nauta MH, Hoekstra PJ, van den Hoofdakker BJ. Self-directed or therapist-led parent training for children with attention deficit hyperactivity disorder? A randomized controlled non-inferiority pilot trial. Internet Interv. 2019;18:100262.
67. Topooco N, Berg M, Johansson S, et al. Chat- and internet-based cognitive-behavioural therapy in treatment of adolescent depression: randomised controlled trial. BJPsych Open. 2018;4(4):199–207.
68. Fenwick-Smith A, Dahlberg EE, Thompson SC. Systematic review of resilience-enhancing, universal, primary school-based mental health promotion programs. BMC Psychol. 2018;6(1):30.
69. Huang HY, Users’ BM. Adoption of Mental Health Apps: examining the Impact of Information Cues. JMIR Mhealth Uhealth. 2017;5(6):e83.
70. Pladevall M, Simpkins J, Donner A, et al. Designing Multicenter Cluster Randomized Trials: An Introductory Toolkit. NIH Health Care Systems Research Collaboratory; 2014. Available from https://dcricollab.dcri.duke.edu/sites/NIHKR/KR/Designing%20CRTs-IntroductoryToolkit.pdf. Accessed June 16, 2021.