Next Article in Journal
An Overview of Thermal Infrared Imaging-Based Screenings during Pandemic Emergencies
Next Article in Special Issue
The Association between Loneliness, Mental Well-Being, and Self-Esteem among Adolescents in Four Nordic Countries
Previous Article in Journal
Investigating Racial Differences among Men in COVID-19 Diagnosis, and Related Psychosocial and Behavioral Factors: Data from the Michigan Men’s Health Event
Previous Article in Special Issue
Loneliness among Homeless Individuals during the First Wave of the COVID-19 Pandemic
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

A Systematic Review of the Development and Psychometric Properties of Loneliness Measures for Children and Adolescents

1
Salford Educational Psychology Service, Burrows House, 10, Priestley Road, Worsley, Salford M28 2LY, UK
2
Manchester Institute of Education, University of Manchester, Manchester M13 9PL, UK
3
School Psychology and Development in Context, KU Leuven, Tiensestraat 102, 3000 Leuven, Belgium
4
Research Foundation–Flanders (FWO), Egmontstraat 5, 1000 Brussels, Belgium
5
Interdisciplinary Social Science, Utrecht University, Padualaan 14, 3584 CH Utrecht, The Netherlands
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2021, 18(6), 3285; https://doi.org/10.3390/ijerph18063285
Submission received: 18 February 2021 / Revised: 15 March 2021 / Accepted: 18 March 2021 / Published: 22 March 2021
(This article belongs to the Special Issue Loneliness: An Issue for Personal Well-Being and Public Health)

Abstract

:
This paper reviews the three most commonly used measures of loneliness for children and adolescents (children: Loneliness and Aloneness Scale for Children and Adolescents [LACA] and Children’s Loneliness and Social Dissatisfaction Scale [CLS]; adolescents: UCLA Loneliness Scale [UCLA] and LACA). Loneliness is a pertinent issue across populations and affects the mental health and academic achievement of children and adolescents. To date, there has been no thorough examination of the loneliness measures for this age group. We examine how each of the three measures was developed, and assess the psychometric properties of those measures, gaining insight into whether they are valid and reliable assessments of loneliness. Results suggest that the UCLA Loneliness Scale is the most popular measure of loneliness for use with adolescents, but it does not have robust psychometric properties for that group. For children, the CLS appears most suitable. Results of the review identify gaps in aspects of measure development, with no measure having been developed with children or adolescents. Implications for future loneliness measurement research are considered.

1. Introduction

Loneliness is a painful experience, associated with feeling unhappy, unloved, restless, and generally despondent across different age groups, including school-aged children [1]. Aligned with the most popular conceptualization [2], loneliness is experienced when one perceives a discrepancy between actual and desired social relationships, and this discrepancy can be experienced in relation to either or both the quantity and quality of one’s relationships. Loneliness has been associated with the absence of play partners and negative relationships in childhood, and a lack of close friends and peer rejection during adolescence [3]. In addition, school-based victimization has been found to be associated with loneliness during adolescence [1] and young adulthood [4], suggesting that loneliness can also ensue from negative social relationships.
Loneliness has been related to a host of negative outcomes, including worse academic attainment, emotional health difficulties and sleep quality in youth [3,5,6,7]. Whilst our understanding about the negative effects of loneliness is increasing, to date there has been no review of the assessment of loneliness for children and adolescents. Such a review is particularly important given the current COVID-19 pandemic and national and regional lockdowns that children are experiencing. The closing of schools associated with the COVID-19 pandemic has raised concerns about increasing loneliness among youth, given their absence from friends and a peer social structure; there is a need to use appropriate measurement to identify whether that is the case. Loneliness in children and adolescents is commonly measured using specific assessments, that is, UCLA Loneliness Scale (UCLA) [8] Children’s Loneliness and Social Dissatisfaction Scale (CLS) [9], and Loneliness and Aloneness Scale for Children and Adolescents (LACA) [10]. However, a systematic overview of development procedures and psychometric properties of those measures with youth is not yet available.
Currently, loneliness among youth is not screened in the way that depression or internalizing problems are, whereby individuals complete self-report measures with pre-determined cut-offs indicating difficulties [11]. However, there are benefits of screening, including identifying those in need of extra support, and prevention of the concurrent and prolonged mental health problems in youth that are linked to loneliness. To do this effectively, there must be robust measurements available. While not initially developed primarily for screening, there are three measures of loneliness that are commonly used to assess loneliness among children and adolescents. However, there has been no systematic review examining their reliability and validity, nor any discussion about their development, including whether they followed guidelines to create robust and useful measures.

Developing Measures

Measure development literature recommends inductive and deductive methods during item creation, to limit contamination and support valid depiction of relations to other constructs [12,13]. The three main steps of measure development are (1) specifying observable characteristics, (2) determining the extent to which they measure the same thing using empirical research and statistical analysis, and (3) performing experiments to determine the extent to which measures are consistent with established views of the construct [14]. Qualitative data from target populations that outline opinions and experiences of the construct are also required to inform understanding of the subjective experience of the concept [15,16]. Valid and reliable measurement is scientifically fundamental and essential for robust research [17,18] and replicability. Thus, in the current study, we (1) explore how the loneliness measures used to collect data from children and adolescents were developed, and, indeed, whether they followed the steps for successful measurement development, and (2) explore the reliability and validity estimates of each measure as they are presented in papers that have subsequently explored their psychometric properties.

2. Materials and Methods

2.1. Literature Search Strategy and Review Process

The MASLO database, details of which are described elsewhere [19], includes studies that apply one of the seven most used loneliness measures for different ages, published between 1978 and 2013. Literature searches were conducted in 2013, yielding 3658 results, of which 1585 were excluded due to not including one of the seven loneliness measures, written in languages other than Dutch, English, French or German, or were irretrievable. Subsequently, papers were read in detail, with further exclusions made in the absence of detail regarding methodology, or the absence of numerical information. For the current study, the MASLO database [19] was screened for papers focused on reliability and validity testing of those measures among youth, with the Loneliness and Aloneness Scale for Children and Adolescents (LACA) [10], UCLA Loneliness Scale (UCLA) [8] and Children’s Loneliness and Social Dissatisfaction Scale (CLS) [9], being drawn from the database, including 1821 papers in total. Between September 2019 and March 2020, additional searches for articles published between 2014 and 2020 in Scopus, PubMed, and PsychInfo were conducted. Key search terms combined included “loneliness scale for children and adolescents”, “loneliness measure”, “reliability”, and “validity”. Additional searches, using the titles of each of the measures, were also conducted, yielding an additional 2345 results. Figure 1 outlines the review process.
After removing duplicates and screening for papers not measuring reliability and validity of one of the three loneliness measures, 64 papers, drawn from both the MASLO database and new database searches, were screened against the inclusion criteria: (1) the study explicitly tests the reliability and validity of the loneliness measure, (2) sample participants under 18 years old (3) a Cronbach’s alpha for the loneliness (sub)scale was presented, and (4) paper was written in English. Five papers for the LACA, nine for the UCLA, and six papers for the CLS, were included in the final review. Development papers for each measure, with the addition of a pre-development paper for the LACA (see Table 1), were included in the review database, subsequent searches for such were conducted using the combined search terms “development”, “UCLA”, “LACA”, “CLS”, “loneliness”, and “scale”. An additional five studies, known to the researchers, were examined against the inclusion criteria, with two being included.
Through screening procedures, reference to “pure” loneliness measure adaptation, resulted in further searches (using the terms “pure”, “loneliness”, “CLS” and “measure”) and the inclusion of four papers. Additionally, upon reading the LACA development paper, Marcoen and Brumagne’s (1985) [20] paper was cited as the research paper from which items were drawn, leading to its inclusion in the current review.
Figure 1. PRISMA diagram [21].
Figure 1. PRISMA diagram [21].
Ijerph 18 03285 g001

2.2. Data Classification

Data classification is discussed first in relation to the development papers, where we used the critical appraisal tool. Then, we review the psychometric properties of each of the loneliness measures, exploring the inclusion of children and adolescent voices in the development of the measures and the reliability and validity as documented in subsequent studies.

2.3. Development of a Critical Appraisal Checklist

The quality and suitability of development processes for each of the measures were determined using a critical appraisal tool, created by the researchers from existing well-established checklists (details of checklist items can be found in Supplementary Table S1). No pre-existing frameworks captured the aims of the current research, so measure development research was consulted to support the inclusion criteria. The tool was informed by four quantitative evaluation frameworks including COSMIN [22], JBI Appraisal Checklist for Studies Reporting Prevalence Data [23], Evidence Based Medicine and Practice checklist [24], and the University of Manchester quantitative evaluation research checklist [25]. Checklist drafts were trialed to refine each element and establish clear wording and weighting of statements (completed checklists and explanations of items can be found in the Supplementary Table S2; completed critical appraisal checklists for each measure can be found in Supplementary Tables S3–S6). Each development paper, plus the Marcoen and Brumagne (1985) [20] paper, was read in full by the first and third author, assessing 13 “core” expectations of measure development, and two supplementary statements for the inclusion of a factor analysis or structural equation modelling, and invariance testing in subsequent papers. The papers selected were the first papers for each measure, outlining development procedures. During this process, researchers looked at quality appraisal literature to support the use of qualitative quality decisions, using overall inter-rater agreements of “high”, “medium”, or “low” [24,26]. Reviewers awarded two stars when the quality statement was met “to a great degree”, one star where it was “partially met”, and a hyphen where the information was “incomplete or omitted”. Moderation discussions ensured consistent interpretation and application of the checklist. Papers with between one and four two-star ratings were deemed “low quality”. Those with between five and eight two-star ratings were noted as “medium quality”; nine or more two-star ratings were deemed “high” quality papers (see Table 1).

2.4. Psychometrics

Following quality appraisal of development procedures, we examined the psychometric properties, focusing on the reliability and validity of each of the measures, in subsequent papers (see Table 2, Table 3 and Table 4). Papers employing an increasingly used brief version of the CLS to represent ‘pure’) loneliness items were also included (items from CLS adapted by Ladd et al. (1996) to represent loneliness separate from social isolation). To further understand how the measures have been used since development we also examined measurement adaptations and sample characteristics in subsequent papers.

2.5. Reliability and Validity

In the quality framework, reliability and validity are relevant and representative of the loneliness construct. Cronbach’s alpha values of 0.8 and above were considered acceptable levels of internal consistency both in development papers and subsequent research [27]. Content- and criterion-related validity were considered through reference to the inclusion of interviews with children and adolescents [28], explanations of theory underpinning the measures, concept definitions [29], and reference to existing constructs of loneliness in the development papers.

3. Results

3.1. Scale Overview

The LACA extends the Louvain Loneliness Scale for Children and Adolescents (LLCA) [20] subscales (peer and parental loneliness), through the incorporation of two new subscales measuring positive and negative attitudes to aloneness and social isolation. The original development paper describes a 48-item measure, with four integrated subscales, which was tested on a sample of 444 children and adolescents from grade 5 to 11 (aged 10–16 years), the widest age range across the development papers of the three measures. Subscales relate to loneliness in parental relations (L-PART), loneliness in peer relations (L-PEER), affinity for aloneness (A-POS), and aversion to aloneness (A-NEG). Subscales were not revised following testing.
The UCLA, based on Sisenwein’s (1964) [30] scale, was developed and tested with young adults [8] using a 5-point scale. Researchers drew 25 items from a 75-item pool, excluding “very extreme statements”. The scale was revised following analysis, leaving a final 20-item measure, such that a revised scale correlation of items with the total loneliness scores and internal consistency, was assessed. Additionally, concurrent validity was explored through correlation with self-reports about current loneliness, comparison between scale scores across the lonely and comparison sample and self-ratings of feelings associated with loneliness. The UCLA is often used with older adolescents, and less often children, though some items are suggested for use with children by the Office of National Statistics (ONS) to measure childhood loneliness [31].
The CLS [9] was developed to explore loneliness and social dissatisfaction. The 24-item scale comprises 16 target and eight “filler” items, not included in the final loneliness score. Its original psychometric study included a sample of 522 children between grades three and six (aged 8–12 years). After two weeks, a sociometric measurement was administered to explore whether classroom peer group status was directly related to loneliness. The scale did not undergo post-test alterations.

3.2. Quality Appraisal

The CLS provided the clearest definition of loneliness and research questions, referring to feelings of loneliness and social dissatisfaction research with children, and aimed to develop a reliable measure of loneliness. The UCLA development outline provided little information regarding overarching constructs, or justification for measure development, referring only to the “lack of a simple and reliable method of assessment” [8] (p. 290). The LACA developers highlighted “age-linked feelings of loneliness” [10] (p. 1025) in youth and made distinctions regarding emotional and social loneliness. Target populations were largely well defined, although they varied between children (CLS) [9] undergraduate psychology students (UCLA) [8], and late childhood and adolescence (LACA) [10]. Furthermore, the ages of those in the development samples ranged between third grade (CLS) and “young adults” (UCLA), suggesting that development samples were not representative of subsequent populations in which the measures are used. Theoretical underpinnings of the measures varied: the LACA was rated most highly, describing the need to “cover related constructs of positively and negatively experienced aloneness” [10] (p. 562).
Drawing on measure development best practice guidance, no development paper was awarded a score for core expectations related to content validity and none interviewed children and adolescents when developing their conceptualization of loneliness. UCLA items were drawn from “20 psychologists describing the experience of loneliness” [8] (p. 291), and statements from Eddy’s (1961) [32] measure, and omitted replication details. LACA items were drawn from Marcoen and Brumagne’s (1985) [20] “original scale”, but did not describe items; and the CLS paper did not outline any item inclusion strategies.
Appropriate data analysis processes (Supplementary Table S2) were defined, including correlations between loneliness scale scores and relevant related constructs, and a Cronbach’s alpha calculated with only the UCLA omitting factor analyses. All measures presented Cronbach’s alphas above 0.8.
Regarding cross-cultural validity, the UCLA development paper examined the effects of region and sex. Each measure, to some extent, compared scores with suitable and related variables. The LACA examined how age, sex, parental occupation, social integration, home environment, ecological situation (hometown size and home conditions), and psychological factors affected understanding and response to items. The CLS compared scores to sociometric status, examining links with friendship nomination, a relation deemed modest by researchers, due to the suggestion loneliness most closely links with perceptions of friendship rather than individual experience. Despite this, none of the measures explicitly explored cross-cultural validity.

3.3. Quantitative Synthesis Psychometrics

Subsequent studies implementing the LACA, UCLA, and CLS with CA were reviewed with a specific focus on exploring the reliability and validity of each measure (see Table 2, Table 3 and Table 4).

Reliability and Validity

Subsequent psychometric studies using the LACA included samples of children and adolescents between grades 5 and 12 (ages 10–18 years), conducted between 1987 and 2020. Each used 4-part response category scales, and either 36 or 48 items; those studies that used the 36 items dropped the L-PART (parent loneliness) subscale. The UCLA, the most widely adapted measure in subsequent studies, least often used with children, included 20, 8-, 6- and 4-item adaptations in psychometric studies between 1978 and 2020, with children and adolescents aged between 11 and 18 years old. Studies with the CLS often used younger samples, between 5 and 13 years old. In its original 24-item form, between three and five response categories were commonly used, prior to extraction of “pure” items [53]. Four papers implementing “pure” loneliness items with participants aged between five and 11 years, presented inconsistent item numbers, and largely insufficient Cronbach’s alphas, ranging from 0.75 to 0.87 [52,53,54,55]. Papers included between three and five response categories, with one paper omitting that detail [53]. Although broadly similar, “pure” loneliness items were not consistent across papers, with both 5-item measures referring to “three items relating to loneliness and an additional two semantically related items”, without clear explanation [53,54].
A Cronbach’s alpha of 0.8 or above was considered an acceptable rating of internal consistency, although a higher alpha does not directly illustrate greater internal consistency, as, if an alpha is too high, perhaps some items are measuring the same thing, in a different form. The largest discrepancy in alphas using the LACA was in the parental relationship subscale (0.81 and 0.93), suggesting difficulties in defining this type of loneliness. The original 20-item UCLA appears the most internally consistent version (between 0.71 and 0.96), although an alpha of 0.96 could suggest some unnecessary items. Contrarily, the lowest alpha was presented for the 4-item UCLA measure (0.31) [41] suggesting decreased reliability following item reduction. Lower alphas were further demonstrated through sample comparisons with populations deviating from the development sample (Hispanic ethnicity and those diagnosed with Attention Deficit Hyperactivity Disorder (ADHD), providing evidence of reduced reliability with populations other than young adults at university, who the scale was developed for. With the CLS, lower Cronbach’s alphas (0.79/0.76) were present in the studies using younger participants, highlighting potential problems with the measure often used with early-primary school aged children (youngest 5.3 years).
Both the CLS and UCLA development papers presented higher internal consistency estimates compared with subsequent studies. That raises questions about their generalizability across diverse child and adolescent samples. Studies with “pure” loneliness items were included in the review and comprised samples of children aged between 5 and 11 years. Only one demonstrated an acceptable Cronbach’s alpha value with children aged between 9 and 11 years (0.87) [55].
Omitted data make mean score comparisons inconsistent, although the UCLA study presented equal scores for male and female samples, 40.34 (7.62), using the 20-item measure [41]. Mean and SD variations for age and nationality subgroups are demonstrated in the CLS. Goossens and Beyers (2002) [33] demonstrated intercorrelations/concurrent validity between the LACA peer-related loneliness subscale and the CLS, although none of the development papers explicitly explored the effects of culture or measurement invariance upon measure completion.

4. Discussion

The current review examined development processes and subsequent reliability and validity testing of the three most widely used loneliness measures for youth: the CLS, UCLA and LACA. These measures were developed some time ago and when considered in relation to recent standards for measure development, it is clear that each omitted key processes, including interviews with children and adolescents, exploration of population variance, and comparisons with suitably related variables. Subsequent studies present scale adaptations with reduced reliability, and there is once more minimal investigation of the effects of culture. Absent also is exploration of concurrent validity. Inconsistencies are evident in research outlines, including descriptions of sample ages, response options, and item selection. In a time of increased focus and understanding of the impact of loneliness on youth, an appropriate measure for exploring the contemporary experience of loneliness among youth is required.
Despite strengths in psychometric development across the three measures, qualitative exploration of loneliness experiences with target populations is absent [15,56]. None of the measures were developed from interviews with youth, suggesting that their views of the loneliness experience did not inform the measures. Partial support for four latent constructs of loneliness (peer-related loneliness, family-related loneliness, aversion to being alone and affinity for being alone), across the LACA and CLS has been suggested, with social loneliness best measured by the CLS and the peer-related subscale of the LACA [33]. Prior to generation of these now well-established scales, it was perhaps difficult to accurately conclude their concurrent validity. However, the current literature review suggests that development procedures were incomplete, and subsequent use of scale items and response categories has been inconsistent. Therefore, the requirement for interviews conducted with youth in order to increase understanding and provide a foundation for establishing concurrent validity of the scales is highlighted.
“Pure” loneliness measures (of the CLS) sought to further extract loneliness from close constructs to support specific intervention. However, that measure is narrowly explored and, to date, inconsistently administered [52,53,55].
Development samples differed from target populations for the measures, potentially reducing validity and reliability [57], as score comparisons are not with demographically similar individuals. If the age range of respondents in subsequent papers is expanded, construct validity is questionable because loneliness is experienced differently across development [3]. The lack of cross-cultural perspectives [58] significantly undermines the generalizability of the measures. These issues present challenges for those seeking to explore loneliness in diverse groups of children and adolescents. Future research should consider the possible impact of virtual interactions and friendship upon feelings of loneliness, and subsequently during measure completion and item understanding, particularly following the recent impact on youth mental health following the COVID-19 pandemic [59]. Researchers found variation in aspects of validity considered across the measures, and suggest further consideration of diverse development samples, matching the age of proposed audience for the measure, is required, along with consideration of cross-cultural validity and measurement invariance to support the use of these measures with present youth populations.
Since development, scale adaptations have been subject to inconsistent reliability and validity testing, with varied use of items and category responses. Test users may choose loneliness measurements by generalizing internal consistency coefficients from original scales, but, if concept development is flawed, then adapted scales have issues of inaccuracy because they are based on inaccurate concepts. Three items taken from the UCLA are currently recommended by the ONS and UK government [31], as the best measure of loneliness in youth following item revision and qualitative testing for ease and interpretation with young people aged 10 to 15 years. However, the current review has highlighted this was not the intended audience, and exploration of reliability and validity was absent, and so encouraging wider use of a similarly adapted scale, perhaps also in other countries, is founded on incomplete evidence.
The “pure” loneliness subscale of the CLS, distinct from social dissatisfaction, demonstrated confusion and inconsistent item selection, with a lack of detail being unsupportive of replication [38,60]. The current review has highlighted, that the CLS appears most widely used with younger children. Practitioners keen to explore loneliness in youth should combine quantitative measures of loneliness with qualitative tools and knowledge of individuals to support a holistic picture and understanding grounded in the conceptualization of loneliness in youth. Consideration of age, which scale version is most suitable and the resulting psychometrics, along with the subsequent interventions that may be selected because of loneliness scores, is also pertinent for practitioners.

Limitations and Future Directions

The current review used robust review processes such as inter-rater agreement and collaborative development of the critical appraisal checklist. However, this tool was developed specifically for this project and further work to refine tools for the evaluation of development measures is warranted, including further development of evaluation tools that consider a range of aspects of validity required for robust measures. Our findings also identified the need for an updated approach to measuring loneliness in youth, one that addresses the key steps in measure development. Incorporating the views of children and adolescents and a more careful consideration of the effects of age and culture on how items are understood, and how loneliness is conceptualized, are particularly important to consider. Exploration of cut-offs is also needed if any measure is to be used for screening purposes. School practitioners should exercise caution when choosing a suitable tool, mindful of the highlighted issues during development and subsequent adaptations. To build on quantitative measures of loneliness, further exploration of youth understanding and views of loneliness, supported by well-established measures, could support adaptation of such, bringing them in line with contemporary conceptualizations of loneliness, suitable for diverse samples.

5. Conclusions

The LACA, UCLA, and CLS, were insufficiently developed for use with children and adolescents, with additional gaps in our understanding of responses across diverse populations. High-quality, robust measures of loneliness are required with clear concept constructs, grounded in qualitative exploration of youth loneliness experiences. Further exploration of reliability, validity, and generalizability of the measures for different populations is required, to support intervention evaluation and screening uses of the measures.

Supplementary Materials

The following are available online at https://www.mdpi.com/1660-4601/18/6/3285/s1, Table S1: Record of checklists from which Critical Appraisal statements were drawn, Table S2: Critical Appraisal Tool for Measure development papers and explanations of statements, Table S3: Completed Critical Appraisal Checklist Marcoen, Goossens & Caes (1987) (LACA), Table S4: Completed Critical Appraisal Checklist Marcoen & Brumagne (1985) (LLCA), Table S5: Completed Critical Appraisal Checklist Russell, Peplau &Ferguson (1978) (UCLA), Table S6: Completed Critical Appraisal Checklist CLS.

Author Contributions

Conceptualization, P.Q., C.B. and A.C.; methodology, P.Q., C.B. and A.C.; resources P.Q. and M.M.; data curation, A.C, P.Q. and C.B.; writing—original draft preparation, A.C, P.Q. and C.B.; writing—review and editing, A.C, P.Q., C.B. and M.M.; funding acquisition, C.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Department for Education (DfE ITEP 2018-2020).

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Institutional Review Board (or Ethics Committee) of UNIVERSITY OF MANCHESTER Environment, Education and Development School Panel PGR (protocol code 2020-7778-15744 and 12/06/2020).

Informed Consent Statement

Informed consent was obtained from all subjects involved in this study. Written informed consent has been obtained from the patient(s) to publish this paper.

Data Availability Statement

All data are available in the table herein.

Acknowledgments

This research was conducted as part of professional doctorate training thesis in Educational and Child Psychology undertaken by the first author at the Manchester Institute of Education, University of Manchester.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

References

  1. Yang, K.; Petersen, K.J.; Qualter, P. Undesirable social relations as risk factors for loneliness among 14-year-olds in the UK: Findings from the Millennium Cohort Study. Int. J. Behav. Dev. 2020. [Google Scholar] [CrossRef]
  2. Perlman, D.; Peplau, L. Loneliness Research: A Survey of Empirical Findings. Prev. Harmful Conseq. Sev. Persistent Loneliness 1984, 13–46. [Google Scholar] [CrossRef]
  3. Qualter, P.; Vanhalst, J.; Harris, R.; Van Roekel, E.; Lodder, G.; Bangee, M.; Maes, M.; Verhagen, M. Loneliness across the Life Span. Perspect. Psychol. Sci. 2015, 10, 250–264. [Google Scholar] [CrossRef]
  4. Matthews, T.; Caspi, A.; Danese, A.; Fisher, H.L.; Moffitt, T.E.; Arseneault, L. A longitudinal twin study of victimization and loneliness from childhood to young adulthood. Dev. Psychopathol. 2020, 1–11. [Google Scholar] [CrossRef]
  5. Hawkley, L.C.; Capitanio, J.P. Perceived social isolation, evolutionary fitness and health outcomes: A lifespan approach. Philos. Trans. R. Soc. B Biol. Sci. 2015, 370, 20140114. [Google Scholar] [CrossRef] [Green Version]
  6. Hymel, S.; Rubin, K.H.; Rowden, L.; LeMare, L. Children’s Peer Relationships: Longitudinal Prediction of Internalizing and Externalizing Problems from Middle to Late Childhood. Child Dev. 1990, 61, 2004. [Google Scholar] [CrossRef]
  7. Qualter, P.; Brown, S.L.; Munn, P.; Rotenberg, K.J. Childhood loneliness as a predictor of adolescent depressive symptoms: An 8-year longitudinal study. Eur. Child Adolesc. Psychiatry 2010, 19, 493–501. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. Russell, D.; Peplau, L.A.; Ferguson, M. Developing Measures of Loneliness. J. Personal. 1978, 48, 290–294. [Google Scholar] [CrossRef]
  9. Asher, S.R.; Hymel, S.; Renshaw, P.D. Loneliness in Children. Child Dev. 1984, 55, 1456. [Google Scholar] [CrossRef]
  10. Marcoen, A.; Goossens, L.; Caes, P. Loneliness in Pre-Through Late Adolescence: Exploring the Contributions of a Multidimensional Approach. J. Youth Adolesc. 1987, 16, 561–577. [Google Scholar] [CrossRef]
  11. Roseman, M.; Kloda, L.A.; Saadat, N.; Riehm, K.E.; Ickowicz, A.; Baltzer, F.; Katz, L.Y.; Patten, S.B.; cile Rousseau, C.; Thombs, B.D. Canadian Psychiatric Association Association des psychiatres du Canada The Canadian Journal of Psychiatry/La Revue Canadienne de Psychiatrie. Can. J. Psychiatry 2016, 61, 746–757. [Google Scholar] [CrossRef] [Green Version]
  12. Mackenzie, S.B.; Podsakoff, P.M.; Podsakoff, N.P. Construct Measurement and Validation Procedures in MIS and Behavioral Research: Integrating New and Existing Techniques. MIS Q. 2011, 35, 293–334. [Google Scholar] [CrossRef]
  13. Morgado, F.F.R.; Meireles, J.F.F.; Neves, C.M.; Amaral, A.C.S.; Ferreira, M.E.C. Scale development: Ten main limitations and recommendations to improve future research practices. Psicol. Reflex. Crit. 2017, 30, 1–20. [Google Scholar] [CrossRef] [Green Version]
  14. Nunnally, J.C.; Bernstein, I.H. Psychometric Theory, 3rd ed.; McGraw: New York, NY, USA, 1994. [Google Scholar]
  15. Carpenter, S. Ten Steps in Scale Development and Reporting: A Guide for Researchers. Commun. Methods Meas. 2018, 12, 25–44. [Google Scholar] [CrossRef]
  16. Hinkin, T.R. A Review of Scale Development Practices in the Study of Organizations. J. Manag. 1995, 21, 967–988. [Google Scholar] [CrossRef]
  17. Clark, L.A.; Watson, D. Constructing validity: New developments in creating objective measuring instruments. Psychol. Assess. 2019, 31, 1412–1427. [Google Scholar] [CrossRef]
  18. DeVellis, R.F. Scale Development: Theory and Application, 26th ed.; Sage Publications: Newbury Park, CA, USA, 2016; Available online: https://books.google.co.uk/books?hl=en&lr=&id=9yfYCwAAQBAJ&oi=fnd&pg=PP1&dq=DeVellis+&ots=HoJDQoX8bj&sig=r_87WmsVsIyairdAAERlrn0Pksw#v=onepage&q=DeVellis&f=false (accessed on 22 May 2020).
  19. Maes, M.; Qualter, P.; Vanhalst, J.; Van den Noortgate, W.; Goossens, L. Gender differences in loneliness across the lifespan: A meta-analysis. Eur. J. Personal. 2019, 33, 642–654. [Google Scholar] [CrossRef]
  20. Marcoen, A.; Brumagne, M. Loneliness among Children and Young Adolescents. Dev. Psychol. 1985, 21, 1025–1031. [Google Scholar] [CrossRef]
  21. Moher, D.; Liberati, A.; Tetzlaff, J.; Altman, D.G.; The PRISMA Group. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLoS Med. 2009, 6, e1000097. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Mokkink, L.B. COSMIN Risk of Bias Checklist; Amsterdam Public Health Research Institute: Amsterdam, NY, USA, 2018; pp. 1–37. Available online: https://www.cosmin.nl/tools/checklists-assessing-methodological-study-qualities/ (accessed on 19 March 2021).
  23. Joanna Briggs Institute. Checklist for Prevalance Studies. 2016, 7. Available online: http://joannabriggs.org/assets/docs/critical-appraisal-tools/JBI_Critical_Appraisal-Checklist_for_Prevalence_Studies.pdf (accessed on 19 March 2021).
  24. Roever, L. Evidence Based Medicine and Practice. Practice 2015, 1, 1. [Google Scholar] [CrossRef]
  25. Woods, K.; Bond, C.; Humphrey, N.; Symes, W.; Green, L. Research Report 179: Systematic Review of Solution Focused Brief Therapy (SFBT) with Children and Families; HM Government (Department for Education): London, UK, 2011.
  26. Oluka, O.C.; Nie, S.; Sun, Y. Quality assessment of TPB-based questionnaires: A systematic review. PLoS ONE 2014, 9, e94419. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Taber, K.S. The Use of Cronbach’s Alpha When Developing and Reporting Research Instruments in Science Education. Res. Sci. Educ. 2018, 48, 1273–1296. [Google Scholar] [CrossRef]
  28. Haynes, S.N.; Richard DC, S.; Kubany, E.S. Content validity in psychological assessment: A functional approach to concepts and methods. Psychol. Assess. 1995, 7, 238–247. [Google Scholar] [CrossRef]
  29. Ebel, R.L.; Frisbie, D.A. Essentials of Educational Measurement, 5th ed.; Prentice-Hall: Englewood Cliffs, NJ, USA, 1991. [Google Scholar]
  30. Sisenwein, R.J. Loneliness and the Individual as Viewed by Himself and Others. Diss. Abstr. 1965, 25, 5379. [Google Scholar]
  31. The Office for National Statistics. Testing of Loneliness Questions in Surveys: Overview of Our Loneliness Question Testing, Methodology and Findings. London. Available online: https://www.ons.gov.uk/peoplepopulationandcommunity/wellbeing/compendium/nationalmeasurementofloneliness/2018/testingoflonelinessquestionsinsurveys (accessed on 1 May 2020).
  32. Eddy, P.D. Loneliness: A Discrepancy with the Phenomenoloigcal Self. Unpublished doctoral dissertation, Adelphi College, Garden City, NY, USA, 1961. [Google Scholar]
  33. Goossens, L.; Beyers, W. Comparing Measures of Childhood Loneliness: Internal Consistency and Confirmatory Factor Analysis. J. Clin. Child Adolesc. Psychol. 2002, 31, 252–262. [Google Scholar] [CrossRef]
  34. Maes, M.; Van Den Noortgate, W.; Goossens, L. A reliability generalization study for a multidimensional loneliness scale: The Loneliness and Aloneness Scale for Children and Adolescents. Eur. J. Psychol. Assess. 2015, 31, 294–301. [Google Scholar] [CrossRef]
  35. Maes, M.; Wang, J.M.; Van den Noortgate, W.; Goossens, L. Loneliness and Attitudes toward Being Alone in Belgian and Chinese Adolescents: Examining Measurement Invariance. J. Child Fam. Stud. 2016, 25, 1408–1415. [Google Scholar] [CrossRef]
  36. Danneel, S.; Maes, M.; Vanhalst, J.; Bijttebier, P.; Goossens, L. Developmental Change in Loneliness and Attitudes toward Aloneness in Adolescence. J. Youth Adolesc. 2018, 47, 148–161. [Google Scholar] [CrossRef]
  37. Danneel, S.; Maes, M.; Bijttebier, P.; Rotsaert, M.; Delhaye, M.; Berenbaum, T.; Goossens, L. Loneliness and Attitudes toward Aloneness in Belgian Adolescents: Measurement Invariance across Language, Age, and Gender Groups. J. Psychopathol. Behav. Assess. 2018, 40, 678–690. [Google Scholar] [CrossRef]
  38. Russell, D.; Peplau, L.A.; Cutrona, C.E. The revised UCLA Loneliness Scale: Concurrent and discriminant validity evidence. J. Personal. Soc. Psychol. 1980, 39, 472–480. [Google Scholar] [CrossRef]
  39. Mahon, N.E.; Yarcheski, A. The dimensionality of the UCLA loneliness scale in early adolescents. Res. Nurs. Health 1990, 13, 45–52. [Google Scholar] [CrossRef]
  40. Neto, F. Loneliness among Portguese Adolescents. Soc. Behav. Personal. 1992, 20, 15–22. [Google Scholar] [CrossRef]
  41. Wilson, D.; Cutts, J.; Lees, I.; Mapungwana, S.; Mauganidze, L. Psychometric properties of the revised UCLA Loneliness scale and two short-form measures of loneliness in Zimbabwe. J. Personal. Assess. 1992, 59, 72–81. [Google Scholar] [CrossRef] [PubMed]
  42. Higbee, K.R.; Roberts, R.E. Reliability and Validity of a Brief Measure of Loneliness with Anglo-American and Mexican American Adolescents. Hisp. J. Behav. Sci. 1994, 16, 459–474. [Google Scholar] [CrossRef]
  43. Russell, D.W. UCLA Loneliness Scale (Version 3): Reliability, Validity, and Factor Structure. J. Personal. Assess. 1996, 66, 20–40. [Google Scholar] [CrossRef]
  44. Neto, F. A short-form measure of loneliness among second-generation migrants. Psychol. Rep. 2001, 88, 201–202. [Google Scholar] [CrossRef]
  45. Lasgaard, M. Reliability and validity of the Danish version of the UCLA Loneliness Scale. Personal. Individ. Differ. 2007, 42, 1359–1366. [Google Scholar] [CrossRef]
  46. Goossens, L.; Klimstra, T.; Luyckx, K.; Vanhalst, J.; Teppers, E. Reliability and validity of the roberts UCLA loneliness scale (RULS-8) with Dutch-speaking adolescents in Belgium. Psychol. Belg. 2014, 54, 5–18. [Google Scholar] [CrossRef] [Green Version]
  47. Cassidy, J.; Asher, S.R. Loneliness and Peer Relations in Young Children. Child Dev. 1992, 63, 350–365. [Google Scholar] [CrossRef] [PubMed]
  48. Bagner, D.M.; Storch, E.A.; Roberti, J.W. A Factor Analytic Study of the Loneliness and Social Dissatisfaction Scale in a Sample of African-American and Hispanic-American Children. Child Psychiatry Hum. Dev. 2004, 34, 237–250. [Google Scholar] [CrossRef]
  49. Coplan, R.J.; Closson, L.M.; Arbeau, K.A. Gender differences in the behavioral associates of loneliness and social dissatisfaction in kindergarten. J. Child Psychol. Psychiatry Allied Discip. 2007, 48, 988–995. [Google Scholar] [CrossRef]
  50. Ebesutani, C.; Drescher, C.F.; Reise, S.P.; Heiden, L.; Hight, T.L.; Damon, J.D.; Young, J. The loneliness questionnaire-short version: An evaluation of reverse-worded and non-reverse-worded items via item response theory. J. Personal. Assess. 2012, 94, 427–437. [Google Scholar] [CrossRef] [PubMed]
  51. Ritchwood, T.D.; Ebesutani, C.K.; Chin, E.G.; Young, J. The Loneliness Questionnaire: Establishing Measurement Invariance across Ethnic Groups. Assessment 2017, 24, 798–809. [Google Scholar] [CrossRef]
  52. Parker, J.G.; Asher, S.R. Friendship and friendship quality in middle childhood: Links with peer group acceptance and feelings of loneliness and social dissatisfaction. Dev. Psychol. 1993, 29, 611–621. [Google Scholar] [CrossRef]
  53. Ladd, G.W.; Kochenderfer, B.J.; Coleman, C.C. Friendship quality as a predictor of young children’s early school adjustment. Child Dev. 1996, 67, 1103–1118. [Google Scholar] [CrossRef]
  54. Ladd Gary, W.; Kochenderfer, B.J.; Coleman, C.C. Classroom Peer Acceptance, Friendship, and Victimization: Distinct Relational Systems That Contribute Uniquely to Children’s School Adjustment? Child Dev. 1997, 68, 1181–1197. [Google Scholar]
  55. Rotenberg, K.J.; McDougall, P.; Boulton, M.J.; Vaillancourt, T.; Fox, C.; Hymel, S. Cross-sectional and longitudinal relations among peer-reported trustworthiness, social relationships, and psychological adjustment in children and early adolescents from the United Kingdom and Canada. J. Exp. Child Psychol. 2004, 88, 46–67. [Google Scholar] [CrossRef] [PubMed]
  56. Kapuscinski, A.N.; Masters, K.S. The current status of measures of spirituality: A critical review of scale development. Psychol. Relig. Spiritual. 2010, 2, 191–205. [Google Scholar] [CrossRef]
  57. Spector, P. Summated Rating Scale Construction Vol. 82: An Introduction. In Summated Rating Scale Construction; SAGE Publications, Inc.: Iowa City, IA, USA, 1992. [Google Scholar]
  58. Office for National Statistics. Population of the UK by Country of birth and Nationality: 2019; Office for National Statistics: London, UK, 2020. [Google Scholar]
  59. Singh, S.; Roy, D.; Sinha, K.; Parveen, S.; Sharma, G.; Joshi, G. Impact of COVID-19 and lockdown on mental health of children and adolescents: A narrative review with recommendations. Psychiatry Res. 2020, 293, 113429. [Google Scholar] [CrossRef]
  60. Turbek, S.P.; Chock, T.M.; Donahue, K.; Havrilla, C.A.; Oliverio, A.M.; Polutchko, S.K.; Shoemaker, L.G.; Vimercati, L. Scientific Writing Made Easy: A Step-by-Step Guide to Undergraduate Writing in the Biological Sciences. Bull. Ecol. Soc. Am. 2016, 97, 417–426. [Google Scholar] [CrossRef]
Table 1. Critical appraisal checklist ratings for each development paper.
Table 1. Critical appraisal checklist ratings for each development paper.
Critical Appraisal Checklist ItemsUCLACLSLACA
Russell, Peplau and Ferguson (1978)Asher, Hymel and Renshaw (1984)Marcoen, Goossens and Caes (1987)Marcoen and Brumagne (1987)
Core development procedureConstruct definition-***-
Research questions outlined*****-
Clear description of target population -******
Theory outlined and described -****
Interviews conducted with children and/or adolescents----
Appropriate qualitative data collection method for item identification----
Replication details included*---
Appropriate data analysis ********
Content validity/Internal structureInterviews with experts regarding concept definition----
FA/structural equations model at development stage-******
Internal consistencyCronbach’s alpha above 0.8********
Invariance testing----
Cross-cultural validity/measurement invarianceConsideration of variance across different groups*-**
Responsiveness (comparison to gold standard)Scores compared with related variables****
Suitable comparisons made****
Overall quality decisionNumber of ** ratings2664
Mean: 5
Qualitative descriptor of overall qualityLowMediumMedium
Core expectation; supplementary expectation; 2 stars (**) indicates that this was done well or in detail, 1 star (*) indicates that this was done partially, hyphen (-) indicates unclear or incomplete processes; overall quality: 1–4 ** ratings = low-quality paper; 5–8 ** ratings = medium-quality paper; 10–13 ** ratings = high-quality paper.
Table 2. Subsequent research papers investigating the psychometric properties of the LACA.
Table 2. Subsequent research papers investigating the psychometric properties of the LACA.
AuthorsYearTitleParticipant AgeNumber of ParticipantsNumber of ItemsResponse CategoriesLanguage of SampleCronbach’s Alpha
1 = (L-PART)
2 = (L-PEER)
3 = (A-POS)
4 = (A-NEG)
Mean (Standard Deviation)
1 = (L-PART)
2 = (L-PEER)
3 = (A-POS)
4 = (A-NEG)
Correlations between Subscale Scores across Waves of Data Collection
¥
1 = (L-PART)
2 = (L-PEER)
3 = (A-POS)
4 = (A-NEG)
Development Paper: Marcoen and Brumagne [20]1985Loneliness among children and young adolescents Grades 5 and 925128ηDutchPeer -related Parent-relatedδδ
0.880.68
Development Paper:
Marcoen, Goossens and Caes [10]
1987Loneliness in pre-through late adolescence: exploring the contributions of a multidimensional approachGrades 5–11
11–17 years
44448ηDutch1 2 341234
0.880.870.800.8118.80 (5.58)21.08 (6.73)29.70 (5.96)30.94 (6.38)δ
Goossens and Beyers [33]2002Comparing measures of childhood loneliness: internal consistency and confirmatory factor analysisGrades 5–6;
Grade 5 mean age 10.5;
Grade 6; mean age 11.5
29248ηDutch12341234
0.810.860.790.7417.87 (5.04)23.32 (6.83)30.50 (6.13)33.53 (5.79)δ
Maes, Van den Noortgate, and Goossens [34]2015A reliability generalization study for a multidimensional loneliness scale: the loneliness and aloneness scale for children and adolescents79 studiesElementary school (children) and secondary school students (adolescents)δδDutch, Arabic, Chinese, English, Greek, Hebrew, Italian, Spanish, Portuguese12341234
0.860.870.790.801.65 (0.27)1.80 (0.17)2.64 (0.14)2.58 (0.20)δ
Maes, Wang, Van den Noortgate, and Goossens [35]2016Loneliness and attitudes toward being alone in belgian and chinese adolescents: examining measurement invarianceAges 11 to 15;
Belgian mean age 12.80;
Chinese mean age = 13.62
Belgian: 229
Chinese: 200
36ηSample 1: Dutch
Sample 2: Chinese
Sample 1
12341234
δ0.910.870.79δ21.39 (7.50)29.06 (7.37)32.04 (6.15)δ
Sample 2
12341234
δ0.890.830.87δ24.05 (7.19)32.52 (6.53)29.92 (7.17)δ
Danneel, Maes, Vanhalst, Bijttebier and Goossens [36]2018Developmental changes in loneliness and attitudes toward aloneness in adolescence. Grades 9–10;
Sample 1 = mean age 14.84;
Sample 2 = mean age 14.82
Sample 1 = 834
Sample 2 = 968
48ηSample 1: Dutch
Sample 2: Dutch
Sample 1
12341234
0.91–0.92θ0.88–0.900.86–0.880.82–0.83 21.2 (6.96) 19.32 (6.48)28.92 (6.36)29.5 (5.88)10.67–0.75
20.53–0.64
30.54–0.64
40.58–0.63
Sample 2
12341234
0.90–0.93
θ
0.86–0.91 0.83–0.88 0.78–0.85 20.4 (6.48)18.48 (5.52)28.80 (5.88)29.40 (5.28)10.59–0.78
20.43–0.67
30.48–0.70
40.44–0.70
Danneel, Maes, Vanhalst, Bijttebier, and Goossens [37]2018Loneliness and attitudes toward aloneness in belgian adolescents: measurement invariance across language, age, and gender groups Grades 7–12; Mean age Grade 7= 11.95 years, Mean age Grade 12= 17.16
French speaking mean age = 14.35
Dutch speaking mean age = 14.36
Dutch speaking: 641
French speaking: 641
48ηSample 1: Dutch
Sample 2: French
Sample 1
12341234
0.910.900.850.8020.53 (6.80)21.17 (7.11)31.15 (6.32)31.72 (5.81)δ
Sample 2
12341234
0.860.830.800.8318.70 (5.99)19.04 (6.63)29.77 (6.66)29.00 (6.25)δ
δ: no data present in paper; θ: across waves of data collection; η: response categories often (4) sometimes, seldom, never (1); ¥: ranges of 1 year stability correlations across three and four measurement waves in sample 1 and sample 2, respectively.
Table 3. Subsequent research papers investigating the psychometric properties of the UCLA Loneliness Scale.
Table 3. Subsequent research papers investigating the psychometric properties of the UCLA Loneliness Scale.
AuthorsYearTitleParticipant AgeNumber of ParticipantsNumber of Items Response CategoriesLanguage of SampleCronbach’s AlphaMean (Standard Deviation)
Development Paper:
Russell, Peplau, and Ferguson [8]
1978Developing a measure of LonelinessYoung adults 239204 δEnglish0.96UCLA sample
Males = 38.7 (11.0)
Females = 40.2 (12.4)
Tulsa sample
Males = 38.6 (9.4)
Females = 37.8 (9.7)
Russell, Peplau and Cutrona[38]1980The revised UCLA loneliness scale: concurrent and discriminant validity evidenceSample 1 = University students in first year
Sample 2 = College students
Sample 1 = 162
Sample 2 = 237
20 + 19
Sample 1 = new items, 20 items made up scale
Sample 2 = 20 + 10 positively worded items
4EnglishSample 1 = 0.94
Sample 2 = 0.94
Sample 2 =
Males = 37.06 (10.91)
Females = 36.06 (10.11)
Mahon and Yarcheski [39]1990The dimensionality of the UCLA loneliness scale in early adolescents12–14 years326204English 0.84β
Neto[40]1992Loneliness among portuguese adolescents14–17 years21764 δPortuguese0.8232.2 (7.0)
Wilson, Cutts, Lees, Mapungwana, and Maunganidze [41]1992Psychometric properties of the Revised UCLA Loneliness Scale and two short form measures of loneliness in ZimbabweMean age = 17.531354204English FemaleMaleFemaleMale
UCLA-200.720.7140.34 (7.62)40.34 (7.62)
UCLA-80.600.5617.67 (4.25)17.08 (4.02)
UCLA-40.380.318.27 (2.30)8.14 (2.20)
Higbee and Roberts [42]1994Reliability and validity of a brief measure of loneliness with anglo-american and mexican american adolescents.11–14 years261484 δEnglishAnglo-American sample = 0.90
Hispanic sample = 0.87
7.13 (5.77)
Russell [43]1996UCLA loneliness scale (version 3): Reliability, validity, and factor structureEnglish489 students
(part of a larger sample including 310 nurses, 316 teachers, 301 elderly)
20 English0.9240.08 (9.50)
Neto [44]2001A short-form measure of loneliness among second-generation migrants.15–18 years10964Portuguese0.71β
Lasgaard [45]2007Reliability and validity of the danish version of the UCLA loneliness scale.13–16 years224204
1 = never
4 = always
EnglishAdolescents with ADHD = 0.84
Sample from regular schools = 0.91
Adolescents with ADHD = 37.6 (7.94)
Sample from regular schools = 37.69 (10.23)
Goossens, Klimstra, Luyckx, Vanhalst, and Teppers [46] 2014Reliability and validity of the Roberts UCLA Scale (RULS-8) with dutch-speaking adolescents in belgium12–18 years
Sample 1 = grades 7–8, 12 and 13 years
Sample 2 = grades 9–12, 14–18 years
Sample 3 = grades 7–12, 12–18 years
Sample 1 = 282
Sample 2 = 1144
Sample 3 = 4810
Sample 1 = 20
Sample 2 = 8
Sample 3 = 8
5
1 = completely disagree
5 = completely agree
DutchSample 1 = 0.80
Sample 2 = 0.80
Sample 3 = 0.83
β
Note: β: no data present; δ: 4 = often, 3 = sometimes, 2 = rarely, and 1 = never.
Table 4. Subsequent research papers investigating the reliability and validity of the CLS.
Table 4. Subsequent research papers investigating the reliability and validity of the CLS.
AuthorsYearTitleParticipant AgeNumber of participantsNumber of items Response CategoriesLanguage of SampleCronbach’s Alpha Mean (Standard Deviation)
Development Paper:
Asher, Hymel and Renshaw [9]
1984Loneliness in childrenGrades 3 to 6506245
(1 = always true, 2 = true most of the time, 3 = true sometimes, 4 = hardly ever true, 5 = not true at all)
English 0.9032.51 (11.82)
Cassidy and Asher [47]1992Loneliness and peer relations in young children 5–7 years452233
“Yes”
“No”
“Sometimes”
English 0.79β
Goossens and Beyers [33]2002Comparing measures of childhood loneliness: internal consistency and confirmatory factor analysisGrades 5–6 292245
η
Dutch0.8733.11 (9.98)
Bagner, Storch, and Roberti [48]2004A factor analytic study of the loneliness and social dissatisfaction scale in a sample of african american and hispanic-american children10–13 years200245English0.87Boys = 0.84Girls = 0.84Ethnicity:
African American = 29.63 (11.71)
Hispanic = 33.92 (12.42)
Grade:
Fifth Grade = 35.42 (13.74)
Sixth grade = 31.65 (11.10)
Gender:
Boys = 33.43 (11.92)
Girls = 33.07 (12.81)
Coplan, Closson, and Arbeau[49]2007Gender differences in the behavioural associates of loneliness and social dissatisfaction in kindergarten.Mean = 64.76 months δ139163English0.76β
Ebesutani, Drescher, Reise, Heiden, Hight, Damon, and Young [50]2012The loneliness questionnaire-short version: an evaluation of reverse-worded and non-reverse-worded items via item response theory.Grades 2–1212722245English Reverse-worded items = 0.73
Non-reverse worded items = 0.92
β
Ritchwood, Ebesutani, Chin, and Young [51]2017The loneliness questionnaire: establishing measurement invariance across ethnic groupsGrades 2–1212344245
η
EnglishAfrican American sample= 0.85
Caucasian sample= 0.88
β
‘Pure’ Loneliness papers
Parker and Asher[52]1993Friendship and friendship quality in middle childhood: links with peer group acceptance and feelings of loneliness and social dissatisfaction Grades 3–5 θ 8813 Σ β English0.77β
Ladd, Kochenderfer, and Coleman[53]1996Friendship quality as a predictor of young children’s early school adjustmentAverage age = 5.61 years825 λ 3
“no”, “sometimes”, “yes”
EnglishAutumn = 0.75
Spring = 0.78
β
Ladd, Kochenderfer, and Coleman [54]1997Classroom peer acceptance, friendship, and victimization: distinct systems that contribute uniquely to children’s school adjustment.Average age = 5:6 years2005 λ3EnglishAutumn = 0.75
Spring = 0.78
β
Rotenburg, McDougall, Boulton, Vaillaincourt, Fox, and Hymel [55]2004Cross-sectional and longitudinal relations among peer-reported trustworthiness, social relationships, and psychological adjustment in children and early adolescents from the united kingdom and Canada 9–11 years
Mean age = 9:9
Time 1 = 505
Time 2 = 475
4 Σ
Additional item = “I have no one to talk to”
5English0.87β
β: data not present; δ: 5 years, 3 months; θ: 7–10 years; η: see development paper response categories; Σ: Items included (1) I feel alone, (2) I feel left out, (3) I am lonely at school; λ: 3 items directly referring to loneliness, plus (4) Are you sad and alone at school? (5) Is school a lonely place for you?
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Cole, A.; Bond, C.; Qualter, P.; Maes, M. A Systematic Review of the Development and Psychometric Properties of Loneliness Measures for Children and Adolescents. Int. J. Environ. Res. Public Health 2021, 18, 3285. https://doi.org/10.3390/ijerph18063285

AMA Style

Cole A, Bond C, Qualter P, Maes M. A Systematic Review of the Development and Psychometric Properties of Loneliness Measures for Children and Adolescents. International Journal of Environmental Research and Public Health. 2021; 18(6):3285. https://doi.org/10.3390/ijerph18063285

Chicago/Turabian Style

Cole, Aimée, Caroline Bond, Pamela Qualter, and Marlies Maes. 2021. "A Systematic Review of the Development and Psychometric Properties of Loneliness Measures for Children and Adolescents" International Journal of Environmental Research and Public Health 18, no. 6: 3285. https://doi.org/10.3390/ijerph18063285

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop