Skip to main content

Functional assessments used by occupational therapists with older adults at risk of activity and participation limitations: a systematic review and evaluation of measurement properties

Abstract

Background

Older adults experience activity and participation limitations that are associated with ageing. Activity and participation limitations affect an older adult’s ability to engage in meaningful daily activities and valued life roles. Occupational therapists provide interventions to reduce such limitations and monitor client change to ensure that interventions are effective. Client change should be measured through the use of valid and reliable assessments. Yet occupational therapists can favour the use of non-standardised assessments leading to inaccurate reflections of client change and difficulties in comparing the effectiveness of interventions. A number of reasons have been suggested as to why therapists may favour non-standardised assessments, including a lack of knowledge (of assessments and their properties) and lack of skill.

Methods/design

This paper describes the systematic review protocol that will be used to identify functional assessments used in randomised trials of occupational therapy interventions for older adults (≥70 years of age). Interventions will focus on enhancing functional independence for either older adults transitioning from hospital to home, or community dwelling older adults. We will search Medline, EBSCO and OTseeker using a pre-determined search strategy to identify Functional assessments. These assessments will be recorded and, in phase two, their measurement properties analysed.

Discussion

This protocol provides a comprehensive guideline for conducting the proposed systematic review. The results of this systematic review will provide a thorough and unbiased identification and evaluation of measurement properties of functional assessment tools used in randomised trials to evaluate occupational therapy intervention. This information can be used to determine which assessment has superior measurement properties and will inform occupational therapy practice.

Peer Review reports

Background

Ageing results in an increased risk of chronic disease and disability, all of which contributes to the demand for acute and chronic healthcare services[1]. In Australia, the largest prevalence of disability is seen in groups aged 70 years and older, with the highest number of people with a disability seen in the 90 years and over age group (70.3%)[2]. Disability is comprised of three areas of functioning: 1) impairment, 2) activity limitations and 3) participation restrictions[3]. Older adults with a disability often require some form of support to live independently[4]. As such, reducing functional limitations experienced by older adults is an essential part of healthcare services.

Occupational therapists have long identified the link between engagement in meaningful daily activities and health and well-being[5]. As such, therapists aim to reduce functional limitations by providing interventions based on activity and participation. Current research has established occupational therapy’s role with older adults in enhancing functional independence in a number of areas for older adults, including community and stroke services, for example,[69].

An important component of therapy is the evaluation of the intervention provided[10]. With an increasing demand on the healthcare system, it is imperative that services are demonstrating the effectiveness of interventions[10]. To provide accurate reflections of practice, occupational therapists should use valid and reliable assessments[11, 12]. Yet, occupational therapists are favouring the use of non-standardised evaluations[1315]. With a number of valid and reliable assessments available for use, (for example. the Nottingham Extended Activities of Daily Living Scale[16]), questions must be raised as to why therapists are not routinely using these. Readiness of therapists to use validated assessment tools, skill, time, motivation, self-confidence, lack of support from management, personal values and beliefs, and lack of knowledge have all been suggested as reasons for limited uptake[13, 15, 1719].

There is little information regarding which functional assessment should be used by occupational therapists when working with older adults. Reviews of functional assessments from an occupational therapy perspective are available but lack methodical selection of assessments, leading to inaccurate reflections of assessment use. Law and Letts, 1989, conducted a literature search of assessment tools used to predict or evaluate activities of daily living (ADL). Authors reviewed the: 1) purpose of scale, 2) clinical utility, 3) scale construction, 4) standardisation, and 5) reliability and validity of identified assessments[20]. The authors concluded that no new ADL assessments should be created; instead, further research should be conducted to enhance current assessments. The Index of ADL, Barthel Index, the revised level of rehabilitation scale and physical maintenance scale were found to have the highest reliability and validity of those reviewed. The population and setting of interest was not specified by authors, which creates difficulty in translating results to practice. A similarly conducted study by Klein et al., 2008, compared 18 functional assessments to the Canadian Model of Occupational Performance to determine whether the assessment measured key occupational therapy perspectives[21]. Again, no information relating to population of interest or setting was provided, and no decisions relating to which assessment should be used in practice were made. Other research includes a literature review of six assessments (Candian Occupational Performance Measure, Assessment of Motor and Process Skills, McMaster Toronto Arthritis, Goal Attainment Scale, Target Complaints and Patient Specific Function)[22]. Authors described the measurement properties of each and concluded the need for occupational therapists to use assessments that are psychometrically sound and reflect practice. Since these tools do not measure the same construct, no definitive conclusions regarding use in practice can be drawn. The proposed review will identify functional assessments used in randomised trials to measure the effectiveness of occupational therapy interventions for at-risk older adults. We expect that reviewing randomised trials will capture a comprehensive selection of functional assessments, and that tools used in these trials would be of higher quality than in-house developed assessments of function that therapists favour in practice. In the second phase of this study, a comprehensive review of measurement properties of each assessment will be completed. The results of this study will provide an objective identification and evaluation of measurement properties of functional assessments used with older adults. Without such comparisons, therapists will continue to use a variety of different assessments which makes benchmarking of practice impossible. Identifying assessments used for measuring functional independence in older adults and their measurement properties will provide therapists with information needed to make informed decisions about the choice of assessment tools for practice.

This protocol outlines the methods to be used to systematically identify functional assessments used by occupational therapists with older adults at-risk of activity and participation limitations. The protocol also describes the process for reviewing the measurement properties of each assessment identified.

Review questions

The review questions are as follows:

  1. I.

    Phase one, systematic identification of functional assessments used in randomised trials: What functional assessments are used by occupational therapists to measure the effectiveness of enhancing functional independence for older adults at-risk of activity and participation limitations?

  2. II.

    Phase two, measurement properties: Of the identified functional assessments, which is psychometrically superior for use with older adults at-risk of activity and participation limitations?

The definition of older adults at risk of functional limitations that will be applied to the review are: persons aged 70 years and over with one or more functional difficulties, who are transitioning from hospital to home or are community dwelling. Functional limitations and difficulties will be defined as limitations in activity performance and participation as described by the International Classification of Functioning (ICF)[3]. People with pre-existing functional difficulties are also at risk of further functional decline[23] and will be included in this review.

Types of publications/studies

Randomised trials published in peer reviewed literature will be considered for this review. Articles must be published in English.

Settings and participants

Participants will be adults aged 70 years or older. Studies will be included where 50% or more of participants are 70 years and over. Participants will either need to be transitioning from hospital to home, or be community dwelling, and recipients of any occupational therapy intervention that aims to enhance functional independence. An occupational therapy intervention is one that is designed and/or implemented by an occupational therapist, provided solely or within a team setting. For example, if a rehabilitation team was providing functional intervention to an older adult and the occupational therapist had a component of intervention, this study would be included in the review.

Types of methods

Randomised trials in which a functional assessment is administered will be included. If the trial is a cross-over trial, both arms may be considered, if relevant.

Types of outcomes

Assessments will be included that measure activity performance and participation as defined using the ICF[3] will be included. Assessment tools which measure ICF impairment will be excluded.

Search methods for the identification of studies

The following electronic databases will be searched: 1) Medline, 2) EBSCO, 3) OTseeker. Medical subject headings (MeSH) and text words will be combined in search strategies (Medline search strategy is attached in Additional file1). Searches will be restricted to studies published in English. Reference lists of included studies will be independently searched by one reviewer to identify additional studies.

Methods/design

Screening

After searches have been completed, abstracts will be downloaded into the reference management system EndNote and duplicates removed. Duplicates will also be removed by hand as required. A study will be considered duplicate if the following are common: 1) authors, 2) location and setting, 3) interventions, 4) number of participants and baseline data, and 5) date and duration of study[24].

Potential studies will be first screened on title, then abstract and finally full manuscript to determine eligibility, see Figure1. The title and abstract, as needed, of each trial will be screened by one review author. Potential studies, which are not excluded, will be further screened independently by two authors, first on abstract and then, if required, the full manuscript. Differences in opinions regarding trial eligibility will be resolved through discussion and consensus of three authors.

Figure 1
figure 1

Systematic review process.

Data management

We will record and report the details of all studies identified in searches, the number of studies (once duplicates are removed), the number of full text papers obtained and the number and reasons for excluded studies[25].We will manage this data in Endnote.

Data extraction

Data will be extracted using a standardised data extraction form. This form will record information related to participants, study design, description of intervention, functional assessments used/administered and measurement properties, if described, study inclusion/exclusion criteria and a brief summary of findings.

Risk of bias assessment

The purpose of this article is to systematically identify functional assessment tools used by occupational therapists and to evaluate the measurement properties of each assessment that is identified. As such, a risk of bias assessment is outside the scope of this review and will not be completed.

Data analysis

For the first review question, a list of each functional assessment tool identified in the review will be presented.

Phase two, measurement property evaluation

To identify research relating to measurement evaluation, Medline, EBSCO and Embase will be searched. Contact with initial developers of the assessment will be made where possible. For database searches, the name and known abbreviation of the assessment tool will be used in conjunction with a search strategy based on Terwee et al., 2009 (adapted for each database)[26]. The assessment tool’s quality can be affected by the reporting available for that particular tool[27]. By appraising the methodological quality of such articles one can be assured that appropriate conclusions are drawn regarding measurement properties[28]. The Consensus-based standards for the selection of health measurement instruments (COSMIN) 4-point checklist will be used to determine overall methodological quality of each included study[28]. Once methodological quality has been determined, Terwee’s criteria relating to good measurement properties will be applied[27]. Terwee’s criteria provides definitions relating to nine measurement properties (content validity, internal consistency, criterion validity, construct validity, reproducibility, responsiveness, floor and ceiling effects and interpretability), which are considered essential in high quality assessment tools. With the use of Terwee’s quality criteria, decisions can be made regarding which functional assessment tool is the highest quality[27].

The COSMIN checklist is designed as a modular tool and, therefore, only criteria reported in the study under review will be extracted. Data extracted according to the COSMIN criteria includes information reported on: 1) internal consistency, 2) reliability (test-retest reliability, inter-rater reliability and intra-reliability), 3) measurement error, 4) content validity (including face validity), 5) structural validity, 6) hypotheses testing, 7) cross cultural validity, 8) criterion validity, 9) responsiveness, 10) interpretability, 11) item response theory (for tools which have used this technique) and 12) generalisability[28]. Additional information will be extracted in accordance with Terwee’s criteria, including construct validity, reproducibility, and floor and ceiling effect[27]. Feasibility information, as developed by Steiner and adapted by Zwakhalen, will also be collected[29, 30]. This analysis will be conducted by two reviewers, in line with COSMIN recommendations.

Discussion

This systematic review will identify which functional assessments are used by occupational therapists when working with older adults at-risk of functional limitations. A comprehensive analysis of the measurement properties of each will be reported. Results will determine the suitability of available assessments and provide guidance to occupational therapists. This information will benefit clients of occupational therapy, occupational therapists and managers in monitoring client outcomes and the effectiveness of interventions.

Abbreviations

ADL:

Activities of daily living

COSMIN:

Consensus-based standards for the selection of health measurement instruments

ICF:

International Classification of Functioning

MeSH:

Medical Subject Headings.

References

  1. World Health Organization: Active Ageing: Towards Age-Friendly Primary Health Care. 2004, World Health Organization, Geneva

    Google Scholar 

  2. Australian Bureau of Statistics: 4430.0 - Disability, Ageing and Carers, Australia: Summary of Findings. 2009,http://www.abs.gov.au/AUSSTATS/abs@.nsf/DetailsPage/4430.02009?OpenDocument,

    Google Scholar 

  3. World Health Organization: International Classification of Functioning, Disability and Health. 2001, World Health Organization, Geneva

    Google Scholar 

  4. Australian Institute of Health and Welfare: Older Australians at a Glance. 2007, Australian Government, Canberra, 4

    Google Scholar 

  5. Latham Trombly CA: Conceptual foundations for practice. Occupational Therapy for Physical Dysfunction. Edited by: Radomski MV, Latham Trombly CA. 2008, Lippincott Williams & Wilkins, Baltimore, 1-20. 6

    Google Scholar 

  6. Steultjens EM, Dekker J, Bouter LM, Jellema S, Bakker EB, van den Ende CH: Occupational therapy for community dwelling elderly people: a systematic review. Age Ageing. 2004, 33: 453-460. 10.1093/ageing/afh174.

    Article  PubMed  Google Scholar 

  7. Gitlin LN, Winter L, Dennis MP, Corcoran M, Schinfeld S, Hauck WW: A randomized trial of a multicomponent home intervention to reduce functional difficulties in older adults. J Am Geriatr Soc. 2006, 54: 809-816. 10.1111/j.1532-5415.2006.00703.x.

    Article  PubMed  Google Scholar 

  8. Clark F, Azen SP, Carlson M, Mandel D, LaBree L, Hay J, Zemke R, Jackson J, Lipson L: Embedding health-promoting changes into the daily lives of independent-living older adults: long-term follow-up of occupational therapy intervention. J Gerontol B Psychol Sci Soc Sci. 2001, 56B: P60-P63.

    Article  Google Scholar 

  9. Legg L, Drummond A, Langhorne P: Occupational therapy for patients with problems in activities of daily living after stroke. Cochrane Database Syst Rev. 2006, 4: CD003585-

    PubMed  Google Scholar 

  10. Unsworth C: Measuring the outcome of occupational therapy: tools and resources. Aust Occup Ther J. 2000, 47: 147-158. 10.1046/j.1440-1630.2000.00239.x.

    Article  Google Scholar 

  11. de Clive-Lowe S: Outcome measurement, cost effectiveness and clinical audit: the importance of standardised assessment to occupational therapists in meeting these new demands. Br J Occup Ther. 1996, 59: 357-362.

    Article  Google Scholar 

  12. Fawcett Laver AJ: The importance of accurate assessment and outcome measurement. Principles of Assessment and Outcome Measurement for Occupational Therapists and Physiotherapists: Theory, Skills and Application. Edited by: Fawcett Laver AJ. 2007, John Wiley & Sons, Chichester, UK, 15-44.

    Google Scholar 

  13. Bowman J: Challenges to measuring outcomes in occupational therapy: a qualitatve focus group study. Br J Occup Ther. 2006, 69: 464-471.

    Article  Google Scholar 

  14. Stapleton T, McBrearty C: Use of standardised assessments and outcome measures among a sample of Irish occupational therapists working with adults with physical disabilities. Br J Occup Ther. 2009, 72: 55-64.

    Article  Google Scholar 

  15. Atwal A, McIntyre A, Craik C, Hunt J: Occupational therapists’ perceptions of predischarge home assessment with older adults in acute care. Br J Occup Ther. 2007, 71: 52-58.

    Article  Google Scholar 

  16. Nouri FM: An extended activities of daily living scale for stroke patients. Clin Rehabil. 1987, 1: 301-305. 10.1177/026921558700100409.

    Article  Google Scholar 

  17. Bowman J, Llewellyn G: Clinical outcomes research from the occupational therapists perspective. Occup Ther Int. 2002, 9: 145-166. 10.1002/oti.162.

    Article  PubMed  Google Scholar 

  18. Mayo N, Cole B, Dowler J, Gowland C, Finch E: Use of outcome measures in physiotherapy: a survey of current practice. Can J Rehabil. 1993, 7: 81-82.

    Google Scholar 

  19. Bowman J, Lannin N, Cook C, McCluskey A: Development and psychometric testing of the clinician readiness for measuring outcomes scale. J Eval Clin Pract. 2009, 15: 76-84. 10.1111/j.1365-2753.2008.00957.x.

    Article  PubMed  Google Scholar 

  20. Law M, Letts L: A critical review of scales of activities of daily living. Am J Occup Ther. 1989, 43: 522-528. 10.5014/ajot.43.8.522.

    Article  CAS  PubMed  Google Scholar 

  21. Klein S, Barlow I, Hollis V: Evaluating ADL measures from an occupational therapy perspective. Can J Occup Ther. 2008, 2: 69-81.

    Article  Google Scholar 

  22. Carswell A, Donnelly C: Individualized outcome measures: a review of the literature. Can J Occup Ther. 2002, 69: 84-100.

    Article  PubMed  Google Scholar 

  23. Hoogerduijn JG, Schuurmans MJ, Duijnstee MS, de Rooij SE, Grypdonck MF: A systematic review of predictors and screening instruments to identify older hospitalized patients at risk for functional decline. J Clin Nurs. 2006, 16: 46-57.

    Article  Google Scholar 

  24. Higgins JPT, Deeks JJ: Selecting studies and collecting data. Cochrane Handbook of Systematic Reviews of Interventions. Edited by: Higgins JPT, Green S. 2008, John Wiley & Sons, Chichester, UK, 151-186.

    Chapter  Google Scholar 

  25. Moher D, Liberati A, Teltzlaff J, Altman DG: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009, 6: e10000097-

    Article  Google Scholar 

  26. Terwee CB, Jansma EP, Riphagen II, de Vet HC: Development of a methodological PubMed search filter for finding studies on measurement properties of measurement instruments. Qual Life Res. 2009, 18: 1115-1123. 10.1007/s11136-009-9528-5.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Terwee CB, de Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, Bouter LM, de Vet HC: Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007, 60: 34-42. 10.1016/j.jclinepi.2006.03.012.

    Article  PubMed  Google Scholar 

  28. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, Bouter LM, de Vet HC: COSMIN Checklist Manual. 2012,http://www.cosmin.nl/images/upload/File/COSMIN%20checklist%20manual%20v6.pdf,

    Google Scholar 

  29. Streiner DL, Norman CR: Health Measurement Scales. A Practical Guide to Their Development and Use. 2003, Oxford University Press, Oxford, UK

    Google Scholar 

  30. Zwakhalen SM, Hamers JP, Abu-Saad HH, Berger MP: Pain in elderly people with severe dementia: a systematic review of behavioural pain assessment tools. BMC Geriatr. 2006, 6: 3-10.1186/1471-2318-6-3.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

There are no acknowledgements. No funding for this research has been provided.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kylie Wales.

Additional information

Competing interests

The authors declare no competing interests.

Authors’ contributions

KW led the design of the protocol and drafting of the manuscript. LC and NL contributed to the design of the protocol and manuscript revisions. IC assisted in the selection of quality assessments and contributed to manuscript revisions. All authors read and approved the final manuscript.

Electronic supplementary material

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Wales, K., Clemson, L., Lannin, N.A. et al. Functional assessments used by occupational therapists with older adults at risk of activity and participation limitations: a systematic review and evaluation of measurement properties. Syst Rev 1, 45 (2012). https://doi.org/10.1186/2046-4053-1-45

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/2046-4053-1-45

Keywords