The Content Validity and Interrater Reliability of Nursing Outcome Classification Self-Care for Toileting among Children with Physical Disabilities

Yogi Hasna Meisyarah; Sri Hartini; Fitri Haryanti

doi:10.14710/nmjn.v11i2.32267

DOI: https://doi.org/10.14710/nmjn.v11i2.32267

The Content Validity and Interrater Reliability of Nursing Outcome Classification Self-Care for Toileting among Children with Physical Disabilities

Yogi Hasna Meisyarah - School of Nursing, Faculty of Medicine, Public Health, and Nursing, Universitas Gadjah Mada, Indonesia

*Sri Hartini

- Department of Pediatric and Maternity Nursing, Faculty of Medicine, Public Health, and Nursing, Universitas Gadjah Mada, Indonesia

Fitri Haryanti

- Department of Pediatric and Maternity Nursing, Faculty of Medicine, Public Health, and Nursing, Universitas Gadjah Mada, Indonesia

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

BibTex Citation Data :

@article{NMJN32267,
    author = {Yogi Hasna Meisyarah and Sri Hartini and Fitri Haryanti},
    title = {The Content Validity and Interrater Reliability of Nursing Outcome Classification Self-Care for Toileting among Children with Physical Disabilities},
    journal = {Nurse Media Journal of Nursing},
  volume = {11},
    number = {2},
    year = {2021},
    keywords = {NOC; physical disabilities; validity; inter-rater reliability; toileting self-care},
    abstract = {  Background : Nursing Outcome Classification (NOC) Self-care for Toileting is an instrument for measuring the abilities of toileting self-care among children with physical disabilities. However, there has been no cultural adaptation in the Indonesian context, especially among children with physical disabilities, so that the validity and inter-rater reliability of the instrument has not been reported. Testing the content validity and interrater reliability of this instrument is necessary so that it could be used to measure the ability of toileting self-care.   Purpose : This study aimed to examine the content validity and inter-rater reliability of NOC Self-care for Toileting among children with physical disabilities.   Methods : This was a descriptive quantitative non-experimental research with a cross-sectional design. In the content validity test, this study employed seven experts teaching in nursing academies with a minimum degree of S2/specialist and had the experiences in basic nursing to assess the validity of NOC Self-care for Toileting. As for the inter-rater reliability test, this study involved two raters of nursing students who have passed block 2.4 lecture on “Growth and Development” and 36 children with physical disabilities at a Special School in Bantul, Yogyakarta. The validity test was analyzed using CVR, CVI, and Aiken’s V indexes, while the inter-rater reliability test was analyzed using Kappa and percent agreement.   Results : The validity test showed the CVR value range of 0.71-1.00, the CVI value of 0.91, and the V coefficient range of 0.86-1.00. In the inter-rater reliability test, the Kappa value obtained was 0.958, and the percent agreement value was 97.22% for all indicators of NOC Self-care for Toileting.   Conclusion : NOC Self-care for Toileting is a valid and reliable instrument for measuring the abilities of toileting self-care among children aged 6-18 with mild to moderate degrees of physical disabilities. Further research can be conducted by involving different respondents and cultures with more than two raters if possible. },
   issn = {2406-8799},   pages = {255--267}  doi = {10.14710/nmjn.v11i2.32267},
    url = {https://ejournal.undip.ac.id/index.php/medianers/article/view/32267}
}

Citation Format:

Abstract

Background: Nursing Outcome Classification (NOC) Self-care for Toileting is an instrument for measuring the abilities of toileting self-care among children with physical disabilities. However, there has been no cultural adaptation in the Indonesian context, especially among children with physical disabilities, so that the validity and inter-rater reliability of the instrument has not been reported. Testing the content validity and interrater reliability of this instrument is necessary so that it could be used to measure the ability of toileting self-care.

Purpose: This study aimed to examine the content validity and inter-rater reliability of NOC Self-care for Toileting among children with physical disabilities.

Methods: This was a descriptive quantitative non-experimental research with a cross-sectional design. In the content validity test, this study employed seven experts teaching in nursing academies with a minimum degree of S2/specialist and had the experiences in basic nursing to assess the validity of NOC Self-care for Toileting. As for the inter-rater reliability test, this study involved two raters of nursing students who have passed block 2.4 lecture on “Growth and Development” and 36 children with physical disabilities at a Special School in Bantul, Yogyakarta. The validity test was analyzed using CVR, CVI, and Aiken’s V indexes, while the inter-rater reliability test was analyzed using Kappa and percent agreement.

Results: The validity test showed the CVR value range of 0.71-1.00, the CVI value of 0.91, and the V coefficient range of 0.86-1.00. In the inter-rater reliability test, the Kappa value obtained was 0.958, and the percent agreement value was 97.22% for all indicators of NOC Self-care for Toileting.

Conclusion: NOC Self-care for Toileting is a valid and reliable instrument for measuring the abilities of toileting self-care among children aged 6-18 with mild to moderate degrees of physical disabilities. Further research can be conducted by involving different respondents and cultures with more than two raters if possible.

Fulltext View|Download

Keywords: NOC; physical disabilities; validity; inter-rater reliability; toileting self-care

Funding: -

Article Metrics:

Article Info

Section: Articles

Language : EN

In Vol 11, No 2 (2021): (August 2021)

Recent articles

Revisiting Job Satisfaction and Intention to Stay: A Cross-sectional Study among Hospital Nurses in the Philippines Effects and Interventions of Pressure Injury Prevention Bundles of Care in Critically Ill Patients: A Systematic Review Self-Instructional Training Application on Diabetic Patients' Self-Care Behaviors Editorial Front Matter Editorial Back Matter More recent articles

Most cited articles

Music and Music Intervention for Therapeutic Purposes in Patients with Ventilator Support; Gamelan Music Perspective Dietary Behaviors among Patients with Type 2 Diabetes Mellitus in Yogyakarta, Indonesia Dyspnea Experience and Dyspnea Management in Patients with Chronic Obstructive Pulmonary Disease in Bangladesh Development of a Community-Based Spiritual Life Review Program for Promoting Resilience of Elders Residing in Disaster-Prone Areas Effects of Acupoint Stimulation with Digital Massager of Oxytocin on the Breast Milk Production of Working Mothers More cited articles

Almeida, M. d. A., Seganfredo, D. H., & Unicovsky, M. R. (2010). Nursing outcome indicator validation for patients with orthopedic problems. Revista da Escola de Enfermagem da USP, 44(4), 1059-1064. https://doi.org/10.1590/S0080-62342010000400029
American Academy of Pediatrics. (2012). Toilet training children with special needs. https://www.healthychildren.org/English/ages-stages/toddler/toilet-training/Pages/ Toilet-Training-Children-with-Special-Needs.aspx
Asaad, A. S. (2004). Measurement and evaluation: Concepts and principles. FEX Book Store
Aslett, H. J. (2006). Reducing variability, increasing reliability: Exploring the psychology of intra- and inter-rater reliability. Investigation on University Teaching and Learning, 4(I), 86-91. http://repository.londonmet.ac.uk/id/eprint/222
Burns, M. K. (2014). How to establish interrater reliability. Nursing, 44(10), 56–58. https://doi.org/10.1097/01.NURSE.0000453705.41413.c6
Cohen, J. (1960) A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37-46. https://doi.org/10.1177/001316446002000104
da Silva, N. C. M., de Souza Oliveira, A. R., & de Carvalho, E. C. (2015). Knowledge produced from the outcomes of the “Nursing Outcomes Classification--NOC”: Integrative review. Revista Gaúcha de Enfermagem/EENFUFRGS, 36(4), 104–111. https://doi.org/10.1590/1983-1447.2015.04.53339
Department of Education, Youth, and Sports. (2018). Data individu sekolah dan data siswa tingkat pendidikan dasar TK-SMA sekolah luar biasa tahun 2017-2018. [Individual school data and student data for Kindergarten-High School special education levels 2017-2018]. Department of Education, Youth, and Sports Yogyakarta
Graham, M., Milanowski, A., & Miller, J. (2012). Measuring and promoting of teacher and principal (Issue February). US Department of Education: Center for Educator Compensation Reform
Guilford, J. P., & Fruchter, B. (1978). Fundamental statistics in psychology and education. Mc Graw-Hill Kogakusha
Gwet, K. L. (2014). Handbook of interrater reliability (4th Ed). Advanced Analytics
Hadzaman, N. A. H., Takim, R., Nawawi, A. H., & Mohamad Yusuwan, N. (2018). Content validity of governing in Building Information Modelling (BIM) implementation assessment instrument. IOP Conference Series: Earth and Environmental Science, 140(1). https://doi.org/10.1088/1755-1315/140/1/012105
Hayati, S., & Lailatussaadah. (2016). Instrumen validity and reliability. [Validity and reliability of instrument]. Didaktika, 16(2), 169–179
Head, B. J., Maas, M., & Johnson, M. (2003). Validity and community-health-nursing sensitivity of six outcomes for community health nursing with older clients. Public Health Nursing, 20(5), 385–398. https://doi.org/10.1046/j.1525-1446.2003.20507.x
Heale, R., & Twycross, A. (2015). Validity and reliability in quantitative studies. Evidence- Based Nursing, 18(3), 66–67. https://doi.org/10.1136/eb-2015-102129
Jones, P. S., Lee, J. W., Philips, L. R., Zhang, X. E., & Jaceldo K. B. (2001). An adaptation of Brislin’s Translation Model for cross-cultural research. Nursing Research, 50(5):303-304. https://doi.org/10.1097/00006199-200109000-00008
Kane, A. E., Hilmer, S. N., Huizer-Pajkos, A., Mach, J., Nines, D., Boyer, D., Gavin, K., Mitchell, S. J., & De Cabo, R. (2015). Factors that impact on interrater reliability of the mouse clinical frailty index. Journals of Gerontology - Series A Biological Sciences and Medical Sciences, 70(6), 694–695. https://doi.org/10.1093/gerona/glv032
Keenan, G., Stocker, J., Barkauskas, V., Johnson, M., Maas, M., Moorhead, S., & Reed, D. (2003). Assessing the reliability, validity, and sensitivity of nursing outcomes classification in home care settings. Journal of Nursing Measurement, 11(2), 135–155. https://doi.org/10.1891/jnum.11.2.135.57285
Khasanah, U., Nurjannah, I., & Harjanto, T. (2018). Interrater reliability dari nursing outcome classification perawatan diri eliminasi pada pasien stroke dengan diagnosis keperawatan defisit perawatan diri eliminasi. [Interrater reliability of nursing outcome classification for elimination self-care in stroke patients with a nursing diagnosis of elimination self-care deficit] (Bachelor’s Thesis). Universitas Gadjah Mada, Yogyakarta, Indonesia
Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 561–580. https://doi.org/10.1111/j.1744-6570.1975.tb01393.x
Lee, B. (2007). Identifying outcomes from the nursing outcomes classification as indicators of quality of care in Korea: A modified delphi study. International Journal of Nursing Studies, 44, 1021-1028. https://doi.org/10.1016/j.ijnurstu.2006.03.016
Lee, C. C., Li, D., Arai, S., & Puntillo, K. (2009). Ensuring cross-cultural equivalence in translation of research consents and clinical documents: A systematic process for translating English to Chinese. Journal of Transcultural Nursing, 20(1), 77–82. doi: 10.1177/1043659608325852
Ljungberg, A. K., Fossum, B., Fürst, C. J., & Hagelin, C. L. (2015). Translation and cultural adaptation of research instruments-guidelines and challenges: An example in FAMCARE-2 for use in Sweden. Informatics for Health and Social Care, 40(1), 67–78. https://doi.org/10.3109/17538157.2013.872111
Macias, M. M., Roberts, K. M., Saylor, C. F., & Fussell, J. J. (2006). Toileting concerns, parenting stress, and behavior problems in children with special health care needs. Clinical Pediatrics, 12, 415–422. https://doi.org/10.1177/0009922806289 616
McHugh, M. L. (2012). Lessons in biostatistics interrater reliability: The Kappa statistic. Biochemica Medica, 22(3), 276–282. https://hrcak.srce.hr/89395
Meisyarah, Y. H., Hartini, S., & Haryanti, F. (2019). Validitas dan interrater reliability dari Nursing Outcome Classification (NOC) perawatan diri toileting pada anak disabilitas fisik di SLB Negeri 1 Bantul. [Validity and interrater reliability of Nursing Outcome Classification (NOC) toileting self-care for children with physical disabilities at SLB Negeri 1 Bantul]. (Bachelor’s Thesis). Universitas Gadjah Mada, Yogyakarta, Indonesia
Ministry of Health Republic of Indonesia. (2018). Hasil utama Riskesdas 2018 [Main results of Riskesdas 2018]. http://kesmas.kemkes.go.id/assets/upload/dir_519d41d8cd98f00/files/Hasil riskesdas-2018_1274.pdf
Moorhead, S., Johnson, M., Maas, M. L., & Swanson, E. (2013). Nursing Outcome Classification (NOC) (5th ed.). Elsevier Mosby
Mueller, J. (2018). Authentic assessment toolbox. http://jfmueller.faculty.noctrl.edu/toolbox/ rubrics.htm
Mulyani, S., & Nurjannah, I. (2019). Validation of nursing outcomes’ indicators of nursing outcomes classification of self-care for patients with stroke. Belitung Nursing Journal, 5(3). https://doi.org/10.33546/bnj.768
National Association for Continence. (2013). What is incontinence?. http://www.nafc.org/bladder-bowelhealth/
Noble, E. (2014). Using prompts to improve toilet training for children with physical disabilities. https://cdn.rifton.com/-/media/files/rifton/white-papers/toilet-training-children-physical -disabilities.pdf
Nurjannah, I., Nurmasari, P., Nugraha, I. T., Katan, D. Y., & Hariyadi, K. (2017). Interrater reliability of client categorization system as a psychiatric status rating scale in measuring psychiatric patients’ health status. International Journal of Research in Medical Sciences, 5(5), 2193-2201. https://doi.org/10.18203/2320-6012.ijrms20171868
Ragupathi, K., & Lee, A. (2020). Beyond fairness and consistency in grading: The role of rubrics in higher education. In C. S. Sanger and N. W. Gleason (Eds.), Diversity and Inclusion in Global Higher Education, pp 73-95. Springer Nature Singapore
Shweta, Bajpai, R. C., & Chaturvedi, H. K. (2015). Evaluation of inter-rater agreement and inter-rater reliability for observational data: An overview of concepts and methods. Journal of the Indian Academy of Applied Psychology, 41 (Special Issue 3), 20–27
Sireci, S., & Faulkner-Bond, M. (2014). Validity evidence based on test content. Psicothema, 26(1), 100–107. https://doi.org/10.7334/psicothema2013.256
Sousa, V. D., & Rojjanasrirat, W. (2011). Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: A clear and user-friendly guideline. Journal of Evaluation in Clinical Practice, 17, 268-274. https://doi.org/10.1111/j.1365-2753.2010.01434.x
Wilson, F., Pan, W., & Schumsky, D. (2012). Recalculation of the critical values for Lawshe’s content validity ratio. Measurement and Evaluation in Counseling and Development, 45(3), 197-210. https://doi.org/10. 1177/0748175612440286
World Health Organization and World Bank. (2011). World report on disability. https://www.unicef.org/protection/World_report_on_disability_eng.pdf
Zamanzadeh, V., Ghahramanian, A., Rassouli, M., Abbaszadeh, A., Alavi-Majd, H., & Nikanfar, A.-R. (2015). Design and implementation content validity study: Development of an instrument for measuring patient-centered communication. Journal of Caring Sciences, 4(2), 165–178. https://doi.org/ 10.15171/jcs.2015.017

Last update:

No citation recorded.

Last update: 2024-11-13 16:25:13

No citation recorded.

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Journal Author(s) Rights

In order for the Department of Nursing, Faculty of Medicine, Universitas Diponegoro to publish and disseminate research articles, we need non-exclusive publishing rights (transferred from the author(s) to the publisher). This is determined by a publishing agreement between the author(s) and the Department of Nursing, Faculty of Medicine, Universitas Diponegoro. This agreement involves the transfer or licensing of the copyright for publishing to the publisher, while authors still retain significant rights to use and share their own published articles. The Department of Nursing, Faculty of Medicine, Universitas Diponegoro supports the need for authors to share, disseminate, and maximize the impact of their research through these rights in any databases.

As the author(s), you have rights to a wide range of uses of your article, including use by your employing institution or company. These author rights can be exercised without the need to obtain specific permission. Authors publishing in the Nurse Media Journal of Nursing have extensive rights to use their works for teaching and scholarly purposes without needing to seek permission, including:

use for classroom teaching by the author or the author’s institution and presentation at a meeting or conference, including distributing copies to attendees;
use for internal training by the author’s company;
distribution to colleagues for their research use;
use in a subsequent compilation of the author’s works;
inclusion in a thesis or dissertation;
reuse of portions or extracts from the article in other works (with full acknowledgment of the final article);
preparation of derivative works (other than for commercial purposes) (with full acknowledgment of the final article);
voluntary posting on open websites operated by the author or the author’s institution for scholarly purposes;

following the open access license of the Creative Commons CC BY-SA License.

Authors, readers, and third parties can copy and redistribute the material in any medium or format, as well as remix, transform, and build upon the material for any purpose, even commercially, but they must give appropriate credit (including the name of the creator and attribution parties, detailed information about the authors, a copyright notice, an open access license notice, a disclaimer notice, and a link to the material), provide a link to the license, and indicate if changes were made. The publisher will indicate any modification of the material (if any) and retain an indication of previous modifications using a CrossMark Policy and information about Erratum-Corrigendum notifications.

Authors, readers, and third parties can read, print, and download, redistribute or republish the article (e.g., display it in a repository), translate the article, download it for text and data mining purposes, reuse portions or extracts from the article in other works, sell or reuse it for commercial purposes, remix, transform, or build upon the material. They must distribute their contributions under the same license as the original Creative Commons Attribution-ShareAlike (CC BY-SA).

Copyright Transfer Agreement for Publishing (Publishing Right)

The Authors submitting a manuscript do so on the understanding that if accepted for publication, non-exclusive right for publishing (publishing right) of the article shall be assigned/transferred to Publisher of the Nurse Media Journal of Nursing (Department of Nursing, Faculty of Medicine, Universitas Diponegoro).

Upon acceptance of an article, authors will be asked to complete a 'Copyright Transfer Agreement for Publishing (CTAP)'. An e-mail will be sent to the Corresponding Author confirming receipt of the manuscript together with a 'Copyright Transfer Agreement for Publishing' form by online version of this agreement.

Nurse Media Journal of Nursing and Department of Nursing, Faculty of Medicine, Universitas Diponegoro, the Editors and the Editorial Board make every effort to ensure that no wrong or misleading data, opinions or statements be published in the journal. In any way, the contents of the articles and advertisements published in the Nurse Media Journal of Nursing are sole and exclusive responsibility of their respective authors and advertisers.

Please note that even though we ask for a transfer of copyright for publishing (CTAP), our journal Author(s) retain (or are granted back) significant scholarly rights as mentioned before.

The Copyright Transfer Agreement for Publishing (CTAP) Form can be downloaded here: [Copyright Transfer Agreement for Publishing (CTAP) Form NMJN 2024]

The copyright form should be signed electronically and send to the Editorial Office in the form of original e-mail below:

Dr. Meira Erawati (Editor-in-Chief)
Editorial Office of Nurse Media Journal of Nursing
Department of Nursing, Faculty of Medicine, Universitas Diponegoro
Jl. Prof. Soedarto, Tembalang, Semarang, Central Java, Indonesia 50275
Telp.: +62-24-76480919; Fax.: +62-24-76486849
E-mail: media_ners@live.undip.ac.id

(This policy statements has been updated at 24th January 2024)

The Content Validity and Interrater Reliability of Nursing Outcome Classification Self-Care for Toileting among Children with Physical Disabilities

Journal Author(s) Rights

Copyright Transfer Agreement for Publishing (Publishing Right)

OFFICE INFORMATION