|Year : 2021 | Volume
| Issue : 4 | Page : 324-331
Psychometrics of the persian version of the team assessment questionnaire in providing care for heart failure patients
Seyed Hamid Seyed-Bagheri1, Hadi Khoshab2, Mahlagha Dehghan3, Fazlollah Ahmadi4
1 Department of Medical Surgical Nursing, School of Nursing and Midwifery, Rafsanjan University of Medical Sciences, Rafsanjan, Iran
2 Department of Medical Surgical Nursing, School of Nursing and Midwifery, Bam University of Medical Sciences, Bam, Iran
3 Department of Medical Surgical Nursing, School of Nursing and Midwifery, Kerman University of Medical Sciences, Kerman, Iran
4 Nursing Department, Faculty of Medical Sciences, Tarbiat Modares University, Tehran, Iran
|Date of Submission||01-Jul-2020|
|Date of Decision||11-Aug-2020|
|Date of Acceptance||07-Mar-2021|
|Date of Web Publication||20-Jul-2021|
Dr. Hadi Khoshab
School of Nursing and Midwifery, Bam University of Medical Sciences, Bam
Source of Support: None, Conflict of Interest: None
Background: Teamwork in the health care domain is the preferred mode of care delivery. Few instruments have been developed to assess teamwork in the field of health care, particularly in Iran. This study aimed to validate the Persian version of the Team Assessment Questionnaire (P-TAQ) in care for Congestive Heart Failure (CHF) patients. Materials and Methods: In this cross-sectional study, the validity (face, content, and construct validity) and the reliability (internal consistency and stability) of the cross-cultural adaptation of the Persian version of the Team Assessment Questionnaire (P-TAQ) were assessed. Results: The P-TAQ had adequate face and content validity. The confirmatory factor analysis confirmed the seven dimensions of the questionnaire. The internal consistency of the P-TAQ was 0.91, and the Intraclass Correlation Coefficient (ICC) was 0.89. Conclusions: The P-TAQ is a valid questionnaire in terms of dimensions and items. Assessing teamwork is an essential component of delivering adequate care. By examining the status of teamwork using this questionnaire, it is possible to promote teamwork and to understand its strengths and weaknesses. Future research is necessary to better understand the P-TAQ so that it can be used for the assessment of teamwork outcomes regarding patient safety, cultural barriers, and medical errors.
Keywords: Health care team, Iran, psychometrics, questionnaire, validation study
|How to cite this article:|
Seyed-Bagheri SH, Khoshab H, Dehghan M, Ahmadi F. Psychometrics of the persian version of the team assessment questionnaire in providing care for heart failure patients. Iranian J Nursing Midwifery Res 2021;26:324-31
|How to cite this URL:|
Seyed-Bagheri SH, Khoshab H, Dehghan M, Ahmadi F. Psychometrics of the persian version of the team assessment questionnaire in providing care for heart failure patients. Iranian J Nursing Midwifery Res [serial online] 2021 [cited 2021 Jul 24];26:324-31. Available from: https://www.ijnmrjournal.net/text.asp?2021/26/4/324/321908
| Introduction|| |
The complexity of care provision and the need for skillful health care providers for Heart Failure (HF) patients have increased. Very few can meet all the complex needs of these patients. Therefore, teamwork in the health care domain is an essential process required for delivering high quality and integrated care because different disciplines with various specializations can better achieve treatment goals. Many studies have shown the necessity of teamwork and its positive effects., For example, the result of Farzi's study showed that medication errors might occur due to a lack of interprofessional collaboration between the health care team and the patient and the patient's family. The collaboration within the health care team and direct communication with patients can have a great impact on patient outcomes.
One of the chronic progressive diseases in which teamwork is essential is Heart Failure (HF)., HF is a leading cause of readmission into hospitals and is associated with high postdiagnosis morbidity and mortality. Patients with HF usually require numerous hospitalizations and a vast range of health care services. These chronically sick patients require interprofessional teams to address their various health care needs because they need many providers to address their different health problems, so the interprofessional health care teams are the preferred mode of care delivery. Although teamwork is a vital component of the health care setting, few instruments in Iran can measure teamwork in a reliable, professional, and economical way. The questionnaires used to study teamwork in Iran generally focus on one aspect of teamwork, such as the relationship between team members, their collaboration, or team attitude. These questionnaires are in two categories: some are researcher-made and evaluate working conditions in groups, and others, such as the Jefferson scale, which focuses on physician-nurse collaboration, are translated from nonspecialized questionnaires and are not specifically designed for teamwork.
So far, no comprehensive model or definition of teamwork has been provided covering all aspects of teamwork in care and treatment. The current definitions are not valid or reliable and do not have scientifically sound support. The TAQ is one of the world's most standard and most widely used questionnaires assessing the different dimensions of teamwork. As HF patients experience both acute and chronic conditions, the care and treatment team of these patients was chosen as the target group so that the translated questionnaire assessed in this study can be used for both acute and chronic diseases later. Therefore, the lack of a specialized and valid questionnaire for assessing teamwork in patient care motivated us to validate the Persian version of the Team Assessment Questionnaire (TAQ).
| Materials and Methods|| |
This cross-sectional study had a methodological design and was conducted to validate the TAQ in the health care teams in Kerman and Bam, in southeast Iran. All the six university hospitals that had heart departments were considered for the study from March to October 2019.
The Team assessment questionnaire and its Persian version. The original version of the TAQ was taken from the Agency for Health care Research and Quality (AHRQ). This questionnaire is used in different health care settings, including that of Norway. This institute tries to increase patient safety in health care systems using an evidence-based approach focused on teamwork. This questionnaire has already been translated into Icelandic too. The TAQ is a 55-item questionnaire using a 5-point Likert scale. It has seven dimensions, including team foundation (12 items), team functioning (6 items), team performance (4 items), team skills (6 items), team leadership (8 items), team climate and atmosphere (10 items), and team identity (9 items). The psychometric values of the original TAQ have been found acceptable in other studies.,
With the permission of the AHRQ, we did a forward-backward procedure to translate the English version of the TAQ into Persian. The translation is a standard method of preparing questionnaires for cross-cultural application. We conducted the translation and cross-cultural adaptation research, according to Beaton et al. Each stage in the process of translation is described in detail below:
Stage 1 (forward translation): Two translators were chosen. One was familiar with the concepts of teamwork, and the other had no background information in this field. They translated the questionnaire into Persian separately.
Stage 2: The two translators and a writer compared the translations and reached a consensus on the discrepancies.
Stage 3 (backward translation): Two bilingual nurses translated the Persian questionnaire back to English. Neither was aware of the previous stages.
Stage 4: The researchers, the translators, a specialist in psychometrics, a physician, and two nurses reviewed all the translations, and the differences were discussed.
Stage 5: After adjusting the translations and considering expert suggestions, the researcher prepared the final Persian version of the TAQ (P-TAQ). In this stage, they checked whether the content of the translated version exactly corresponds with that of the original version.
Finally, Item 5, “Everyone on the team has a clear and vital role,” was divided into two items because in Iranian culture, “clear role” and “vital role” have different meanings. Thus, the total number of P-TAQ items increased to 56.
For checking face and construct validity and reliability, the health care providers (nurses and physicians of the heart departments of Kerman and Bam Universities of Medical Sciences) were considered. The inclusion criteria were willingness to participate in the study (informed consent) and having worked for more than 3 years in the university hospitals' heart wards. For content validity measurement, Kerman and Bam Universities of Medical Sciences faculty members with different experience levels (up to 5 years) were selected. As in factor analysis, the sample size should be four or five times the number of all items studied, the maximum sample size was calculated (more than 280). The eligible participants were selected using convenience sampling in all phases except construct validity, where the census was used. The self-declaration questionnaires were distributed among the participants in different shifts. Sampling lasted from August to November 2018. Some participants failed to return the questionnaire (18 persons). The final response rate was 93.50%.
In this study, we assessed face validity qualitatively and quantitatively. In the qualitative method, the questionnaire was assessed by 15 persons from the target community, and their opinion about clarity, feasibility, readability, consistency of style, and formatting of the P-TAQ was collected in the face to face interviews. In the quantitative stage, the 56 items in the questionnaire were scored based upon a 5-point Likert scale. The Impact Score (IS) (frequency × importance) was calculated. The items were adopted if they had an impact score higher than 1.5.
Content validity reflects the degree to which the instrument spans the domain of the construct's theoretical definition. The content validity of the questionnaire was evaluated by ten faculty members of Kerman and Bam Universities of Medical Sciences. Content Validity Ratio (CVR) and Content Validity Index (CVI) were assessed.
CVR assesses the relevance and ensures that the most relevant content (item necessity) is selected. The formula was used to calculate the CVR for the total scale after the participants replied to the items. According to Lawshe's table, an acceptable CVR value for ten specialists was 0.62.
CVI assesses the relation and simplicity of an item to the content represented in the questionnaire. Both Item-level CVI (I-CVI) and Scale-level CVI (S-CVI) were calculated. The minimum score of 0.78 was considered acceptable for both I-CVI and S-CVI.
For construct validity, 403 nurses, physicians, and other team members completed the questionnaire. The data were analyzed using IBM SPSS Statistics 25 and analysis of moment structures (AMOS). Twenty-nine missing scores were replaced with the mean score in the relevant dimension. A Confirmatory Factor Analysis (CFA) was done to test the factor structure of the P-TAQ. CFA provides useful information about scale dimensionality and validity. CFA aims to test explicit hypotheses about the measure's dimensionality. This is particularly pivotal for questionnaires that have been translated or culturally adapted. To assess the strength of the model, the three fit indices, the Root Mean Square Error of Approximation (RMSEA), the Tucker-Lewis Index (TLI), and the Comparative Fit Index (CFI) were used. The RMSEA represents an absolute fit index and takes into account the error estimates in the population. The RMSEA is accepted as the best estimation of how well the values of the model with unknown but optimally chosen parameters fit the population covariance matrix if it were available., For the RMSEA, cutoff values close to 0.06 indicate a good fitting model with values as high as 0.08 representing reasonable errors of approximation in the population. TLI and CFI represent indices of comparative fit. These indices compare the Chi-square values for the hypothesized model with those from a null model, in which all of the variables are uncorrelated; thus, having a large Chi-square value is indicative of a poor fit. For both indices, cutoff values close to 0.95 offer evidence of a good model fit. Each of these fit indices has a set cutoff value akin to the common p < 0.05 of hypothesis testing. Specifically, when used in combination (i.e., more than one fit index for a model), the acceptable values for these indices are as follows: TLI ≥0.95, CFI ≥0.95, and RMSEA ≥0.06. Ultimately, two models were assessed. At each stage, post hoc modifications were made to improve the fit of the model. Parameter estimates and fit indices were evaluated, starting with the first theoretical model, to determine how well the data fit. Specifically, the analyses evaluated several fit indices commonly used to interpret CFA findings. Also, the correlation of different dimensions should be high with the total score and should be low with each other. If different instrument dimensions are highly dependent on each other, colinearity will result, and using two or more dependent factors is not correct. The Pearson correlation coefficient was used to calculate the associations.
As the evaluation of the reliability of internal consistency alone provides no information on the stability of participants' responses, we used both internal consistency and test-retest reliability. The internal consistency of the questionnaire was assessed using Cronbach's alpha coefficient for each dimension separately and in total. The values equal to or greater than 0.70 were considered satisfactory in the study. To evaluate the repeatability of the P-TAQ, the Intraclass Correlation Coefficient (ICC) was calculated in a pilot study. To do so, we selected thirty members of the care team through random sampling. They were instructed to check each item. They filled out the TAQ twice, separated by a period of 2 weeks. The ICC was computed using the two-way mixed model and absolute agreement type. The ICC coefficient varies between 0 and 1.
The Ethics Committee of Bam University of Medical Sciences approved the protocol of the study (IR.MUBAM.REC.1397.002). Written permission for translation, validation, and use of the TAQ was obtained from Professor David I. Lewin. Before entering the study, informed consent was obtained from the participants, and they were assured the information would remain confidential.
| Results|| |
The mean and standard deviation of participants' age was 33.90 (0.60), and most were female nurses (62.80%). The other demographic characteristics of the participants are presented in [Table 1].
Face and content validity
In the qualitative stage of face validity, some minor words were changed according to the participants' suggestions. Impact scores of items ranged from 2.40 to 4.30 in face validity. The CVR for most of the items was more than that of Lawshe's Scale for ten persons (0.62). They ranged from 0.50 to 1, so the items proved acceptable, and no item was rejected in this stage. Only the CVR score of Item 22 was lower than the acceptable score (0.50). As this study aimed to validate the P-TAQ, we were cautious not to omit any item from the original questionnaire. Therefore, the research team decided to keep this item in the questionnaire in this phase.
The CVI of the questionnaire was 0.90 in total. The CVI for items ranged from 0.68 to 1. Three items had CVI scores lower than the acceptable level [Table 2]. Item 22 (The team is productive) with CVI 0.68, item 37 (My boss/supervisor leads by example), and item 55 (I am a member of a team in which the leader promotes teamwork) with CVI 0.71. After collecting comments and qualitative data on the panel of experts, the first item was changed to “team has output,” and the second was modified as “My boss/supervisor leads the team based on a specific pattern.” For Item 55, after a detailed survey of the scores, the researchers decided to move this item from team identity to the team leadership dimension temporarily and confirm it after construct validity, so Item 55 was placed in the questionnaire as item 38).
|Table 2: Distribution of validity scores, test-retest reliability scores and Cronbach's alpha of Persian version of the Team Assessment Questionnaire|
Click here to view
The construct validity of the translated P-TAQ was verified through a CFA index standard. The result indicated that each set of items that were supposed to accompany each teamwork dimension represents that specific construct. Our first model contained the seven dimensions and their representative items and error terms. Each dimension had different items associated with it. This model did not show a confirmable fit with the data (S967;2 = 4953.37, df = 880, p < 0.001, RMSEA = 0.07, TLI = 0.89, CFI = 0.80). Referring to four sets of items with high modification indices, we decided to analyze a second model within three of the seven dimensions in order to improve the fit of the model. This included Items 10 and 11 under team foundation, Items 15 and 16 under team functioning, and Items 47 and 52 under team identity. To improve the fitness of the model, after correlation of the error terms of items 10, 11, 15, 16, 47, and 52, the second model was conducted. The resultant model had the following fit indices: (χ2 = 4261.63, df = 879, p < 0. 001, RMSEA = 0.07, TLI = 0.96, CFI = 0.96). The hypothesized model containing seven dimensions fits the data very well. Besides, the correlation between the P-TAQ score and each dimension was between 0.65 and 0.79, and correlations of each dimension with other dimensions were between 0.32 and 0.57. The detailed correlations are shown in [Table 3].
|Table 3: Correlations of the Persian version of the team assessment questionnaire dimensions with each other and the total score (n=403)|
Click here to view
Cronbach's alpha coefficient showed a suitable agreement in this instrument (0.91). The average measure of the ICC was 0.89, with a 95% confidence interval of 0.81 and 0.92. According to Landis and Koch (1977), values above 0.80 are considered excellent for a reliable questionnaire. The P-TAQ items correlations ranged from -0.19 (Item 10) to 0.79 (Item 28) [Table 2]. The results of the item deleted in Cronbach's alpha showed none of the items that had negative Cronbach's alpha coefficient and had a significant effect on the total Cronbach's alpha if they were omitted. Therefore, we had no omission at this stage. The reliability of each dimension is presented separately in [Table 2].
| Discussion|| |
This study aimed to translate and cross-validate the TAQ into Persian/Farsi (P-TAQ) and test the questionnaire for psychometric properties among health care teams. In terms of difference with past studies, it is an unprecedented in Iran. The P-TAQ was shown to have good psychometric properties and can contribute to the improvement of evidence-based knowledge of teamwork.
One of the main problems in the psychometric properties of this questionnaire was the conversion of English words into exact and equivalent Persian words. However, health care staff had little knowledge of how teamwork works and its dimensions. In Iranian culture, having a “vital role” is different from having a “clear role” in a team, and these are two separate issues. Having a vital role in the team means that your presence in the team is essential, and in your absence, the life of the patient is compromised, but having a clear role in a team means that the duties of the members are well defined, and they know exactly what they should do. Dividing item 5 into two separate items increased the number of team foundation items to 13.
As Item 55 in the original TAQ was about team leader features (I am a member of a team in which the leader promotes teamwork), after reviewing the suggestions of specialists in the panel of experts, we decided to move it to the team leadership dimension. We believed that as this item is about the characteristics of the team leader, it would be better to move it from team identity to the team leadership dimension. Therefore, the number of team identity items decreased to eight, and the number of team leadership items reached nine. The CFA of the questionnaire showed that these changes cause no disruption in the structure of the questionnaire.
In the end, the arrangement of items for each dimension in the P-TAQ was team foundation (13 items), team functioning (6 items), team performance (4 items), team skills (6 items), team leadership (9 items), team climate and atmosphere (10 items), and team identity (8 items).
The CFA model strongly demonstrates that the P-TAQ adequately measures its intended dimensions. Further, the CFA exhibited remarkable fit across multiple standardized indices. These fit indices provide clear proof that the P-TAQ can be used as a valid tool to assess teamwork status in health care centers.
Although the analyses presented here tested the structure of the P-TAQ (i.e., construct validity) as a measurement tool for assessing teamwork, we did not test criterion validity or predictive validity. In other words, this analysis only shows to what extent the survey measured teamwork status and does not directly link the condition of teamwork to external performance criteria (e.g., patient safety outcomes or the results of providing good care). Some researchers have shown that good teamwork is associated with increasing the quality of care for HF patients,, but this paper provided no empirical data demonstrating this relationship.
This study has both strengths and limitations. The study's strengths are the high response rate (more than 95%) and the stringent and precise process of translation and testing of data. The main limitations are the development of this instrument in another language and country for the first time, which caused limitations in comparing the psychometric results with similar studies, and not considering patients, who are influential members of the treatment team, in the study.
| Conclusion|| |
Having a valid questionnaire for assessing the treatment team can help the health care provider find and solve teamwork problems. The result showed that this questionnaire has standard validity and reliability in terms of both the number of dimensions and the variety of items. Assessing teamwork is an essential component of delivering effective care. Without proper teamwork, it is difficult, if not impossible, to improve patient care outcomes., The P-TAQ is a valid and reliable measure of assessing teamwork. Although it does not measure actual teamwork behavior, it is a relatively time- and cost-effective survey that can evaluate team foundation, team functioning, team performance, team skills, team leadership, team climate and atmosphere, and team identity. In addition, the P-TAQ is a multidimensional questionnaire able to monitor different aspects of the care and treatment team. It assesses the team with regard to how well they are performing their duties, how the leader is conducting the team, what the team's mood is, and how the interactions between team members are. Further, the P-TAQ would probably be a useful tool for different health care teams. Although the target group of this study was the team members providing care for HF patients, and the P-TAQ can be used in assessing both teams taking care of acute and chronic patients, future research is needed to further understand the P-TAQ in relation to teamwork outcomes such as patient safety, cultural barriers, and medical errors.
The authors extend their appreciation to the participants for their cooperation throughout the study.
Financial support and sponsorship
Bam University of Medical Sciences
Conflicts of interest
Nothing to declare.
| References|| |
Kalisch BJ, Lee KH. Variations of nursing teamwork by hospital, patient unit, and staff characteristics. Appl Nurs Res 2013;26:2-9.
Dickerson J, Latina A. Team nursing: A collaborative approach improves patient care. Nursing 2017;47:16-7.
Khoshab H, Nouhi E, Tirgari B, Ahmadi F. Invisible cobwebs in teamwork—Impediments to the care of patients with heart failure: A qualitative study. Int J Health Plann Manage 2018;33:e663-73. doi: 10.1002/hpm.2518.
Farzi S, Irajpour A, Saghaei M, Ravaghi H. Weak professional interactions as main cause of medication errors in intensive care units in Iran. Iranian Red Crescent Med J 2017;19:1-7.
LaDonna KA, Bates J, Tait GR, McDougall A, Schulz V, Lingard L, et al
. 'Who is on your health-Scare team?' Asking individuals with heart failure about care team membership and roles. Health Expect 2017;20:198-210.
Rogers C, Bush N. Heart failure: Pathophysiology, diagnosis, medical treatment guidelines, and nursing management. Nurs Clin 2015;50:787-99.
Lurie SJ, Schultz SH, Lamanna G. Assessing teamwork. Fam Med 2011;43:731-4.
Hekmat SN, Dehnavieh R, Rahimisadegh R, Kohpeima V, Jahromi JK. Team attitude evaluation: An evaluation in hospital committees. Mater Sociomed 2015;27:429-38.
Jasemi M, Rahmani A, Aghakhani N, Hosseini F, Eghtedar S. Nurses and Physicians' viewpoint toward interprofessional collaboration. Iran J Nurs 2013;26:1-10.
Zamani AR, Zamani N, Sherafat Z. Assessment and compare of nurses and physicians views about Dr-nurse relationship cycle in Alzahra hospital. J Isfahan Med School 2011;28:1-8.
Ward J, Schaal M, Sullivan J, Bowen ME, Erdmann JB, Hojat M. The Jefferson scale of attitudes toward physician–nurse collaboration: A study with undergraduate nursing students. J Interprof Care 2008;22:375-86.
Ballangrud R, Husebø SE, Hall-Lord ML. Cross-cultural validation and psychometric testing of the Norwegian version of the TeamSTEPPS® teamwork perceptions questionnaire. BMC Health Serv Res 2017;17:799-811.
Salas E, Rosen MA. Building high reliability teams: Progress and some reflections on teamwork training. BMJ Qual Saf 2013;22:369-73.
Ward MM, Zhu X, Lampman M, Stewart GL. TeamSTEPPS implementation in community hospitals: Adherence to recommended training approaches. Int J Health Care Qual Assur 2015;28:234-44.
Baker DP, Amodeo AM, Krokos KJ, Slonim A, Herrera H. Assessing teamwork attitudes in healthcare: Development of the TeamSTEPPS teamwork attitudes questionnaire. Qual Saf Health Care 2010;19:e49.
Bragadóttir H, Kalisch BJ, SmS225;radóttir SB, Jónsdóttir HH. The psychometric testing of the Nursing Teamwork Survey in Iceland. Int J Nurs Pract 2016;22:267-74.
Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al
. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: Report of the ISPOR Task Force for Translation and Cultural Adaptation. Value Health 2005;8:94-104.
Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine 2000;25:3186-91.
MacCallum RC, Widaman KF, Zhang S, Hong S. Sample size in factor analysis. Psychological Methods 1999;4:84-99.
Hosseini Z, Ghorbani Z, Ebn Ahmady A. Face and content validity and reliability assessment of change cycle questionnaire in smokers. J Mashhad Dent School 2015;39:147-54.
Ayre C, Scally AJ. Critical values for Lawshe's content validity ratio: Revisiting the original methods of calculation. Meas Eval Couns Dev 2014;47:79-86.
Yaghmale F. Content validity and its estimation. J Med Educ 2003;3:25-7.
Lawshe CH. A quantitative approach to content validity 1. Pers Psychol 1975;28:563-75.
Bilandi RR, Farahamni FK, Ahmadi F, Kazemnejad A, Mohamadi R, Amiri M. Psychometric properties of the iranian version of modified RHAQWRA questionnaire. J Family Reprod Health 2015;9:184-93.
Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health 2007;30:459-67.
Fox-Wasylyshyn SM, El-Masri MM. Handling missing data in self-report measures. Res Nurs Health 2005;28:488-95.
Blunch NJ. Introduction to Structural Equation Modeling using IBM SPSS Statistics and EQS. Sage; 2015.
Polit DF, Yang F. Measurement and the Measurement of Change: A Primer for the Health Professions. Wolters Kluwer Health; 2015.
Byrne BM. Structural Equation Modeling with AMOS: Basic Concepts, Applications, and Programming. Routledge; 2016.
Hu Lt, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Modeling 1999;6:1-55.
Dehghan M, Dehghan-Nayeri N, Iranmanesh S. Translation and validation of the Persian version of the treatment adherence questionnaire for patients with hypertension. ARYA Atherosclerosis 2016;12:76-91.
DeVon HA, Block ME, Moyle-Wright P, Ernst DM, Hayden SJ, Lazzara DJ, et al
. A psychometric toolbox for testing validity and reliability. J Nurs Scholarsh 2007;39:155-64.
Waltz CF, Strickland OL, Lenz ER. Measurement in Nursing and Health Research. Springer Publishing Company; 2010.
Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977;33:159-74.
Khoshab H, Nouhi E, Tirgari B, Ahmadi F. A survey on teamwork status in caring for patients with heart failure: A cross-sectional study. J Interprof Care 2019;33:8-14.
Körner M, Bütof S, Müller C, Zimmermann L, Becker S, Bengel J. Interprofessional teamwork and team interventions in chronic care: A systematic review. J Interprof Care 2016;30:15-28.
Firth-Cozens J. Cultures for improving patient safety through learning: The role of teamwork. BMJ Qual Saf 2001;10(Suppl 2):ii26-31.
Keebler JR, Dietz AS, Lazzara EH, Benishek LE, Almeida SA, Toor PA, et al
. Validation of a teamwork perceptions measure to increase patient safety. BMJ Qual Saf 2014;23:718-26.
[Table 1], [Table 2], [Table 3]