|Year : 2014 | Volume
| Issue : 2 | Page : 134-138
Health science students' attitude towards research training programs in the Kingdom of Saudi Arabia: Reliability and validity of the questionnaire instrument
Ahmed A. Al-Kuwaiti
Deanship of Quality and Academic Accreditation, University of Dammam, Dammam, Saudi Arabia
|Date of Web Publication||19-Jun-2014|
Ahmed A. Al-Kuwaiti
University of Dammam, King Fahd Hospital of the University, P.O. Box 40065,
Source of Support: None, Conflict of Interest: None
| Abstract|| |
Objective: The aim of this paper was to determine the validity and reliability of a questionnaire tool for measuring students' attitudes toward components relevant to research training programs in the Kingdom of Saudi Arabia. Materials and Methods: The paper reports the responses of 564 Saudi Arabian students from seven government universities to the questionnaire comprising 16 items on 3 conceptual subscales, which measured students' attitude to research activities in the college; students' opinion of faculty involvement in research; and infrastructural facilities in the college. The results of this study provide the final scale, with all the 16 items of the initial Likert scale, for which strong evidence was obtained. Results: Results indicated that the students' attitude toward the research (SAR) scale had three latent factors, which explained 62% of the variance: The three subscales measured includes: (i) Research activities offered in the college, (ii) students' opinion of faculty involvement in research, and (iii) infrastructural facilities offered in the college for research. The full scale including three subscales had good internal consistency (rs = 0.72 and α = 0.77 for full scale; and α between 0.71 and 0.79 for three subscales). Conclusion: This study provides evidence of reliability and validity of the SAR scale for the measurement of students' attitudes toward research training programs in Saudi Arabian Universities. The research findings will provide the basis for further research on health science students.
Keywords: Attitude, reliability, research, validity
|How to cite this article:|
Al-Kuwaiti AA. Health science students' attitude towards research training programs in the Kingdom of Saudi Arabia: Reliability and validity of the questionnaire instrument. J Fam Community Med 2014;21:134-8
|How to cite this URL:|
Al-Kuwaiti AA. Health science students' attitude towards research training programs in the Kingdom of Saudi Arabia: Reliability and validity of the questionnaire instrument. J Fam Community Med [serial online] 2014 [cited 2020 May 25];21:134-8. Available from: http://www.jfcmonline.com/text.asp?2014/21/2/134/134775
| Introduction|| |
The National Commission for Academic Accreditation and Assessment (NCAAA) is responsible for the academic accreditation of Universities in the Kingdom of Saudi Arabia (KSA). NCAAA has instituted several key performance indicators to measure various attributes of the quality of higher education institutions. One of the requirements of this is the evaluation of students attitudes toward research training programs. There has also been a significant shift toward providing health science students with early research experience in their curriculum. ,, The resident research activities have several benefits such as the teaching of skills relevant to evidence-based medicine, promotion of lifelong learning, and an inspiration to residents' career choices and continued scholarly work. ,
Previous studies which also showed the relationship between research programs and medical education indicated that research had a positive impact on the motivation of medical students. ,,, Similarly, it is likely that doctors who had participated in a scientific program during their academic career would make more accurate diagnoses and better professional decisions.  Despite these merits of research work, many obstacles lie in the path of health science students who want to take part in research. This study was thus conducted to explore the attitude of Saudi Health Sciences toward their participation in research. It was expected that, any issues raised by the students in the course of the survey of their attitudes can be easily addressed. Appropriate reforms can be undertaken to improve the quality of research training programs in KSA.
Moreover, at the undergraduate level, students tend to have a negative view of courses on research methods. A better understanding of these attitudes is, therefore, necessary to help instructors create a more positive attitude in their students toward the courses in order to facilitate their learning of research.  Exploration of the literature, revealed that instruments for measuring the attributes of research training programs from the students' point of view were limited. Through this study, a standard questionnaire instrument tool was devised to garner the research attitudes of the students, and establish its appropriate validity and reliability.
The primary aim of this study was to develop a valid reliable instrument to measure students' attitude toward research training programs. It was to discover the opinion of students about the availability of Research Training Programs in selected Health Sciences Colleges in KSA. Furthermore, it dealt with the degree of involvement of the students in these programs and the obstacles they encountered in their attempt to get involved in research.
| Materials and methods|| |
The students' attitude toward the research (SAR) questionnaire was used to assess the attitude of students of the health sciences toward research training activities offered at the level of higher education institutions in KSA. It was structured in a fashion that would allow the results to be interpreted in the light of national and international recommendations. This instrument consisted of 16 items related to three different attitude subscales, as follows: (a) Attitude of students to the research activities offered in the college, (b) students' opinion of faculty involvement in research, and (c) students' opinion of the infrastructural facilities offered by the college for research. Each item of the instrument used a 5-point Likert scale ranging from 1-strongly disagree to 5-strongly agree.
A total of 564 students were invited by stratified sampling method from 19 different health science colleges from seven Government Universities in KSA. Care had been taken to get a wide representation of samples by covering all provinces of KSA.
The study was conducted in a 12-month period covering the academic year 2011-2012. The students belonging to the health sciences colleges cluster of the seven selected government universities located in four different geographical zones in the KSA were the focus of this study. Only the final year/internship students in the selected health sciences colleges were recruited as the sample for this study. It was based on survey data collected as part of the study on students' attitudes toward research training program. A self-administered questionnaire consisting of 16 closed-ended items with ordinal-level response choices was used to assess attitudes of university students toward research training programs.
The test of validity and reliability of the questionnaire was based on the undergraduate students' opinion on the research training program offered in the selected health sciences colleges in KSA.
The evaluation of questionnaire's reliability-internal consistency was made possible by Cronbach's α,  which is considered the most important reliability index, and is based on the number of the variables/items of the questionnaire, as well as on correlations between the variables.  The reliability of the instrument means that its results are characterized by repetitiveness and not connected with measurement errors.  Such reliability is evaluated by Cronbach's α coefficient.
An exploratory factor analysis was conducted to assess the dimensions of the students' attitude to the research training program scale. The author used principal axis analysis in SPSS version 19.0 (Illinois, USA) as the extraction method. Based on the relatively high correlations among the majority of items (>0.3), an oblique rotation was performed using Promax. Three criteria from Green and Salkind were applied to determine the number of factors to be retained: (1) The absolute values of the Eigenvalues; (2) the relative values of the Eigenvalues; and (3) the relative interpretability of the rotated solutions. In addition, a scree plot and variance explained by the factor solution were also considered in making decisions to retain or exclude factors. Then a principal components analysis with Varimax rotation which produces the dimension of differentiation was used to confirm the scale construct validity. To determine if the sub-scales were suitable for factor analysis, two statistical tests were used. The first was the Bartlett's test of sphericity, which examined the inter-independence of the subscales of the scale, and the second was the criterion Kaiser-Meyer-Olkin (KMO) (KMO Measure of Sampling Adequacy, KMO),  which examined sample sufficiency. The main method of extracting factors is the analysis of main components with right-angled rotation of Varimax type, so that the variance between loads of variables are maximized on a specific factor, thus reducing the size of small loads, making big loads bigger, and finally, minimizing those with intermediate values.  This means that the factors (components) extracted were linearly irrelevant.  The criterion of Eigenvalue or characteristic root (Eigenvalue) ≥1 was used to define the number of factors that were kept.  Model acceptance was based on two criteria: (a) In order to be included in the variable cluster of a factor, each variable must have loaded to it >0.5 and (b) <0.4 to the rest of the factors.  Moreover, each factor must have more than two variables. In addition, it was considered that on the basis of common variable communalities, the variables with high communality (h 2 ) imply great contribution to the factorial model. 
| Results|| |
Reliability statistics [Table 1] showed the value of the coefficient of Cronbach for the research scale as 0.768. This was over the 70%, which is a good value for the internal consequence of the conceptual construction of the investigated scale.  If release of units continues in the same way, i.e. with the standardized value of the variables, the coefficient Cronbach α will slightly increase the value of α to 0.788. This means that even if the number of the items is increased, Cronbach α will take the value of 0.788.
The table scale statistics [Table 2] gives scores that are related to the entire scale, which presents a mean of 49.88 and a standard deviation of the class of 6.822 units. [Table 3] shows the detailed results of the evaluation of the internal consistency for each sub-scale (factor) of the questionnaire of SAR, and also indicates that the internal consistency of the questions making up each sub-scale was extremely high (Cronbach's α >0.7). The integrity of the instrument as a whole has been demonstrated by invariably positive and significant inter-factor correlations [Table 4].
|Table 3: Evaluation of the internal consistency of the sub-scales of questionnaire for evaluation of the SAR (Cronbach's α) |
Click here to view
Initially, the relevance of the data used for the factor analysis was confirmed. The statistical criteria KMO (KMO = 0.524) and the Bartlett test of sphericity (value 556.442, P < 0.001) [Table 5], indicated that the raw data were suitable for the implementation of factor analysis. Eventually, from the following values [Table 6] of common communality, we learnt that the majority of the questions had a value higher than 0.50, which indicates that the quality of the measurements is satisfactory.
Factor analysis was performed for the evaluation of the construct validity of the questionnaire for the SAR. From the 16 original questions used in the factor analysis, three factors came off, using the Kaiser criterion and Varimax orthogonal rotation. The overall rate of variation of the initial data indicated that three factors interpreted in common, amounted to 62.079%. Factor analysis extracted three factors which conjointly explained 62.079% of the variance in students' attitudes [Table 7].
| Discussion|| |
The present study has achieved its main objective, namely the validation of the SAR questionnaire. The initial face validity and content validity were confirmed by the construct validity generated from the factor analysis. The internal consistency and reliability of the extracted factors were ascertained by Cronbach's α coefficients. The integrity of the instrument as a whole has been demonstrated by invariably positive and significant inter-factor correlations.
The 16 items making up our instrument is intermediate among the reported range of 13  to 100.  The number of three extracted factors is modal among the reported range of 3  to 11  factors. The explained variance of 62.079% is exceeded by only one out of 13 studies ranging in variance from 44%  to 68%.  Our within-factor α coefficients ranging from 0.71 to 0.79 were intermediate among 25 other studies in which the range reported was from 0.43  to 0.90.  These comparisons justify the recommendation of the use of this questionnaire on students' attitude toward research training programs in various academic settings. The recommendations are as follows: (1) The results of this study need to be re-examined with other samples of students studying different courses. (2) Relationships between students' attitude and achievement in research have to be explored.
Overall, the study results validate the utilization of the SAR scale in measuring students' attitude toward research. Further studies are needed to identify and incorporate some hitherto unused determinants of students' attitude.
| Conclusion|| |
The study successfully developed and validated a students' attitude toward research training program questionnaire suitable for health science colleges. The following three attributes make SAR strongly commendable for the investigation of the state of SAR in various academic settings. They are the (i) Explained variance of 62.079%, (ii) the overall 0.768 α coefficients of internal consistency reliability, and (iii) the invariably positive and significant inter-factor correlations. Moreover, sample sufficiency tested by KMO, and content and construct validity of the instrument tested by product moment correlation and principle component analysis, indicated a high reliability (internal consistency) and good content, construct and criterion-related validity. This is, therefore, a reliable valid tool for measuring students' attitude toward research training program in health science colleges. It is therefore, recommended that this tool be incorporated or adapted by colleges and universities as one of the means of assessing SAR training programs.
| References|| |
|1.||Lloyd T, Phillips BR, Aber RC. Factors that influence doctors' participation in clinical research. Med Educ 2004;38:848-51. |
|2.||Fang D, Meyer RE. Effect of two Howard Hughes Medical Institute research training programs for medical students on the likelihood of pursuing research careers. Acad Med 2003;78:1271-80. |
|3.||Frishman WH. Student research projects and theses: Should they be a requirement for medical school graduation? Heart Dis 2001;3:140-4. |
|4.||Rivera JA, Levine RB, Wright SM. Completing a scholarly project during residency training. Perspectives of residents who have been successful. J Gen Intern Med 2005;20:366-9. |
|5.||Levine RB, Hebert RS, Wright SM. Resident research and scholarly activity in internal medicine residency training programs. J Gen Intern Med 2005;20:155-9. |
|6.||Yamamoto LG. The role of research in medical education. Hawaii Med J 1999;58:25-6. |
|7.||Solomon SS, Tom SC, Pichert J, Wasserman D, Powers AC. Impact of medical student research in the development of physician-scientists. J Investig Med 2003;51:149-56. |
|8.||Jacobs CD, Cross PC. The value of medical student research: The experience at Stanford University School of Medicine. Med Educ 1995;29:342-6. |
|9.||Takahashi O, Ohde S, Jacobs JL, Tokuda Y, Omata F, Fukui T. Residents' experience of scholarly activities is associated with higher satisfaction with residency training. J Gen Intern Med 2009;24:716-20. |
|10.||de Oliveira NA, Luz MR, Saraiva RM, Alves LA. Student views of research training programmes in medical schools. Med Educ 2011;45:748-55. |
|11.||Papanastasiou EC. Factor structure of the attitudes toward research scale. Stat Educ Res J 2005;4:16-2. |
|12.||Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika 1951;16:297-34. |
|13.||Nunnally CJ. Psychometric Theory. New York: McGraw Hill Book Co.; 1978. |
|14.||Zafiropoulos K. How a scientific essay is done? Scientific research and essay writing. Athens, Greece: ED, Kritiki; 2005. |
|15.||Kaiser HF. An index of factorial simplicity. Psychometrika 1974;39:31-6. |
|16.||Hair FJ, Balck CW, Badin NJ, Anderson ER, Tatham RL. Multivariate Data Analysis. New Jersey: Pearson Education Inc.; 2005. |
|17.||Anastasiadou S. Factorial validity evaluation of a measurement through principal component analysis and implicative statistical analysis. In: Xatzidimou DX, Mpikos K, Stravakou PA, Xatzidimou KD, editors. 5 th Hellenic Conference of Pedagogy Company. Greece: Thessaloniki; 2006. p. 341-8. |
|18.||Kaiser HF. The application of electronic computers to factor analysis. Educ Psychol Meas 1960;20:141-51. |
|19.||Schene AH, van Wijngaarden B, Koeter MW. Family caregiving in schizophrenia: Domains and distress. Schizophr Bull 1998;24:609-18. |
|20.||Anastasiadou S, Anastasiadis L, Angeletos T, Vandikas J. A multidimensional statistical analysis of students' attitude toward physics. Int J Divers Organ Communities Nations 2010;16:341-56. |
|21.||Wolosin RJ, Gesell SB, Taber B, Epting GJ. Construct validation of a physician satisfaction survey. J Healthc Qual 2006;28:10-21. |
|22.||Weiss DJ, Dawis RV, England GW, Lofquist LH. Manual of the Minnesota Satisfaction Questionaire. Industrial Relations Center Bulletin 45. Minnesota Studies in Vocational Rehabilitation 22. Minneapolis: University of Minnesota; 1977. |
|23.||Li J, Yang W, Liu P, Xu Z, Cho SI. Psychometric evaluation of the Chinese (mainland) version of job content questionnaire: A study in university hospitals. Ind Health 2004;42:260-7. |
|24.||Lloyd S, Streiner D, Hahn E, Shannon S. Development of the emergency physician job satisfaction measurement instrument. Am J Emerg Med 1994;12:1-10. |
|25.||García-Peña MC, Reyes-Lagunes I, Reyes-Frausto S, Villa-Contreras S, Libreros-Bango V, Munõz Hernández O. Development and validation of an inventory for measuring job satisfaction among family physicians. Psychol Rep 1996;79:291-301. |
|26.||Soo Hoo WE, Ramer L. Development of the physician satisfaction survey instrument. J Healthc Qual 1998;20:34-8. |
|27.||Li W, Zhang JQ, Sun J, Tan PF, Wang S. Reliability and validity of job content questionnaire in Chinese petrochemical employees. Psychol Rep 2007;100:35-46. |
|28.||Beasley BW, Kern DE, Howard DM, Kolodner K. A job-satisfaction measure for internal medicine residency program directors. Acad Med 1999;74:263-70. |
[Table 1], [Table 2], [Table 3], [Table 4], [Table 5], [Table 6], [Table 7]
|This article has been cited by|
||Factors associated with the quality of outpatient service: The application of factor analysis – A case study
| ||Ahmed Alkuwaiti,Thennarasu Maruthamuthu,Seval Akgun |
| ||International Journal of Healthcare Management. 2018; : 1 |
|[Pubmed] | [DOI]|
||Pharmacy studentsæ anxiety towards research during their undergraduate degree; How to reduce it?
| ||Mari Kannan Maharajan,Kingston Rajiah,Ai May Tam,Siew Ling Chaw,May Jing Ang,Mei Wan Yong,Andrew R. Dalby |
| ||PLOS ONE. 2017; 12(4): e0176095 |
|[Pubmed] | [DOI]|
||Health science students’ perception about research training programs offered in Saudi universities
| ||Ahmed Al Kuwaiti,Arun Vijay Subbarayalu |
| ||Quality Assurance in Education. 2015; 23(2): 196 |
|[Pubmed] | [DOI]|
||Appraisal of students experience survey (SES) as a measure to manage the quality of higher education in the Kingdom of Saudi Arabia: an institutional study using six sigma model
| ||Ahmed Al Kuwaiti,Arun Vijay Subbarayalu |
| ||Educational Studies. 2015; 41(4): 430 |
|[Pubmed] | [DOI]|