- Research article
- Open access
- Published:
Validation of general job satisfaction in the Korean Labor and Income Panel Study
Annals of Occupational and Environmental Medicine volume 29, Article number: 10 (2017)
Abstract
Background
The purpose of this study is to assess the validity and reliability of general job satisfaction (JS) in the Korean Labor and Income Panel Study (KLIPS).
Methods
We used the data from the 17th wave (2014) of the nationwide KLIPS, which selected a representative panel sample of Korean households and individuals aged 15 or older residing in urban areas. We included in this study 7679 employed subjects (4529 males and 3150 females). The general JS instrument consisted of five items rated on a scale from 1 (strongly disagree) to 5 (strongly agree). The general JS reliability was assessed using the corrected item-total correlation and Cronbach’s alpha coefficient. The validity of general JS was assessed using confirmatory factor analysis (CFA) and Pearson’s correlation.
Results
The corrected item-total correlations ranged from 0.736 to 0.837. Therefore, no items were removed. Cronbach’s alpha for general JS was 0.925, indicating excellent internal consistency. The CFA of the general JS model showed a good fit. Pearson’s correlation coefficients for convergent validity showed moderate or strong correlations.
Conclusion
The results obtained in our study confirm the validity and reliability of general JS.
Background
Job satisfaction is one of the most important factors in the general quality of life, because it is connected closely with working life [1]. There are many definitions of Job Satisfaction (JS), so there are many assessment tools for it. These tools have usually been divided into two types of scale: specific and general scales. General scales are used to estimate the respondent’s general overall feelings about the job. These feelings are expected to predict important behavior, such as quitting or being absent [2].
Since 2002, the nationwide Korean Labor and Income Panel Study (KLIPS) has been conducted annually to collect information on general JS.). The questionnaire of general JS was formulated by specialists based on the Job Satisfaction Index [3]. It consisted of five items rated on a scale from 1 (strongly disagree) to 5 (strongly agree). The general JS of KLIPS has usually been analyzed to provide statistical data for labor policies, but it has not been validated. Validity and reliability are the two fundamental elements in evaluation of a measurement instrument [4].
We investigated the validity and reliability of general JS in the Korean Labor and Income Panel Study (KLIPS).
Methods
The reliability of the general JS scale was assessed using the corrected item-total correlation and Cronbach’s alpha coefficient. The validity was assessed using confirmatory factor analysis (CFA) and Pearson’s correlation coefficients.
Data
This study used the data from the 17th wave (2014) of the nationwide Korean Labor and Income Panel Study (KLIPS), which selected a representative panel sample of Korean households and individuals aged 15 or older residing in urban areas. The first survey was launched in 1998, and data have been collected yearly since then. The general JS data have been collected yearly since 2002. The survey was conducted using interviews by trained staff. For the purpose of this study, we selected those subjects having jobs (n = 7679).
The survey was conducted by the Korean Labor Institution and was approved by the ethical review board of Statistics Korea. A written informed consent form was obtained from each subject.
Instrument of general JS
The questionnaire of general JS consisted of five items rated on a scale from 1 (strongly disagree) to 5 (strongly agree). It was formulated by specialists based on the Job Satisfaction Index [3]. The framing question is: “What do you think of your current job? Answer by indicating the extent to which you agree or disagree with each item.”
The five items are:
-
“I am satisfied with my current job” (item1),
-
“I am enthusiastic about my current job” (item2),
-
“I enjoy my current job” (item3),
-
“I’m feeling rewarded by my current job” (item4),
-
“I want to keep my current job unless there is a good reason for changing” (item5).
Reliability
The reliability of the general JS scale was assessed using the corrected item-total correlation and Cronbach’s alpha coefficient.
We used the corrected item-total correlation to identify the items that were less reliable and to remove them from the general JS scale. Presumably, a low corrected item-total correlation means that a specific item is less associated with the overall scale and would have lower overall reliability [5]. A correlation coefficient of 0.40 or higher was used as a cut-off for identifying the candidate items [6].
Cronbach’s alpha is the most widely used objective measure of reliability. A threshold of 0.7 was considered acceptable, a value >0.8 good, and a value >0.9 to indicate excellent internal consistency [7].
Validity
Construct validity refers to the extent to which a test measures the construct it is supposed to measure [8]. A commonly used method to investigate construct validity is confirmatory factor analysis (CFA) [9, 10]. CFA is used when researchers have prior knowledge of latent (underlying) variables and seek to confirm factors that they have found [11].
Since our general JS includes only one theoretical construct, CFA was conducted in order to test whether the one factor model construct was confirmed in this sample.
Several fit indices were selected for the CFA model, including the Root mean Square Error of Approximation (RMSEA), the Comparative Fit Index (CFI) and the Tucker-Lewis Index (TLI). Since the overall χ2 fit index is greatly influenced by the sample size, tending to over-reject models with a large sample size, this index was not used when drawing conclusions [12]. For CFI and TLI, a threshold value > 0.9 was considered a good fit [13].
For the RMSEA, on the other hand, a value <0.06 was considered as a good fit, a value <0.08 was considered as an acceptable fit and a value >0.1 led to rejection of the model [14].
Convergent validity was used to assess the construct validity. The convergent validity was evaluated with the Pearson’s correlation coefficients for the theoretically correlated construct (one item general JS). The following question was used to assess the one item JS: “Overall, how satisfied are you with your present job?” The answer is assessed using a 5-point Likert scale that ranged from 1 (very dissatisfied) to 5 (very satisfied). Correlations <0.3 were considered negligible, a value between 0.3 and 0.5 as moderate and a value >0.5 as strong [15].
Statistical analysis
All analyses were performed with SPSS (IBM Corp. Released 2010. IBM SPSS Statistics for Windows, Version 19.0. Armonk, NY: IBM Corp.).
The reliability of the general JS was assessed using the corrected item-total correlation and Cronbach’s alpha coefficient.
We examined validity of the general JS using CFA and Pearson’s correlations. We evaluated the Pearson’s correlations of our scale (five-items) with a one item scale for convergent validity.
We used multiple goodness of fit tests to test the one factor model, including the Root Mean Square Error of Approximation (RMSEA), the Comparative Fit Index (CFI) and the Tucker-Lewis Index (TLI). We used AMOS17 for CFA.
Results
Subject characteristics are presented in Table 1. The total number of subjects is 7679 (male 59%, female 41%). The age group is the most frequent in the forties (26.1%). The occupation is the most frequent in the professionals (19.2%) (Table 1).
The corrected item-total correlations ranged from 0.736 to 0.837. Therefore, no items were removed. The Cronbach’s alpha for general JS equals 0.925, indicating excellent internal consistency of the measure (Table 2).
The CFA of the general JS model showed good construct validity, with the observed data fitting well with the theoretical model. The CFI, TLI and RMSEA (0.995, 0.990 and 0.063, respectively), indicated a good fit (Table 3).
The Pearson’s correlation of the five-item scale with the one-item scale of JS ranged from 0.477 to 0.607, indicating moderate or strong correlations of the measure (Table 4).
Discussion
This study is the first to investigate the reliability and validity of the general JS in KLIPS. There are many definitions of general JS. Locke suggested that general JS is the pleasant sentiment derived from the perception (cognition) that the professional activity performed allows one’s personal needs and values linked to the job (behavior) to be satisfied and one’s goals to be achieved [16]. According to Spector, the general JS is the way people “feel” about their job and the aspects characterizing it [17].
The general scales of JS ask the respondent to combine his or her reactions to various aspects of the job into a single integrated response. They assume that some sort of processing takes place and ask for its end product. During this process, the respondent may incorporate other aspects not measured in the facet scales or items [2].
There are various instruments to assess general JS: the job satisfaction index (18 items) of Brayfield and Rothe (1951), Minnesota Satisfaction questionnaire (20 items) of Weiss, Dawis, Engl, and Lofquist (1967), the overall measure (five-items) of Hackman and Oldham (1975), the Facet-free Job Satisfaction (five-items) of Quinn and Staines (1979), the Michigan Organizational Assessment Questionnaire (MOAQ) (3 items) of Cammann, Fichman, Jenkins, and Klesh (1979), Job in General (JIG) (18 items) of Ironson et al. [4, 17].
Although they can be classified differently according to the researchers, criterion validity was usually used when a gold standard is available. Content validity and construct validity were usually used when a gold standard is lacking, as in the case of our study [18].
Content validity is a qualitative type of validity, where the domain of the concept is made clear and the analyst judges whether the measures fully represent the domain [19]. Because there is no statistical test to determine whether a measure adequately covers a content area or adequately represents a construct, the content validity usually depends on the judgment of experts in the field [20]. The items of general JS in this study were formulated by experts by considering the Korean situation based on the Job Satisfaction Index [4].
Construct validity forms an essential part of evaluating validity. Our study used CFA and Pearson’s correlation to assess the construct validity. The fit indices of the one factor model showed a good fit in the CFA of our study.
Two types of assessment of general JS have been conducted annually in KLIPS, the five-item scale and one item scale. The Pearson’s correlation of the five-item scale with the one item scale were used to assess the convergent validity. The result showed moderate or strong correlations.
The main procedures for estimating internal consistency among a number of different questions that are supposed to reflect the same concept are the corrected item-total correlation and alpha reliability coefficients [6]. The corrected item-total correlation was used to identify the items that had less reliable signs and to remove them from the general JS scale. The correlations are all >0.4 in our study, so no items were removed.
The most common method of testing internal consistency is the coefficient alpha [21]. The coefficient alpha is useful for estimating the reliability of the item-specific variance in a unidimensional test [22]. The Cronbach’s alpha of 0.925 obtained in our study showed excellent internal consistency. The occupations held by participants in this study are broadly diverse (Table 1). Therefore, this participant pool may be representative of the general population having jobs in Korea.
The description of the qualitative study conducted in the process of making the questionnaires was insufficient, because no validation was conducted when the instrument of general JS was developed for the first time. Although this study provided various validation processes of general JS, other forms of reliability and validity tests could be required to strengthen its applicability in other populations.
Conclusion
The results observed in our study confirm the validity and reliability of the general JS.
Abbreviations
- CFA:
-
Confirmatory factor analysis
- JS:
-
Job Satisfaction
- KLIPS:
-
Korean Labor and Income Panel Study
References
Bang H, Lee S. The Definition of ‘Good Job’ and Determinant. Korean Sociol. 2006;1:93–126 (in Korean).
Ironson GH, Smith PC, Brannick MT, Gibson WM, Paul KB. Construction of a job in general scale: A comparison of global, composite, and specific measures. J Appl Psychol. 1989;74:193–200.
Cook JD, Hepworth SJ, Wall TD, Warr PB. Experience of work: A compendium and review of 249 measures and their use. New York: Academic; 1981.
Tavakol M, Dennick R. Making sense of Cronbach’s alpha. Int J Med Educ. 2011;2:53–5.
Cox EO, Green KE, Seo H, Inaba M, Quillen AA. Coping with late-life challenges: Development and validation of the care-receiver efficacy scale. The Gerontologist. 2006;46:640–9.
Aday LA, Cornelius LJ. Designing and conducting health surveys: a comprehensive guide. John Wiley & Sons; 2006.
Nunnally JC, Bernstein IH. Psychometric theory. 3rd ed. New York: McGraw-Hill; 1994.
Cohen R, Swerdlik M, Philips S. Psychological testing and assessment. An introduction to tests and measurements. 3rd ed. California: Mayfield Publishing Company; 1996.
Boelen PA, van den Hout MA, van den Bout J. The factor structure of posttraumatic stress disorder symptoms among bereaved individuals: a confirmatory factor analysis study. J Anxiety Disord. 2008;22:1377–83.
Fournier-Vicente S, Larigauderie P, Gaonac’h D. More dissociations and interaction with central executive functioning: a comprehensive latent-variable analysis. Acta Psychol. 2008;129:32–48.
Tavakol S, Dennick R, Tavakol M. Psychometric properties and confirmatory factor analysis of the Jefferson Scale of Physician Empathy. BMC Med Educ. 2011;11:1–8.
Hu L, Bentler P. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Model. 1999;6:1–55.
Bentler P, Bonett D. Significance tests and goodness of fit in the analysis of covariance structures. Psychol Bull. 1980;88:588–606.
Brown M, Cudeck R. Alternative ways of assessing model fit. Sociol Methods Res. 1992;21:230–58.
Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale: L. Erlbaum Associates; 1988.
Locke EA. What is job satisfaction? Organ Behav Hum Perform. 1969;4:309–36.
Spector PE. Job satisfaction. Application assessment, causes and consequences, Advanced topics in organizational behavior, vol. 3. Thousand Oaks: Sage Publications; 1997.
Guyatt GH, Jaeschke R, Feeny DH, Patrick DL. Measurement in Clinical Trials: Choosing the Right Approach. In: Spilker B, editor. Quality of life and pharmacoeconomics in clinical trials. 2nd ed. Philadelphia, New York: Lippincott-Raven; 1996. p. 41–8.
Bollen KA. Structural Equations with Latent Variables. Wiley; 1989.
Kimberlin CL, Winterstein AG. Validity and reliability of measurement instruments used in research. Am J Health Syst Pharm. 2008;65:2276–84.
Drost EA. Validity and reliability in social science research. Educ Res Perspect. 2011;38:105–23.
Cortina JM. What is coefficient alpha? An examination of theory and applications. J Appl Psychol. 1993;78:98–104.
Acknowledgement
All authors including myself have seen and approved manuscript.
Funding
Not applicable.
Availability of data and materials
The authors obtained the data set from the website for the KLIPS at the Korea Labor Institute which is: http://www.kli.re.kr/klips/en/about/introduce.jsp
Authors’ contributions
SGP designed the study and analyzed the data. SHH participated in its design and wrote the first draft of the manuscript. SGP and SHH revised the draft paper. Both authors read and approved the final manuscript.
Competing interests
The authors declare that they have no competing interests.
Consent for publication
Not applicable.
Ethics approval and consent to participate
The survey was conducted by the Korean Labor Institution and was approved by the ethical review board of Statistics Korea. A written informed consent form was obtained from each subject.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Park, S.G., Hwang, S.H. Validation of general job satisfaction in the Korean Labor and Income Panel Study. Ann of Occup and Environ Med 29, 10 (2017). https://doi.org/10.1186/s40557-017-0167-y
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s40557-017-0167-y