Exploring the Job Competencies of Data Scientists Using Online Job Posting

Xiangdan Jin, Seung Ik Baek


As the global business environment is rapidly changing due to the 4th industrial revolution, new jobs that did not exist before are emerging. Among them, the job that companies are most interested in is ‘Data Scientist’. As information and communication technologies take up most of our lives, data on not only online activities but also offline activities are stored in computers every hour to generate big data. Companies put a lot of effort into discovering new opportunities from such big data. The new job that emerged along with the efforts of these companies is data scientist. The demand for data scientist,  a promising job that leads the big data era, is constantly increasing, but its supply is not still enough. Although data analysis technologies and tools that anyone can easily use are introduced, companies still have great difficulty in finding proper experts. One of the main reasons that makes the data scientist’s shortage problem serious is the lack of understanding of the data scientist’s job. Therefore, in this study, we explore the job competencies of a data scientist by qualitatively analyzing the actual job posting information of the company. This study finds that data scientists need not only the technical and system skills required of software engineers and system analysts in the past, but also business-related and interpersonal skills required of business consultants and project managers. The results of this study are expected to provide basic guidelines to people who are interested in the data scientist profession and to companies that want to hire data scientists.


Full Text:



Boyatzis, R.E., The competent manager: A model for effective performance, New York: Wiley, 1982.

Chen, C. and Jiang, H., “Important skills for data scientists in china: two delphi studie,” Journal of Computer Information Systems, Vol. 60, No. 3, pp. 287-296, 2018.

Cho, W.S., “Big Data Era, Data Scientist Training Plan,” Science and Technology Policy, Vol. 192, pp. 44-55, 2013.

Cho, W.S., “Big Data Utilization and Data Scientist,” Communications of the Korean Institute of Information Scientists and Engineers, Vol. 32, No. 1, pp. 59-65, 2014.

Davenport, T.H. and Patil, D.J., “Data scientist,” Harvard business review, Vol. 90, No. 5, pp. 70-76, 2012.

DeAngelis, J.T. and Wolcott, M.D., “A job analysis to define the role of the pharmacy preceptor,” American journal of pharmaceutical education, Vol. 83, No. 7, pp. 1480-1491, 2019.

Dhar, V., “Data science and prediction,” Communications of the ACM, Vol. 56, No. 12, pp. 64-73, 2013.

Ecleo, J.J. and Galido, A., “Surveying LinkedIn profiles of data scientists: The case of the Philippines,” Procedia Computer Science, Vol. 124, pp. 53-60, 2017.

Gardiner, A., Aasheim, C., Rutner, P., and Williams, S., “Skill requirements in big data: A content analysis of job advertisements,” Journal of Computer Information Systems, Vol. 58, No. 4, pp. 374-384, 2018.

Gehl, R.W., “Sharing, knowledge management and big data: A partial genealogy of the data scientist,” European journal of cultural studies, Vol. 18, No. 4-5, pp. 413-428, 2015.

Hattingh, M., Marshall, L., Holmner, M., and Naidoo, R., “Data Science Competency in Organisations: A Systematic Review and Unified Model,” Proceedings of the South African Institute of Computer Scientists and Information Technologists, pp. 1-8, 2019.

Ho, S.Y. and Frampton, K., “A competency model for the information technology workforce: Implications for training and selection,” Communications of the Association for Information Systems, Vol. 27, No. 1, pp. 1-21, 2010.

Hu, H., Luo, Y., Wen, Y., Ong, Y. S., and Zhang, X., “How to find a perfect data scientist: A distance-metric learning approach,” IEEE Access, Vol. 6, pp. 60380-60395, 2018.

Kart, L. and Laney, D., “Emerging Role of the Data Scientist and the Art of Data Science,” March, Gartner Research, https://www.gartner.com/en/documents/1955615/emerging-role-of-the-data-scientist-and-the-art-of-data-, 2012.

Landau, K. and Rohmert, W. (Eds.), Recent developments in job analysis, Taylor & Francis, 2017.

Landy, E.J. and Vasey, J., “Job analysis: The Composition of SME Samples,” Personnel Psychology, Vol. 44, pp. 27–50, 1991.

LaValle, S., Lesser, E., Shockley, R., Hopkins, M.S., and Kruschwitz, N., “Big data, analytics and the path from insights to value,” Sloan Management Review, Vol. 52, No. 2, pp. 21-32, 2011.

Kim, J.Y. and Lee, C.K., “An empirical analysis of requirements for data scientists using online job postings,” International Journal of Software Engineering and Its Applications, Vol. 10, No. 4, pp. 161-172, 2016.

Kim, J.H., “Real estate training course development through job analysis,” Korea Real Estate Academy Review, Vol. 59, pp. 231-245, 2014. (in Korean)

National Information Society Agency, “Human Resources in the Big Data Era, Roles and Possibilities of Data Scientists,” IT & Future Strategy, Vol. 8, http://www.itsa.or.kr/bbs/board.php?bo_table=mmmmm1&wr_id=357&page=2&ckattempt=1, 2012. (in Korean).

Matei, J., Chui, M., Brown, B., Bughin, J., Dobbs, R., Roxburgh, C., and Hung Byers, A., Big data: The next frontier for innovation, competition, and productivity. McKinsey Global Institute, 2011.

McClelland, D.C., “Testing for competence rather than for intelligence,” American Psychologist, Vol. 28, pp. 1-14, 1973.

McCormick, E.J., “Job and Task Analysis,” In M.D. Dunnette (Ed,), Handbook of Industrial and Organizational Psychology, Chicago: Rand McNally, pp. 651-696, 1976.

Metcalf, M. and Brenza, J., “Evaluating big data projects - success and failure using an integral lens,” Integral Leadership Review, http://integralleadershipreview.com/10945-evaluating-big-data-projects-success-failure-using-integral-lens/, 2013.

Park, C.W., Kim J.W., and Kwon, H.J., “An Empirical Research on Information Privacy Risks and Policy Model in the Big Data Era,” The Journal of Society for e-Business Studies, Vol. 21, No. 1, pp. 131-145, 2016.

Park, J.S. and Han, S.G., “Job Analysis Guidelines for Vocational Education & Training Program Development,” Korea Vocational Competency Development Institute, Working Paper, 2005.

Patil, D.J., Building Data Science Teams. OReilly, 2011.

Pereira, P., Cunha, J., and Fernandes, J.P., “On understanding data scientists,” In 2020 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) (pp. 1-5). IEEE, 2020.

Saif, N., Khan, M.S., Rehman, K., Rehman, S.U., Rehman, Z.U., Nawa, T., & Naqeeb, M., “Competency based Job Analysis,” International Journal of Academic Research in Accounting, Finance and Management Sciences, Vol. 3, No. 1, pp. 105-111, 2013.

Sanchez, J.I. and Levine, E.L., “Is job analysis dead, misunderstood, or both?: New forms of work analysis and design,” Evolving Practices in Human Resource Management, pp. 43-68, 1999.

Sanchez, J.I. and Levine, E.L., “What is (or should be) the difference between competency modeling and traditional job analysis?,” Human resource management review, Vol. 19, No. 2, pp. 53-63, 2009.

Sanchez, J.I. and Levine, E.L., “The Rise and Fall of Job Analysis and the Future of Work Analysis,” Annual Review of Psychology, Vol. 63, pp. 397-425, 2012.

Singh, P., “Job analysis for a changing workplace,” Human Resource Management Review, Vol. 18, No. 2, pp. 87-99, 2008.

Sopa, A., Asbari, M., Purwanto, A., Santoso, P. B., Mustofa, D. H., Maesaroh, S., & Primahendra, R., “Hard skills versus soft skills: which are more important for Indonesian employee’s innovation capability,” International Journal of Control and Automation, Vol. 13, No. 2, pp. 156-175, 2020.

Sullivan, D., Official Google Cloud Certified Professional Data Engineer Study Guide. John Wiley & Sons, 2020.

Swan, A. and Brown, S., “The skills, role and career structure of data scientists and curators: An assessment of current practice and future needs,” Technical Report, University of Southampton, 2008.

Tammaro, A.M., Matusiak, K.K., Sposito, F.A., & Casarosa, V., “Data curators roles and responsibilities: an international perspective,” International Journal of Libraries & Information Services, Vol. 69, No. 2, pp. 89-104, 2019.

Thompson, D.E. & Thompson, T.A., “Court standards for job analysis in test validation,” Personnel Psychology, Vol. 35, No. 4, pp. 865–874, 1982.

Todd, P., McKeen, J.D., & Gallupe, R.B., “The evolution of IS skill: A content analysis of IS job advertisements from 1979 to 1990,” MIS Quarterly, Vol. 19, No. 1, pp. 1-27, 1995.

Verma, A., Yurov, K.M., Lane, P.L., and Yurova, Y.V. (2019), “An investigation of skill requirements for business and data analytics positions: A content analysis of job advertisements,” Journal of Education for Business, Vol. 94, No. 4, pp. 243-250, 2019.

Yoon, J. H., Ahn, J. Y. & Lee, C. C., “A review of the data scientist requirements: based on AHP technique,” Korean Review of Corporation Management, Vol. 12, No. 1, pp. 41-62, 2021.


  • There are currently no refbacks.