Discovering Job Market Trends with Text Analytics

摘要

Due to the current dynamic and competitive nature of job markets especially the IT job market, it has become incumbent for organizations and businesses to stay informed about the current job market trends. Staying current with trends entails collecting and analyzing huge amounts of data which in the past, has always involved a great deal of manual work. In this paper, we present out work on collecting, analyzing and visualizing local job data using text mining techniques. We also discuss technologies used such as: cron jobs for automation; Java for API data collection and web scrapping, Elastic search for data subsetting and keyword analysis, and R for data analysis and visualization. We expect this work to be of relevance to a diverse range of job seekers as well as employers and educational institutions.