DIGITAL LIBRARY ARCHIVE
HOME > DIGITAL LIBRARY ARCHIVE
< Previous   List   Next >  
Construction of Consumer Confidence index based on Sentiment analysis using News articles
Full-text Download
Song Minchae (Big Data Analytics, Ewha Womans University)
Shin Kyung-shik (School of Business, Ewha Womans University)
Vol. 23, No. 3, Page: 1 ~ 27
10.13088/jiis.2017.23.3.001
Keywords
Sentiment analysis, Unstructured data, Economic sentiment index, Consumer sentiment index,
Economic trends and outlook
Abstract
It is known that the economic sentiment index and macroeconomic indicators are closely related because economic agent’s judgment and forecast of the business conditions affect economic fluctuations.For this reason, consumer sentiment or confidence provides steady fodder for business and is treated as an important piece of economic information. In Korea, private consumption accounts and consumer sentiment index highly relevant for both, which is a very important economic indicator for evaluating and forecasting the domestic economic situation. However, despite offering relevant insights into private consumption and GDP, the traditional approach to measuring the consumer confidence based on the survey has several limits. One possible weakness is that it takes considerable time to research, collect, and aggregate the data. If certain urgent issues arise, timely information will not be announced until the end of each month. In addition, the survey only contains information derived from questionnaire items, which means it can be difficult to catch up to the direct effects of newly arising issues. The survey also faces potential declines in response rates and erroneous responses. Therefore, it is necessary to find a way to complement it.
For this purpose, we construct and assess an index designed to measure consumer economic sentiment index using sentiment analysis. Unlike the survey-based measures, our index relies on textual analysis to extract sentiment from economic and financial news articles. In particular, text data such as news articles and SNS are timely and cover a wide range of issues; because such sources can quickly capture the economic impact of specific economic issues, they have great potential as economic indicators.
There exist two main approaches to the automatic extraction of sentiment from a text, we apply the lexicon-based approach, using sentiment lexicon dictionaries of words annotated with the semantic orientations. In creating the sentiment lexicon dictionaries, we enter the semantic orientation of individual words manually, though we do not attempt a full linguistic analysis (one that involves analysis of word senses or argument structure); this is the limitation of our research and further work in that direction remains possible.
In this study, we generate a time series index of economic sentiment in the news. The construction of the index consists of three broad steps: (1) Collecting a large corpus of economic news articles on the web, (2) Applying lexicon-based methods for sentiment analysis of each article to score the article in terms of sentiment orientation (positive, negative and neutral), and (3) Constructing an economic sentiment index of consumers by aggregating monthly time series for each sentiment word.
In line with existing scholarly assessments of the relationship between the consumer confidence index and macroeconomic indicators, any new index should be assessed for its usefulness. We examine the new index’s usefulness by comparing other economic indicators to the CSI. To check the usefulness of the newly index based on sentiment analysis, trend and cross - correlation analysis are carried out to analyze the relations and lagged structure. Finally, we analyze the forecasting power using the one step ahead of out of sample prediction. As a result, the news sentiment index correlates strongly with related contemporaneous key indicators in almost all experiments. We also find that news sentiment shocks predict future economic activity in most cases. In almost all experiments, the news sentiment index strongly correlates with related contemporaneous key indicators. Furthermore, in most cases, news sentiment shocks predict future economic activity; in head-to-head comparisons, the news sentiment measures outperform survey-based sentiment index as CSI.
Policy makers want to understand consumer or public opinions about existing or proposed policies. Such opinions enable relevant government decision-makers to respond quickly to monitor various web media, SNS, or news articles. Textual data, such as news articles and social networks (Twitter, Facebook and blogs) are generated at high-speeds and cover a wide range of issues; because such sources can quickly capture the economic impact of specific economic issues, they have great potential as economic indicators. Although research using unstructured data in economic analysis is in its early stages, but the utilization of data is expected to greatly increase once its usefulness is confirmed.
Show/Hide Detailed Information in Korean
뉴스기사를 이용한 소비자의 경기심리지수 생성
송민채 (이화여자대학교 빅데이터분석학)
신경식 (이화여자대학교 경영대학)
Keywords
감성 분석, 비정형데이터, 경기심리지수, 소비자동향조사, 경제동향 및 전망
Abstract
경제주체들의 경기상황에 대한 판단 및 전망은 경기변동에 영향을 미치므로 경기심리지수와 거시경제지표들간에는 밀접한 관련성을 나타내는 것으로 알려져 있다. 경기선행지표로 국내에서 많이 사용되는 경기심리지수에는 소비자동향조사, 기업경기조사, 경제심리지수가 있다. 그러나 설문조사를 통해 생성된 지수는 자료의 성격상 속보성이 떨어지는 문제가 있다. 본 연구에서는 이러한 정형데이터의 한계를 보완할 수 있도록 비정형데이터에서 정보를 추출해 경기심리지수를 생성하고, 경제분석에서의 활용 가능성을 검토하였다. 민간소비와 관련된 실물지표에는 소매판매업지수와 서비스업생산지수를 사용하였고, 고용지표에는 고용률과 실업률을, 가격지표에는 소비자물가상승률과 가계의 대출금리를 사용하여 지표들 간의 추이 분석 및 시차구조 파악을 위한 교차상관분석을 수행하였다. 마지막으로 이들 지표들에 대한 예측 가능성을 점검하였다. 분석결과, 다른 지표들의선행지수로 많이 사용되는 소비자심리지수와 비교해 선택 지표들과 높은 상관관계를 보이며, 1~2개월 선행한것으로 나타났다. 예측력 또한 향상되어 텍스트데이터에서 생성한 소비자 경기심리지수의 유용성이 확인되었다. 온라인에서 생성되는 뉴스기사나 소셜 SNS 등의 텍스트 데이터는 속보성이 뛰어나고, 커버리지가 넓어 특정 경제적 이슈가 발생할 경우 이것이 경제에 미치는 영향을 빠르게 파악할 수 있다는 점에서 경기판단지표로써의 잠재적 가능성이 클 것으로 보인다. 경제분석에서 비정형데이터를 활용한 국내연구는 초기 단계지만 데이터의 유용성이 확인되면 그 활용도가 크게 높아질 것으로 기대한다.
Cite this article
JIIS Style
Minchae, S., and S. Kyung-shik, "Construction of Consumer Confidence index based on Sentiment analysis using News articles", Journal of Intelligence and Information Systems, Vol. 23, No. 3 (2017), 1~27.

IEEE Style
Song Minchae, and Shin Kyung-shik, "Construction of Consumer Confidence index based on Sentiment analysis using News articles", Journal of Intelligence and Information Systems, vol. 23, no. 3, pp. 1~27, 2017.

ACM Style
Minchae, S., and Kyung-shik, S., 2017. Construction of Consumer Confidence index based on Sentiment analysis using News articles. Journal of Intelligence and Information Systems. 23, 3, 1--27.
Export Formats : BiBTeX, EndNote

Warning: include(/home/hosting_users/ev_jiisonline/www/admin/archive/advancedSearch.php) [function.include]: failed to open stream: No such file or directory in /home/hosting_users/ev_jiisonline/www/archive/detail.php on line 429

Warning: include() [function.include]: Failed opening '/home/hosting_users/ev_jiisonline/www/admin/archive/advancedSearch.php' for inclusion (include_path='.:/usr/local/php/lib/php') in /home/hosting_users/ev_jiisonline/www/archive/detail.php on line 429
@article{Minchae:JIIS:2017:695,
author = {Minchae, Song and Kyung-shik, Shin},
title = {Construction of Consumer Confidence index based on Sentiment analysis using News articles},
journal = {Journal of Intelligence and Information Systems},
issue_date = {September 2017},
volume = {23},
number = {3},
month = Sep,
year = {2017},
issn = {2288-4866},
pages = {1--27},
url = {http://dx.doi.org/10.13088/jiis.2017.23.3.001 },
doi = {10.13088/jiis.2017.23.3.001},
publisher = {Korea Intelligent Information System Society},
address = {Seoul, Republic of Korea},
keywords = { Sentiment analysis, Unstructured data, Economic sentiment index and Consumer sentiment index,
Economic trends and outlook },
}
%0 Journal Article
%1 695
%A Song Minchae
%A Shin Kyung-shik
%T Construction of Consumer Confidence index based on Sentiment analysis using News articles
%J Journal of Intelligence and Information Systems
%@ 2288-4866
%V 23
%N 3
%P 1-27
%D 2017
%R 10.13088/jiis.2017.23.3.001
%I Korea Intelligent Information System Society