Critical Insights Into the Design of Big Data Analytics Research: How Twitter "Moods" Predict Stock Exchange Index Movement
Keywords:
twitter moods, predict, stock exchange index movement, big data analytics, Africa and developing countriesAbstract
The research explored whether one or more of the South African Twitter moods could be used to predict the movement of the Johannesburg Stock Exchange (JSE) All Share Index (ALSI). This is a proof of principle study in the field of big data analytic research in South Africa, which is at a relatively early stage of development. The research methods used secondary data from Twitter’s application programming interfaces (APIs), and formulated a model to extract public mood data and search for a causal effect of the mood on the closing values of the JSE ALSI. Over three million tweets were gathered and analysed over a 55-day period, with data collected from the JSE for 39 weekdays, from which only one variable (mood states) was considered. Four of the South African Twitter mood states did not produce any correlation with the movement of the JSE ALSI. The mood Depression had a significant negative correlation with the same day’s JSE ALSI values. The major finding was that there was a highly significant positive correlation between the Fatigue mood and the next day’s closing value of the JSE ALSI, and a significant causality correlation from the Fatigue mood to the JSE ALSI values. The findings support the behavioural finance theory (Wang, Lin & Lin, 2012), which states that public mood can influence the stock market. Organisations and governments could use Twitter data to gauge public mood and to ascertain the influence of public mood on particular issues. However, very large data sets are required for analytical purposes, possibly five to ten years of data, without which predictability is likely to be low.
References
Atsalakis, G. S., Dimitrakakis, E. M., & Zopounidis, C. D. (2011). Elliott wave theory and neuro-fuzzy systems, in stock market prediction: The WASP system. Expert Systems with Applications, 38(8), 9196-9206. https://doi.org/10.1016/j.eswa.2011.01.068
Berger, B. G., & Motl, R. W. (2000). Exercise and mood: A selective review and synthesis of research employing the profile of mood states. Journal of Applied Sport Psychology, 12(1), 69-92. https://doi.org/10.1080/10413200008404214
Bhattacharya, U., Daouk, H., Jorgenson, B., & Kehr, C. (2000). When an event is not an event: The curious case of an emerging market. Journal of Financial Economics, 55(1), 69-101. https://doi.org/10.1016/S0304-405X(99)00045-8
Blas, J. (2014, 28 September). London Stock Exchange to pursue African company listings. Financial Times. Available from http://www.ft.com/cms/s/0/2247f5f0-4313-11e4-8a43-00144feabdc0.html#axzz3F4dXyfAv
Bollen, J., Mao, H., & Zeng, X. (2011). Twitter mood predicts the stock market. Journal of Computational Science, 2(1), 1-8. https://doi.org/10.1016/j.jocs.2010.12.007
Brandt, P. T., & Davis, W. R. (2012). MSBVAR: Markov-Switching, Bayesian, vector autoregression models [online]. Available from http://cran.r-project.org/web/packages/MSBVAR/index.html
Brown, J. D. (1997). Skewness and kurtosis [online]. Available from http://www.jalt.org/test/bro_1.htm
Campbell, M. H. (2011). Simple technical trading rules on the JSE Securities Exchange of South Africa, Part 2. Proceedings of the World Congress on Engineering. July 6-8. London, U.K.
Chen, G. M. (2011). Tweet this: A uses and gratifications perspective on how active Twitter use gratifies a need to connect with others. Computers in Human Behaviour, 27(2), 755-762. https://doi.org/10.1016/j.chb.2010.10.023
Clay, R., & Keeton, G. (2011). The South African yield curve as a predictor of economic downturns: An update. African Review of Economics and Finance, 2(2), 167-193.
Culnan, M. J., Mchugh, P. J., & Zubillaga, J. I. (2010). How large U.S. companies can use Twitter and other social media to gain business value. MIS Quarterly Executive, 9(4), 243-260.
Dimpfl, T. (2011). The impact of US news on the German stock market - An event study analysis. Quarterly Review of Economics and Finance, 51(4), 389-398. https://doi.org/10.1016/j.qref.2011.07.005
Edmans, A., Garcia, D., & Norli, O. (2007). Sports sentiment and stock returns. Journal of Finance 62(4), 1967-1998. https://doi.org/10.1111/j.1540-6261.2007.01262.x
Eita, J. H. (2012). Inflation and stock market returns in South Africa. International Business & Economics Research Journal, 11(6), 677-686. https://doi.org/10.19030/iber.v11i6.7020
Ellis, C., & Faricy, C. (2011). Social policy and public opinion: How the ideological direction of spending influences public mood. The Journal of Politics, 73, 1095-1110. https://doi.org/10.1017/S0022381611000806
Forgha, N.G. (2012). An investigation into the volatility and stock returns efficiency in African stock exchange markets. International Review of Business Research Papers, 8(5), 176-190.
Fischer, E. (2011). Language communities of Twitter [online]. Available from http://www.flickr.com/photos/walkingsf/6277163176/in/photostream#
GET statuses/sample [online]. (2012). Available from https://dev.twitter.com/docs/api/1/get/statuses/sample
GET statuses/show/:id [online](2012). Available from https://dev.twitter.com/docs/api/1/get/statuses/show/%3Aid
Golbeck, J., Grimes, J.M., & Rogers, A. (2010). Twitter use by the US. Congress. Journal of the American Society for Information Science and Technology, 61(8), 1612-1621. https://doi.org/10.1002/asi.21344
Hakhverdian, A. (2012). The causal flow between public opinion and policy: Government responsiveness, leadership, or counter movement? West European Politics, 35 (6), 1386-1406. https://doi.org/10.1080/01402382.2012.713751
Hart, M. L., & Webber, R. (2005). The shareholder-wealth effects of information technology infrastructure investments in South Africa. Investment Analysts Journal, 62, 42-53. https://doi.org/10.1080/10293523.2005.11082472
Hart, M. L. (2006). Using event study methodology to assess financial impact of media announcements on companies. In D. Remenyi (Ed.): Proceedings of the 5th European Conference on Research Methods in Business and Management. Dublin, Ireland: Trinity College, 161-169.
Hothorn, T., Zeileis, A., Millo, G., & Mitchell, D. (2012). lmtest: Testing linear regression models [online]. Available from http://cran.r-project.org/web/packages/lmtest/index.html
Johnston, C. D., & Newman, B. J. (2014). Economic inequality and U.S. public policy mood across space and time (February 22, 2014). Available from Social Science Research Network http://dx.doi.org/10.2139/ssrn.2399927
JSE. (2015). Data from the Johannesburg Stock Exchange [JSE]. Available from https://www.jse.co.za
Kahn, M., Higgs, R., Davidson, J., & Jones, S. (2014). Research data management in South Africa: How we shape up. Australian Academic & Research Libraries, 45(4), 296-308. https://doi.org/10.1080/00048623.2014.951910
Keller, G. (2012). Managerial statistics. 9th ed. China: South-Western.
Khan, M. J. (2011). The BRICS and South Africa as the gateway to Africa. The Journal of the Southern African Institute of Mining and Metallurgy, 111(7), 493-496.
Lee, A.S., & Baskerville, R.L. (2003). Generalizing generalizability in information systems research. Information Systems Research, 14(3), 221-243. https://doi.org/10.1287/isre.14.3.221.16560
Li, Q., Wang, T., Li, P., Liu, L., Gong, Q., & Chen, Y. (2014). The effect of news and public mood on stock movements. Information Sciences, 278, 826-840. https://doi.org/10.1016/j.ins.2014.03.096
Malkiel, B. G. (2003). The efficient market hypothesis and its critics. Journal of Economic Perspective, 17(1), 59-82. https://doi.org/10.1257/089533003321164958
Malkiel, B. G. (2005). Reflections on the efficient market hypothesis: 30 years later. The Financial Review, 40(1), 1-9. https://doi.org/10.1111/j.0732-8516.2005.00090.x
McNair, D. M., Lorr, M. & Droppleman, L. E. (1971). Manual for the profile of mood states (POMS). San Diego, CA: Educational and Industrial Testing Service.
Mwakikagile, G. 2010. South Africa as a multi-ethnic society. United Kingdom: Continental Press. Partner providers of Twitter data [online]. Available from https://dev.twitter.com/docs/twitter-data-providers
O'Hara, M. (2003). Presidential address: Liquidity and price discovery. The Journal of Finance, 58(4), 1335-1354. https://doi.org/10.1111/1540-6261.00569
Pepe, A., & Bollen, J. (2008). Between conjecture and memento: Shaping a collective emotional perception of the future. Proceedings of the Association for the Advancement of Artificial Intelligence Spring Symposium on Emotion, Personality, and Social Behavior. March 26-28, Palo Alto, California.
Remenyi, D., Williams, B., Money, A., & Swartz, E. (1998). Doing research in business and management: An introduction to process and method. London: Sage. https://doi.org/10.4135/9781446280416
Rios, M., & Lin, J. (2012). Distilling massive amounts of data into simple visualizations: Twitter case studies. Proceedings of the Association for the Advancement of Artificial Intelligence Conference on Weblogs and Social Media, June 4-7, Dublin, Ireland.
Salkind, N. J. (2004). Statistics for people who think they hate statistics. Thousand Oaks, USA: Sage.
Saunders, M., Lewis, P., & Thornhill, A. (2009). Research methods for business students. Harlow: Prentice Hall.
Schumaker, R. P., & Chen, H. (2009). Textual analysis of stock market prediction using breaking financial news: The AZFinText system. ACM Transactions on Information Systems, 27(2), 12:1-12:19. https://doi.org/10.1145/1462198.1462204
Seth, A. K. (2010). A MATLAB toolbox for Granger causal connectivity analysis. Journal of Neuroscience Methods, 186(2010), 262-273. https://doi.org/10.1016/j.jneumeth.2009.11.020
StatsSA. (2014, 31 July). Statistical release P0302: Mid-year population estimates 2014. Pretoria: South Africa: Author.
StatsSA. (2015, 24 February). Statistical release P0441: Gross domestic product, Fourth quarter 2014. Pretoria, South Africa: Author.
Stolarski, M., Matthews, G., Postek, S., Zimbardo, P.G. & Bitner, J. (2014). How we feel is a matter of time: Relationships between time perspectives and mood. Journal of Happiness Studies, 15(4), 809-827.
https://doi.org/10.1007/s10902-013-9450-y
Subrahmanyam, A. (2007). Behavioural finance: A review and synthesis. European Financial Management, 14(1), 12-29. https://doi.org/10.1111/j.1468-036X.2007.00415.x
Sugimoto, K., Matsuki, T., & Yoshida, Y. (2013). The spillover analysis on the African stock markets in the crises period. Available from http://www.apeaweb.orgwww.apeaweb.org/confer/osaka13/papers/Sugimoto_Kimiko.pdf
Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach's alpha. International Journal of Medical Education, 2, 53-55. Twitter Translation Center [online]. Available from http://translate.twttr.com/welcome
https://doi.org/10.5116/ijme.4dfb.8dfd
Vermeulen, J. (2012). Biggest social networks in South Africa [online]. Available from http://mybroadband.co.za/news/internet/44061-biggest-social-networks-in-south-africa.html
Wang, Y., Lin, C., & Lin, J. (2012). Does weather impact the stock market? Empirical evidence in Taiwan. Quality & Quantity, 46(2), 695-703. https://doi.org/10.1007/s11135-010-9422-9
World Stock Exchanges. (2014). Stock exchanges in Africa. Available from http://www.world-stock-exchanges.net/africa.html
WordNet [online]. Available from http://wordnet.princeton.edu/
Zhang, Y., & Wu, L. (2009). Stock market prediction of S&P 500 via combination of improved BCO approach and BP neural network. Expert Systems with Application, 36(5), 8849-8854. https://doi.org/10.1016/j.eswa.2008.11.028
Downloads
Published
Issue
Section
License
Copyright (c) 2015 https://creativecommons.org/licenses/by/4.0
This work is licensed under a Creative Commons Attribution 4.0 International License.
How to Cite
- Abstract 285
- pdf 141
.png){kind=spacer}