Techniques for Stock Market Prediction: A Review
Main Article Content
Abstract
Stock market forecasting has long been viewed as a vital real-life topic in economics world. There are many challenges in stock market prediction systems such as the Efficient Market Hypothesis (EMH), Nonlinearity, complex, diverse datasets, and parameter optimization. A stock's value on the stock market fluctuates due to many factors like previous trends of the stock, the current news, twitter feeds, any online customer feedbacks etc. In this paper, the literature is critically analysed on approaches used for stock market prediction in terms of stock datasets, features used, evaluation metrics used, statistical, machine learning and deep learning techniques along with the directions for the future. The focus of this review is on trend and value prediction for stocks. Overall, 68 research papers have been considered for review from years 1998-2023. From the review, Indian stock market datasets are found to be most frequently used datasets. Evaluation metrics used commonly are accuracy and Mean Absolute Percentage Error. ARIMA is reported as the most used frequently statistical technique for stick market prediction. Long-Short Term Memory and Support Vector Machine are the commonly used algorithms in stock market prediction. The advantages and disadvantages of frequently used evaluation metrics, machine learning, deep learning and statistical approaches are also included in this survey.
Article Details
References
Akhtar, M., Zamani, A., Khan, S., Shatat, A., Dilshad, S., 2022. Stock market prediction based on statistical data using machine learning algorithms. Journal of King Saud University. 34(4), 1-7. doi.org/10.1016/j.jksus.2022.101940.
Aldhyani, T., Alzahrani, A., 2022. Framework for Predicting and Modeling Stock Market Prices Based on Deep Learning Algorithms. MDPI. 11,1-19. Doi:10.3390/electronics11193149.
Ali, M., Alahmari, S., Aldhafiri, Y., Mustaqeem, A., Maqsood, M., Awais, A., 2017. Using machine learning classifiers to predict stock exchange index. International Journal of Machine Learning and Computing. 7(2), 24-29. doi: 10.18178/ijmlc.2017.7.2.614.
Ayodele, A.A., Aderemi, O. A., Ayo, C.K., 2014. Stock price prediction using the ARIMA model. International Conference on computer modelling and simulation. 106-112. doi: 10.1109/UKSim.2014.67.
Ballings, M., Poel, D., Hespeels, N., Gryp, R., 2015. Evaluating multiple classifiers for stock price direction prediction. Expert Systems with Applications. 42 (20), 7046–7056. doi.org/10.1016/j.eswa.2015.05.013.
Banerjee, D., 2014. Forecasting of Indian stock market using time-series ARIMA Model. In: Proceedings of International Conference on business and information management (ICBIM). 131-135. doi.org/10.1109/ICBIM.2014.6970973.
Bansal, M., Goyal, A., Choudhary, A., 2022. Stock market prediction with high accuracy using machine learning techniques. Procedia Computer Science. 247-265.doi.org/10.1016/j.procs.2022.12.028.
Billah, B., King, M.L., Snyder., Koehler, A.B., 2006. Exponential Smoothing Model Selection for Forecasting. International Journal of Forecasting. 22(2), 239-47. doi.org/10.1016/j.ijforecast.2005.08.002.
Biswas, M., Nova, A.J., Mahbub, Md. K., et al., 2021. Stock market prediction: A survey and evaluation. International Conference on Science & Contemporary Technologies (ICSCT). IEEE. 978-1-6654-2132-4/21. doi: 10.1109/ICSCT53883.2021.9642681.
Boyacioglu, M., Avci, D., 2010. An adaptive network-based fuzzy inference system (ANFIS) for the prediction of stock market return: The case of the Istanbul Stock Exchange. Expert Systems with Applications. 37, 7908–7912. doi: 10.1016/j.eswa.2010.04.045.
Cao, H., Tiantian L., Li, Y., Zhang, H., 2019. Stock price pattern prediction based on complex network and machine learning. Hindawi. 1-12.doi.org/10.1155/2019/4132485.
Daradkeh, K., 2022. A hybrid data analytics framework with sentiment convergence and multi-feature fusion for stock trend prediction. MDPI Journal of Electronics. 11, 1-20. doi.org/10.3390/electronics11020250.
Das, S., Behera, R., M., Kumar, Rath, S., 2018. Real-Time sentiment analysis of twitter streaming data for stock prediction. Procedia Computer Science. 132, 956–964. doi: 10.1016/j.procs.2018.05.111.
Dash, R., Dash, P., 2016. A hybrid stock trading framework integrating technical analysis with machine learning techniques. The Journal of Finance and Data Science. 2(1), 42-57. doi.org/10.1016/j.jfds.2016.03.002.
Devi, B. U., Sundar, D., Alli, P., 2013. An Effective Time Series Analysis for Stock Trend Prediction Using Arima Model for Nifty Midcap-50. International Journal of Data Mining & Knowledge Management Process. 3(1), 65-78. doi: 10.5121/ijdkp.2013.3106.
Ding, X., Zhang, Y., Liu, T., Duan, J., 2015. Deep Learning for Event-Driven Stock Prediction. In: Proceedings of International Conference on Artificial Intelligence (IJCAI). pp. 2327-2333.
Dongdong, LV., Yuan, S., Li, M., Xiang, Y., 2019. An empirical study of machine learning algorithms for stock daily trading strategy. Hindawi, Mathematical Problems in Engineering. 1-30. doi.org/10.1155/2019/7816154.
Drashti, T., Miral.P., Bhargesh, P., 2022. Stock Market Prediction Using LSTM Technique. International Journal for Research in Applied Science & Engineering Technology. 10(6),1820-1828. doi.org/10.22214/ijraset.2022.43976.
Eapen, J., Verma, A., Bein, D., 2019. Novel deep learning model with CNN and Bi-Directional LSTM for improved stock market index prediction. In: Proceedings of IEEE Computing and communication workshop and conference. pp. 0264-0270.doi.org/10.1109/CCWC.2019.8666592.
Elbahloul, K., 2019. Stock Market Prediction Using Various Statistical Methods. pp. 1-5. doi.org/10.13140/RG.2.2.13235.17446.
Faria, E. L.D., Albuquerque, M.P., Gonzalez, J. L., Cavalcante, J.T.P., 2009. Predicting the Brazilian Stock Market through Neural Networks and Adaptive Exponential Smoothing Methods. Expert Systems with Applications. 36,12506–9. doi: 10.1016/j.eswa.2009.04.032.
Faustryjak, D., Jackowska-Strumi??o, L., Majchrowicz, M., 2018. Forward forecast of stock prices using LSTM neural networks with statistical analysis of published messages. IEEE International Inter-disciplinary PhD workshop (IIPhDW). pp. 288-292.doi.org/10.1109/IIPHDW.2018.8388375.
Ghosh, P., Neufeld, A., Sahoo, J., 2021. Forecasting directional movements of stock prices for intraday trading using LSTM and random forests. Financial Research Letters. 1-8. doi.org/10.48550/arXiv.2004.10178.
Guo, Z., Wang, H., Liu, Q., Yang, J., 2014. A feature fusion-based forecasting model for financial time series. Journal of Public Library of Science. 9, 1-13. doi: 10.1371/journal.pone.0101113.
Hiransha, M., Gopalakrishnan, E.A., Menon, V.K., Soman K.P., 2018. NSE stock market prediction using deep-learning models. Procedia Computer Science. 132, 1351–1362. doi: 10.1016/j.procs.2018.05.050.
Hossain, M.A., Karim, R., Thulasiram, R., Bruce, N.D.B., Wang, Y., 2018. Hybrid deep learning model for stock price prediction. IEEE Symposium Series on Computational Intelligence (SSCI). pp. 18–21. doi.org/10.1109/SSCI.2018.8628641.
Hu, Y., Liu, K., Zhang, X., Su, L., 2015. Application of evolutionary computation for rule discovery in stock algorithmic trading: A literature review. Applied Soft Computing. 36, 534–51. doi: 10.1016/j.asoc.2015.07.008.
Idrees SM., Alam MA., Agarwal, P., 2019. A prediction approach for stock market volatility based on time series data. IEEE Access. 7, 17287-17298. doi: 10.1109/ACCESS.2019.2895252, IEEE Access.
Iyyappan, M., Sultan, A., Jha, S., Alam, A., Yaseen, M., Abdeljaber, H. (2022). A Novel AI-Based Stock Market Prediction Using Machine Learning Algorithm. Hindawi, 1-11. doi.org/10.1155/2022/4808088.
Jiawei, X. and Murata, T. (2019). Stock market trend prediction with sentiment analysis based on LSTM neural network. In: Proceedings of the International Multiconference of Engineers and Computer Scientists. pp. 1-5.
Khan, W., Ghazanfar, M., Azam, A., Karami, A., (2020). Stock market prediction using machine learning classifiers and social media, news. Journal of Ambient Intelligence and Humanized Computing Springer Nature. 1-24. doi.org/10.1007/s12652-020-01839-w.
Kofi, N.I., Adebayo Felix Adekoya, Benjamin, A. (2020). A comprehensive evaluation of ensemble learning for stock market prediction. Journal of Big Data. 7-20. https://journalofbigdata.springeropen.com/articles/10.1186/s40537-020-00299-5.
Kulshreshtha, S., Vijayalakshmi A. (2020). An ARIMA- LSTM hybrid model for stock market prediction using live data. Journal of Engineering Science and Technology Review. 13(4), 117 – 123. doi:10.25103/jestr.134.11.
Kim. (2003). Financial time series forecasting using support vector machines. Elsevier, Journal of Neurocomputing. 55, 307-319.doi.org/10.1016/S0925-2312(03)00372-2.
Kyungjoo, L., Sehwan, Y., John, J.J. (2007). Neural network model vs. SARIMA model in forecasting Korean stock price index (KOSPI). Issues in Information System. 2, 372-378. doi.org/10.48009/2_iis_2007_372-378.
Merh, N., Saxena, V., Pardasani, K.R. (2010). A comparison between hybrid approaches of ANN and ARIMA for Indian stock trend forecasting. Journal of Business Intelligence. 3(2), 23-43.
Mukherjee, S., Sadhu khan, B., Sarkar, N., Roy, D., De, S. (2021). Stock market prediction using deep learning algorithms. CAAI Trans. Intell. Technol.82–94. doi: 10.1049/cit2.12059.
Nelson, D. M. Q., Pereira A. C. M., de Oliveira R. A. (2017). Stock market's price movement prediction with LSTM neural networks. In: Proceedings of International Joint Conference on Neural Networks (IJCNN). pp. 1419-1426.doi.org/10.1109/IJCNN.2017.7966019.
Nikola, M. (2016). Equity forecast: predicting long term stock price movement using machine learning. Financial Data Analysis and Prediction. 1-5. doi.org/10.48550/arXiv.1603.0075.
Nguyen, T.H., Shirai, K., Velcin, J. (2015). Sentiment analysis on social media for stock movement prediction. Expert Systems with Applications. 42, 9603–9611.doi.org/10.1016/j.eswa.2015.07.052.
Park, C.H., Irwin, S.H. (2007). What Do We Know about the Profitability of Technical Analysis? Journal of Economic Surveys. 21, 786–826. doi: 10.1111/j.1467-6419.2007. 00519.x.
Patel, J., Shah, S., Thakkar, P., Kotecha, K., 2015. Predicting stock market index using fusion of machine learning techniques. Expert Systems with Applications. 42 (4), 2162–72. doi.org/10.1016/j.eswa.2014.10.031.
Persio, L., Honchar, O., 2017. Recurrent neural networks approach to the financial forecast of google assets. International Journal of Mathematics and Computers in Simulation. 11, 7–13.
Pramod, B.S., Mallikarjuna, S. P. M., 2020. Stock Price Prediction Using LSTM. The Mattingley Publishing Co., Inc, 83. 5246-5251.
Rao, P. S., Srinivas, K., Krishna Mohan, A., 2020. A survey on stock market prediction using machine learning techniques. ICDSMLA Springer Nature. 923-931. doi: 10.1007/978-981-15-1420-3_101.
Powell, N., Foo, S.Y., Weatherspoon, M., 2008. Supervised and Unsupervised methods for stock trend forecasting. Symposium on System Theory. pp. 203-205.doi.org/10.1109/SSST.2008.4480220.
Roondiwala, M., Patel, H., Varma, S., 2017. Predicting stock prices using LSTM. International Journal of Science and Research (IJSR). 6(4), 1754–1756.doi.org/10.21275/ART20172755.
Leila Abadi, Amira Khalid, Predictive Maintenance in Renewable Energy Systems using Machine Learning , Machine Learning Applications Conference Proceedings, Vol 3 2023.
Rouf, N., Bashir, M., Tasleem, A., Sharma, S., et al., 2021. Stock market prediction using machine learning techniques: A decade survey on methodologies, recent developments, and future directions. Electronics. 10, 1-25.doi.org/10.3390/electronics10212717.
Sezer, O.B., Ozbayoglu, M., Dogdu, E., 2017. A deep neural-network based stock trading system based on evolutionary optimized technical analysis parameters. Procedia Computer Science. 114, 473–480. doi: 10.1016/j.procs.2017.09.031
Shah, A., Gor, M., Meet, S., Shah, M., 2022. A stock market trading framework based on deep learning architectures. Multimedia Tools and Applications. 81,14153–14171. doi.org/10.1007/s11042-022-12328-x.
Shanthi, D.S., Aarthi, T., Bhuvanesh, A.K., Chooriya Prabha, R.A., 2020. Pattern recognition in stock market. International Journal of Computer Science and Mobile Computing. 106-111.
Sharma, D., Hota, H., Brown, K., Handa, R., 2021. Integration of genetic algorithm with artificial neural network for stock market forecasting. Int. Journal Syst Assur Eng Manag, Springer. 1-14. doi.org/10.1007%2Fs13198-021-01209-5.
Shen, S., Jiang, H., Zhang, T., 2012. Stock market forecasting using machine learning algorithms. Stanford University 1–5.
Stankovi?, J., Markovi?, I., Stojanovi?, M. , 2015. Investment strategy optimization using technical analysis and predictive modelling in emerging markets. Procedia Economics and Finance. 19, 51-62. doi: 10.1016/S2212-5671(15)00007-6.
Taylan, K., Fatih Enes Usta., 2022. Predicting the stock trend using news sentiment analysis and technical indicators in spark. Statistical Finance, Machine Learning. 1-4. doi.org/10.48550/arXiv.2201.12283.
Teixeira, L.A., Oliveira A.L.I. de., 2010. A method for automatic stock trading combining technical analysis and nearest neighbour classification. Expert Systems with Applications. 37, 6885–6890. doi: 10.1016/j.eswa.2010.03.033.
Ticknor, J.L., 2013. A bayesian regularized artificial neural network for stock market forecasting. Expert Systems with Applications. 40(14),5501–5506.doi.org/10.1016/j.eswa.2013.04.013.
Sharma, M. K. (2021). An Automated Ensemble-Based Classification Model for The Early Diagnosis of The Cancer Using a Machine Learning Approach. Machine Learning Applications in Engineering Education and Management, 1(1), 01–06. Retrieved from http://yashikajournals.com/index.php/mlaeem/article/view/1
Tiwari, S., Pandit, R., Richhariya, V. ,2010. Predicting Future Trends in Stock Market by Decision Tree Rough-Set Based Hybrid System with HHMM. International Journal of Electronics and Computer Science Engineering. 1, 1578–87.
Vijh, M, Chandola, D., Tikkiwal, V., Kumar, A., 2020. Stock Closing Price Prediction using Machine Learning Techniques. Procedia Computer Science. 167, 599–606. doi:10.1016/j.procs.2020.03.326.
Xiaojian, Z., 2023. Stock price prediction based on CNN model for Apple, Google and Amazon. BCP Business & Management, EMFRM 2022. 38. doi:10.54691/bcpbm.v38i.3696.
Mark White, Thomas Wood, Carlos Rodríguez, Pekka Koskinen, Jónsson Ólafur. Machine Learning for Adaptive Assessment and Feedback. Kuwait Journal of Machine Learning, 2(1). Retrieved from http://kuwaitjournals.com/index.php/kjml/article/view/169
Yeh, W., Hsieh, T., Hsiao, H., 2011. Forecasting stock markets using wavelet transforms and recurrent neural networks: An integrated system based on artificial bee colony algorithm. Applied Soft Computing. 11, 2510-2525. doi:10.1016/j.asoc.2010.09.007.
Kshirsagar, D. R. . (2021). Malicious Node Detection in Adhoc Wireless Sensor Networks Using Secure Trust Protocol. Research Journal of Computer Systems and Engineering, 2(2), 12:16. Retrieved from https://technicaljournals.org/RJCSE/index.php/journal/article/view/26
Yoo, P.D., Maria, H.K., Jan, T., 2005. Machine Learning Techniques and Use of Event Information for Stock Market Prediction: A Survey and Evaluation. In: Proceedings of International Conference on Computational Intelligence for Modelling, Control and Automation – CIMCA. pp. 835-841. 0-7695-2504-0/05.
Yoshihara, A., Fujikawa, K., Seki, K., Uehara, 2014. Predicting Stock Market Trends by Recurrent Deep Neural Networks. In: Proceedings of Pacific RIM International Conference on Artificial Intelligence. pp. 759-769.doi.org/10.1007/978-3-319-13560-1_60.
Zaheer, S., Nadeem, A., Hussain, S., Algarni, A., 2023. A Multi Parameter Forecasting for Stock Time Series Data Using LSTM and Deep Learning Model. MDPI-Mathematics. 1-24. doi.org/10.3390/math11030590.
Zhang, G., Patuwo, B.E., Hu, M.Y., 1998. Forecasting with artificial neural networks: The state of the art. International Journal of Forecasting. 14, 35 –62.doi.org/10.1016/S0169-2070(97)00044-7.
Zhang, J., Cui, S., Yan Xu, Qianmu Li, Tao Li., 2018. A novel data-driven stock price trend prediction system. Elsevier Ltd. Expert Systems with Applications. 97, 60–69. doi.org/10.1016/j.eswa.2017.12.026.
Zhong, X., Enke, D. ,2017. Forecasting daily stock market return using dimensionality reduction. Expert Systems with Applications. 67, 126–39.doi.org/10.1016/j.eswa.2016.09.027.
Zou, J., Yang, J., Cao, H., Liu, Y., Yan, Q. ,2023. Stock market prediction via deep learning techniques: A survey.1-35.
Dr. Nitin Sherje. (2020). Biodegradable Material Alternatives for Industrial Products and Goods Packaging System. International Journal of New Practices in Management and Engineering, 9(03), 15 - 18. https://doi.org/10.17762/ijnpme.v9i03.91