MS-LASSO: The Tool for Forecasting Non-linear Volatility

  • Andrei Gurevich Baltika Breweries, 3, 6, Verkhny per., St. Petersburg, 194292, Russia
  • Maria Piankova Joint stock company «T-Bank», 38A, Bldg. 26, 2-ya Khutorskaya st., Moscow, 127287, Russia
  • Alexander Skorobogatov HSE University, 16, Soyuza Pechatnikov st., St. Petersburg, 190121, Russia
  • Oleg Sviridov HSE University, 16, Soyuza Pechatnikov st., St. Petersburg, 190121, Russia
Keywords: Markov-switching model, regularization, realized volatility, oil shocks, nonlinear relationship

Abstract

Forecasting and analyzing the volatility of financial instruments is one of the fundamental tasks in stock market operations. The literature most often employs linear models for predicting market volatility. However, this tool may not be the most suitable for the stated objective, as the market is inherently non-constant, with its volatility exhibiting distinct periods of high and low values. One method that allows for accounting of this instability is the Markov regime-switching model, which permits the market to exist in at least two states: high and low volatility. When combined with regularization techniques that guard against overfitting, the Markov-switching model can demonstrate superior forecasting performance compared to traditional linear models.

The present study is dedicated to demonstrating this very fact. We model and forecast stock market volatility using both simulated and real-world data. For real-world examples, data from the Moscow Exchange (MOEX) and the NASDAQ exchange were taken. Simulations demonstrate that the Markov-switching model with the application of LASSO regularization forecasts at least as accurately as the linear model on linear data and significantly outperforms it on nonlinear data. The results on real data reveal that for the Russian stock market, characterized by nonlinear dependencies in the data, a model assuming a linear relationship possesses low predictive power. The Markov-switching model enhances the accuracy of volatility forecasts in the presence of nonlinear data relationships. Conversely, for the NASDAQ exchange, where the data linkages are predominantly linear, the Markov model does not yield substantial advantages over its linear counterpart.

Downloads

Download data is not yet available.

Author Biographies

Andrei Gurevich, Baltika Breweries, 3, 6, Verkhny per., St. Petersburg, 194292, Russia

Bachelor, Manager of Automation and Planning Systems Development

Maria Piankova, Joint stock company «T-Bank», 38A, Bldg. 26, 2-ya Khutorskaya st., Moscow, 127287, Russia

Bachelor, Product Analyst (junior)

Alexander Skorobogatov, HSE University, 16, Soyuza Pechatnikov st., St. Petersburg, 190121, Russia

Candidate of Economic Sciences, Professor, Associate Professor, Department of Economics, National Research University Higher School of Economics, St. Petersburg

Oleg Sviridov, HSE University, 16, Soyuza Pechatnikov st., St. Petersburg, 190121, Russia

postgraduate student, lecturer at the Department of Economics, National Research University Higher School of Economics, St. Petersburg

References

Aastveit K.A. (2014) Oil Price Shocks in a Data-Rich Environment. Energy Economics, 45, pp. 268–279.

Apergis N., Miller S.M. (2009) Do Structural Oil-Market Shocks Affect Stock Prices? Energy Economics, 31, 4, pp. 569–575.

Arouri M., Rault C. (2011) Oil Prices and Stock Markets in GCC Countries: Empirical Evidence from Panel Analysis. International Journal of Finance & Economics, 17, 3, pp. 242–253.

Barunik J., Krehlik T., Vacha L. (2016) Modeling and Forecasting Exchange Rate Volatility in Time-Frequency Domain. European Journal of Operational Research, 251, 1, pp. 329–340.

Bastianin A., Conti F., Manera M. (2016) The Impacts of Oil Price Shocks on Stock Market Volatility: Evidence from the G7 Countries. Energy Policy, 98, pp. 160–169.

Broadstock D., Filis G. (2014) Oil Price Shocks and Stock Market Returns: New Evidence from the United States and China. Journal of International Financial Markets, Institutions and Money, 33, pp. 417–433.

Cheng M., Swanson N.R., Yang X. (2021) Forecasting Volatility Using Double Shrinkage Methods. Journal of Empirical Finance, 62, pp. 46–61.

Chiou J., Lee Y. (2009) Jump Dynamics and Volatility: Oil and the Stock Markets. Energy, 34, 6, pp. 788–796.

Cuñado J., Jo S., de Gracia F.P. (2015) Macroeconomic Impacts of Oil Price Shocks in Asian Economies. Energy Policy, 86, pp. 867–879.

Cuñado J., de Gracia F.P. (2014) Oil Price Shocks and Stock Market Returns: Evidence for Some European Countries. Energy Economics, 42, pp. 365–377.

El-Sharif I., Brown D., Burton B., Nixon B., Russell A. (2005) Evidence on the Nature and Extent of the Relationship between Oil Prices and Equity Values in the UK. Energy Economics, 27, 6, pp. 819–830.

Escobari D., Sharma S. (2020) Explaining the Nonlinear Response of Stock Markets to Oil Price Shocks. Energy, 213.

Fang T., Lee T., Su Z. (2020) Predicting The Long-Term Stock Market Volatility: A GARCH MIDAS Model with Variable Selection. Journal of Empirical Finance, 58, pp. 36–49.

Filis G. (2010) Macro Economy, Stock Market and Oil Prices: Do Meaningful Relationships Exist among Their Cyclical Fluctuations? Energy Economics, 32, 4, pp. 877–886.

Filis G., Chatziantoniou I. (2014) Financial and Monetary Policy Responses to Oil Price Shocks: Evidence from Oil-Importing and Oil-Exporting Countries. Review of Quantitative Finance and Accounting, 42, 4, pp. 709–729.

Gong X., Chen L., Lin B. (2020) Analyzing Dynamic Impacts of Different Oil Shocks on Oil Price. Ener¬gy, 198.

Gupta R., Modise M.P. (2013) Does The Source of Oil Price Shocks Matter for South African Stock Re-turns? A Structural VAR Approach. Energy Economics, 40, pp. 825–831.

Hamilton J.D. (1989) A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle. Journal of the Econometric Society, pp. 357–384.

Huang R.D., Masulis R.W., Stoll H.R. (1996) Energy Shocks and Financial Markets. The Journal of Futures Markets, 16, 1, pp. 1–27.

Jammazi R., Aloui C. (2010) Wavelet Decomposition and Regime Shifts: Assessing the Effects of Crude Oil Shocks on Stock Market Returns. Energy Policy, 38, 3, pp. 1415–1435.

Jammazi R. (2012) Oil Shock Transmission to Stock Market Returns: Wavelet-Multivariate Markov Switching GARCH Approach. Energy, 37, 1, pp. 430–454.

Jiménez-Rodríguez R. (2014) Oil Price Shocks and Stock Markets: Testing for Non-Linearity. Empirical Economics, 48, 3, pp. 1079–1102.

Kang W., Ratti R.A., Yoon K.H. (2015b) Time-Varying Effect of Oil Market Shocks on the Stock Mar-ket. Journal of Banking and Finance, 61, pp. S150–S163.

Kang W., Ratti R.A., Vespignani J.L. (2016) The Impact of Oil Price Shocks on the U.S. Stock Market: A Note on the Roles of U.S. and non-U.S. Oil Production. Economics Letters, 145, pp. 176–181.

Kilian L., Park C. (2009) The Impact of Oil Price Shocks on the U.S. Stock Market. International Eco-nomic Review, 50, 4, pp. 1267–1287.

Kim D., Baek C. (2020) Factor-Augmented HAR Model Improves Realized Volatility Forecasting. Applied Economics Letters, 27, 12, pp. 1002–1009.

Li X., Wei Y., Chen X., Ma F., Liang C., Chen W. (2020) Which Uncertainty Is Powerful to Forecast Crude Oil Market Volatility? New Evidence. International Journal of Finance & Economics, 27, 4, pp. 4279–4297.

Lu X., Ma F., Wang J., Zhu B. (2021) Oil Shocks and Stock Market Volatility: New Evidence. Energy Economics, 103.

Ma F., Wang J., Wahab M.I.M., Ma Y. (2023) Stock Market Volatility Predictability in a Data-Rich World: A New Insight. International Journal of Forecasting.

Maheu J.M., Song Y., Yang Q. (2020) Oil Price Shocks and Economic Growth: The Volatility Link. International Journal of Forecasting, 36, 2, pp. 570–587.

McLeod A.I., Li W.K. (1983) Diagnostic Checking ARMA Time Series Models Using Squared‐Residual Autocorrelations. Journal of Time Series Analysis, 4, 4, pp. 269–273.

Miller J.I., Ratti R.A. (2009) Crude Oil and Stock Markets: Stability, Instability, and Bubbles. Energy Economics, 31, 4, pp. 559–568.

Nakajima J. (2011) Time-Varying Parameter VAR Model with Stochastic Volatility: An Overview of Methodology and Empirical Applications. Monetary and Economic Studies, 29, pp. 107–142.

Narayan P.K., Narayan S. (2010) Modelling the Impact of Oil Prices on Vietnam’s Stock Prices. Applied Energy, 87, 1, pp. 356–361.

Nusair S.A., Al-Khasawneh J.A. (2017) Oil Price Shocks and Stock Market Returns of the GCC Countries: Empirical Evidence from Quantile Regression Analysis. Economic Change and Restructuring, 51, 4, pp. 339–372.

Panopoulou E., Pantelidis T. (2015) Speculative Behaviour and Oil Price Predictability. Economic Modelling, 47, pp. 128–136.

Park J., Ratti R.A. (2008) Oil Price Shocks and Stock Markets in the U.S. and 13 European Countries. Energy Economics, 30, 5, pp. 2587–2608.

Reboredo J.C. (2010) Nonlinear Effects of Oil Shocks on Stock Returns: A Markov-Switching Approach. Applied Economics, 42, 29, pp. 3735–3744.

Sadorsky P. (1999) Oil Price Shocks and Stock Market Activity. Energy Economics, 21, 5, pp. 449–469.

Salisu A.A., Gupta R. (2021) Oil Shocks and Stock Market Volatility of the BRICS: A GARCH-MIDAS Approach. Global Finance Journal, 48.

Sevillano M.C. et al. (2024) Connectedness between Oil Price Shocks and US Sector Returns: Evidence from TVP-VAR and Wavelet Decomposition. Energy Economics, 131, p. 107398.

Shahrestani P., Rafei M. (2020) The Impact of Oil Price Shocks on Tehran Stock Exchange Returns: Application of the Markov Switching Vector Autoregressive Models. Resources Policy, 65.

Sim N., Zhou H. (2015) Oil Prices, US Stock Return, and the Dependence between Their Quantiles. Journal of Banking and Finance, 55, pp. 1–8.

Sukcharoen K., Zohrabyan T., Leatham D.J., Wu X. (2014) Interdependence of Oil Prices and Stock Market Indices: A Copula Approach. Energy Economics, 44, pp. 331–339.

Sviridov O., Skorobogatov A. (2025) A Сausal Link Analysis from Oil Price to the Russian Stock Market. Applied Econometrics, 77, pp. 5–24. (In Russ.)

Wang Y., Wu C., Yang L. (2013) Oil Price Shocks and Stock Market Activities: Evidence from Oil-Importing and Oil-Exporting Countries. Journal of Comparative Economics, 41, 4, pp. 1220–1239.

Wei Y., Guo X. (2017) Oil Price Shocks and China's Stock Market. Energy, 140, pp. 185–197.

Xiao J., Hu C., Ouyang G., Wen F. (2019) Impacts of Oil Implied Volatility Shocks on Stock Implied Volatility in China: Empirical Evidence from a Quantile Regression Approach. Energy Economics, 80, pp. 297–309.

Zhang D. (2017) Oil Shocks and Stock Markets Revisited: Measuring Connectedness from a Global Perspective. Energy Economics, 62, pp. 323–333.

Published
2025-12-19
How to Cite
GurevichA., PiankovaM., SkorobogatovA., & SviridovO. (2025). MS-LASSO: The Tool for Forecasting Non-linear Volatility. HSE Economic Journal, 29(4), 691-716. https://doi.org/10.17323/1813-8691-2025-29-4-691-716