Improving modeling of stochastic processes by smart denoising

Authors

  • Jakob Jelenčič
  • Dunja Mladenić prof. dr.

DOI:

https://doi.org/10.31449/inf.v46i1.3875

Abstract

This paper proposes a novel method for modeling stochastic processes, which are knownto be notoriously hard to predict accurately. State of the art methods quickly overfitand create big differences between train and test datasets. We present a method basedon smart noise addition to the data obtained from unknown stochastic process, whichis capable of reducing data overfitting. The proposed method works as an addition tothe current state of the art methods in both supervised and unsupervised setting. Weevaluate the method on equities and cryptocurrency datasets, specifically chosen fortheir chaotic and unpredictable nature. We show that with our method we significantlyreduce overfitting and increase performance, compared to several commonly used machinelearning algorithms: Random forest, General linear model and LSTM deep learning model.

References

Kraken exchange.

Yahoo Finance.om

A. Creswell, T. White, V. Dumoulin,

K. Arulkumaran, B. Sengupta, and A. A.

Bharath. Generative adversarial networks:

An overview. IEEE Signal Processing Maga-

zine, 35(1):53–65, 2018.

P. Jaworski, F. Durante, W. K. Hardle, and

T. Rychlik. Copula theory and its applications,

volume 198. Springer, 2010.

J. Jelencic and D. Mladenic. Modeling stochas-

tic processes by simultaneous optimization of latent representation and target variable. 2020.

H. Joe. Dependence Modeling with Copulas.

CRC Press, 2014.

D. Kingma and J. Ba. Adam: A Method

for Stochastic Optimization. 2014. https:

//arxiv.org/abs/1412.6980.

K. Y. Levy. The power of normalization:

Faster evasion of saddle points. arXiv preprint

arXiv:1611.04831, 2016.

M. Liu, W. Wu, Z. Gu, Z. Yu, F. Qi, and Y. Li.

Deep learning based on batch normalization

for p300 signal detection. Neurocomputing,

:288–297, 2018.

R. C. Merton. Option pricing when underlying

stock returns are discontinuous. Journal of

financial economics, 3(1-2):125–144, 1976.

J. J. Murphy. Technical Analysis of the Fi-

nancial Markets: A Comprehensive Guide to

Trading Methods and Applications. New York

Institute of Finance Series. New York Insti-

tute of Finance, 1999.

T. Salimans and D. P. Kingma. Weight nor-

malization: A simple reparameterization to

accelerate training of deep neural networks.

Advances in neural information processing sys-

tems, 29:901–909, 2016.

B. W. Turnbull. The empirical distribution

function with arbitrarily grouped, censored

and truncated data. Journal of the Royal

Statistical Society: Series B (Methodological),

(3):290–295, 1976.

R. Vidal, J. Bruna, R. Giryes, and S. Soatto.

Mathematics of deep learning. arXiv preprint

arXiv:1712.04741, 2017.

P. Vincent, H. Larochelle, Y. Bengio, and

P.-A. Manzagol. Extracting and composing

robust features with denoising autoencoders.

In Proceedings of the 25th international con-

ference on Machine learning, pages 1096–1103,

N. Wax. Selected papers on noise and stochas-

tic processes. Courier Dover Publications,

Downloads

Published

2022-03-15

How to Cite

Jelenčič, J., & Mladenić, D. (2022). Improving modeling of stochastic processes by smart denoising. Informatica, 46(1). https://doi.org/10.31449/inf.v46i1.3875

Issue

Vol. 46 No. 1 (2022)

Section

Regular papers

License

I assign to Informatica, An International Journal of Computing and Informatics ("Journal") the copyright in the manuscript identified above and any additional material (figures, tables, illustrations, software or other information intended for publication) submitted as part of or as a supplement to the manuscript ("Paper") in all forms and media throughout the world, in all languages, for the full term of copyright, effective when and if the article is accepted for publication. This transfer includes the right to reproduce and/or to distribute the Paper to other journals or digital libraries in electronic and online forms and systems.

I understand that I retain the rights to use the pre-prints, off-prints, accepted manuscript and published journal Paper for personal use, scholarly purposes and internal institutional use.

In certain cases, I can ask for retaining the publishing rights of the Paper. The Journal can permit or deny the request for publishing rights, to which I fully agree.

I declare that the submitted Paper is original, has been written by the stated authors and has not been published elsewhere nor is currently being considered for publication by any other journal and will not be submitted for such review while under review by this Journal.  The Paper contains no material that violates proprietary rights of any other person or entity. I have obtained written permission from copyright owners for any excerpts from copyrighted works that are included and have credited the sources in my article. I have informed the co-author(s) of the terms of this publishing agreement.


Copyright ©  Slovenian Society Informatika