An empirical survey of data augmentation for time series classification with neural networks

Abstract

In recent times, deep artificial neural networks have achieved many successes in pattern recognition. Part of this success can be attributed to the reliance on big data to increase generalization. However, in the field of time series recognition, many datasets are often very small. One method of addressing this problem is through the use of data augmentation. In this paper, we survey data augmentation techniques for time series and their application to time series classification with neural networks. We propose a taxonomy and outline the four families in time series data augmentation, including transformation-based methods, pattern mixing, generative models, and decomposition methods. Furthermore, we empirically evaluate 12 time series data augmentation methods on 128 time series classification datasets with six different types of neural networks. Through the results, we are able to analyze the characteristics, advantages and disadvantages, and recommendations of each data augmentation method. This survey aims to help in the selection of time series data augmentation for neural network applications.

Full text

Its licence does not allow us to show the full text. Read it at PubMed Central:

References 118

1. 1.

   Ding H, Trajcevski G, Scheuermann P, Wang X, Keogh E. Querying and mining of time series data. Proc Very Larg Data Base Endow. 2008;1(2):1542–1552.

   Not in our library

2. 2.

   Schmidhuber J. Deep learning in neural networks: An overview. Neural Networks. 2015;61:85–117

   Not in our library10.1016/j.neunet.2014.09.003

3. 3.

   Wang Z, Yan W, Oates T. Time series classification from scratch with deep neural networks: A strong baseline. In: IJCNN; 2017.

   Not in our library

4. 4.

   Rumelhart DE, Hinton GE, Williams RJ. Learning representations by back-propagating errors. Nat. 1986;323(6088):533–536

   Not in our library10.1038/323533a0

5. 5.

   Chen Q, Liang B, Wang J. A comparative study of LSTM and phased LSTM for gait prediction. Int J Artificial Intelli & App. 2019;10(4):57–66

   Not in our library10.5121/ijaia.2019.10405

6. 6.

   Kluwak K, Nizynski T. Gait classification using LSTM networks for tagging system. In: IEEE SoSE; 2020.

   Not in our library

7. 7.

   Xu G, Xing G, Jiang J, Jiang J, Ke Y. Arrhythmia detection using gated recurrent unit network with ECG signals. J Medical Imag and Health Inform. 2020;10(3):750–757

   Not in our library10.1166/jmihi.2020.2928

8. 8.

   Kim BH, Pyun JY. ECG identification for personal authentication using LSTM-based deep recurrent neural networks. Sensors. 2020;20(11):3069

   Not in our library10.3390/s20113069

9. 9.

   Sun L, Su T, Liu C, Wang R. Deep LSTM networks for online Chinese handwriting Recognition. In: ICFHR; 2016.

   Not in our library

10. 10.

    Carbune V, Gonnet P, Deselaers T, Rowley HA, Daryin A, Calvo M, et al. Fast multi-language LSTM-based online handwriting recognition. Int J Doc Analy and Recogn. 2020;23(2):89–102

    Not in our library10.1007/s10032-020-00350-4

11. 11.

    Lecun Y, Bottou L, Bengio Y, Haffner P. Gradient-based learning applied to document recognition. Proc IEEE. 1998;86(11):2278–2324

    Not in our library10.1109/5.726791

12. 12.

    Bai S, Kolter JZ, Koltun V. An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv preprint arXiv:180301271. 2018;.

    Not in our library

13. 13.

    Iwana BK, Uchida S. Time series classification using local distance-based features in multi-modal fusion networks. Pattern Recogn. 2020;97:107024

    Not in our library10.1016/j.patcog.2019.107024

14. 14.

    Banko M, Brill E. Scaling to very very large corpora for natural language disambiguation. In: AMACL; 2001.

    Not in our library

15. 15.

    Torralba A, Fergus R, Freeman WT. 80 Million tiny images: A large data set for nonparametric object and scene recognition. IEEE Trans Pattern Anal and Mach Intell. 2008;30(11):1958–1970

    Not in our library10.1109/tpami.2008.128

16. 16.

    Dau HA, Keogh E, Kamgar K, Yeh CCM, Zhu Y, Gharghabi S, et al. The UCR time series classification archive; 2018.

    Not in our library

17. 17.
    Text Data Augmentation for Deep Learning · 2021

    No notice
18. 18.

    Olson M, Wyner A, Berk R. Modern neural networks generalize on small data sets. In: NeurIPS; 2018. p. 3619–3628.

    Not in our library

19. 19.
    SMOTE for high-dimensional class-imbalanced data · 2013

    No notice
20. 20.

    Hasibi R, Shokri M, Dehghan M. Augmentation scheme for dealing with imbalanced network traffic classification using deep learning. arXiv preprint arXiv:190100204. 2019;.

    Not in our library

21. 21.

    Krizhevsky A. Learning multiple layers of features from tiny images. University of Tront Thesis. 2009;.

    Not in our library

22. 22.

    Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, et al. ImageNet large scale visual recognition challenge. Int J Comput Vis. 2015;115(3):211–252

    Not in our library10.1007/s11263-015-0816-y

23. 23.

    Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:14091556. 2014;.

    Not in our library

24. 24.

    He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: IEEE CVPR; 2016.

    Not in our library

25. 25.

    Huang G, Liu Z, Maaten LVD, Weinberger KQ. Densely connected convolutional networks. In: IEEE CVPR; 2017.

    Not in our library

26. 26.

    Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, et al. Going deeper with convolutions. In: IEEE CVPR; 2015.

    Not in our library

27. 27.

    Wen Q, Sun L, Song X, Gao J, Wang X, Xu H. Time series data augmentation for deep learning: A survey. arXiv preprint arXiv:200212478. 2020;.

    Not in our library

28. 28.

    Fields T, Hsieh G, Chenou J. Mitigating drift in time series data with noise augmentation. In: ICCSCI; 2019.

    Not in our library

29. 29.

    Le Guennec A, Malinowski S, Tavenard R. Data augmentation for time series classification using convolutional neural networks. In: IWAATD; 2016.

    Not in our library

30. 30.

    Um TT, Pfister FMJ, Pichler D, Endo S, Lang M, Hirche S, et al. Data augmentation of wearable sensor data for Parkinson’s disease monitoring using convolutional neural networks. In: ACM ICMI; 2017. p. 216–220.

    Not in our library

31. 31.

    Jaitly N, Hinton GE. Vocal tract length perturbation (VTLP) improves speech recognition. In: ICML WDLASLP; 2013.

    Not in our library

32. 32.

    Cao H, Tan VYF, Pang JZF. A parsimonious mixture of Gaussian trees model for oversampling in imbalanced and multimodal time-series classification. IEEE Trans Neural Networks and Learning Sys. 2014;25(12):2226–2239

    Not in our library10.1109/tnnls.2014.2308321

33. 33.

    Wendling F, Bellanger JJ, Bartolomei F, Chauvel P. Relevance of nonlinear lumped-parameter models in the analysis of depth-EEG epileptic signals. Bio Cybernetics. 2000;83(4):367–378

    Not in our library10.1007/s004220000160

34. 34.

    Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, et al. Generative adversarial nets. In: NeurIPS; 2014. p. 2672–2680.

    Not in our library

35. 35.

    Bergmeir C, Hyndman RJ, Benítez JM. Bagging exponential smoothing methods using STL decomposition and Box–Cox transformation. Int J Forecasting. 2016;32(2):303–312

    Not in our library10.1016/j.ijforecast.2015.07.002

36. 36.

    Eltoft T. Data augmentation using a combination of independent component analysis and non-linear time-series prediction. In: IJCNN; 2002. p. 448–453.

    Not in our library

37. 37.

    Forestier G, Petitjean F, Dau HA, Webb GI, Keogh E. Generating synthetic time series to augment sparse datasets. In: IEEE ICDM; 2017.

    Not in our library

38. 38.

    Liu B, Zhang Z, Cui R. Efficient Time Series Augmentation Methods. In: CISP-BMEI; 2020.

    Not in our library

39. 39.

    Iwana BK, Uchida S. Time series data augmentation for neural networks by time warping with a discriminative teacher. In: ICPR; 2021.

    Not in our library

40. 40.

    Kamycki K, Kapuscinski T, Oszust M. Data augmentation with suboptimal warping for time-series classification. Sensors. 2019;20(1):98

    Not in our library10.3390/s20010098

Reads

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.