Machine Learning for Neural Decoding

Abstract

Despite rapid advances in machine learning tools, the majority of neural decoding approaches still use traditional methods. Modern machine learning tools, which are versatile and easy to use, have the potential to significantly improve decoding performance. This tutorial describes how to effectively apply these algorithms for typical decoding problems. We provide descriptions, best practices, and code for applying common machine learning methods, including neural networks and gradient boosting. We also provide detailed comparisons of the performance of various methods at the task of decoding spiking activity in motor cortex, somatosensory cortex, and hippocampus. Modern methods, particularly neural networks and ensembles, significantly outperform traditional approaches, such as Wiener and Kalman filters. Improving the performance of neural decoding algorithms allows neuroscientists to better understand the information contained in a neural population and can help to advance engineering applications such as brain–machine interfaces. Our code package is available at github.com/kordinglab/neural_decoding .

Shown for reading. Its publisher allows quoting it, not republishing it.

References 75

1. 1.

   Arora S, Cohen N, Hu W, Luo Y (2019 ) Implicit regularization in deep matrix factorization. Adv Neural Inf Process Syst, pp 7411–7422.

   Not in our library

2. 2.

   Baeg E, Kim Y, Huh K, Mook-Jung I, Kim H, Jung M (2003 ) Dynamics of population code for working memory in the prefrontal cortex. Neuron 40:177–188.

   Not in our library10.1016/s0896-6273(03)00597-x

3. 3.

   Barbieri R, Wilson MA, Frank LM, Brown EN (2005 ) An analysis of hippocampal spatio-temporal representations using a Bayesian algorithm for neural spike train decoding. IEEE Trans Neural Syst Rehabil Eng 13:131–136.

   Not in our library10.1109/tnsre.2005.847368

4. 4.
   Modern Machine Learning as a Benchmark for Fitting Neural Responses · 2018

   Not checked
5. 5.

   Bergstra J, Bengio Y (2012 ) Random search for hyper-parameter optimization. J Mach Learn Res 13:281–305.

   Not in our library

6. 6.

   Bergstra J, Yamins D, Cox DD (2013 ) Making a science of model search: hyperparameter optimization in hundreds of dimensions for vision architectures. Proc Mach Learn Res 28:115–123.

   Not in our library

7. 7.

   Bishop CM (2006 ) Pattern recognition and machine learning. New York: Springer.

   Not in our library

8. 8.

   Breiman L (2017 ) Classification and regression trees. Boca Raton, FL: CRC.

   Not in our library

9. 9.
   Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates · 2003

   No notice
10. 10.

    Chang C-C, Lin C-J (2011 ) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2:1–27.

    Not in our library10.1145/1961189.1961199

11. 11.

    Chen T (2014 ) Introduction to boosted trees. University of Washington Computer Science 22:115.

    Not in our library

12. 12.

    Chen T, Guestrin C (2016 ) XGBoost: a scalable tree boosting system In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pp 785–794. New York: ACM.

    Not in our library

13. 13.

    Cho K, Van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014 ) Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv:1406.1078.

    Not in our library

14. 14.

    Collinger JL, Wodlinger B, Downey JE, Wang W, Tyler-Kabara EC, Weber DJ, McMorland AJ, Velliste M, Boninger ML, Schwartz AB (2013 ) High-performance neuroprosthetic control by an individual with tetraplegia. Lancet 381:557–564.

    Not in our library10.1016/s0140-6736(12)61816-9

15. 15.

    Corbett E, Perreault E, Koerding K (2010 ) Mixture of time-warped trajectory models for movement decoding. Adv Neural Inf Process Syst, pp 433–441.

    Not in our library

16. 16.

    Cranmer M, Sanchez-Gonzalez A, Battaglia P, Xu R, Cranmer K, Spergel D, Ho S (2020 ) Discovering symbolic models from deep learning with inductive biases. arXiv:2006.11287.

    Not in our library

17. 17.

    Dankers C, Kronseder V, Wagner M, Casalicchio G (2020 ) Introduction to feature importance In: Limitations of ML Interpretability. Munich, Germany: Department of Statistics, LMU Munich.

    Not in our library

18. 18.

    Davidson TJ, Kloosterman F, Wilson MA (2009 ) Hippocampal replay of extended experience. Neuron 63:497–507.

    Not in our library10.1016/j.neuron.2009.07.027

19. 19.

    Dekleva BM, Ramkumar P, Wanda PA, Kording KP, Miller LE (2016 ) Uncertainty leads to persistent effects on reach representations in dorsal premotor cortex. Elife 5:e14316

    Not in our library10.7554/elife.14316

20. 20.

    Ethier C, Oby ER, Bauman MJ, Miller LE (2012 ) Restoration of grasp following paralysis through brain-controlled stimulation of muscles. Nature 485:368–371.

    Not in our library10.1038/nature10987

21. 21.

    Fagg AH, Ojakangas GW, Miller LE, Hatsopoulos NG (2009 ) Kinetic trajectory decoding using motor cortical ensembles. IEEE Trans Neural Syst Rehabil Eng 17:487–496.

    Not in our library10.1109/tnsre.2009.2029313

22. 22.

    Farshchian A, Gallego JA, Cohen JP, Bengio Y, Miller LE, Solla SA (2018 ) Adversarial domain adaptation for stable brain-machine interfaces. arXiv:1810.00045.

    Not in our library

23. 23.

    Friedman J, Hastie T, Tibshirani R (2001 ) The elements of statistical learning. New York: Springer.

    Not in our library

24. 24.

    Gao P, Trautmann E, Byron MY, Santhanam G, Ryu S, Shenoy K, Ganguli S (2017 ) A theory of multineuronal dimensionality, dynamics and measurement. bioRxiv. Advance online publication. Retrieved Nov 12, 2017. doi:10.1101/214262.

    Not in our library

25. 25.

    Gilja V, Nuyujukian P, Chestek CA, Cunningham JP, Yu BM, Fan JM, Churchland MM, Kaufman MT, Kao JC, Ryu SI, Shenoy KV (2012 ) A high-performance neural prosthesis enabled by control algorithm design. Nat Neurosci 15:1752–1757.

    Not in our library10.1038/nn.3265

26. 26.
    Population coding of conditional probability distributions in dorsal premotor cortex · 2018

    Not checked
27. 27.

    Glaser JI, Benjamin AS, Farhoodi R, Kording KP (2019 ) The roles of supervised machine learning in systems neuroscience. Prog Neurobiol 175:126–137.

    Not in our library10.1016/j.pneurobio.2019.01.008

28. 28.

    Goodfellow I, Bengio Y, Courville A (2016 ) Deep learning. Cambridge, MA: MIT.

    Not in our library

29. 29.

    Hastie T, Tibshirani R, Friedman J (2009 ) The elements of statistical learning: data mining, inference, and prediction. New York: Springer Science and Business Media.

    Not in our library

30. 30.

    He K, Zhang X, Ren S, Sun J (2015 ) Delving deep into rectifiers: surpassing human-level performance on ImageNet classification In: Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), pp 1026–1034.

    Not in our library10.1109/iccv.2015.123

31. 31.

    Hernández A, Nácher V, Luna R, Zainos A, Lemus L, Alvarez M, Vázquez Y, Camarillo L, Romo R (2010 ) Decoding a perceptual decision process across cortex. Neuron 66:300–314.

    Not in our library10.1016/j.neuron.2010.03.031

32. 32.

    Hochreiter S, Schmidhuber J (1997 ) Long short-term memory. Neural Comput 9:1735–1780.

    Not in our library10.1162/neco.1997.9.8.1735

33. 33.

    Hoerl AE, Kennard RW (1970 ) Ridge regression: biased estimation for nonorthogonal problems. Technometrics 12:55–67.

    Not in our library10.1080/00401706.1970.10488634

34. 34.

    Hung CP, Kreiman G, Poggio T, DiCarlo JJ (2005 ) Fast readout of object identity from macaque inferior temporal cortex. Science 310:863–866.

    Not in our library10.1126/science.1117593

35. 35.

    Ibos G, Freedman DJ (2017 ) Sequential sensory and decision processing in posterior parietal cortex. Elife 6:e23743

    Not in our library10.7554/elife.23743

36. 36.

    Kaggle (2020 ) Kaggle. Available at https://www.kaggle.com.

    Not in our library

37. 37.

    Kao JC, Stavisky SD, Sussillo D, Nuyujukian P, Shenoy KV (2014 ) Information systems opportunities in brain–machine interface decoders. Proc IEEE 102:666–682.

    Not in our library10.1109/jproc.2014.2307357

38. 38.

    Kao JC, Nuyujukian P, Ryu SI, Shenoy KV (2017 ) A high-performance neural prosthesis incorporating discrete state selection with hidden Markov models. IEEE Trans Biomed Eng 64:935–945.

    Not in our library10.1109/tbme.2016.2582691

39. 39.

    Kloosterman F, Layton SP, Chen Z, Wilson MA (2014 ) Bayesian decoding using unsorted spikes in the rat hippocampus. J Neurophysiol 111:217–227.

    Not in our library10.1152/jn.01046.2012

40. 40.

    Kriegeskorte N, Douglas PK (2019 ) Interpreting encoding and decoding models. Curr Opin Neurobiol 55:167–179.

    Not in our library10.1016/j.conb.2019.04.002

41. 41.

    Krizhevsky A, Sutskever I, Hinton GE (2012 ) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst, pp 1097–1105.

    Not in our library

42. 42.
    Deep learning · 2015

    No notice
43. 43.

    Liaw A, Wiener M (2002 ) Classification and regression by randomForest, pp 218–222. Vienna, Austria: R Foundation.

    Not in our library

44. 44.

    Mizuseki K, Sirota A, Pastalkova E, Buzsáki G (2009a ) Multi-unit recordings from the rat hippocampus made during open field foraging. New York: NYU Data Catalog.

    Not in our library

45. 45.

    Mizuseki K, Sirota A, Pastalkova E, Buzsáki G (2009b ) Theta oscillations provide temporal windows for local circuit computation in the entorhinal-hippocampal loop. Neuron 64:267–280.

    Not in our library10.1016/j.neuron.2009.08.037

46. 46.

    Molnar C (2018 ) A guide for making black box models explainable. Available at https://christophm.github.io/interpretable-ml-book/.

    Not in our library

47. 47.

    Nadeau C, Bengio Y (2000 ) Inference for the generalization error. Adv Neural Inf Process Syst, pp 307–313.

    Not in our library

48. 48.
    Gradient boosting machines, a tutorial · 2013

    No notice
49. 49.

    Naufel S, Glaser JI, Kording KP, Perreault EJ, Miller LE (2019 ) A muscle-activity-dependent gain between motor cortex and EMG. J Neurophysiol 121:61–73.

    Not in our library10.1152/jn.00329.2018

50. 50.
    Brain Computer Interfaces, a Review · 2012

    No notice
51. 51.

    Olah C, Satyanarayan A, Johnson I, Carter S, Schubert L, Ye K, Mordvintsev A (2018 ) The building blocks of interpretability. Distill 3:e10

    Not in our library10.23915/distill.00010

52. 52.

    Pagan M, Simoncelli EP, Rust NC (2016 ) Neural quadratic discriminant analysis: nonlinear decoding with V1-like computation. Neural Comput 28:2291–2319.

    Not in our library10.1162/neco_a_00890

53. 53.

    Pohlmeyer EA, Solla SA, Perreault EJ, Miller LE (2007 ) Prediction of upper limb muscle activity from motor cortical discharge during reaching. J Neural Eng 4:369–379.

    Not in our library10.1088/1741-2560/4/4/003

54. 54.

    Quiroga RQ, Snyder LH, Batista AP, Cui H, Andersen RA (2006 ) Movement intention is better predicted than attention in the posterior parietal cortex. J Neurosci 26:3615–3620.

    Not in our library10.1523/jneurosci.3468-05.2006

55. 55.

    Raposo D, Kaufman MT, Churchland AK (2014 ) A category-free neural population supports evolving demands during decision-making. Nat Neurosci 17:1784–1792.

    Not in our library10.1038/nn.3865

56. 56.

    Ribeiro MT, Singh S, Guestrin C (2016 ) "Why should I trust you?” Explaining the predictions of any classifier In: Proceedings of KDD '16: The 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (Balaji K, Shah M, eds), pp 1135–1144. New York, NY: Association for Computing Machinery.

    Not in our library

57. 57.

    Rich EL, Wallis JD (2016 ) Decoding subjective decisions from orbitofrontal cortex. Nat Neurosci 19:973–980.

    Not in our library10.1038/nn.4320

58. 58.

    Rosenblatt F (1961 ) Principles of neurodynamics. Perceptrons and the theory of brain mechanisms. Buffalo, NY: Cornell Aeronautical Laboratory.

    Not in our library

59. 59.

    Rumelhart DE, Hinton GE, Williams RJ (1986 ) Learning representations by back-propagating errors. Nature 323:533–536.

    Not in our library10.1038/323533a0

60. 60.

    Serruya M, Hatsopoulos N, Fellows M, Paninski L, Donoghue J (2003 ) Robustness of neuroprosthetic decoding algorithms. Biol Cybern 88:219–228.

    Not in our library10.1007/s00422-002-0374-6

61. 61.

    Serruya MD, Hatsopoulos NG, Paninski L, Fellows MR, Donoghue JP (2002 ) Instant neural control of a movement signal. Nature 416:141–142.

    Not in our library10.1038/416141a

62. 62.

    Silver D, Huang A, Maddison CJ, Guez A, Sifre L, van den Driessche G, Schrittwieser J, Antonoglou I, Panneershelvam V, Lanctot M, Dieleman S, Grewe D, Nham J, Kalchbrenner N, Sutskever I, Lillicrap T, Leach M, Kavukcuoglu K, Graepel T, Hassabis D (2016 ) Mastering the game of Go with deep neural networks and tree search. Nature 529:484–489.

    Not in our library10.1038/nature16961

63. 63.

    Smola AJ, Schölkopf B (2004 ) A tutorial on support vector regression. Stat Comput 14:199–222.

    Not in our library10.1023/b:stco.0000035301.49549.88

64. 64.

    Snoek J, Larochelle H, Adams RP (2012 ) Practical Bayesian optimization of machine learning algorithms. Adv Neural Inf Process Syst, pp 2951–2959.

    Not in our library

65. 65.

    Sussillo D, Nuyujukian P, Fan JM, Kao JC, Stavisky SD, Ryu S, Shenoy K (2012 ) A recurrent neural network for closed-loop intracortical brain–machine interface decoders. J Neural Eng 9:e026027.

    Not in our library10.1088/1741-2560/9/2/026027

66. 66.
    Making brain–machine interfaces robust to future neural variability · 2016

    Corrected
67. 67.

    van der Meer MA, Johnson A, Schmitzer-Torbert NC, Redish AD (2010 ) Triple dissociation of information processing in dorsal striatum, ventral striatum, and hippocampus on a learned spatial decision task. Neuron 67:25–32.

    Not in our library10.1016/j.neuron.2010.06.023

68. 68.

    Weichwald S, Meyer T, Özdenizci O, Schölkopf B, Ball T, Grosse-Wentrup M (2015 ) Causal interpretation rules for encoding and decoding models in neuroimaging. Neuroimage 110:48–59.

    Not in our library10.1016/j.neuroimage.2015.01.036

69. 69.

    Weygandt M, Blecker CR, Schäfer A, Hackmack K, Haynes J-D, Vaitl D, Stark R, Schienle A (2012 ) fMRI pattern recognition in obsessive–compulsive disorder. Neuroimage 60:1186–1193.

    Not in our library10.1016/j.neuroimage.2012.01.064

70. 70.

    Wolpert DH, Macready WG (1997 ) No free lunch theorems for optimization. IEEE Trans Evol Comput 1:67–82.

    Not in our library10.1109/4235.585893

71. 71.

    Wu W, Hatsopoulos NG (2008 ) Real-time decoding of nonstationary neural activity in motor cortex. IEEE Trans Neural Syst Rehabil Eng 16:213–222.

    Not in our library10.1109/tnsre.2008.922679

72. 72.

    Wu W, Black MJ, Gao Y, Serruya M, Shaikhouni A, Donoghue J, Bienenstock E (2003 ) Neural decoding of cursor motion using a Kalman filter. Adv Neural Inf Process Syst, pp 133–140.

    Not in our library

73. 73.

    Wu Z, Litwin-Kumar A, Shamash P, Taylor A, Axel R, Shadlen MN (2020 ) Context-dependent decision making in a premotor circuit. Neuron 106:316–328.e6.

    Not in our library10.1016/j.neuron.2020.01.034

74. 74.

    Zhang C, Bengio S, Hardt M, Recht B, Vinyals O (2016 ) Understanding deep learning requires rethinking generalization. arXiv:1611.03530.

    Not in our library

75. 75.

    Zhang K, Ginzburg I, McNaughton BL, Sejnowski TJ (1998 ) Interpreting neuronal population activity by reconstruction: unified framework with application to hippocampal place cells. J Neurophysiol 79:1017–1044.

    Not in our library10.1152/jn.1998.79.2.1017

Cited by papers we hold 2

• Preserved neural dynamics across animals performing similar behaviour · 2023
  No notice
• A Comparison of Neural Decoding Methods and Population Coding Across Thalamo-Cortical Head Direction Cells · 2019
  Not checked

Reads

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.