Numenta Logo

Research Papers

  1. Jeff Hawkins & Subutai AhmadNeuroscience
    Published in Frontiers in Neural Circuits Journal2016/03/30

    Foundational paper describing core HTM theory for sequence memory and its relationship to the neocortex. Written with a neuroscience perspective, the paper explains why neurons need so many synapses and how networks of neurons can form a powerful sequence learning mechanism.

  2. Yuwei Cui, Subutai Ahmad & Jeff HawkinsMachine learning
    Preprint of journal submission2015/12/17

    Analysis of HTM sequence memory applied to various sequence learning and prediction problems. Written with a machine learning perspective, the paper contains some comparisons to statistical and Deep Learning techniques.

  3. Yuwei Cui, Subutai Ahmad & Jeff HawkinsNeuroscience
    Preprint of journal submission2016/11/02

    This paper describes an important component of HTM, the HTM spatial pooler, which is a neutrally inspired algorithm that learns sparse distributed representations online. Written from a neuroscience perspective, the paper demonstrates key computational properties of HTM spatial pooler.

  4. Alexander Lavin & Subutai AhmadMachine learning
    Published conference paper2015/10/12

    14th IEEE ICMLA 2015 - This paper discusses how we should think about anomaly detection for streaming applications. It introduces a new open-source benchmark for detecting anomalies in real-time, time-series data.

  5. Subutai Ahmad & Scott PurdyMachine learning
    Preprint of journal submission2016/07/08

    Much of the worlds data is streaming, time-series data, where anomalies give significant information in critical situations. Yet detecting anomalies in streaming data is a difficult task, requiring detectors to process data in real-time, and learn while simultaneously making predictions.

  6. Subutai Ahmad & Jeff HawkinsNeuroscience
    Preprint of journal submission2016/01/05

    This paper describes a mathematical model for quantifying the benefits and limitations of sparse representations in neurons and cortical networks.

  7. Subutai Ahmad & Jeff HawkinsNeuroscience
    Research Paper2014/10/28

    An earlier version of the above submission, this paper applies our mathematical model of sparse representations to practical HTM systems.

  8. Scott PurdyMachine learning
    Research Paper2016/02/18

    Hierarchical Temporal Memory (HTM) is a biologically inspired machine intelligence technology that mimics the architecture and processes of the neocortex. In this white paper we describe how to encode data as Sparse Distributed Representations (SDRs) for use in HTM systems. We explain several existing encoders, which are available through the open source project called NuPIC, and we discuss requirements for creating encoders for new types of data.

  9. Sebastian Billaudelle & Subutai AhmadNeuroscience
    Research Paper2015/05/08

    Recently there has been much interest in building custom hardware implementations of HTM systems. This paper discusses one such scenario, and shows how to port HTM algorithms to analog hardware platforms such as the one developed by the Human Brain Project.