Complex Systems

Investigating Rules and Parameters of Reservoir Computing with Elementary Cellular Automata, with a Criticism of Rule 90 and the Five-Bit Memory Benchmark Download PDF

Tom Eivind Glover 1 , 4
Pedro Lind 1
Anis Yazidi 1
Evgeny Osipov 2
Stefano Nichele 1 , 3


1 Department of Computer Science
Oslo Metropolitan University
Oslo, Norway
2 Department of Computer Science, Electrical and Space Engineering
Luleå University of Technolog
Luleå, Sweden
3 Department of Computer Science and Communication
Østfold University College
Halden, Norway
4 tomglove@oslomet.no, tom.eivind.glover@gmail.com

Abstract

Reservoir computing with cellular automata (ReCAs) is a promising concept by virtue of its potential for effective hardware implementation. In this paper, we explore elementary cellular automata rules in the context of ReCAs and the 5-bit memory benchmark. We combine elementary cellular automaton theory with our results and use them to identify and explain some of the patterns found. Furthermore, we use these findings to expose weaknesses in the 5-bit memory benchmark as it is typically applied in ReCAs, such as pointing out what features it selects for or solving it using random vectors. We look deeply into previously successful rules in ReCAs such as rule 90 and explain some of the consequences of its additive properties as well as the correlation between grid size and performance. Additionally, we present results from exhaustively exploring ReCAs on key parameters such as distractor period, iterations and grid size. The findings of this paper should motivate the ReCAs community to move away from using the 5-bit memory benchmark as it is being applied today.

Keywords: Reservoir Computing; Cellular Automata; Reservoir Computing with Cellular Automata (ReCAs); Edge of Chaos

Cite this publication as:
T. E. Glover, P. Lind, A. Yazidi, E. Osipov and S. Nichele, “Investigating Rules and Parameters of Reservoir Computing with Elementary Cellular Automata, with a Criticism of Rule 90 and the Five-Bit Memory Benchmark,” Complex Systems, 32(3), 2023 pp. 309–351.
https://doi.org/10.25088/ComplexSystems.32.3.309