Very interestingly put and great references! I agree, GPUs are really ideal for ANNs but not for brain-based architectures where you only need to use a tiny subset of “weights” for each specific input. Currently we are using CPUs and parallelize across those which gives much more flexibility and efficiency for an architecture like ours. But we are also looking to collaborate with groups implementing hardware that is specifically optimized for brain-like architectures. For instance this group at CMU is doing super interesting work: [2405.11844] NeRTCAM: CAM-Based CMOS Implementation of Reference Frames for Neuromorphic Processors