Hebbian learning inspired estimation of the linear regression parameters from queries

Understand

Local learning rules in biological neural networks (BNNs) are commonly referred to as Hebbian learning.

• [26] links a biologically motivated Hebbian learning rule to a specific zeroth-order optimization method.
• In this work, we study a variation of this Hebbian learning rule to recover the regression vector in the linear regression model.
• Zeroth-order optimization methods are known to converge with suboptimal rate for large parameter dimension compared to first-order methods like gradient descent, and are therefore thought to be in general inferior.