Active Online Learning in the Binary Perceptron Problem*

Supported by the National Natural Science Foundation of China under Grant Nos. 11421063 and 11747601 and the Chinese Academy of Sciences under Grant No. QYZDJ-SSW-SYS018

Zhou Hai-Jun1, 2, †
       

An example of the overlap function q(n) for a small perceptron of size N = 33. The random initial binary pattern ξ happens to have overlap q(0) = 7 with the teacher’s binary weight vector T, and q(n) is the new overlap with T after the first n entries of ξ are all flipped. In this example q(n) changes sign seven times.