O'Reilly logo
  • Victor Bos thinks this is interesting:

Our algorithms try to separate data into classes based on the features; therefore as the number of features increases, so will the number of datapoints we need.

From

Cover of Machine Learning, 2nd Edition

Note

Moreover, the number of data points has to grow much faster. Does it have to grow at an exponential rate of the number of features?