A 128-neuron RBM layer leads to higher test set accuracy but a lower overall accuracy:
Reconstruction loss: 0.180337: 100%|██████████| 5/5 [00:32<00:00, 6.44s/it] Start deep belief net finetuning... Tensorboard logs dir for this run is /home/ubuntu/.yadlt/logs/run57 Accuracy: 0.0698: 100%|██████████| 1/1 [00:03<00:00, 3.16s/it] Test set accuracy: 0.0763999968767