Practical aspects of deep learning

If your Neural Network model seems to have high variance, what of the following would be promising things to try?

Make the Neural Network deeper

N

Get more training data

Y

Get more test data

N

Add regularization

Y

Increase the number of units in each hidden layer

N

You are working on an automated check-out kiosk for a supermarket, and are building a classifier for apples, bananas and oranges. Suppose your classifier obtains a training set error of 0.5%, and a dev set error of 7%. Which of the following are promising things to try to improve your classifier? (Check all that apply.)

Increase the regularization parameter lambda

Y

Decrease the regularization parameter lambda

N

Get more training data

Y

Use a bigger neural network

N