How to tune parameters to avoid cost:nan?

[o0windseed0o]

Using our own data from EHR and default parameters of med2vec, the cost went nan in epoch 1. Which parameter should I adujst to avoid such things happen? Enhance L2 or set a bigger log_eps? We have in total over 100 thousand batches, do we need to set a bigger batch_size?

[mp2893]

First you need to figure out where the NaN is coming from.
It could be coming from the model output (the predicted values), or the gradients.
But finding the source of NaN is not easy in Theano (refer to this page)
I would suggest you change the size of the mini batch from 2 to 100 or even 1000.
Hope this helps.
Ed