Ok, I know this is probably trivial, but since this has cost me a better part of a Sunday, here I go:
The error
tensorflow/stream_executor/cuda/cuda_dnn.cc:427] could not set cudnn tensor descriptor: CUDNN_STATUS_BAD_PARAM
is in 99.9% of cases NOT a Tensorflow problem, but YOU messing up inputs to whatever layer. Trust me.