“Very late at night” in Chinese is 深夜 (shēnyè).
在深夜，我总是如释重负。
I am always freed of all of my worries and concerns in the depth of the night.
Example sentence from Tatoeba (CC BY 2.0).