“Yesterday” in Chinese is 昨天 (zuótiān).
我昨天很忙。
I was busy yesterday.
Example sentence from Tatoeba (CC BY 2.0).