I moved to BA in January back in the day and I loved it. The city was half empty as per usual for a January so it wasn't overwhelming, it was hot but I'm used to heat and humidity. Many may think the opposite, that BA is boring in January since it does empty out (which is what makes it my favorite month!) so it's up to you, I think you should just come on down!