The cold weather sticks around through the first several hours of 2026 before a warm up begins Thursday afternoon.