A wind chill Thursday is making it feel colder in South Florida. But temperatures will start to climb up to end the week.