Is it cold in the air?

Nope, It's not colder than the air on the ground. Because the balloon moves with the wind, there is no breeze.

It's recommended that you dress in layers - so that you can remove clothing if you get too warm. Generally the coldest part of the experience is in the early morning when you meet with the operator.