Do I go down a rank if I spend my points?

No! Once you hit a rank, you will remain that rank until you level up. Spending your points will not decrease your total point count in terms of reaching the next level.