Yes, you can purchase VIP items using Closet Swap without having a VIP account. Please note that Closet Swap does not work on all items. Because of this, it is best to save items one at-a-time.

Also, ensure you have enough points for the item you are trying to take (this is irrelevant for free items).