Rainmeter provides a basic user interface for managing your library of skins, saving and restoring layouts, and changing basic settings such as a skin's location, transparency, and "always on top" behavior.
After choosing your desired setting on the Rainmeter menu, you can see the immediate effect by clicking on the "refresh" tab like below. Whatever setting that you choose, make sure to click the "refresh" tab to see the result of the skin itself.