If you go back to premium now and continue to use premium everything will be fine.Over the long term it can damage the engine, and in the short term you will lose power and maybe even get funny noises from the engine.Don't worry about what you did, I seriously doubt you caused any harm. Just don't do it in future.