You need to allocate a certain amount of memory to the virtual machine. So if you don’t have much RAM, or you use a lot of applications on your main OS, then yes, it can slow down performance while you are running your virtual machine. In most cases it’s not noticeable though. I run a virtual windows machine on my Linux box with no noticeable slowdown at all.