Yup, virtual machines usually have a really bad drop in performance. "Usually", because you can reserve a spare graphics card and resources only for use with this one specific machine. But in that case, you might just buy another computer or dual boot (thats what I did while getting used to Linux) instead.