Personally I've worked out for years doing primarily the big 4, and have gotten good results. Occasionally id do assistance work but not usually. The only thing that's noticeable are my arms and back are a little lacking in definition imo, but not severely. Id say you should be fine, especially if you plan to pick it up more accessory work later on.

I also lift on the heavier side of my %ORM for strength though.