Rift PvE or PvP gameplay? What players usually prefer?

I just want to know which game play server is good and have lots of players to interact with? I'm still weighing things around if I go for PvP or should I go for PvE. I really want the PvP server but it just gets annoying sometimes when you’re doing PvE and then suddenly players who reach the level cap starts attacking you.