What's to stop other sha256 miners with lots of hash just m…

What's to stop other sha256 miners with lots of hash just mining blocks with few transactions in them. This is completely within the rules, they could even mine empty blocks. They can come & go freely. This is my concern. W