Okay. But if you replace the Orcs with let's say... Lizard People. Do you really lose anything? No. You don't. The fact that they're Orcs and they're there add nothing to the story.
Like I said, I am not suggesting you develop every individual Orc, but the secret to good world building is asking yourself 'Why?'
Why is this village here and not over here, because the river they are on gives them more food, why do focus on fish and not wild game or some other food, where does the river come from? Why is it filled with do many fish? The more of these questions you answer or hint at, the more fleshed out your world becomes.
Why're the Orcs Attacking the Humans, Because Sauron told them to. Why are the Orcs listening to Sauron? Well, it's definitely not because he treats them well, it's presumably because he promised them power of some kind. But we don't really ever see an Orc with this Power, like, we don't see Orc Ring Wraiths or anything like that for example. Once again Shadow of Mordor sort of touches on this with some of the Orcs, but that's because that game is focused on making the Orcs a believable part of the world with their own culture and attitudes towards the world that we actually get to see. We see their rituals, their day to day, their hierarchy, the different clans and how they each behave.
However, we never see anything like that in the Main Series of LotR.
There should be a reason you are picking Orcs Instead of Goliaths, or Trolls, or Goblins, or Kobolds, or Bugbears, or Hobgoblins, or Giants. You shouldn't just make them all the exact same interchangeable creature just with slightly different abilities. The best universes are ones that expand on each and every monster, because news flash, no one is evil because they are evil, it's not realistic, no one ever thinks they're the bad guys. So that begs the question, why do Orcs think these actions are acceptable? Is it part of their culture? Are they trying desperately to survive? Have they been pushed out of their native lands and are now forced to try and take whatever they can get? Make it so your Orcs have a reason to actually be Orcs.
Have them act like actual thinking, reasoning beings that aren't driven by a mindless murder boner. Your players will thank you.