That’s according to Steve McMahon, former star of rivals Liverpool.
The Red Devils season came to a whimpering end with a 2-0 loss to Cardiff last weekend.
Ole Gunnar Solskjaer’s side finished sixth in the Premier League table, only winning two of their last 12 games of the season.
This has seen speculation emerge of the Norwegian making big changes this summer.
And one star at the centre of it is Pogba, who was on the end of abuse from fans at Old Trafford.
The Frenchman has been one of the most prolific United stars this season, with 16 goals and 11 assists.
But McMahon, who made more than 200 appearances for the Reds, told Stadium Astro the midfielder was part of the problem at the club.
“They down tools whenever they like,” the 57-year-old said.
McMahon’s claims come as:
“Pogba throws his dummy out of the pram any time it suits him and you can’t do anything about it because you can’t sack players.
“Players have got a lot to do with the downfall at Man United.”
And the Liverpool legend made a huge claim about Pogba’s impact on the club.
McMahon added: “Sir Alex Ferguson was brave enough to get rid of the superstars because he thought they weren’t good enough for the club.
“He got rid of Pogba – there’s a reason why he did it, because of his mentality.
“Pogba throws his dummy out of the pram any time it suits him. They’re further away than they’ve ever been”
“They have to attract players with the right heart, who want to play for United for the right reasons, not financial gain.
“They’re further away than they’ve ever been.
“They’re as far away as they’ll ever be from winning the Premier League or getting back to the Champions League.
“They’re a million miles away.”
McMahon then explained how United can rebuild next season.
“It’s a rebuild, from the top down,” he continued.
“And it’s not just the management. The hierarchy have got to take responsibility.
“There’s been too many times where they’ve been looking over their shoulder to Sir Alex, saying ‘what should we do’.
“I’d like one of the managers to stand up.
“Jose [Mourinho] tried it and he was fighting a losing battle because the players are so powerful in this day and age.”
This comes as a former star is reportedly ready for a United return.