Jamie Vardy (twice) and Danny Drinkwater scored for the hosts, before Phillipe Coutinho pulled one back for the Reds.
Musa was not included for their first game since Claudio Ranieri was sacked as manager.
The supporters have been campaigning for Demarai Gray to take Musa’s spot in the team.
Gray has made 19 appearances and scored one goal in the league this season, while Musa has played 18 games and scored two goals. Gray was named on the bench for the encounter at the King Power Stadium.
Another Eagles star, Wilfred Ndidi, however started the game.