Charlie Sheen lost the court trial against ex-wife Denise Richards and is now calling for a boycott of the latter’s upcoming E! reality show. The actor took his ex-wife to court in a failed attempt to prevent her from putting their two daughters in her own reality show. Charlie does not want the spotlight on their daughters, as both are still very young.

“Issue a mass boycott,” the actor half-jokingly told PEOPLE at an Academy for TV event for his sitcom, Two and a Half Men.

In January, a judge gave Denise Richards permission to include the ex-couple’s daughters, Sam and Lola, in the upcoming show. The show is being produced by Ryan Seacrest’s company and is as yet untitled. It is supposed to air this summer.

Even though he lost the court trial, Charlie is still publicly opposed to the project. “You don’t go to court and make stands to prevent that if you don’t firmly believe in it,” he said. When asked about the court decision the star replied, ”The world is upside down sometimes.”