Prince Harry Loses Legal Fight for Police Protection in the U.K.

The Duke of Sussex had argued that he should have automatic protection for himself and his family whenever they visit the U.K. from their home in California after the U.K. authorities stripped away the right in February 2020, shortly after he and wife Meghan Markle stepped back from official royal duties.

 In a statement in December, Harry said he "felt forced" to step back from his royal role and leave the U.K. in 2020, citing security concerns for his family: his wife, Meghan, the Duchess of Sussex, and their two children, son Prince Archie, 4, and Princess Lilibet, 2.On Wednesday, however, High Court judge Peter Lane upheld the decision by the U.K. government and, specifically, the Executive Committee for the Protection of Royalty and Public Figures (RAVEC) to downgrade his security.

The court has found that there has not been any unlawfulness in reaching the decision of 28 February 2020," Lane ruled in documents seen by PEOPLE. "The decision was not irrational. The decision was not marred by procedural unfairness.

"The court has also found that there has been no unlawfulness on the part of RAVEC in respect of its arrangements for certain of the claimant’s visits to Great Britain," the

 ruling added.Harry is now going to appeal

 against the decision.

“The Duke is not asking for preferential treatment, but for a fair and lawful application of RAVEC’s own rules, ensuring that he receives the same consideration as others in accordance with RAVEC’s own written policy," a legal spokesperson said in a statement to PEOPLE on Wednesday.