BLOOMFIELD, N.M. (KRQE) – A New Mexico city is working to keep its monument of the Ten Commandments despite a court ruling saying it violates the Separation of Church and State.

The case stems from a suit filed by the ACLU on behalf of two pagan worshipers who say they are offended by the monument in Bloomfield.

A federal judge told the city to take it down.Wednesday, the U.S. Court of Appeals agreed. But now, the city is considering appealing to the U.S. Supreme Court.

They argue the monument honors significant documents in American history and should not be removed because two people are offended.