Supreme Court Justice Samuel Alito told Democrats in Congress that he won’t step aside from two pending cases related to former President Donald Trump and the Jan. 6 attack following news reports about contentious flags flown at his house and vacation home.

The conservative justice said in letters to House and Senate Democrats that he had no involvement in the decision to fly the flags, which have been embraced by Trump supporters who protested the 2020 election results, because they were raised by his wife, Martha-Ann Alito, who he said wouldn’t take one of them down “for several days” despite his entreaties.