The vocal quartet The Tenors have apologized and suspended one its members for adding the words “All Lives Matter” to a version of “O Canada” during Tuesday night’s All-Star Game.

On July 12, the group was performing a rendition of “O Canada” at the 2016 MLB All-Star game when member Remigio Pereira altered the lyrics of the Canadian national anthem to include the words “All Lives Matter.” He also held up a handwritten sign saying the same thing. The FOX stations in the U.S. did not air that part of the broadcast, but it was shown in Canada and mostly meant with criticism.

The other group members Victor Micallef, Fraser Walters and Clifton Murray released a statement via Twitter after the performance saying that they did not know Pereira was planning to do that and were shocked and embarrassed by his actions. They also apologized and said that they have suspended performances with him until further notice.

Pereira later took to Twitter with his own statements in which he said he has been “so moved” by the tragedies that have taken place recently that he felt compelled to do what he did. He did not, however, apologize for it.