Jimmy Eat World covered Taylor Swift’s “We Are Never Ever Getting Back Together” during their set on Conan Monday night.

The rockers also played their own song “Damage” off their new album Damage Billboard reports. They added their own style to Swift’s song by ditching the light pop sound and replacing it with hard-hitting guitars.

The band have performed their version during their set on their North American tour, which is supporting their newly released album.

“I hate saying more raw, but it’s more raw and warm. I would describe it as an attempt at making an adult break-up record,” frontman Jim Adkins said to Rolling Stone regarding the album. “There was less an emphasis on it being clean and perfect. There’s a lot of stuff that’s more about the performance that it sounding pristine. And I think it feel better for what the songs are.”

Damage hit number 14 on Billboard 200 during its June release. Check out the performance below.