Four years after the release of their last album, rock band Paramore is preparing to release their biggest album yet.

In a recent interview with The Guardian, band members Hayley Williams and Taylor York admitted that the album almost never happened.

Their last album, Paramore, released in 2013 reached No. 1 in the U.S. and U.K. and won the band a Grammy for the single “Ain’t It Fun.” But despite their mainstream success, Paramore has had their fill of inner drama.

Williams, 28, founded the rock band when she was 15. According to the interview, the 13 years since the band’s foundation have never been easy. Originally 5 members, Paramore now consists of only three and Williams is the only person who has ever stayed constant. An act that she admitted was hard to do.

Related: Top 10 songs by Paramore

“Two years ago I asked Taylor if we could start a new band,” Williams told The Guardian. “I was so sick of this crap. I said we should just try something new, give it a new name.”

York agreed with Williams enthusiastically.

“I’ve wanted to quit this band so many times,” he said. “Going through all this conflict and drama over the years… I was just like: ‘Man, I feel like we can keep going, but this is not worth it if we don’t want to be here.”

Paramore’s fifth album, After Laughter,  will be released on May 12.