Banned Los Angeles Clippers owner Donald Sterling says he will not pay the $2.5 million fine the NBA imposed on him last month for his racist remarks.

According to USA Today Sports, the 80-year-old’s attorney, Maxwell Blecher, sent a letter to the NBA saying that his client doesn't warrant "any punishment at all" for his comments.

Sports Illustrated noted that the letter says, “We reject your demand for payment.”

The letter goes on to claim that Sterling has not breached the NBA constitution and that his "due process rights" were violated by the league's investigation.

Late last month, TMZ Sports released a recording in which the owner was heard making racist comments on the phone to his girlfriend V. Stiviano.

After the audio was made public, NBA commissioner Adam Silver banned him from the game for life and handed down the fine.

The fine was due this week. Sterling can continue to contest it, however, NBA bylaws state that his ownership could be terminated if the fine is not paid within 30 days of written notice.