Twins for Costello and Krall

Singers Elvis Costello and Diana Krall welcomed twin boys into their family on Wednesday. The 42-year-old jazz singer gave birth to the twins in New York City on December 6. They named the boys Dexter Henry Lorcan and Frank Harlan James. The couple said in a statement about their new bundles of joy, "We are ecstatic!" The statement continued saying, "both mother and sons are doing splendidly."

The birth of the twins comes just one day after the couple celebrated their third anniversary. The 52-year-old Rock and Roll Hall of Famer has been married twice before, but this is Krall's first marriage.

This past spring, Costello released an album with Allen Toussaint called The River in Reverse, while Krall released her latest, From This Moment On, in September.