The family rejoiced over the birth of their first child.
Idiomatic Expressions for rejoice
Phrase: rejoice in someone's success
Meaning: to feel joy or satisfaction in someone else's achievements or accomplishments
Usage: True friends rejoice in each other's success and support each other through thick and thin.