It is not unusual for a celebration for family and friends to follow the Baptism ceremony of your baby boy or girl, by bringing a gift. Items religious in nature are the customary baptism gift to give. Bibles, rosaries, crosses, picture frames and jewelry are perfect examples of baptismal remembrances of the day.