Man charged in death of infant