The decision was made Tuesday by officials with the Blackstone Health Department to order the owner of the home to tear it down.
Earlier this month, the bodies of three babies and several animals were discovered in the vermin-infested home after the neighbor alerted authorities.
The home was also filled with dirty diapers, trash and rodents.
The mother, Erika Murray, 31, faces several charges, including fetal death concealment.
Four other children, including a 6-month-old, a 3-year-old, a 10-year-old and a 13-year-old, were removed from the house in August after a neighbor notified police about their living conditions. Those children are in state custody.
The father of the children found living in the home said he was unaware of the deplorable conditions.
The owner Kristina Rivera now has seven days to begin the demolition process. Town officials say Rivera has not responded to notices from the town.
If Rivera does not tear the house down within seven days, she will be fined $500 a day plus the $20,000 she already owes for the cleanup.