A baby girl was left inside a house without adults two times – and completely alone on another occasion – before she died of suspicious injuries, detectives will allege.