“You only saw my baby once” – Lady calls out her mother for failing as a grandmother