Audrey's father left to get the milk very early on, and she barely remembers him. Her family had been middle class and living in a good neighborhood before this happened, but her mom wasn’t able to find a job that paid well enough for them to keep the house after her husband left (sexism yay), and they ended up in Skid Row. Audrey was just old enough to kind of understand what was happening at the time, and she has some vague memories from before she ended up in Skid Row. This is why she is the only character who has a Brooklyn accent.