1. Years ago Sam was down and out. He had no job and no money.
2. This is a shelter for the down and out of the city. The homeless can come here for a hot meal and a place to sleep at night.

The expression suggests the idea of being down at the bottom of society and out of luck.