1. Before I took this job with the government, I had to reveal the fact that I had been arrested when I was a teenager. That has always been my skeleton in the closet.
2. Rachel’s family had a relative who spent years in prison. They always tried to keep that family skeleton a secret.

The expression suggests something undesirable that is hidden away in the closet but that one cannot get rid of.