The phrase to be left holding the bag is as widely used as the expression to let the cat out of the bag.

VOA: special.2009.01.25

Once the public revolted, after realizing that it would be left holding the bag, the Icelandic feds had no choice.

FORBES: When Sovereign Default Is The Most Attractive Option

Nobody knows, but do you want to be left holding the bag if the next one is worse than the last one?

FORBES: More Thoughts on Renting Your Fun

And unfortunately, you, you're going to be left holding the bag because you've gotten the mortgage that you probably couldn't afford to begin with.

NPR: Will Interest-Rate Cut Really Help?