Sit on one's hand

This weekend, I watched one movie called "Pride and Glory" by Colin Farrell. There's one sentence "don't sit on your hands here" I don't know. After looking up in the dictionary, I understood it means "fail to act". I think this would be one useful phrase.