Let yourself go
"Let yourself go" is a derogatory phrase meaning that you stopped taking care of your physical self.
"Let yourself go" is also a strong suggestion to relax. To settle into yourself and to be more free.
In the conflict of those interpretations is the fear of being ourselves.