Desires are roots of interactions in this world.
We desire something from others. This moves us towards others.
Others desire something from us. They drive them towards us.
Interactions are happy and painful. They cause sufferings and pleasures.
First free from your desires.
Then protect yourself from desires of others from you..
If you have objects of material pleasures, like money, it is natural for all mankind to want it from you.