Navigation: Bookkeeping > Select Client > Purchases > Payments

You may simply delete the advance payment by using the delete option under Action drop-down box.

Please refer below screenshot for more help.