Doing something "on purpose" means that you intended to do it. In other words, it wasn't a mistake.
A: Did you do that on purpose?
B: No, it was an accident.
You can also use the word "purposefully":
A: You purposefully lied to me!
B: No, I thought I was telling you the truth.