Its upto yourself if you fit a push to exit button, it will give it a more professional finish but as you said can be opened by turning the yale.
a point to remember though.... if you are fitting this on a fire route you must have a green break glass unit for emergencies, which will make the door fail safe so people dont get trapped in a panic