Can you kill zeds by hiting them with guns?

Or do you only push them back? Also can you preform that with every weapon? Or only some (non melee ofc)?