Primly derives from Middle English -ly, Latin primus meaning "first," and Proto-Indo-European per-, tracing ultimately to roots meaning "forward" or "first in order."
primly (English): In a prim manner