It maybe poorly fitted handle plate, there's a retaining slider/latch behind that can only be moved by lifting the handle fully up & with a thin tool slide it across so the handle plate can come of, its a pita to do sometimes.
Any pics of both drivers/passengers handles to see if there's any major differences in fitment, pics side by side would be good.