i think there is a perspective problem: on the reference, the distance between the tip of the nose and the border of the face on the right is much smaller than on your portrait. The nose is also covering part of an eye on the reference, and this is missing in your painting. Have you tried flipping the canvas horizontally? This helps spotting that kind of problems.