I put images in Text Boxes and format the boxes to not move with text. (select box and right click for "format Text Box" or find another similar thing on a ribbon somewhere (or are they toolbars?).
Captions inside the boxes under the image.

It is so much easier than trying to control images alongside text because Micr$oft thinks it knows how you want it to behave and any changes to the images can revert to their methodology.