magento2: [2.2.4] Gallery Magnifier hover event does not always cancel magnifier when mouse leaves gallery

Gallery Magnifier hover event does not always cancel magnifier when mouse leaves gallery

Preconditions

1. Stock Magento 2.2.4 install
2. Apply PR #15020 so we are not testing issue ontop of issue
3. Change luma theme to enable magnifier

        <var name="magnifier">
            <var name="fullscreenzoom">20</var>  <!-- Zoom for fullscreen (integer)-->
            <var name="top"></var> <!-- Top position of magnifier -->
            <var name="left"></var> <!-- Left position of magnifier -->
            <var name="width"></var> <!-- Width of magnifier block -->
            <var name="height"></var> <!-- Height of magnifier block -->
            <var name="eventType">hover</var> <!-- Action that atcivates zoom (hover/click) -->
            <var name="enabled">true</var> <!-- Turn on/off magnifier (true/false) -->
        </var>

1. Set current theme to luma
2. Create test product with image

Steps to reproduce

1. View test product on frontend
2. Move mouse over image
3. Move mouse away from image over each of the four sides of the image in turn

Expected result

1. Magnifier should appear when mouse over image
2. Magnifier should disappear when mouse leaves images

Actual result

1. Magnifier does not always disappear

Video of it happening