customize-cra: config-overrides not being processed in test command

I’m doing this to add emotion support:

addBabelPlugin('emotion'),

it works just fine on yarn start but if I run yarn test I get the error saying that I’m trying to use the emotion shortcuts without the babel plugin.

Do I need to do something to inject the plugin in the Jest config?