Very interesting point. Probably the most pressing problem then is to find a way for the black box to be formally verified and the role of AI engineers shifts to keeping the CI\CD green.