Use FunctionWrappers to avoid function specialization in test scenarios

[gdalle]

This could potentially save a lot of compilation time

https://github.com/JuliaLang/FunctionWrappers.jl

[ChrisRackauckas]

But AD doesn't do very well with them in many cases, or have to dereference them 😅