[Feature] Run regression tests against Local Livy

[mdrakiburrahman]

Is this your first time submitting a feature request?

• I have searched the existing issues, and I could not find an existing issue for this feature
• I am requesting a straightforward extension of existing dbt functionality, rather than a Big Idea better suited to a discussion

Describe the feature

Take a Spark + Livy Container and run tests against it, something like this:

https://github.com/mdrakiburrahman/spark-devcontainer

We can potentially make something like this work by using casettes:

microsoft/fabric-cicd#739

Describe alternatives you've considered

Don't test stuff

Who will this benefit?

All customers, reliability and integration tests are great for quality

Are you interested in contributing this feature?

Yes

Anything else?

No response