[Feature] DBT Instrumentation with opentelemetry tracing

[sfc-gh-vguttha]

Is this your first time submitting a feature request?

• I have read the expectations for open source contributors
• I have searched the existing issues, and I could not find an existing issue for this feature
• I am requesting a straightforward extension of existing dbt functionality, rather than a Big Idea better suited to a discussion

Describe the feature

We are collaborating to add opentelemetry auto instrumentation to DBT execution which involves in code changes to dbt-core, dbt-common, dbt-adapters.

As part of this feature we want to achieve the following:

1. Add span to trace the dbt model execution.
2. Add span for pre_hooks and post_hooks executed within a model and the parent of these spans gonna be model span.
3. Add a span for on-run-start and on-run-end executions.
4. Add a span called metadata setup which traces the metadata queries DBT submits to find database/schema and create schema if required.

To support this we add new dependency on opentelemetry-api.

Describe alternatives you've considered

No response

Who will this benefit?

Snowflake customers can have auto-instrumented Telemetry for their dbt workloads but we believe this would be useful for other users of DBT to understand and debug the pipeline by configuring opentelemetry and collecting the exported instrumentation.

Are you interested in contributing this feature?

Yes

Anything else?

No response