DOM-74290 - Update airflow & packaging. Remove unused deps

[ddl-s-rodriguez]

Link to JIRA

DOM-74290

What issue does this pull request solve?

Airflow dependency is old and implies fixing packaging among other ones which ends up having conflicts for some users

What is the solution?

• Bump airflow to a less restrictive version ~=2.11 (not yet jumping to v3)
  • Some small changes needed to be done to the Airflow operator
• Allow more flexibility for the packaging lib --> >=23.2,<27
• Fix frozendict version that showed different versions in the requires vs dev
• Removed unused dependencies from the dev package: [Jinja2, nbconvert, packaging, polling2]

Testing

Briefly describe how the change was tested. The purpose of this section is that a reviewer can identify a test gap, if any.

e.g. "I ran an upgrade from 4.2 to 4.6".

• Unit test(s)

Pull Request Reminders

• Has the changelog been updated
• Has relevant documentation been updated?
• Does the code follow [Python Style Guide] (https://black.readthedocs.io/en/stable/the_black_code_style/current_style.html)
• Are the existing unit tests still passing?
• Have new unit tests been added to cover any changes to the code?
• Has the JIRA ticket(s) been linked above?

References (optional)