WIP: Add support for remote Parquet writer with openDAL

[comphead]

Which issue does this PR close?

Running experiments to use openDAL with HDFS writes on local and remote clusters

Closes #2890 .

Rationale for this change

What changes are included in this PR?

How are these changes tested?

[codecov-commenter]

Codecov Report

❌ Patch coverage is 0% with 3 lines in your changes missing coverage. Please review.
✅ Project coverage is 55.82%. Comparing base (f09f8af) to head (959f192).
⚠️ Report is 801 commits behind head on main.

Files with missing lines	Patch %	Lines
...comet/serde/operator/CometDataWritingCommand.scala	0.00%	3 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff              @@
##               main    #2929      +/-   ##
============================================
- Coverage     56.12%   55.82%   -0.31%     
- Complexity      976     1282     +306     
============================================
  Files           119      167      +48     
  Lines         11743    15494    +3751     
  Branches       2251     2570     +319     
============================================
+ Hits           6591     8649    +2058     
- Misses         4012     5578    +1566     
- Partials       1140     1267     +127     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[comphead]

I can see double writes in the plan now

[comphead]

Filed #2971 for double writes