Skip to content

Replaced URI.openStream with HTTPClient/HttpRequest so that user-agen… #93

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
subkanthi wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Replaced URI.openStream with HTTPClient/HttpRequest so that user-agen… #93

subkanthi wants to merge 1 commit into from

Conversation

@subkanthi
Copy link
Collaborator

@subkanthi subkanthi commented Jan 22, 2026 

 insert nyc.taxis2 -p https://d37ci6vzurychx.cloudfront.net/trip-data/yellow_tripdata_2025-01.parquet
2026-01-22 12:30:21 [61304908-50] INFO c.a.i.r.c.i.r.RESTCatalogServlet > @token GET v1/config
2026-01-22 12:30:21 [61304908-32] INFO c.a.i.r.c.i.r.RESTCatalogServlet > @token HEAD v1/namespaces/nyc/tables/taxis2
2026-01-22 12:30:21 [61304908-32] WARN c.a.i.r.c.i.r.RESTCatalogServlet > @token HEAD v1/namespaces/nyc/tables/taxis2: Table does not exist: nyc.taxis2
2026-01-22 12:30:26 [61304908-50] INFO c.a.i.r.c.i.r.RESTCatalogServlet > @token HEAD v1/namespaces/nyc
2026-01-22 12:30:26 [61304908-51] INFO c.a.i.r.c.i.r.RESTCatalogServlet > @token POST v1/namespaces/nyc/tables
2026-01-22 12:30:26 [61304908-50] INFO c.a.i.r.c.i.r.RESTCatalogServlet > @token POST v1/namespaces/nyc/tables/taxis2
2026-01-22 12:30:26 [61304908-51] INFO c.a.i.r.c.i.r.RESTCatalogServlet > @token GET v1/namespaces/nyc/tables/taxis2
2026-01-22 12:30:27 [61304908-50] INFO c.a.i.r.c.i.r.RESTCatalogServlet > @token GET v1/namespaces/nyc/tables/taxis2
2026-01-22 12:30:27 [-5-thread-1] INFO c.a.i.c.internal.cmd.Insert > https://d37ci6vzurychx.cloudfront.net/trip-data/yellow_tripdata_2025-01.parquet: processing
2026-01-22 12:30:27 [-5-thread-1] INFO c.a.i.c.internal.cmd.Insert > https://d37ci6vzurychx.cloudfront.net/trip-data/yellow_tripdata_2025-01.parquet: copying to s3://bucket1/nyc/taxis2/data/1769106627015-5526da589bc474f953669f343505ec94f0074bfc701eb046184de439bfe0485f.parquet
2026-01-22 12:30:33 [-5-thread-1] INFO c.a.i.c.internal.cmd.Insert > https://d37ci6vzurychx.cloudfront.net/trip-data/yellow_tripdata_2025-01.parquet: adding data file (copy took 6s)
2026-01-22 12:30:33 [main] INFO o.a.i.SnapshotProducer > Committed snapshot 5974146167345494494 (MergeAppend)
2026-01-22 12:30:34 [61304908-51] INFO c.a.i.r.c.i.r.RESTCatalogServlet > @token POST v1/namespaces/nyc/tables/taxis2/metrics
2026-01-22 12:30:34 [61304908-50] INFO c.a.i.r.c.i.r.RESTCatalogServlet > @token GET v1/namespaces/nyc/tables/taxis2
2026-01-22 12:30:34 [61304908-51] INFO c.a.i.r.c.i.r.RESTCatalogServlet > @token POST v1/namespaces/nyc/tables/taxis2

@subkanthi
Replaced URI.openStream with HTTPClient/HttpRequest so that user-agen…
077b6c5 
…t headers can be set and any errors are visible (403, redirection) to the user
@subkanthi subkanthi linked an issue Jan 22, 2026 that may be closed by this pull request
Error inserting file from taxi example: file is not a Parquet file #91
Open
@subkanthi subkanthi requested a review from xieandrew January 22, 2026 18:32
xieandrew
xieandrew approved these changes Jan 22, 2026
View reviewed changes
Copy link
Collaborator

@xieandrew xieandrew left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@xieandrew xieandrew xieandrew approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Error inserting file from taxi example: file is not a Parquet file

3 participants

@subkanthi @xieandrew