-
Notifications
You must be signed in to change notification settings - Fork 1.1k
Open
Labels
t-toolingIssues with this label are in the ownership of the tooling team.Issues with this label are in the ownership of the tooling team.
Milestone
Description
- There are multiple opportunities throughout Crawlee to improve type safety and optionally introduce runtime validation:
- Dataset items (
CrawlingContext.pushData) - Key-value store content
Request.userData- Request routing labels
- ? possibly somewhere else
- Dataset items (
- One option is allowing the user to declare some special types (
DatasetItem,RequestLabel, ...) in a.d.tsfile and using it for type checking- TanStack router utilizes a similar approach
- A safer and more versatile approach would be to accept standard-schema models (either via
BasicCrawlerorConfiguration) and infer the types from those- this would also add runtime validation (in contrast to the
.d.tsapproach which is more of a gentleman agreement)
- this would also add runtime validation (in contrast to the
Metadata
Metadata
Assignees
Labels
t-toolingIssues with this label are in the ownership of the tooling team.Issues with this label are in the ownership of the tooling team.