Skip to content

Refactored and added new tests and data for Date, GroupBy operations, Value functions and other scenarios #536

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 3 commits into
base: master
Choose a base branch
from

Conversation

KazimMir
Copy link
Member

Refactored and added new tests and data as below:

  • Added Data and Schema for NycTaxiDateData
  • Added tests to validate the date scenarios
  • Added tests to validate the GroupBy operations, Value functions and other scenarios

KazimMir added 3 commits June 11, 2025 09:45
… Value functions and other scenarios

- Implemented GroupByWithListAverage query to calculate average LocationID by Borough.
- Added output for GroupByWithListAverage to validate results.
- Created GroupByWithListMinMax query to find max and min values for Zone and LocationID by Borough.
- Added output for GroupByWithListMinMax to validate results.
- Developed GroupByWithListMinMaxDateTime query to find max and min pickup datetime by PULocationID.
- Added output for GroupByWithListMinMaxDateTime to validate results.
- Implemented GroupByWithTableRunCount query to count occurrences of Zones.
- Added output for GroupByWithTableRunCount to validate results.
- Created ValueFunctions query to test various mathematical operations on passenger_count and total_amount.
- Added output for ValueFunctions to validate results.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we just have Table.FirstN(table,1) for these kind of scenarios. It is hard to figure out whats in pqout file.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The output is larger for only NoSkipTake which is expected. There are 3 options - Leave it as is, reduce the source table to from 264 to something smaller like 5 rows or just do a rowcount comparison. Any suggestions?

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same applies here and some other scenarios. Table.FirstN is what we should use.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'll check and address and other places.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants