Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test with and without spark #252

Merged
merged 8 commits into from
Dec 8, 2023
Merged

Test with and without spark #252

merged 8 commits into from
Dec 8, 2023

Conversation

jdawang
Copy link
Contributor

@jdawang jdawang commented Dec 7, 2023

Similar to #251, except shifting around the tests to be able to test under more installs and potentially more isolated builds in the future.

  • Drop spark 3.0 from matrix as fugue[spark] does not support it. Add spark 3.5 in.
  • Break test_fugue.py into multiple files, one for each backend that allows for skips if the backend cannot be imported.
  • Add datacompy[tests-spark] extras to allow to install [tests] extras without the spark test extras.
  • Add new jobs to the test package workflow. Three tests for installs: dev, bare and fugue without spark. The test structure allows us to add more specific jobs for specific installs in the future if we want to.

@fdosani
Copy link
Member

fdosani commented Dec 8, 2023

@jdawang you might need to rebase

Copy link
Member

@fdosani fdosani left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Amazing 🚀 LGTM! You might still need to rebase I'm guessing?

Update: Seems like It is fine with merging.

@fdosani fdosani merged commit f57faad into develop Dec 8, 2023
24 checks passed
@jdawang jdawang deleted the test-no-spark branch December 8, 2023 15:47
@fdosani fdosani mentioned this pull request Feb 21, 2024
rhaffar pushed a commit to rhaffar/datacompy that referenced this pull request Sep 12, 2024
* Test without spark

* Bump setup python version

* Separate tests out

* Install datacompy step

* Drop 3.0 and add 3.5

* Add fugue no spark

* Add permissions

* Format and docstrings
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants