feat: update package config

[vorel99]

In python world, new standard for package configuration is pyproject.toml. So I moved all static config from setup.py to pyproject.toml.

• move all static package setup from setup.py to pyproject.toml
• add commands to Makefile
  • install_dev: install all requirements for pandas development and testing
  • install_test_pandas: install ydata-profiling with optional dependencies for testing
  • install_test_spark: install ydata-profiling with optional dependencies for testing spark
  • remove all requirements files
• update spark testing
  • delete pytest-spark
  • add spark_session as pytest fixture
• update gitlab actions
  • replace all requirements files usage
  • remove pyspark tests with version of pandas 0.25.3

[codecov-commenter]

Codecov Report

Patch coverage has no change and project coverage change: +0.04% 🎉

Comparison is base (fdc0346) 89.49% compared to head (8632412) 89.53%.

❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files

@@             Coverage Diff             @@
##           develop    #1448      +/-   ##
===========================================
+ Coverage    89.49%   89.53%   +0.04%     
===========================================
  Files          194      194              
  Lines         6318     6316       -2     
===========================================
+ Hits          5654     5655       +1     
+ Misses         664      661       -3     

Flag	Coverage Δ
py3.8-ubuntu-22.04-pandas	89.53% <0.00%> (+0.04%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files Changed	Coverage Δ
setup.py	0.00% <0.00%> (ø)

... and 1 file with indirect coverage changes

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[fabclmnt]

Hi @vorel99 ,

once again than you for your contribution :)

I've already requested the review from the team!

[vascoalramos]

Hi @vorel99.

Thank you for your work in the migration to pyproject.toml.
I left some change requests mostly related to the makefile and dependency options.
The primary reason for most of the requests relates to keeping consistency between all of our open-source projects.

[vascoalramos]

Everything else seems fine to me. @portellaa, what do you think?

[vorel99]

hello,
@vascoalramos @portellaa what is the status of MR? Is there any blocker to be resolved?

[portellaa]

Hi @vorel99

Thanks for your PR.

Unfortunately we don't have the time right now to move forward with this, we kindly ask you to give us some more time.
Given the amount of the changes, it breaks some internal alignments that we will need to work with you, but right now we can't focus on this.

Sorry for this.
We will get in touch as soon as we can pick this.

Cheers

[vorel99]

Thanks for reply @portellaa,
there wasn't that many of changes (its probably result of force-push from aquemy).
Changes were just in 15 files with 189 additions and 171 deletions.
There is an example of pull request, what it looked like when it was created and vascoalramos did review.
vorel99#78

I can rebase my branch to new develop, when you are ready.

Regards,
JC