Linting and formatting: add Ruff

[Laurynas-Jagutis]

Adds Ruff linting and formatting, replaces the old linting and formatting tools.

[mgovers]

although not too bad, it is quite a lot of files. I propose the following:
create a separate branch off main in which you do the github workflows, precommit and pyproject.toml changes
this branch should not contain any code changes.
instead, you can disable any violating rules in the pyproject.toml in the configuration
then rebase this branch off the other one
note: this may cause some merge/rebase conflicts but after merging, this branch in your local, rebased checkout should be completely the same as the one in the PR ( git diff origin/feature/add-ruff yields an empty diff)
all the configuration disablings in the pyproject.toml should now be "normal" again
then this change is split into 2 stages which helps people migrate, as well as prove that this is indeed the right way to go forward

[TonyXiang8787]

You need to change the recommended vscode extensions to ruff.

[figueroa1395]

Nice to have ruff now.

[figueroa1395]

Only one minor additional thing left from me. There are still some pylint comments at dataset_class_maps.py.jinja. Remove those as well and don't forget to run the code generator afterwards. Besides that, it looks good to me and locally it is formatted the same as here.

[mgovers]

Quality Gate passed

Issues 1 New issue 0 Accepted issues

Measures 0 Security Hotspots 96.7% Coverage on New Code 0.0% Duplication on New Code

See analysis details on SonarQube Cloud

please just add a nosonar because it's intended

[sonarqubecloud]

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
100.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud

[mgovers]

many previously disabled rules were removed because we don't have PL checks enabled. Some of these may be re-added in a later PR, but for now, let's go ahead and merge