Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improvement of automatic text detection #903

Open
wants to merge 10 commits into
base: master
Choose a base branch
from
Open

Improvement of automatic text detection #903

Changes from 1 commit
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
1357d3a
- rebase on master
andreygetmanov Sep 6, 2022
404e888
- now tfidf tries to fit on every potential text col
andreygetmanov Sep 20, 2022
75341b1
- added autodetection of columns with links
andreygetmanov Sep 21, 2022
2cdb32c
- fixed bug with crash on tuning
andreygetmanov Sep 29, 2022
f6e9828
- added ngram_range=(1,4) to search space
andreygetmanov Oct 6, 2022
57bfc86
- minor changes
andreygetmanov Oct 6, 2022
507d136
- max_features of tfidf is set to 10e5 to reduce memory consumption
andreygetmanov Oct 8, 2022
edffc87
- word2vec trained outline
andreygetmanov Oct 13, 2022
c0ed0d7
Fixed R2 calculation
andreygetmanov Dec 13, 2022
86ae96f
Fixed bug with regression test
andreygetmanov Dec 19, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
- max_features of tfidf is set to 10e5 to reduce memory consumption
  • Loading branch information
@andreygetmanov
andreygetmanov committed Dec 19, 2022
commit 507d136ffafbb1acc625f34b8d5f3a2247c07948
3 changes: 2 additions & 1 deletion fedot/core/repository/data/default_operation_params.json
View file
Original file line number Diff line number Diff line change
@@ -139,7 +139,8 @@
},
"tfidf": {
"min_df": 0.01,
"max_df": 0.9
"max_df": 0.9,
"max_features": 100000
},
"fast_ica": {
"whiten": "unit-variance"