What's new 0.25.0

[nicolay-r]

Main Changes

Support of the new UI

It is expected to be a separated UI for the ARElight, which is sourced there:
https://github.com/nicolay-r/ARElight-server

• Inference argument JSON exporter function #142
• ARElight operations -- logger #143
• ARElight inference -- support dynamic log writing #141
• 🔥 Support SQlite filtering operation for relation pairs. #144
• 🔥 🐛 MLTextTranslatorPipelineItem -- causes issues with the indices in tranlation (batching mode) #146
• 📺 ✨ Remove server-related code #148

Refactored features

• Improve DeepPavlov NER performance by adopting batching #140
• Support new pipelines concept from AREkit with optional batching #136 🔥
• Add SQLite support for sampling #129
• Support prediction writing in SQLite #130
• Refactoring SQLite impemenation for OpenNRE #134
• OpenNRE implement SentenceREDataset based on SQLite storage #132
  * SentenceRELoader create a custom implementation (torch 🔥 dependency)
  * SentenceREDataset implement, fix the original issue of storing the whole data in memory! (torch 🔥 dependency )
• AREkit version of 0.25.0 (c8fb0bb)

Minor

• CustomTermsSplitterPipelineItem -- remove that class since it only complicates NER pipeline  #135
• Appropriate formatting of unit tests (https://github.com/nicolay-r/ARElight/blob/main/test/test_translation.py)
• 🔧 Predict header formatter -- sync #137
• 🔧 Sync samples storing path between different pipeline elements #138
• Fix httpx package 📦 related issues
• 🐛 SQLite3Writer -- extension is missed for the results of BERT application #145
• torch -- take control over num_workers parameter #149
• 🔥 🐛 MLTextTranslatorPipelineItem -- causes issues with the indices in tranlation (batching mode) #146
• ❌ save_demo_page method is no longer applicable. #151