A second corrections release. Primarily addresses technical debt and stability issues.
New features:
- Cleaned up the code and technical documentation in several places
- Sideloading improvements, notably the ability to sideload reddit posts d970836
- Additional search options QueryStrategy and TemporalBias are exposed through the query-service API 66b3e71
- Domain ranking is overhauled to use JGraphT instead of the primordial home-cooked pagerank impl previously in effect: #80
- The start-up time of several services are improved in production by delaying the loading of the domain id blacklist. e61e7f4
🧯 Notable Fixes:
- A disastrous series of actions in the operations gui is mitigated, where it was possible to lose crawl data if a re-crawl is performed before loading a spec-generated crawl. This is mitigated in several ways, both to address the specific scenario, but also to reduce the harm of similar unforeseen situations: c73e43f
Marginalia App Changes:
- Correcting the sort order of the results in the API gateway 6950dff
- The 'popular' filter was temporarily removed, as it doesn't really do anything except be a bit worse than 'no filter'
- The 'vintage' and 'show recent' filters were updated to use the new TemporalBias feature 66b3e71 16526d2 a175b36
- A new 'search in title' option was added, using the new QueryStrategy parameter 66b3e71 2515993 752e677