Bulk updates #141
Merged
Bulk updates #141
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Contributor
kursataktas
commented
Feb 24, 2025
•
kursataktas
commented
- Stopping the crawler when the browser is closed
- Fixing the datasource indexing issue
- Removing link_limits from the Crawler API
- Improve GitHub indexing
- Fix loading animation completion
…d state management
Task/selfhosted fixes
* Refactor settings retrieval in requester and views using get_default_settings utility * Fix my_gurus view 404 handling for empty guru queries * Fix widget id interactivity on selfhosted + move its error messages to toasts * Add missing file to previous commit * Remove unused imports * Refactor navigation items into a centralized configuration
- Introduce DataSourceService to centralize data source operations - Add validation and error handling for data source creation, deletion, and reindexing - Simplify views by delegating logic to the service layer - Improve error reporting and logging for data source operations
Remove redundant and unused imports to improve code clarity and reduce potential conflicts
Modify signals and tasks to introduce a configurable countdown delay for data source retrieval, improving synchronization and preventing potential race conditions
This was needed for selfhosted. Otherwise the data source updates would still show "pending updates", which didnt send anything to the backend
Task/improve data source creation
- Introduce CrawlState source tracking (UI/API) - Add last_polled_at field to track crawl activity - Implement periodic task to stop inactive UI crawls - Update crawl start methods to support source specification - Add migration for new CrawlState fields
Task/crawler refactor
- Optimize PageTransition component animation and state management - Add handleNavigationComplete method to useNavigation hook - Simplify navigation methods in useAppNavigation - Remove unused navigation-related code and imports
- Modify Django settings for self-hosted configuration - Adjust Redis and Postgres host configurations - Reduce inactive UI crawl check interval from 15 to 3 seconds - Add various configuration parameters and API keys (Note: These should be removed in a real commit)
Task/improve GitHub indexing
- Modify progress animation to start from 0% width - Reduce final width to 80% - Change animation mode from infinite to forward-only
- Add path normalization to handle trailing slashes - Prevent navigation to the same path or URL - Improve navigation method checks to avoid unnecessary state changes
- Add checks to skip question update when selecting the current question - Improve node selection logic to avoid unnecessary state changes - Enhance user experience by preventing duplicate navigation
…letion Task/fix loading animation completion
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.