Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Research Mode [Part 2]: Improve Prompts, Edit Chat Messages. Set LLM Seed for Reproducibility #954

Merged
merged 36 commits into from
Nov 2, 2024
Merged

Research Mode [Part 2]: Improve Prompts, Edit Chat Messages. Set LLM Seed for Reproducibility #954

merged 36 commits into from
Nov 2, 2024

Commits on Oct 30, 2024

  1. Make cursor in chat input take on selected agent color

    @debanjum
    debanjum committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    2ac840e View commit details
    Browse the repository at this point in the history

  2. Defer turning cursor color to selected agents color for later 

    Capability exists but idea needs to be investigated further
    @debanjum
    debanjum committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    358a6ce View commit details
    Browse the repository at this point in the history

  3. Improve handling embedding model config from admin interface 

    - Allow server to start if loading embedding model fails with an error.
  This allows fixing the embedding model config via admin panel.

  Previously server failed to start if embedding model was configured
  incorrectly. This prevented fixing the model config via admin panel.

- Convert boolean string in config json to actual booleans when passed
  via admin panel as json before passing to model, query configs

- Only create default model if no search model configured by admin.
  Return first created search model if its been configured by admin.
    @debanjum
    debanjum committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    d44e68b View commit details
    Browse the repository at this point in the history

  4. Support setting seed for reproducible LLM response generation 

    Anthropic models do not support seed. But offline, gemini and openai
models do. Use these to debug and test Khoj via KHOJ_LLM_SEED env var
    @debanjum
    debanjum committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    b3a6301 View commit details
    Browse the repository at this point in the history

  5. Handle add/delete file filter operation on non-existent conversation

    @debanjum
    debanjum committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    f64f5b3 View commit details
    Browse the repository at this point in the history

  6. Store turn id with each chat message. Expose API to delete chat turn 

    Each chat turn is a user query, khoj response message pair
    @debanjum
    debanjum committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    ba15686 View commit details
    Browse the repository at this point in the history

  7. Add ability to delete messages from the web app

    @debanjum
    debanjum committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    ca5a683 View commit details
    Browse the repository at this point in the history

  8. Resolve train of thought component needs unique key id error on web app

    @debanjum
    debanjum committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    cb90abc View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2024

  1. Fix deleting new messages generated after conversation load

    @debanjum
    debanjum committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    e8e6ead View commit details
    Browse the repository at this point in the history

  2. Put train of thought ui before Khoj response on web app

    @debanjum
    debanjum committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    e17dc9f View commit details
    Browse the repository at this point in the history

  3. Only show trash can when turnId is present

    @sabaimran
    sabaimran committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    a137606 View commit details
    Browse the repository at this point in the history

  4. Do not exit if/else loop in research loop when notes not found

    @sabaimran
    sabaimran committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    559601d View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2024

  1. Only add /research prefix in research mode if not already in user query

    @debanjum
    debanjum committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    5b15176 View commit details
    Browse the repository at this point in the history

  2. Json dump contents in prompt tracer to make structure discernable

    @debanjum
    debanjum committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    89597ae View commit details
    Browse the repository at this point in the history

  3. Improve research planner prompt to reduce looping

    @debanjum
    debanjum committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    52163fe View commit details
    Browse the repository at this point in the history

  4. Improve online chat actor prompt for research and normal mode 

    - Match the online query generator prompt to match the formatting of
  extract questions
- Separate iteration results by newline
- Improve webpage and online tool descriptions
    @debanjum
    debanjum committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    302bd51 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'master' of github.com:khoj-ai/khoj into improve-debug-r… 

    …easoning-and-other-misc-fixes
    @sabaimran
    sabaimran committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    1924180 View commit details
    Browse the repository at this point in the history

  6. Remove conversation command always in query, filter out inferred quer… 

    …ies that were not with selected tool when going through tool selection iterations
    @sabaimran
    sabaimran committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    21858ac View commit details
    Browse the repository at this point in the history

  7. Use bottom anchor for the commandbar popover

    @sabaimran
    sabaimran committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    149cbe1 View commit details
    Browse the repository at this point in the history

  8. Only include inferred-queries in chat history when present

    @sabaimran
    sabaimran committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    3ea94ac View commit details
    Browse the repository at this point in the history

  9. Set usage limits on the research mode

    @sabaimran
    sabaimran committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    0145b2a View commit details
    Browse the repository at this point in the history

  10. Add experimental notice to research mode tooltip

    @sabaimran
    sabaimran committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    33d36ee View commit details
    Browse the repository at this point in the history

  11. Handle case where infer_webpage_url returns no valid urls

    @sabaimran
    sabaimran committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    1fc280d View commit details
    Browse the repository at this point in the history

  12. Add template for a code sandbox to the docker-compose configuration

    @sabaimran
    sabaimran committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    ffa7f95 View commit details
    Browse the repository at this point in the history

  13. Add documentation for python code execution capability

    @sabaimran
    sabaimran committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    23a49b6 View commit details
    Browse the repository at this point in the history

  14. Standardize rate limits to 1/6 ratio

    @sabaimran
    sabaimran committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    b3dad1f View commit details
    Browse the repository at this point in the history

  15. Merge branch 'master' of github.com:khoj-ai/khoj into improve-debug-r… 

    …easoning-and-other-misc-fixes
    @sabaimran
    sabaimran committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    2b35790 View commit details
    Browse the repository at this point in the history

  16. Simplify logic to get default search model. Remove unused import

    @debanjum
    debanjum committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    ac21b10 View commit details
    Browse the repository at this point in the history

  17. Use standard per minute rate limits across user types

    @debanjum
    debanjum committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    9c7b36d View commit details
    Browse the repository at this point in the history

  18. Clarify description of the code evaluation environment: not for docum… 

    …ent creation
    @sabaimran
    sabaimran committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    b79a9ec View commit details
    Browse the repository at this point in the history

  19. create defiltered query after conversation command is extracted

    @sabaimran
    sabaimran committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    327fcb8 View commit details
    Browse the repository at this point in the history

  20. Limit the number of urls the webscraper can extract for scraping

    @sabaimran
    sabaimran committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    a213b59 View commit details
    Browse the repository at this point in the history

  21. Merge branch 'improve-debug-reasoning-and-other-misc-fixes' of github… 

    ….com:khoj-ai/khoj into improve-debug-reasoning-and-other-misc-fixes
    @sabaimran
    sabaimran committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    e6eb87b View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2024

  1. Clean API chat router. Move FeedbackData response type to router helper

    @debanjum
    debanjum committed Nov 2, 2024
    Configuration menu
    Copy the full SHA
    1a83bbc View commit details
    Browse the repository at this point in the history

  2. Expect query before tool in response to give think space in research … 

    …prompt
    @debanjum
    debanjum committed Nov 2, 2024
    Configuration menu
    Copy the full SHA
    ab321dc View commit details
    Browse the repository at this point in the history

  3. Add prompt tracing, agent personality to infer webpage urls chat actor

    @debanjum
    debanjum committed Nov 2, 2024
    Configuration menu
    Copy the full SHA
    14e4530 View commit details
    Browse the repository at this point in the history