Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Legal Element Extraction #30

Open
mchen644 opened this issue Nov 28, 2023 · 1 comment
Open

Legal Element Extraction #30

mchen644 opened this issue Nov 28, 2023 · 1 comment
Labels
disc-law-sft Related to DISC-Law-SFT dataset fine-tuning Fine-tuning DISC-LawLLM

Comments

@mchen644
Copy link

Hello, very great job! Thank you for your contributions!
Could you provide some more details on how to construct the legal element extraction dataset? If so, I would highly appreciate it!
By the way, I want to find out if you have encountered the decrease of general ability while fine-tuning?

@Charlie-XIAO
Copy link
Collaborator

Could you provide some more details on how to construct the legal element extraction dataset?

There are multiple open-source datasets that you can refer to, for instance, LEVEN and JointExtraction. Based on these, we use ChatGPT to provide some chain-of-thoughts.

By the way, I want to find out if you have encountered the decrease of general ability while fine-tuning?

Yes, but I cannot summarize a method to avoid this from happening. As some suggestions, you may increase the diversity of your prompts, and mix some other types of data in each fine-tuning. Still, this is largely trial-and-error.

@Charlie-XIAO Charlie-XIAO added disc-law-sft Related to DISC-Law-SFT dataset fine-tuning Fine-tuning DISC-LawLLM labels Dec 3, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
disc-law-sft Related to DISC-Law-SFT dataset fine-tuning Fine-tuning DISC-LawLLM
Projects
None yet
Development

No branches or pull requests

2 participants