Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support others LLMs & APIs for the OP generate_qa_from_text_mapper #535

Open
2 tasks done
yxdyc opened this issue Jan 9, 2025 · 0 comments
Open
2 tasks done

Support others LLMs & APIs for the OP generate_qa_from_text_mapper #535

yxdyc opened this issue Jan 9, 2025 · 0 comments
Labels
dj:op issues/PRs about some specific OPs enhancement New feature or request

Comments

@yxdyc
Copy link
Collaborator

yxdyc commented Jan 9, 2025

Search before continuing 先搜索,再继续

  • I have searched the Data-Juicer issues and found no similar feature requests. 我已经搜索了 Data-Juicer 的 issue 列表但是没有发现类似的功能需求。

Description 描述

Currently (in v1.0.3), the OP generate_qa_from_text_mapper has a fix format assumption binding to PAI models, we can extend it into other use cases depending on general DJ-format, such as using local Qwen models and other APIs.
Refer to many other existing OPs like generate_qa_from_examples_mapper, and calibrate_qa_mapper.py.

Use case 使用场景

No response

Additional 额外信息

No response

Are you willing to submit a PR for this feature? 您是否乐意为此功能提交一个 PR?

  • Yes I'd like to help by submitting a PR! 是的!我愿意提供帮助并提交一个PR!
@yxdyc yxdyc added the enhancement New feature or request label Jan 9, 2025
@yxdyc yxdyc added the dj:op issues/PRs about some specific OPs label Jan 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dj:op issues/PRs about some specific OPs enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant