Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LoRA半精度微调 #1798

Open
dayunyan opened this issue Nov 5, 2024 · 0 comments
Open

LoRA半精度微调 #1798

dayunyan opened this issue Nov 5, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@dayunyan
Copy link

dayunyan commented Nov 5, 2024

Describe the bug/ 问题描述 (Mandatory / 必填)
如何使用mindnlp实现LoRA的半精度微调?在

  • Hardware Environment(Ascend/GPU/CPU) / 硬件环境:

Please delete the backend not involved / 请删除不涉及的后端:
GPU

  • Software Environment / 软件环境 (Mandatory / 必填):
    -- MindSpore version (e.g., 1.7.0.Bxxx) :2.3.1
    -- Python version (e.g., Python 3.7.5) :3.9
    -- OS platform and distribution (e.g., Linux Ubuntu 16.04): ubuntu22.04
    -- GCC/Compiler version (if compiled from source):

  • Excute Mode / 执行模式 (Mandatory / 必填)(PyNative/Graph):

Please delete the mode not involved / 请删除不涉及的模式:
/mode pynative

To Reproduce / 重现步骤 (Mandatory / 必填)
Steps to reproduce the behavior:

  1. f6a98cb5f7025fe345248533a8824b0b
  2. fb681ecc28b7f5a0c9a21b4045c9525a
  3. image
  4. See error

Expected behavior / 预期结果 (Mandatory / 必填)
成功运行

Screenshots/ 日志 / 截图 (Mandatory / 必填)
79d877e977fc4ba10f409f1b1c580daa

Additional context / 备注 (Optional / 选填)
Add any other context about the problem here.

@dayunyan dayunyan added the bug Something isn't working label Nov 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant