Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Possible conversion error when converting max/min values #24

Open
MrKevinWeiss opened this issue Nov 30, 2022 · 0 comments
Open

Possible conversion error when converting max/min values #24

MrKevinWeiss opened this issue Nov 30, 2022 · 0 comments
Labels
bug Something isn't working

Comments

@MrKevinWeiss
Copy link
Collaborator

MrKevinWeiss commented Nov 30, 2022

During some corner case testing I got:

  File "\mm_pal\mm_if.py", line 761, in commit_write
    self.write_reg(reg, data, offset=offset, verify=verify,
  File "\mm_pal\mm_if.py", line 728, in write_reg
    self._write_formatted_bytes(reg_info, data, offset, size, timeout,
  File "\mm_pal\mm_if.py", line 674, in _write_formatted_bytes
    wb_data = self._write_data_to_bytes(reg_info, data)
  File "\mm_pal\mm_if.py", line 623, in _write_data_to_bytes
    wdata += element.to_bytes(reg_info['type_size'], "little",
OverflowError: int too big to convert

I was feeding it an array of int16_t with some of the values were -45567 or so I guess. I should look into it.

@MrKevinWeiss MrKevinWeiss added the bug Something isn't working label Nov 30, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant