Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Label logic needs separating from metrics #55

Open
neworderofjamie opened this issue Mar 21, 2023 · 0 comments
Open

Label logic needs separating from metrics #55

neworderofjamie opened this issue Mar 21, 2023 · 0 comments
Labels
enhancement New feature or request
Milestone

Comments

@neworderofjamie
Copy link
Contributor

neworderofjamie commented Mar 21, 2023

  • Multiple metrics e.g. SparseCategoricalAccuracy and SparseCategoricalAccuracy require access to YTrue
  • Would also allow compilers to add stuff like YTrueBack more generically

In Keras, behaviour of metrics is described as:

When you pass the strings 'accuracy' or 'acc', we convert this to one of tf.keras.metrics.BinaryAccuracy, tf.keras.metrics.CategoricalAccuracy, tf.keras.metrics.SparseCategoricalAccuracy based on the shapes of the targets and of the model output. We do a similar conversion for the strings 'crossentropy' and 'ce' as well. The metrics passed here are evaluated without sample weighting; if you would like sample weighting to apply, you can specify your metrics via the weighted_metrics argument instead.

@neworderofjamie neworderofjamie added the enhancement New feature or request label Mar 21, 2023
@neworderofjamie neworderofjamie added this to the mlGeNN 2.1 milestone Mar 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant