Skip to content
This repository has been archived by the owner on Sep 1, 2023. It is now read-only.

cpp TP Checkpointing inconsistent after many records #1065

Open
rhyolight opened this issue Aug 29, 2016 · 0 comments
Open

cpp TP Checkpointing inconsistent after many records #1065

rhyolight opened this issue Aug 29, 2016 · 0 comments

Comments

@rhyolight
Copy link
Member

rhyolight commented Aug 29, 2016

The script mentioned below appear out of date. Instead, see https://github.com/numenta/nupic/blob/64400aa71982adb8069ec595ecbd4b9950d23183/tests/integration/nupic/opf/opf_checkpoint_test/opf_checkpoint_test.py#L461-L483

In a test between two models - one checkpointed and the other not - the results begin to vary after many records.

This does not happen for NonTemporal models nor for the python version of the TP.

Tests have been added (currently being skipped) to demonstrate behavior:

  • /tests/regression/checkpointCompatibility/TestCheckpointValidity.py

Feeds 300 records through two raw clamodel objects, checkpointing one after 100 records. This test is more for debugging to give the ability to view internal properties of the models.

  • /qa/opf/opfLocalCheckpointTest/TestOpfLocalCheckpoints.py

Tests PositiveTests.test_TemporalMultiStep and test_TemporalAnomaly, these generate experiments and run two models, one checkpointed one not and verify results. This is a more comprehensive test but does not give good insight into the models.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

1 participant