Skip to content

Commit

Permalink
Merge remote-tracking branch 'origin/release/chi-demo-0524'
Browse files Browse the repository at this point in the history
# Conflicts:
#	packages/client/hmi-client/src/components/workflow/ops/model-config/tera-model-config.vue
#	packages/client/hmi-client/src/components/workflow/ops/model-edit/tera-model-edit.vue
#	packages/client/hmi-client/src/components/workflow/ops/stratify-mira/tera-stratify-mira.vue
  • Loading branch information
dgauldie committed May 17, 2024
2 parents 5964d13 + 30088dc commit 7b32a86
Showing 1 changed file with 101 additions and 0 deletions.
101 changes: 101 additions & 0 deletions testing/Stratify-LLM-Tests.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,101 @@
## [Name of the Test Scenario]
Please go through __every__ step of the test scenario.\
When blocked, an error, or a UI/UX anomaly occurs, please report which scenario and step to [\#askem-testing](https://unchartedsoftware.slack.com/archives/C06FGLXB2CE).

### 1. Begin test
1. Login to https://app.staging.terarium.ai using the test account
```
email: [email protected]
password: askem-quality-assurance
```
2. Create, or open, project named `Q&A [Your Name] [YYMMDD]`

### 2. Test Stratify LLM Responses
1. Make sure you have a model in your project.
2. Create a workflow
Drop in your model in the workflow
Create a Stratify node
Connect the model to the stratify node
3. Drill down into the Stratify node and go to the notebook section.

Ask the follow questions one at a time, wait for the response, check the response matches
reset the code block move on to the next.

Q) "Stratify my model by the ages young and old",
A)
model = stratify(
template_model=model,
key= "Age",
strata=['young', 'old'],
structure= [],
directed=False,
cartesian_control=False,
modify_names=True
)

Q) Stratify my model by the ages young and old where young can transition to old
A)
model = stratify(
template_model=model,
key= "Age",
strata=['young', 'old'],
structure= [['young', 'old']],
directed=True,
cartesian_control=False,
modify_names=True
)

Q) Stratify my model by the ages young and old where young and old can become old, but old cannot become young
A)
model = stratify(
template_model=model,
key= "Age",
strata=['young', 'old'],
structure= [['young', 'old']],
directed=False,
cartesian_control=False,
modify_names=True
)

Q) Stratify my model by the locations Toronto and Montreal where Toronto and Montreal cannot interact
A)
model = stratify(
template_model=model,
key= "Location",
strata=['Toronto', 'Montreal'],
structure= [],
directed=False,
cartesian_control=False,
modify_names=True
)

Q) Stratify my model by the locations Toronto and Montreal where Toronto and Montreal can interact
A)
model = stratify(
template_model=model,
key= "Location",
strata=['Toronto', 'Montreal'],
structure= [['Toronto', 'Montreal'], ['Montreal', 'Toronto']],
directed=False,
cartesian_control=True,
modify_names=True
)

OR
model = stratify(
template_model=model,
key= "Location",
strata=['Toronto', 'Montreal'],
structure= [['Toronto', 'Montreal']],
directed=True,
cartesian_control=True,
modify_names=True
)

Q) What is cartesian_control in stratify?
A)
No code response, instead just a message in the thought section.


### 4. End test
1. logout of the application

0 comments on commit 7b32a86

Please sign in to comment.