Skip to content

Conversation

@msuarezcrocus
Copy link
Contributor

Hi @jalvord1! This bundle is ready for your review.

- operation: filter_rows
query: "result != 'NULL' and result!=''"
behavior: include
- operation: distinct_rows
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what is the purpose of the distinct rows here? Are there dupes?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jalvord1 Yes, we found duplicates. For example, for 2015-2016 file, after the distinct_rows in studentAssessment, the duplicated values were reduced from 140 to 104.
This means 2 things:

  • There are records with exactly the same information in all cells
  • There are 104 students with records that have the same information but different scores.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Okay yeah since this distinct rows will just drop exact dupe rows, I'm cool with it

@jalvord1
Copy link
Collaborator

This looks good @msuarezcrocus - just want to check on a few things:

  • is there no vendor file structure so therefore the bundle will be written off of the enrich structure?
  • there are no composite or combined scores and that is why the assessment identifiers are so granular?

@msuarezcrocus
Copy link
Contributor Author

msuarezcrocus commented Aug 21, 2025

This looks good @msuarezcrocus - just want to check on a few things:

  • is there no vendor file structure so therefore the bundle will be written off of the enrich structure?
  • there are no composite or combined scores and that is why the assessment identifiers are so granular?

@jalvord1

  • There is no vendor file for Dominie.
  • There are not composite scores. We sent an email with this question and, after discussing it, this was your response:
image

Wendy agreed with you.

@jalvord1
Copy link
Collaborator

This looks good @msuarezcrocus - just want to check on a few things:

  • is there no vendor file structure so therefore the bundle will be written off of the enrich structure?
  • there are no composite or combined scores and that is why the assessment identifiers are so granular?

@jalvord1

  • There is no vendor file for Dominie.
  • There are not composite scores. We sent an email with this question and, after discussing it, this was your response:
image Wendy agreed with you.

Ha, thank you for reminding me that I already weighed in on this 😶‍🌫️ Too many assessments flying around in my brain.

@msuarezcrocus
Copy link
Contributor Author

No problem at all!

Dominie_General_Letter Know,Dominie Letter Know Assessment,uri://pearson.com/Assessments/Dominie,Dominie,uri://pearson.com/Assessments/Dominie/AssessmentCategoryDescriptor#Diagnostic,uri://ed-fi.org/academicSubjectDescriptor#Early Literacy,letterknow
Dominie_General_Phoneme Segmentation,Dominie Phoneme Segmentation Assessment,uri://pearson.com/Assessments/Dominie,Dominie,uri://pearson.com/Assessments/Dominie/AssessmentCategoryDescriptor#Diagnostic,uri://ed-fi.org/academicSubjectDescriptor#Early Literacy,phonseg
Dominie_General_Phoneme Deletion,Dominie Phoneme Deletion Assessment,uri://pearson.com/Assessments/Dominie,Dominie,uri://pearson.com/Assessments/Dominie/AssessmentCategoryDescriptor#Diagnostic,uri://ed-fi.org/academicSubjectDescriptor#Early Literacy,phondel
Dominie_General_Core Rdg.,Dominie Core Rdg. Assessment,uri://pearson.com/Assessments/Dominie,Dominie,uri://pearson.com/Assessments/Dominie/AssessmentCategoryDescriptor#Diagnostic,uri://ed-fi.org/academicSubjectDescriptor#Early Literacy,corerdg
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we update the assessment IDs to be more consistent in using underscores, removing periods and other special characters?

@msuarezcrocus
Copy link
Contributor Author

@jalvord1, please let me know if these IDs are acceptable or if you’d prefer adjustments.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants