This is the PreACT pull request

assessments/PreACT/README.md

@@ -0,0 +1,45 @@
+* **Title**: PreACT Assessment - API 7.1
+* **Description**: PreACT is a multiple-choice assessment designed for 10th grade students that provides:
+  - Early practice experience for the ACT test
+  - Assessment of achievement in English, Mathematics, Reading, and Science
+  - Insights to help students identify academic strengths and areas for improvement
+  - Guidance for high school coursework planning and career exploration
+* **API version**: 7.1
+* **Submitter name**: Bruk Woldearegay
+* **Submitter organization**: CrocusLLC
+To run this bundle, please add your own source file<code>data/PreACT_Data_File.csv</code>
+
+This bundle works with PreACT files in the format provided by the assessment vendor (namely fixed-width .txt files). 
+
+## CLI Parameters
+
+### Required
+- **OUTPUT_DIR**: Where output files will be written
+- **INPUT_FILE**: The assessment file to be mapped
+- **STUDENT_ID_NAME**: Which column to use as the Ed-Fi `studentUniqueId`. Can be one of the native columns in the assessment file (e.g., `Stu_ID_Num`) when the bundle is run directly. Otherwise leave the default value `edFi_studentUniqueID` 
+- **POSSIBLE_STUDENT_ID_COLUMNS**: This should contain all the possible native student id columns in the assessment file( e.g., `Stu_ID_Num`) . 
+### Optional
+- **DESCRIPTOR_NAMESPACE**: This should be the default namespace for descriptors such as ResultDatatypeTypeDescriptor . The default value is : uri://ed-fi.org
+
+### Examples
+
+Using an ID column from the assessment file:
+```bash
+earthmover run -c ./earthmover.yaml -p '{
+  "INPUT_FILE": "path/to/PreACT_Data_File.csv",
+  "OUTPUT_DIR": "./output",
+  "STUDENT_ID_NAME": "Stu_ID_Num"
+}'
+```
+
+Once you have inspected the output JSONL for issues, check the settings in lightbeam.yaml and transmit them to your Ed-Fi API with:
+
+```bash
+lightbeam validate+send -c ./lightbeam.yaml -p '{
+  "DATA_DIR": "./output/",
+  "API_YEAR": "yourAPIYear",
+  "BASE_URL": "yourURL",
+  "EDFI_API_CLIENT_ID": "yourID",
+  "EDFI_API_CLIENT_SECRET": "yourSecret"
+}'
+```

assessments/PreACT/data/Records_anonymized.csv

@@ -0,0 +1,5 @@
+Process_Num,School_Attend_Code,State_Code,Cycle_Code,Tested_Own_School,School_Reported_Code,L_Name,F_Name,M_Initial,Doc_Id,DOB,Gender,Ethn_FedValues,Grade_Reported,Test_Dte,Grade_School_Header,Grade_Student_Grid,Eng,Mth,Rdg,Sci,Composite,STEM,E_Earn_Prod,E_Earn_Knlg,E_Earn_Conv,M_Earn_Higher,M_Earn_NumQ,M_Earn_Alg,M_Earn_Func,M_Earn_Geom,M_Earn_Stat,M_Earn_Essen,M_Earn_Mod,R_Earn_Ideas,R_Earn_Struc,R_Earn_Knlg,S_Earn_Data,S_Earn_Inv,S_Earn_Eval,Eng_Low,Eng_High,Mth_Low,Mth_High,Rdg_Low,Rdg_High,Sci_Low,Sci_High,Composite_Low,Composite_High,STEM_Low,STEM_High,Pred_ACT_Eng_Low,Pred_ACT_Eng_High,Pred_ACT_Mth_Low,Pred_ACT_Mth_High,Pred_ACT_Rdg_Low,Pred_ACT_Rdg_High,Pred_ACT_Sci_Low,Pred_ACT_Sci_High,Pred_ACT_Composite_Low,Pred_ACT_Composite_High,Pred_ACT_STEM_Low,Pred_ACT_STEM_High,USRnk_Sub_Engl,USRnk_Sub_Math,USRnk_Sub_Rdg,USRnk_Sub_Sci,USRnk_Comp,USRnk_STEM,C_Readiness,Best_Lan,Program_Of_Study,EdLevel_Mthr,EdLevel_Fthr,Partic_InstMus,Partic_VocMus,Partic_Pubs,Partic_Debate,Partic_Art,Partic_Theater,Partic_VAthl,Partic_Sci,Partic_Honors,Partic_Cheer,Partic_ServOrg,Partic_RacEthOrg,Partic_Abroad,Partic_PolOrg,Partic_RadioTV,Partic_RelOrg,Partic_ROTC,Partic_FratSor,Partic_StuGov,Partic_NotPartic,Clg_Outreach,WorkHrs,Highest_ed_exp,Career,EOS_OptIn,Results_Void,Help_EdPlan,Help_Writing,Help_Reading,Help_StudySk,Help_MathSk,Help_Computer,Help_Public_Speaking,IntInv_Responses,IntInv_MapReg1,IntInv_MapReg2,IntInv_MapReg3,IntInv_LikePerc,IntInv_IndiffPerc,IntInv_DislikePerc,IntInv_TechSta,IntInv_SciSta,IntInv_ArtSta,IntInv_SocSta,IntInv_BusCSta,IntInv_BusOpSta,IntInv_TechStd,IntInv_SciStd,IntInv_ArtStd,IntInv_SocStd,IntInv_BusCStd,IntInv_BusOpStd,IntInv_TechRnk,IntInv_SciRnk,IntInv_ArtRnk,IntInv_SocRnk,IntInv_BusCRnk,IntInv_BusOpRnk,English_9,English_10,English_11,English_12,English_Other,English_Other_2,English_Other_3,English_Credit,Algebra_1,Geometry,Algebra_2,Trigonometry,Pre_Calc,Calculus,Math_Other,Math_Other_2,Math_College_Prep_9,Math_College_Prep_10,Math_College_Prep_11,Math_College_Prep_12,Math_Credit,History_US,History_World,Gvt_Civics,Global_Studies,Geography,Economics,Psychology,Sociology,Social_Studies_Other,Social_Studies_Other_2,Social_Studies_Credit,General_Science,Biology_1,Biology_2,Chemistry_1,Chemistry_2,Physics,Anat_Phys,Natural_Science_Other,Natural_Science_Other_2,Natural_Science_Credit,Spanish_Credit,French_Credit,German_Credit,Lang_Other_Credit,IntCareer_Fit,G_HS_Avg,G_AllEng,G_AllMth,G_AllSocSt,G_AllNatSc,Core_Ind,Suppl_Local_Itms,Test_Form,Eng_Responses,Math_Responses,Read_Responses,Sci_Responses,Eng_Itm_Scores,Math_Itm_Scores,Read_Itm_Scores,Sci_Itm_Scores,Eng_Raw,Math_Raw,Read_Raw,Sci_Raw,Address1,City,State,Zip,Stu_ID_Num,Preid_Local_Items,Pred_PreACT_Eng_Low,Pred_PreACT_Eng_High,Pred_PreACT_Mth_Low,Pred_PreACT_Mth_High,Pred_PreACT_Rdg_Low,Pred_PreACT_Rdg_High,Pred_PreACT_Sci_Low,Pred_PreACT_Sci_High,Pred_PreACT_Composite_Low,Pred_PreACT_Composite_High,Pred_PreACT_STEM_Low,Pred_PreACT_STEM_High
+V4549000,410935,41,913,Y,410935,lastName1,firstName1,m,7a3,19431101,0,4,10,20201007,10,10,08,13,14,12,12,13,05,01,05,03,01,01,01,00,00,02,03,04,02,02,03,03,01,06,10,12,14,12,16,10,14,11,13,12,14,09,14,12,16,13,19,13,18,12,15,13,16,10,10,26,14,12,12,,A,B,G,F,,,,,,,,,,,,,,,,,,,,1,N,A,F,,Y,,N,N,N,N,Y,N,N,112111112121111112112111111112112113112112111111112112121112112112111212,05,06,07,001,024,075,6,2,2,3,2,3,54,38,34,39,36,41,66,11,5,14,8,19,2,2,1,0,0,0,0,2.5,2,1,4,0,4,4,0,0,0,0,0,0,4.5,2,2,4,0,4,3,3,1,0,0,5.5,2,3,0,0,3,0,2,0,0,3.0,,,,,0,,,,,,2,,20A,442133232321434123312321443214232,234234122135131431523142541434155142,2323431414132212134413241,312311133441141414232432141234,001110001100100001011100000000001000000000000,000000000000100010000000000000100110,0110100110000011000000100,000100010001110000101000000000,11,05,08,07,8aaa791349c5090bcf8efbe951d93009ad59a92adfb174ad9a,25e04e1cc5f2a67f6ed20f6cb3d04d,32,88bf63ce98,cd6becfda7,,,,,,,,,,,,,
+V4549000,410935,41,913,Y,410935,lastName2,firstName2,m,7a3,19110120,f,4,10,20201007,10,10,12,16,19,18,16,17,05,04,09,06,00,02,02,02,00,07,05,08,05,00,06,03,04,10,14,15,17,17,21,16,20,15,17,16,18,12,17,16,19,17,23,17,22,16,19,17,20,31,43,56,57,45,50,,A,B,D,D,,,,,,,,,1,,,,,,,,,,,,N,A,H,X,N,,Y,Y,N,N,N,N,Y,332112232122333211121111123211232111223111231112122111132232332113112113,08,09,10,022,032,046,6,5,7,5,3,4,53,52,60,48,40,46,61,58,83,41,16,35,24,4,4,4,0,0,0,4.0,24,24,4,4,4,4,4,4,4,4,4,4,9.5,24,24,4,0,4,0,4,24,0,0,6.0,24,23,0,4,0,4,4,0,0,5.0,1,,1,,1,3.9,4.0,4.0,4.0,3.5,1,,20A,412314122144422233141332414443231223231314332,541315533142353532522351425313233532,1334124413343144114222112,133114211312433432242213343121,011001111010100101000110010000000101100011000,110111010001010011001010000010000000,1101010110101100010110010,101001101010001000111110000001,18,13,13,13,cc569d2759523b4da4e4692419084832db1a7179933f9b8cc2,25e04e1cc5f2a67f6ed20f6cb3d04d,32,88bf63ce98,fe27d22a60,,,,,,,,,,,,,
+V4549000,410935,41,913,Y,410935,lastName3,firstName3,m,7a3,19841203,f,6,10,20201007,10,10,18,18,28,22,22,20,06,05,15,07,02,01,02,02,00,11,09,14,03,04,07,06,07,16,20,16,20,25,31,20,24,21,23,19,21,18,23,18,22,24,30,21,26,22,25,20,23,66,63,88,81,80,72,,A,A,D,B,,,,,,,,,,1,,,,,,,,,,,N,,,,Y,,N,N,N,Y,Y,N,Y,212113233133213232112111212121213211213111232111213111212212232123232321,00,00,00,021,036,043,6,6,4,6,4,5,53,53,45,54,44,53,61,62,32,66,26,60,24,23,23,4,0,0,0,4.0,24,22,4,0,4,4,0,0,0,0,0,0,5.0,23,4,0,0,24,0,0,24,0,0,4.0,23,23,0,4,0,0,4,0,0,4.0,,,,,0,3.3,3.3,3.0,3.7,3.0,1,,20A,214133122323413141241331412321212113412211,543335454425541132334532145213145142,4324421412323112221321214,123333231242413142242112224313,110110111101111010100110011111011001000110000,111101100010000111110100000010110110,0111110111111111101011111,111100111100001110111010111110,26,18,21,20,da43c722c071e13ece28a508f64aac372a91d887b28a60fbd8,25e04e1cc5f2a67f6ed20f6cb3d04d,32,88bf63ce98,b51a282f3e,,,,,,,,,,,,,
+V4549000,410935,41,913,Y,410935,lastName4,firstName4,m,7a3,20490426,f,4,10,20201007,10,10,10,16,19,16,15,16,06,03,06,04,01,00,00,03,00,10,05,06,04,03,05,06,00,08,12,15,17,17,21,14,18,14,16,15,17,11,16,16,19,17,23,16,21,15,18,16,19,20,43,56,42,37,41,,A,A,B,B,,,,,,,,,,,,,,,,,,,,1,N,A,G,,Y,,Y,Y,N,N,Y,N,Y,222111223122212221123121322121112111213111221112112111122211121111111221,05,08,00,006,039,056,4,5,4,4,3,5,44,49,44,46,40,50,26,46,27,36,16,49,231,4 1,4 1,4 1,0,0,0,4.0,22,4,2,0,0,0,0,0,0,0,0,0,3.0,2,0,0,0,241,0,24,0,0,0,3.0,0,221,0,2,0,0,0,0,0,2.0,,,,,0,3.0,3.0,2.0,4.0,2.0,2,,20A,242124122213444343214311414,542324414222153542233555314,132442442434311223,123333331241432141,101101111001100011110100010000000000000000000,110100100011110001010110101000000000,1111110100101111100000000,111100011101000111000000000000,15,14,13,11,988aa7cb5ca1f327b16544251bf1969a2647d50eeadbaa50b8,e3b0c44298fc1c149afbf4c8996fb9,e3,e3b0c44298,b6ffcafce2,,,,,,,,,,,,,

assessments/PreACT/data/Records_anonymized.txt

@@ -0,0 +1,5 @@
+V4549000410935      41      913 Y410935    lastName1                firstName1      m                     7a31943110104          102020100710    10  0813141212130501053 1 1 1 0 0 2 3 040202030301  061012141216101411131214        09141216131913181215131610.10 26.14.12.12.n       ABGFnnnnnnnnnnnnnnnnnnn1NAFn  Ynan NNNNYNN112111112121111112112111111112112113112112111111112112121112112112111212                  5.6.7.0 1  24 75   62232354383439364166.11.5.014.8.019.2  2  1  0  0  0  0  2.52  1  4  0  4  4  0  0  0  0  0  0  4.52  2  4  0  4  3  3  1  0  0  5.52  3  0  0  3  0  2  0  0  3.0nnnn0nannannannannan2nan         20A            442133232321434123312321443214232                 234234122135131431523142541434155142    2323431414132212134413241312311133441141414232432141234001110001100100001011100000000001000000000000     000000000000100010000000000000100110    0110100110000011000000100000100010001110000101000000000115 0807        8aaa791349c5090bcf8efbe951d93009ad59a92a25e04e1cc5f2a67f6ed20f6cb3288bf63ce98                          cd6becfda7                                                            nanananananananananananan 
+V4549000410935      41      913 Y410935    lastName2                firstName2      m                     7a319110120f4          102020100710    10  1216191816170504096 0 2 2 2 0 7 5 080500060304  101415171721162015171618        12171619172317221619172031.43 56.57.45.50.n       ABDDnnnnnnnn1nnnnnnnnnnnNAHX  Nnan YYNNNNY332112232122333211121111123211232111223111231112122111132232332113112113                  8.9.10. 22 32 46   65753453526048404661.58.83.41.16.35.24 4  4  4  0  0  0  4.024 24 4  4  4  4  4  4  4  4  4  4  9.524 24 4  0  4  0  4  24 0  0  6.024 23 0  4  0  4  4  0  0  5.01n1n13.94.04.04.03.51nan         20A            412314122144422233141332414443231223231314332     541315533142353532522351425313233532    1334124413343144114222112133114211312433432242213343121011001111010100101000110010000000101100011000     110111010001010011001010000010000000    110101011010110001011001010100110101000100011111000000118131313        cc569d2759523b4da4e4692419084832db1a717925e04e1cc5f2a67f6ed20f6cb3288bf63ce98                          fe27d22a60                                                            nanananananananananananan 
+V4549000410935      41      913 Y410935    lastName3                firstName3      m                     7a319841203f6          102020100710    10  1818282222200605157 2 1 2 2 0 119 140304070607  162016202531202421231921        18231822243021262225202366.63 88.81.80.72.n       AADBnnnnnnnnn1nnnnnnnnnnNnnn  Ynan NNNYYNY212113233133213232112111212121213211213111232111213111212212232123232321                  0.0.0.0 21 36 43   66464553534554445361.62.32.66.26.60.24 23 23 4  0  0  0  4.024 22 4  0  4  4  0  0  0  0  0  0  5.023 4  0  0  24 0  0  24 0  0  4.023 23 0  4  0  0  4  0  0  4.0nnnn03.33.33.03.73.01nan         20A            214133122323413141241331412321212113412211        543335454425541132334532145213145142    4324421412323112221321214123333231242413142242112224313110110111101111010100110011111011001000110000     111101100010000111110100000010110110    011111011111111110101111111110011110000111011101011111026182120        da43c722c071e13ece28a508f64aac372a91d88725e04e1cc5f2a67f6ed20f6cb3288bf63ce98                          b51a282f3e                                                            nanananananananananananan 
+V4549000410935      41      913 Y410935    lastName4                firstName4      m                     7a320490426f4          102020100710    10  1016191615160603064 1 0 0 3 0 105 060403050600  081215171721141814161517        11161619172316211518161920.43 56.42.37.41.n       AABBnnnnnnnnnnnnnnnnnnn1NAGn  Ynan YYNNYNY222111223122212221123121322121112111213111221112112111122211121111111221                  5.8.0.0 6  39 56   45443544494446405026.46.27.36.16.49.2314 14 14 10  0  0  4.022 4  2  0  0  0  0  0  0  0  0  0  3.02  0  0  0  2410  24 0  0  0  3.00  2210  2  0  0  0  0  0  2.0nnnn03.03.02.04.02.02nan         20A            242124122213444343214311414                       542324414222153542233555314             132442442434311223       123333331241432141            101101111001100011110100010000000000000000000     110100100011110001010110101000000000    111111010010111110000000011110001110100011100000000000015141311        988aa7cb5ca1f327b16544251bf1969a2647d50ee3b0c44298fc1c149afbf4c89e3e3b0c44298                          b6ffcafce2                                                            nanananananananananananan 
+V4549000410935      41      913 Y410935    lastName5                firstName5      m                     7a319221217f4          102020100710    10  1516142117190704106 1 2 1 1 1 8 4 060101080604  131715171216192316181820        15201619131920251720192249.43 26.76.52.66.n       ABFDn1nn1nn11nnnnnnnnnnnNAI*  Ynan YNYYYNY233112132112123222223112121112122111113211132111113111122112122111112212                  0.0.0.0 11 35 54   53553352435153404156.23.53.60.16.19.2312410  0  0  0  0  2.02314  2410  4  0  0  0  0  0  0  0  4.024 24 0  0  2310  0  61 0  0  4.023 2310  4  0  0  0  0  0  3.0nnnn03.23.53.53.03.02nan         20A            212124422143323343412132413434431113242133241     542312415122123432313545245132*35311    3124223113132113123114114423344233211413142242234231223111101011011001011011010010000100001110000100     110110101011100011100100000100000000    001101001000011000000001101110111011100111011110110000021140818        6bedcaa497aa677373ef67cc4a922bdc64a5d961bb34095cffa75d45823c9aee33288bf63ce98                          97e78ce1e4                                                            nanananananananananananan