Release Notes 11.3

This document describes the technical enhancements to Generate version 11.3 released in February 2024. The purpose of this document is to communicate the technical updates made to Generate in version.

Release Overview

Generate version 11.3 is primarily focused on Directory, small user interface changes, and NodeJS updates. We also added the hotfix changes from the last round of Assessment submissions and Discipline views (emailed 2/5) to this release.

Required State Changes

For states that do not have internet access from their Generate server, we have modified the Update logic so that you can leverage the auto-update process, with two manual steps.

1. You will receive an update package from us. When you do:

   • Upload it to the /Updates folder found within both the /web and /background directories on your web server.

2. Open the configuration file and change the “callservice” setting to false.

   • On your webserver, navigate to the location of the /web files and then go to /wwwroot/assests/config

NOTE: There may be more than one file in that location depending on how you installed/configured Generate. Make the change to any config files in that location.

Run the update process from the UI as normal.

Important Updates

The below items do NOT require state action, but we wanted to bring your attention to:

• If you are submitting Directory (FS029) through Generate and you run into an issue creating a csv submission file because there are commas in the incoming data, we have an open ticket to address escaping the commas. That work is not complete so if you do experience that issue you can either remove the commas from the incoming data or create a TAB delimited submission file.

• We added a new Staging Table Snapshot utility. The documentation for this utility is available here - Staging Table Snapshot

• We now have a new way of displaying report data in the User Interface that will help us in promoting Generate to the Source Community. The new method is currently applied to most student-level reports only. The look and feel are slightly different, and we will be working on the next release making to make it faster as well. There is a new search feature will allow you to search for elements to filter to leverage for your data analysis. Turn on the search feature by selecting “Search” and then use categories to set filters.

How to Use the New Search Feature

1. Activate the search functionality by selecting the “Search” option.

Select the search box to view the filters

1. Utilize categories to set filters, narrowing down your analysis to the most relevant data.

Filter options displayed for SEA, SEA ID, Disability Category, Sex, and Racial Ethnic fields, facilitating refined data selection within the interface.

The Search feature is currently case and text specific.

Example: To filter by Disability Category, ensure you input the category name exactly as it appears. For instance, to filter for Deaf-blindness, type it with the capital 'D', the dash, and the lowercase 'b'.

Filtering by Disability Category: Ensure precise input for accurate results.

---

Generate Enhancements

The following EDFacts reports were updated in this release.

Type of Impact:

• Data – the changes will improve data quality and completeness.

• User Interface – the changes impact the Generate User Interface and/or migration process.

• Source to Staging ETL – the changes may require modifications to the SEA’s Source to Staging ETL

• Performance – the changes improve the performance of the application.

• Migration – the changes impact a data migration process.

• Submission Files – the changes may impact submission file(s)

• Database – changes to the Generate database structure.

Directory

Report	Approved Change	Ticket #	Type of Impact
FS029	Create delimiter handling for EDFacts Report Exports	CIID-2627	Data
	The column lengths for the Organization Address fields were different between staging and the RDS. We added code to ensure there are no issues with the migrations while we look at structural changes to permanently address it.	CIID-5241	Data
	We corrected the date-handling logic in Staging-to-FactOrganizationCounts so that it can handle multiple LEAs when some of them are future dated.	CIID-5731	Data
	The logic used in the migration of LEA data to determine whether to use NA or NOTCHR for the LEA Charter Status was incorrect, that has been corrected	CIID-6462	Data
	Corrected an issue in the code that was preventing Charter Primary and Secondary Authorizer data from displaying in the UI and in the submission file.	CIID-6484	Data
	Corrected a mapping issue that was preventing Charter School Authorizer Type Codes from migrating into the Data Warehouse with the proper values	CIID-6468	Data
	Corrected the PV for GunFreeSchoolsActReportingStatusCode because it was displaying the dimension code value, not the EDFacts code in the UI and the submission file	CIID-6467	Data
FS163	Corrected the PV for GunFreeSchoolsActReportingStatusCode because it was displaying the dimension code value, not the EDFacts code in the UI and the submission file	CIID-6467	Data
FS116	Corrected an issue in the Directory export that was excluding Prior LEA Identifier, Effective Date, and Updated Operational Status.	CIID-3963	Data

Assessment

Report	Approved Change	Ticket #	Type of Impact
FS175 FS178 FS179 FS185 FS188 FS189	Added a Toggle setting to allow states to report combined results for Asian and NativeHawaiianorOtherPacificIslander as a single Major Race Category of “MAP”.	CIID-5973	Data
	The Assessment logic was not correctly handling English Learner participation, ‘PARTELP’, that needs to be included in FS188, that has been corrected.	CIID-6029	Data
	Corrected an issue in the race handling logic that was excluding Hispanic students in Private Schools from Reports	CIID-6043	Data
	Updated this release with the Assessment hotfix changes discovered after the 11.2 release to update the order of the logic to apply Medically Exempt and English Learner Participation	CIID-6048	Data

Discipline

Report	Approved Change	Ticket #	Type of Impact
FS005	Updated the report creation logic when there is no age selected in Toggle for Developmental Delay (Child Count) to interpret that selection as a state not using Developmental Delay and excluding DD from any zero counts.	CIID-4793	Data
FS005 FS006 FS007 FS088 FS143 FS144	Caught during our internal testing for this release, there was a change to the metadata, and Discipline data was not populating on the UI screen but still showed in the submission file. There was one additional metadata script that needed to be included in the update package that resolved that issue.	CIID-6453	Data

Child Count

Report	Approved Change	Ticket #	Type of Impact
FS002 FS089	Corrected an issue in 2 scripts to create appropriate zero counts in the LEA and SCH files.	CIID-6021	Data

Immigrant

Report	Approved Change	Ticket #	Impact
FS045	One of the scripts that handles the report creation logic did not include the Immigrant Dimension definition and primary key, that has been corrected.	CIID-6444	Performance

Title III

Report	Approved Change	Ticket #	Type of Impact
FS116	Our internal automated collection of updated metadata did not contain the updates for FS116 so we manually pulled that data and added it to the script that will update the metadata for this release.	CIID-6445	Data

Staff

Report	Approved Change	Ticket #	Type of Impact
FS070 FS099 FS112	Updated the Age Group Taught Permitted Values in the category Age Group to the new more detailed descriptions, AGE3TO5NOTK and AGE5KTO21.	CIID-5923	Data
FS112	Corrected a metadata issue that was preventing Paraprofessional Qualification Status from showing in the UI or submission file	CIID-6479	Data

General

Report	Approved Change	Ticket #	Type of Impact
	The join logic in the debug view vwStudentDetails was not displaying the LEA Operational Status for non-Federally reported schools. That is now corrected.	CIID-6044	Data
FS045	Adjusted the width of the ‘Migration Date’ and ‘Message’ sections of the log on the migration screens to eliminate unneeded space for the date so more of the message text is visible in the preview window.	CIID-6011	Migration
	The name of the new Source migration scripts, Source-to-Staging_ChildCount for example, was causing an issue when executed through the UI. We added brackets [] around the names in the table that stores them so SQL will execute them without error.	CIID-6430	User Interface
	Verified the SPR/APR Submission reports Indicator 4A, 4B, 9 and 10 are working as expected.	CIID-5772	Migration
	Expanded the auto-upgrade feature for states with no internet access from their server.	CIID-5999	Performance
	As detailed in the Important Updates section above, this is the ticket where we are replacing the library that handles the display of report data in the UI with one that will help us promote Generate to the Open-Source Community.	CIID-6003	Performance
	Updated the Metadata for DATA POPULATION SUMMARY Reports.	CIID-6004	Performance
	As referred to in the Important Updates section, we created a new utility to create snapshots of the staging tables as needed. There is a documentation link above as well.	CIID-6013	Performance
	Corrected the logic that resets the RecordEndDateTime in both Staging-to-DimPeople_K12Staff and Staging-to-DimPeople_K12Students to accurately record start and end dates for longitudinal logic.	CIID-6045	Performance
	We have scheduled security scans that run against all the Generate software and based on the latest run we updated NodeJS & child dependencies.	CIID-5981	Performance

Upgrade Procedure

No changes have been made to the Generate upgrade procedure for this release. Follow the standard Generate upgrade process to install version 11.3.

Compatible Systems

Generate was tested on the following operating systems and browsers:

• Windows 10 Pro

• Google Chrome, Version 68 0.3440.106 (Official Build) (64-bit) and Firefox Quantum 61.01 (64 bit)

---

Office Hour

Generate 11.3 Office Hour Recording