Release Notes 12.0

This document describes the technical enhancements to Generate version 12.0 released September 18, 2024.

Release Overview

Generate version 12.0 is focused on the Assessment files, file specifications FS175, FS178, FS179, FS185, FS188, and FS189 due for submission to EDPass January 8, 2025.

Release Highlights

• Single Button Migration - We’ve simplified the migration process in Generate! With a new single-button interface. The migration screen consolidates everything into one place, integrating both the migration log and staging validation results, so you can keep tabs on the entire process with minimal effort. For more details, view the Data Migration guide.

• OAuth Support - Generate 12.0 now supports OAuth for both authentication and authorization, giving users an added layer of security and seamless access across systems. Learn how to set up OAuth in your environment by checking out our OAuth Configuration guide.

• Installation Updates - We’ve added the ability to run Generate from a subfolder on your web server, increasing flexibility in deployment configurations. This update simplifies hosting Generate alongside other applications and services. See the Subfolder Configuration guide for detailed steps.

• API Metadata Feature - The new API Metadata feature lets you retrieve the EDFacts file specification metadata directly from EDPass via an API call. This automation saves time and ensures you’re always working with the most up-to-date specs. Find out how to integrate this feature in the Configuring Metadata guide and how to run the refresh from the Metadata guide.

Important Updates

• Generate in the OSC - We’ve removed the last application dependencies on Wijmo, improving Generate’s compatibility within the Open Source Community (OSC) framework. This update not only makes Generate more lightweight but also prepares us for its upcoming transition to an open-source tool on GitHub. With this move, users will soon be able to contribute directly to Generate's development.

• Migrations - Improvements have been made to the migration performance for key organization tables—DimSeas, DimLeas, and DimK12Schools—leading to faster and more efficient migrations.

• Generate Utilities Several Generate utilities have been updated to provide more accuracy and faster processing. These include:

  • Check_SourceSystemReferenceData_Mapping: Improved mapping validation between source systems.

  • Cleanup_Debug_Tables: Enhanced functionality for cleaning up debug data more efficiently.

  • Submission File Comparison Documentation: Improved tools for comparing submission files.

Documentation Updates

• New Fact Type Documentation - We’ve introduced a new guided documentation page to help users navigate the complete process of generating each set of Fact Type files from start to finish. The first draft focuses on the Assessment Fact Type and serves as a prototype for future Fact Type pages. We're eager to collaborate with the community to refine and improve these pages. At the bottom of the page, you’ll find a feedback form—we encourage you to share your thoughts and suggestions!

Generate Enhancements

The following EDFacts reports were updated in this release.

Type of Impact:

• Data – changes will improve data quality and completeness.

• User Interface – changes impact the Generate User Interface and/or migration process.

• Source to Staging ETL – changes may require modifications to the SEA’s Source to Staging ETL.

• Performance – changes improve the performance of the application.

• Migration – changes impact a data migration process.

• Submission Files – changes may impact submission file(s).

• Database – changes to the Generate database structure.

Assessment

Report	Approved Changes	Ticket #	Impact
FS175, FS178, FS179, FS 185, FS188, FS189	Added ability to include ‘HS' as a Grade Level in Assessment files.	CIID-6030	Data
FS175, FS178, FS179, FS185, FS188, FS189	Corrected an issue to assure that only SEA level Assessment files contain zero counts.	CIID-6423	Data

Directory

Report	Approved Change	Ticket #	Impact
FS029, FS039	Cleaned up the population of the State values into the DimLeas, DimK12Schools, DimCharterSchoolAuthorizers, and DImK12CharterSchoolManagementOrganizations tables.	CIID-7057	Performance
FS029, FS039	Modified the migration of Organization phone numbers to remove the parentheses and hyphens	CIID-7072	Data
FS198	Corrected an issue with the web code to display the Charter Contract ID, Charter Approval Date, and Charter Renewal Date columns in the UI and populate these fields in the submission file.	CIID-6898	Data
FS129	Added logic to exclude Reportable Programs and Schools opened after October 1st from the report.	CIID-6917	Data
FS129	Updated the metadata for FS129 to populate Shared Time Status, Virtual School Status, and NSLP Status, excluding Magnet School Status.	CIID-6918	Data

Discipline

Report	Approved Change	Ticket #	Impact
FS086	Corrected an issue in the view that supports the IDEA Firearms Discipline data that was preventing it from migrating to the RDS level.	CIID-7005	Data

Exiting

Report	Approved Changes	Ticket	Impact
FS009	Enhanced Toggle questions for Exiting to match EDPass questions regarding Diplomas. Separated the Toggle Question for “Regular High School Diplomas” into two questions: Alternate Diploma and Certificates.	CIID-5657	Data

Graduation

Report	Approved Changes	Ticket #	Impact
FS150 FS151	We added CohortGraduationYearId and CohortYearId to FactK12StudentCounts to support FS150 and FS151.	CIID-6491	Data
FS150 FS151	We modified the RDS and Report migrations to support the new data elements that were added to FactK12StudentCounts to support FS150 and FS151.	CIID-6506	Data

Homeless

Report	Approved Change	Ticket #	Impact
FS118	Corrected an aggregation count issue.	CIID-4771	Data

Membership

Report	Approved Changes	Ticket #	Impact
FS033 FS052	The exclusion of Reportable Programs from the school level counts was added to our count logic but not to the zero count logic so we had to update that code to create the appropriate zero count rows.	CIID-6941	Data
FS052	We recently added code to handle the creation of the submission file more efficiently because the file size is very large at the school level. We corrected an issue in that new code that was causing the header row to repeat every 100k rows.	CIID-6984	Performance
FS033, FS052	We updated the zero count logic to exclude Schools with no students reported in FS052.	CIID-7017	Data

Staff

Report	Approved Changes	Ticket #
SF070, SF099, SF112, SF059	Added some additional error handling on the FTE value in the Staging to RDS code when NULL values come in.	CIID-6969	Data
FS059	Modified the report population logic for FS059 - Staff FTE to only include Teachers in the counts at the School level.	CIID-7020	Data

General

Approved Changes	Ticket #	Impact
Made enhancements to debug.vwStudentDetails to help with troubleshooting data issues.	CIID-6481	Data
Incorporated all of the Generate v11.4 changes into v12	CIID-6981	Data
Updated the Utilities to the latest table/column names	CIID-7066	Data
We replaced the Wijmo library in Toggle, Calendar display and selection, and the report detail view in the grid.	CIID-6475	User Interface
We expanded Hydrate (our internal test data creation tool) to produce 2 years' worth of data for the same set of test students.	CIID-6515	Performance
In a previous release we removed the generic ‘submission’ fact type and created the specific fact types Discipline, Assessment, and Staff. We also created a metadata table the relates the Fact Types to the EDFacts reports that they support and updated the code to use the new metadata,	CIID-6525	Data
Corrected an issue with Reports Migration that was logging unnecessary activities in DataMigrationHistories.	CIID-6943	Performance
Updated the ‘Check_SourceSystemReferenceData_Mapping’ utility to use the new metadata tables that we’ve created to provide a connection between Generate Report and Fact Type	CIID-6948	Performance

Upgrade Procedure

No changes have been made to the Generate upgrade procedure for this release. Follow the standard Generate upgrade process to install version 12.0.

Compatible Systems

Generate was tested on the following operating systems and browsers:

• Windows 10 Pro

• Google Chrome, Version 68 0.3440.106 (Official Build) (64-bit) and Firefox Quantum 61.01 (64 bit)

---

Generate 12.0 Office Hour