February 7, 2020 – Ottawa, Canada: WiseWithData, proven leaders in legacy SAS migrations, announce the general availability of SPROCKET Validator tool for validating migrated code.

Hardened by several large scale migrations, Validator is a key tool in the migration process, helping to quickly work though User Acceptance Testing of migrated code. It performs thorough row-by-row, column-by-column comparisons on all data outputs, and produces detailed reports on any inconsistencies, at blazing speeds. This enables customers to have the confidence that the SAS business process was successfully and accurately converted into PySpark. Going forward, Validator will be packaged with all SPROCKET migration offerings, and will be a key part of the delivery methodology.

Validator takes two input dataframes in PySpark and compares each and every data value between them. Any differences in data schema, data types or values are noted in a detailed report. Features in the output report include:

  • Complete data schema comparison
  • Summary of rows and columns with differences
  • Fuzzy comparisons for dealing with rounding differences
  • Samples of differences
  • Cross-tabulations of differences
  • NULL value comparisons

About WiseWithData

Founded in 2015, WiseWithData are leading experts in Apache Spark™ and Cloud migrations of legacy SAS based analytics. The SPROCKET Migration Solution is the world’s only solution that converts SAS code to highly optimized native Databricks Delta and PySpark Dataframe API output with over 95% automation. The generated code is able to be run on-premise and in all supporting Cloud platforms including Databricks, AWS, Azure and GCP.

SPROCKET is fast, simple and accurate. Tailored for Enterprises and offered as a Conversion-as-a-Service, SPROCKET provides a seamless solution for migrating SAS based ETL and analytics jobs into the world’s most advanced analytics technologies. SPROCKET dramatically accelerates an otherwise intensive and error prone manual “brute force” process. Manually converting SAS code into production ready code could take months or even years to accomplish. SPROCKET maintains the original structure and workflow of the process, while simplifying testing & knowledge transfer.