FOR IMMEDIATE RELEASE
August 15, 2020 – Ottawa, Canada: WiseWithData, masters in legacy SAS migrations to Apache Spark, have released version 3.0 of their extraordinary automated SPROCKET migration solution. With this release, SPROCKET pushes the boundaries of automation by exploiting new features in Spark 3.0.
While this release includes thousands of new features and optimizations, one of the most exciting features is the ability to leverage transformer functions (new in Spark 3.0) to simplify the converted code. This has also lead to key improvements in the ability to handle complex and dynamic macro logic with changing scope.
Prior versions of SPROCKET supported both the base library engine an all the access engines, but this release goes a step further. The default “base” engine reads/writes data to the wildly popular and efficient Apache Parquet file format (in place of sas7bdat files). While this makes sense, thanks to the great work by developers at Databricks, there is now a better option for many workloads. Delta Lake is a format that builds on top of Apache Parquet, to provide true ACID compliant transactions in Spark. SPROCKET 3 now supports converting any existing libraries into the Delta format.
Overall, this release has improved the level of automation dramatically, approaching 100% in many cases. This level of automation means that the conversion process itself, is no longer a constraining factor for the speed of migration. SPROCKET 3 unlocks the ability to scale the speed of delivery to any customers needs.
Comments:
“The R&D team has been tirelessly pouring over new features in Spark 3.0 that we can exploit to improve the experience for our customers. Transformer functions in particular have been a key feature for us to build dynamic reusable code that can adjust to different data schemas in similar ways to SAS’ processing engine. Support for Delta Lake is another key milestone, enabling our customers not only to benefit from Spark’s incredible performance, but also enjoy exciting new features like atomic transactions, rollback and time-travel.”
Ian J. Ghent – President – WiseWithData
About WiseWithData
Founded in 2015, WiseWithData are leading experts in Apache Spark™ and Cloud migrations of legacy SAS based analytics. The SPROCKET Migration Solution is the world’s only solution that converts SAS code to highly optimized native Databricks Delta and PySpark Dataframe API output with over 95% automation. The generated code is able to be run on-premise and in all supporting Cloud platforms including Databricks, AWS, Azure and GCP.
SPROCKET is fast, simple and accurate. Tailored for Enterprises and offered as a Conversion-as-a-Service, SPROCKET provides a seamless solution for migrating SAS based ETL and analytics jobs into the world’s most advanced analytics technologies. SPROCKET dramatically accelerates an otherwise intensive and error prone manual “brute force” process. Manually converting SAS code into production ready code could take months or even years to accomplish. SPROCKET maintains the original structure and workflow of the process, while simplifying testing & knowledge transfer.
###