by Ian J. Ghent | Sep 11, 2020 | Apache Spark, Apache Spark Cafe, Python, SAS
At WiseWithData, we believe we can be and help support agents of positive change in our communities and around the world. We see Open Source Software (OSS) as a truly shining example of the power of global communities coming together to solve common challenges. Thanks...
by Ian J. Ghent | Sep 3, 2020 | Apache Spark, Apache Spark Cafe, SAS, Solutions
It was 5 years ago that we announced the development of the SPROCKET conversion service. One of the consistent messages that we’ve been hearing from our clients is that they love the SAS to PySpark migration solution, but they want more. Many of our customers...
by Andrea Bacqué | Jun 19, 2020 | Apache Spark, Apache Spark Cafe, Customer Experience, Python, SAS, Solutions
The Wise With Data Team have been eagerly anticipating Spark 3.0’s release and it is official as of today. As experts in open source data science, we’d like to share what to expect with Spark 3.0. Also a reminder that Spark Summit 2020 is next week… What are we...
by Ian J. Ghent | May 28, 2020 | Apache Spark, Apache Spark Cafe, Python, SAS, Solutions
As Enterprises look to rationalize investments and re-architect technology stacks, their data needs to be open and accessible – not locked into closed formats or proprietary systems. In the world of data science, Apache Spark stands out as the clear leader with...
by Mike Sun | May 20, 2020 | Apache Spark, Apache Spark Cafe, Java, Python, R, Scala
RDD, DataFrame, and Dataset are the three most common data structures in Spark, and they make processing very large data easy and convenient. Because of the lazy evaluation algorithm of Spark, these data structures are not executed right way during creations,...
by Bryan Chuinkam | May 20, 2020 | Apache Spark, Apache Spark Cafe, Python
What is Koalas? Koalas is an implementation of the pandas DataFrame API on top of Apache Spark. Pandas is the go-to Python Library for data analysis, while Apache Spark is becoming the go to for big data processing. Koalas allows you leverage the simplicity of Pandas...
