Data platforms
Google makes Managed Spark 4.0 generally available
Google Cloud says Managed Service for Apache Spark 4.0 is generally available across serverless and managed-cluster deployments.
What happened
Google Cloud’s release adds an Apache Spark 4.2 runtime, a redesigned console, AI-assisted job troubleshooting and IDE tools for building and running Spark pipelines. It also attaches workloads to the Lakehouse runtime catalog by default.
Why it matters
Independent data engineers and data scientists using Managed Service for Apache Spark can work across serverless and managed clusters on the same software stack. Google Cloud says its Lightning Engine offers up to 3.25 times the price-performance of a leading high-speed Spark alternative.
What to watch
Consider checking whether your team’s freelance Spark developers can use the new runtime, IDE integrations and Lakehouse catalog with their current access permissions.
