.Net for apache spark combines .net development with the big data engine

.Net for apache spark connects .net development with the big data engine

Microsoft releases version 1.0 of .NET for Apache Spark. The open source package is designed to connect .NET development with the Big Data processing platform.

Apache Spark scales complex data analytics and machine learning applications across a cluster. The software has established itself as a standard tool for big data analysis and is written in the Scala programming language.

Support for .NET applications

The current release offers support for .NET applications for the .NET standard 2.0 or older, it also offers the possibility to use user-defined functions of .NET (user-defined functions, short: UDFs) to use.

In addition, users will have access to Apache Spark’s DataFrame APIs (version 2.3, 2.4 and 3.0) and the ability to use Spark SQL – an Apache Spark module for processing and querying structured data.

The Big Data engine is currently in its third major release. For more information on .NET for Apache Spark can be found in the release notes and in the post on the .NET blog from Microsoft. There you will also find detailed instructions on how developers can start their projects.

Like this post? Please share to your friends:
Leave a Reply

;-) :| :x :twisted: :smile: :shock: :sad: :roll: :razz: :oops: :o :mrgreen: :lol: :idea: :grin: :evil: :cry: :cool: :arrow: :???: :?: :!: