Tag: .NET for Apache Spark

10. August 2019 .NET Core, Apache Spark, Big Data

.NET for Apache Spark – MQTT Streaming

.NET for Apache Spark 0.4.0 was released recently. Therefore, it is now time to test, if it can be used for MQTT Streaming as well.

If you followed my series about a real-time data processing pipeline, you probably remember that I have used Apache Bahir to retrieve streaming data from Apache ActiveMQ via the MQTT protocol. The data itself was generated by IanniX and forwarded to ActiveMQ utilizing my osc2activemq docker image.

Preparing .NET for Apache Spark for MQTT Streaming

For the most parts, you can follow this quick intro tutorial, which walks … more

3. August 2019 .NET Core, Apache Spark, Big Data, Docker

.NET for Apache Spark 0.4.0 docker image

.NET for Apache Spark

.NET for Apache Spark 0.4.0 has been released.
If you want to test it out, you might find my Docker image useful.
Details are available at https://hub.docker.com/r/3rdman/dotnet-spark

UPDATE:

There’s a new image available. Click here for more details.

Quick reference

The image is based on Ubuntu 18.04, Apache Spark 2.4.3 with Hadoop 2.7, .NET Core 2.1.801 and .NET for Apache Spark 0.4.0. It is intended for the purpose of testing .NET for Apache Spark, without the need to install the required bits manually.
Per default, the related container will start up one … more

11. May 2019 .NET Core, Apache Spark, C#, Development, Entity Framework, Machine Learning

.NET News

In den letzten Tagen gab es einige sehr interessant Neuigkeiten zu den verschiedensten .NET Themen. Hier ein kleine Auflistung:

… more
Scroll to top