3rd man • IT and beyond

20. June 2021 .NET Core, Apache Spark, Big Data, C#, Docker, Jupyter, Visual Studio Code

.NET for Apache Spark 2.0.0 released

Microsoft just recently announced the release of .NET for Apache Spark 2.0.0.

It provides a couple of new features, like the support for the Apache Spark 3.1.0 APIs, for example.

Apache Spark 2.3.x support has now officially been dropped, however.

I have also updated my different docker images, so that you can try out all the different combinations of the supported Apache Spark versions along with the new .NET for Apache Spark 2.0.0 runtime.

As you might be aware, there are actually 3 different kinds of docker images provided.

Interactive Jupyter Notebook

This image allows you … more

29. May 2021 .NET Core, C#, Database, Docker, Entity Framework, Informix, Visual Studio

IBM Informix and EntityFrameworkCore

Just recently I needed to explore how I could get IBM Informix and EntitiyFrameworkCore to work together with an existing database, and therefore decided to document my findings in this simple step-by-step walk-through.

Prerequisites

As mentioned here, the IBM® Data Server Provider for .NET IBM DB2® provider option is now the preferred Informix® provider for developing new applications.

Looking at the related site for the IBM Data Server Provider for .NET, it actually states that the former Informix specific provider (IBM.Data.Informix) is now deprecated.

Although this statement actually applies to the provider for .NET, … more

28. November 2020 Apache Spark, Big Data, Docker

My .NET for Apache Spark docker image at .NET Conf 2020

This year’s .NET Conference covered many interesting topics in various online sessions. One of them was titled “The Missing Piece – Diving into the World of Big Data with .NET for Apache Spark”.
Since I wrote about .NET for Apache Spark in the past, I obviously was very curious to find out what this session might cover.

I almost couldn’t believe my eyes when I saw my name mentioned on one of the slides. But the next surprise wasn’t long in coming. One of my .NET for Apache Spark docker images was even used during … more

27. October 2020 .NET Core, Apache Spark, Big Data, C#, Data Science, Docker, Jupyter, Learning

.NET for Apache Spark 1.0 is available

Microsoft has released version 1.0 of .NET for Apache® Spark™. The official announcement provides a brief overview of the basic features, performance and the future of .NET for Apache Spark.

It even mentions my docker images, which are now available for version 1.0.0, too. Some of my articles are mentioned on the Open Source Blog as well. A big Thank You to everyone supporting me by trying out the images, providing feedback or contributing in any other way.

Speaking of docker images: In case you didn’t know yet, there are now three different types of … more

21. October 2020 .NET Core, Apache Spark, Big Data, C#, Data Science, Docker, Jupyter, Learning

.NET for Apache Spark – interactive notebook Docker image

If you are reading this, you are probably aware of my .NET for Apache Spark Docker images that I’ve made available so far. Just recently I’ve added a development image that allows you to easily build .NET for Apache Spark with VS Code in a browser. Today I want to introduce you to the latest member of the family:

The .NET for Apache Spark interactive notebook Docker image.

Jupyter Notebooks

In case you are not aware of what Jupyter Notebooks are, here’s a quick summary quote from the Jupyter project site.

The Jupyter Notebook

… more