Hadi Fadlallah

Getting Started with Apache Kafka and Apache Flume (Import data to HDFS)

Towards Data Science

Posted on November 6, 2018

This article contains a complete guide for Apache Kafka installation, creating Kafka topics, publishing and subscribing Topic messages. In addition, it contains Apache Flume installation guide and how to import Kafka topic messages into HDFS using Apache Flume.

Tags: big data kafka hadoop flume data engineering tds

Installing Hadoop 3.1.0 multi-node cluster on Ubuntu 16.04 Step by Step

Towards Data Science

Posted on November 5, 2018

There are many links on the web about install Hadoop 3. Many of them are not working well or need improvements. This article is taken from the official documentation and other articles in addition of many answers from Stackoverflow.com

Tags: big data hadoop hadoop 3 ubuntu ubuntu 16 tds

How to check column structure in ssis?

Stack Overflow

Posted on November 1, 2018

A solution for validating flat files headers using SSIS script component.

Tags: ssis stack overflow

Automate Version number Retrieval from .Dtsx files

Stack Overflow

Posted on April 24, 2017

A solution for retrieving the SSIS packages metadata without installing SQL Server nor Integration Services.

Tags: ssis stack overflow