Automated big data quality assessment using knowledge graph embeddings

International Journal of Data Mining, Modelling and Management

This paper introduces a knowledge-based approach to automate data quality assessment, addressing the limitations of traditional methods that overlook contextual data characteristics. By using knowledge graph embeddings, it predicts missing connections between a dataset’s context and relevant quality rules within a knowledge graph. This integration of diverse representations enables a... [Read More]

Load JSON into SQL Server Table

MSSQLTips.com

When working with SQL Server, sooner or later you’ll need to deal with JSON. APIs, log files, and even some third-party integrations send data in JSON format. The challenge is that JSON doesn’t map directly to tables. Especially when the data includes nested objects or arrays. [Read More]

T-SQL in One Hour

MSSQLTips.com

Writing effective and precise SQL queries is a basic competency for database administrators and developers. The shift from general SQL concepts to T-SQL mastery is difficult for many students and even seasoned professionals. This article is a part of the “X in one hour” series that I am writing for... [Read More]

Natural Language Query for SQL Server

MSSQLTips.com

Data is usually the most important asset in organizations, but only SQL developers can frequently access that data. Technical teams often write queries for non-technical users. This restricts agility, slows decision-making, and creates a bottleneck in data accessibility. One possible remedy is natural language processing (NLP), which enables users to... [Read More]

SQL Developer Interview Questions

MSSQLTips.com

A lot of online T-SQL interview questions are overly abstract and unrelated to practical applications. They frequently ignore how SQL is actually used in daily work in favor of concentrating on theoretical distinctions or basic syntax. This makes it challenging to assess a candidate’s ability to write effective, maintainable queries... [Read More]
Tags: sql interview

FedDQ: An Intelligent Federated Data Quality Assessment for Wireless Sensors Network

MENACOMM'2025

The widespread adoption of IoT devices and wireless sensor networks (WSNs) has revolutionized various domains leading to unprecedented data generation and connectivity. Thus, ensuring the quality of this data is crucial, as inaccuracies can pose major risks in mission-critical applications. Context awareness is also crucial in this regard since it... [Read More]

Web Scraping with Python Scrapy Framework

MSSQLTips.com

In a bid to make decisions, obtain knowledge, or build applications, major institutions and individuals often have to retrieve and analyze large amounts of data from various websites, a gut-wrenching and siloed task that equally wastes time. Collecting and treating that data is tedious, prone to inaccuracies, and inefficient, especially... [Read More]

Power BI in One Hour

MSSQLTips.com

One of the best business intelligence tools is Microsoft’s Power BI, which makes it possible for organizations to interact with, understand, and make decisions using its data. It connects different sources of data (SQL Server on-premises, cloud databases, Salesforce, etc.), changes raw information into reports, apps and dashboards, and enables... [Read More]
Tags: power bi

SSIS in One Hour: Hands-On Tutorial

MSSQLTips.com

The goal of this tutorial is to enable ETL developers to obtain practical knowledge to exploit SSIS in transforming and combining data through hands-on exploration to be ready for real-world challenges in managing information. We’ll examine and discuss some of the most essential components and functionalities. We will begin by... [Read More]

Addressing the Velocity Challenge of Big Data in Radiation Pollution Monitoring: Implementation and Demonstration

IMCET'2023

Real-time data quality assessment is crucial in processing big data across various applications. Our previous work introduced BIGQA, a declarative solution based on ISO/IEC 15939, ISO/IEC 25000, and ISO/IEC 20547 standards. BIGQA offers a comprehensive and systematic approach to assessing big data quality, addressing the challenges of volume and variety.... [Read More]

Towards Data Quality: an Introduction

Tech Blog

This article emphasizes the significance of data quality in data-driven strategies and highlights the consequences of implementing data warehousing scenarios that need more attention to data quality. It introduces the concept of data quality management and discusses the ISO/IEC 25012 standard’s fifteen data quality characteristics. The article explains the different... [Read More]