This paper introduces a knowledge-based approach to automate data quality assessment, addressing the limitations of traditional methods that overlook contextual data characteristics. By using knowledge graph embeddings, it predicts missing connections between a dataset’s context and relevant quality rules within a knowledge graph. This integration of diverse representations enables a...
[Read More]
Load JSON into SQL Server Table
MSSQLTips.com
When working with SQL Server, sooner or later you’ll need to deal with JSON. APIs, log files, and even some third-party integrations send data in JSON format. The challenge is that JSON doesn’t map directly to tables. Especially when the data includes nested objects or arrays.
[Read More]
T-SQL in One Hour
MSSQLTips.com
Writing effective and precise SQL queries is a basic competency for database administrators and developers. The shift from general SQL concepts to T-SQL mastery is difficult for many students and even seasoned professionals. This article is a part of the “X in one hour” series that I am writing for...
[Read More]
Natural Language Query for SQL Server
MSSQLTips.com
Data is usually the most important asset in organizations, but only SQL developers can frequently access that data. Technical teams often write queries for non-technical users. This restricts agility, slows decision-making, and creates a bottleneck in data accessibility. One possible remedy is natural language processing (NLP), which enables users to...
[Read More]
SQL Developer Interview Questions
MSSQLTips.com
A lot of online T-SQL interview questions are overly abstract and unrelated to practical applications. They frequently ignore how SQL is actually used in daily work in favor of concentrating on theoretical distinctions or basic syntax. This makes it challenging to assess a candidate’s ability to write effective, maintainable queries...
[Read More]
SQL Server Management Studio 21 (SSMS) Quick Start Guide
MSSQLTips.com
In many conversations with my colleagues and other developers who work with different database engines, they often underestimate SQL Server. In my opinion, one of the key causes is that they didn’t work with the SQL Server Management Studio GUI to see how much easier it is to manage SQL...
[Read More]
FedDQ: An Intelligent Federated Data Quality Assessment for Wireless Sensors Network
MENACOMM'2025
The widespread adoption of IoT devices and wireless sensor networks (WSNs) has revolutionized various domains leading to unprecedented data generation and connectivity. Thus, ensuring the quality of this data is crucial, as inaccuracies can pose major risks in mission-critical applications. Context awareness is also crucial in this regard since it...
[Read More]
Select SQL Server Data Between Two Dates
MSSQLTips.com
Many SQL developers encounter challenges when efficiently searching for data within a specific date range. This is especially difficult when dealing with large, partitioned or sharded tables. In this SQL tutorial, we look at different ways to write SQL to return data between date ranges. We will also see how...
[Read More]
Power BI to Visualize and Profile Data for Data Quality
MSSQLTips.com
In a previous tip, we provided a data profiling script for SQL Server to collect information. The script was intended to collect information about the structure and data in a specific database. Still, the large number of columns in the result table made it harder to investigate and analyze the...
[Read More]
Web Scraping with Python Scrapy Framework
MSSQLTips.com
In a bid to make decisions, obtain knowledge, or build applications, major institutions and individuals often have to retrieve and analyze large amounts of data from various websites, a gut-wrenching and siloed task that equally wastes time. Collecting and treating that data is tedious, prone to inaccuracies, and inefficient, especially...
[Read More]
Power BI in One Hour
MSSQLTips.com
One of the best business intelligence tools is Microsoft’s Power BI, which makes it possible for organizations to interact with, understand, and make decisions using its data. It connects different sources of data (SQL Server on-premises, cloud databases, Salesforce, etc.), changes raw information into reports, apps and dashboards, and enables...
[Read More]
SSIS in One Hour: Hands-On Tutorial
MSSQLTips.com
The goal of this tutorial is to enable ETL developers to obtain practical knowledge to exploit SSIS in transforming and combining data through hands-on exploration to be ready for real-world challenges in managing information. We’ll examine and discuss some of the most essential components and functionalities. We will begin by...
[Read More]
Data Quality Management Issues in Time Series Analysis Resolved with Python
MSSQLTips.com
How to Visualize Time Series Data using Microsoft Excel
MSSQLTips.com
Build Python Matplotlib Charts to Visualize Application Log Data
MSSQLTips.com
Contextualizing Quality: A Journey from Data to Personal Assessment
Tech Blog
Addressing the Velocity Challenge of Big Data in Radiation Pollution Monitoring: Implementation and Demonstration
IMCET'2023
Real-time data quality assessment is crucial in processing big data across various applications. Our previous work introduced BIGQA, a declarative solution based on ISO/IEC 15939, ISO/IEC 25000, and ISO/IEC 20547 standards. BIGQA offers a comprehensive and systematic approach to assessing big data quality, addressing the challenges of volume and variety....
[Read More]
CTXDQ: An Automated Context-Driven Data Quality Assessment
IMCET'2023
Accurate data quality assessment is crucial for ensuring the reliability of data-driven applications. The manual inspection of data quality is a challenging process due to the large volume of data and the complexity of identifying data quality issues manually. To address these challenges and enable continuous monitoring and updating of...
[Read More]
An overview of SQL Server monitoring tools
SQL Shack
SQL Script for SQL Server Table and Column Properties
MSSQLTips.com
This step-by-step technical article will explore how to perform data profiling on a database using SQL code. We will use a combination of SQL queries to gather various metrics and statistics about the data, such as column data types, null values, data length, and more. Ultimately, all SQL code portions...
[Read More]
Data Wrangling in SQL Server for Cleaning, Transforming and Merging Data
MSSQLTips.com
Implicit Conversion Concerns for SQL Server Performance
MSSQLTips.com
Towards Data Quality: An Overview of SQL Server Data Quality Solutions
Tech Blog
Towards Data Quality: an Introduction
Tech Blog
This article emphasizes the significance of data quality in data-driven strategies and highlights the consequences of implementing data warehousing scenarios that need more attention to data quality. It introduces the concept of data quality management and discusses the ISO/IEC 25012 standard’s fifteen data quality characteristics. The article explains the different...
[Read More]