Python Data Pipelines with Polars and DuckDB
I’m going to say something that’ll upset a lot of people: pandas had its run. Polars is just better.
I don’t mean that lightly. I …
Read Article →Databases
26 articles about databases development, tools, and best practices
AWS Aurora Serverless v2: Architecture and Performance Guide
Aurora Serverless v2 is what v1 should have been. I don’t say that lightly — I ran v1 in production for two years and spent more time fighting …
Read Article →Data Consistency Models in Distributed Systems
In distributed systems, one of the most challenging aspects is managing data consistency across multiple nodes. The CAP theorem tells us that we …
Read Article →How to clone a table structure in MySQL
I have often needed to clone a table without it’s data in MySQL.
Oftentimes this has been because I have a continually growing temporary table …
Read Article →pt-online-schema-change Add Index
Percona has a great toolkit that allows you to perform schema changes on a MySQL or MariaDB database without any downtime, it works by creating a new …
Read Article →The Relational Database Model
Relational databases first made an appearance in the mid-1970s, between the years 1974 and 1977 with the creation of Ingres and System R which led to …
Read Article →Product Update: ADD becomes Serengeti
As a product update; The “Autonomous Distributed Database”, otherwise known as simply ADD has been renamed to Serengeti.
The Serengeti is …
Read Article →All About Distributed Databases
A database “is a structured collection of data. Card indices, printed catalogues of archaeological artefacts and telephone directories are all …
Read Article →Distributed Database Systems Observations
Traditional database systems were a centralised powerful database server that housed all operations pertaining to the database.
There are countless …
Read Article →Top-down vs Bottom-up Database Design
There are essentially two different approaches one can take when designing databases; these, from a high-level analytic point of view, narrow down to …
Read Article →Relational Database Proprietary Extensions
Standard Query Language – or SQL for short – is a language designed for relational databases that allows end users such as developers and database …
Read Article →Locks used in Database Management Systems
Database Management Systems (DBMS?) are designed to store any amount of data that can then be retrieved or manipulated at a later date.
In order to …
Read Article →Resolving InsufficientPrivilege Errors in Redshift
If you are getting the mysterious error:
[ERROR] InsufficientPrivilege: permission denied for schema errors
Then you can easily resolve this by …
Read Article →How to increase column size in Redshift database tables
It is only possible to alter VARCHAR columns, and only under the following circumstances:
- You can not alter a column with compression encodings …
Entity and Referential Integrity in Relational Databases
Data integrity is the overall completeness, accuracy and consistency of data (Techopedia, n.d.).
In order to achieve data integrity, it is important …
Read Article →Data Warehouses vs Data Marts
Although the terms “data warehouse” and “data mart” sound similar, they are quite different. It is important to first …
Read Article →Graph Databases and their Properties
The concept of a graph in mathematics is simply a collection of elements which are typically called Nodes and are joined together by Edges. Each Node …
Read Article →How to Install MongoDB on Mac
You can use Homebrew to install MongoDB on a Mac.
For ages you were able to simply do:
brew install mongodb, but more recently, that has stopped …
Relational (SQL) vs NoSQL Database Models
The Relational (SQL) database has been a central piece to businesses since the 1970s when they first had their claim to fame.
Experts say that the …
Read Article →When to use FLUSH PRIVILEGES in MySQL
So if you’ve ever created users and given them specific permissions from with SQL or the commandline, you will be familiar with a statement …
Read Article →MySQL Community Server MSI Installer Hangs on Windows 10
I was trying to install MySQL Community Server for Windows 10 using the standard .MSI installer provded from the MySQL website and the installer just …
Read Article →A bit on SQL Standards
SQL (Structured Query Language) for relational databases was maintained and standardised by the American National Standards Institute (ANSI) and the …
Read Article →A Brief Talk on Databases
Databases have been around since ancient times, when elaborate database systems were deployed by governments, hospitals and organisations to keep …
Read Article →Perform a Mysql Query using Joomla!
This is really actually meant for future reference for myself as lately I’ve been doing quite a lot of Joomla! mysql coding and have used the …
Read Article →