Today I used Harlequin for the first time. It is a SQL IDE for the terminal and the setup or installation was surprisingly easy. I tried out the tool as part of my “elt-on-github-actions” repository (more information on that will follow). I wanted to test the conditional logic in my marts models: If it is the production environment, output to blob storage and if it is not, then create a view in the duckdb database. ...
A recent project of mine involved determining duplicate CRM objects across Salesforce and Hubspot. I utilized duckdb for my data processing and found this neat little text function duckdb provides: strip_accents(string). It does exactly what it says: Strip accents from a string. Thus Mühleisen becomes Muheisen. This feature saved me from manually defining a map of umlaut characters and replacing them in a bunch of places. SELECT strip_accents(first_name) as first_name_normalized, ... FROM salesforce.contacts Neat! ...