Google Big Query (BQ) Results to GCS Storage Bucket Folder
Export data from BQ to a GCS(Google Cloud Storage) bucket. The below example will export a CSV file output to the bucket location in the &qu...
Friday, 12 January 2024
Friday, 25 November 2022
Trino - On Demand Clusters for ADHOC Large ETL Jobs on GCP Google Cloud Platform using Python Flask
Creating a Basic Trino Service to Start On Demand Clusters for ADHOC Large ETL Jobs on GCP Google Cloud Platform using Python Flask. ...
Monday, 25 October 2021
Trino Graceful Shutdown on GCP Using Instance Groups
I was setting up a Trino cluster for one of my clients on GCP and shutting down nodes causes query errors. I have been using Trino previ...
Thursday, 1 April 2021
GCP Dataproc HDFS Error on Creation of Cluster
Google Dataproc HDFS Error when spinning up a cluster Error You will Encounter On creation of Google Dataproc Cluster - You will get the fol...
Saturday, 6 February 2021
Oracle to GCP Google Cloud Data Migration
Oracle to Google Cloud Platform Data Migration We have had many clients approach us for different reasons of moving from Oracle on premise ...
Tuesday, 9 June 2020
Hive - Setting Up Hive Admin User - GCP Dataproc
HIVE ADMIN User setup - GCP etc 👀 We had issues assigning the hive admin user role to our admin users. We googled everything and the only ...
Friday, 27 March 2020
Jenkins vs Spinnaker Continuous Deployment
Jenkins vs Spinnaker: What are the differences? Continuous delivery (CD) platforms help DevOps teams manage software releases in shor...
Friday, 13 March 2020
HDFS Namenode ,FsImage,Editlogs Backup And Restore
HDFS Namenode ,FsImage,Editlogs Backup And Restore How to perform HDFS metadata backup: Backing up HDFS primarily involves cr...
Monday, 9 March 2020
Table or partition location information from Apache Hive
How to list table or partition location from Hive Metastore Goal: This article provides the SQL to list table or partition loca...
