Translate

Friday 12 January 2024

Shahed

Google Big Query (BQ) Results to GCS Storage Bucket Folder

Export data from BQ to a GCS(Google Cloud Storage) bucket. The below example will export a CSV file output to the bucket location in the &qu...

Friday 25 November 2022

Shahed

Trino - On Demand Clusters for ADHOC Large ETL Jobs on GCP Google Cloud Platform using Python Flask

  Creating a Basic Trino Service to Start On Demand Clusters for ADHOC Large ETL Jobs on GCP Google Cloud Platform using Python Flask.   ...

Monday 25 October 2021

Shahed

Trino Graceful Shutdown on GCP Using Instance Groups

  I was setting up a Trino cluster for one of my clients on GCP and shutting down nodes causes query errors. I have been using Trino previ...

Thursday 1 April 2021

Shahed

GCP Dataproc HDFS Error on Creation of Cluster

Google Dataproc HDFS Error when spinning up a cluster Error You will Encounter On creation of Google Dataproc Cluster - You will get the fol...

Saturday 6 February 2021

Shahed

Oracle to GCP Google Cloud Data Migration

 Oracle to Google Cloud Platform Data Migration We have had many clients approach us for different reasons of moving from Oracle on premise ...

Tuesday 9 June 2020

Shahed

Hive - Setting Up Hive Admin User - GCP Dataproc

HIVE ADMIN User setup - GCP etc 👀 We had issues assigning the hive admin user role to our admin users. We googled everything and the only ...

Friday 27 March 2020

Shahed

Jenkins vs Spinnaker Continuous Deployment

Jenkins vs Spinnaker: What are the differences? Continuous delivery (CD) platforms help DevOps teams manage software releases in shor...

Friday 13 March 2020

Shahed

HDFS Namenode ,FsImage,Editlogs Backup And Restore

HDFS Namenode ,FsImage,Editlogs Backup And Restore How to perform HDFS metadata backup: Backing up HDFS primarily involves cr...

Monday 9 March 2020

Shahed

Table or partition location information from Apache Hive

How to list table or partition location from Hive Metastore Goal: This article provides the SQL to list table or partition loca...


About Authors

Shahed Munir

Krishna Udathu

Shahed and Krishna are Oracle / Big Data Experts