Google Big Query (BQ) Results to GCS Storage Bucket Folder

Google Big Query (BQ) Results to GCS Storage Bucket Folder

Export data from BQ to a GCS(Google Cloud Storage) bucket. The below example will export a CSV file output to the bucket location in the ...

Trino - On Demand Clusters for ADHOC Large ETL Jobs on GCP Google Cloud Platform using Python Flask

Trino - On Demand Clusters for ADHOC Large ETL Jobs on GCP Google Cloud Platform using Python Flask

  Creating a Basic Trino Service to Start On Demand Clusters for ADHOC Large ETL Jobs on GCP Google Cloud Platform using Python Flask.   ...

Trino Graceful Shutdown on GCP Using Instance Groups

Trino Graceful Shutdown on GCP Using Instance Groups

  I was setting up a Trino cluster for one of my clients on GCP and shutting down nodes causes query errors. I have been using Trino previ...

GCP Dataproc HDFS Error on Creation of Cluster

GCP Dataproc HDFS Error on Creation of Cluster

Google Dataproc HDFS Error when spinning up a cluster Error You will Encounter On creation of Google Dataproc Cluster - You will get the fol...

Oracle to GCP Google Cloud Data Migration

Oracle to GCP Google Cloud Data Migration

 Oracle to Google Cloud Platform Data Migration We have had many clients approach us for different reasons of moving from Oracle on premise ...

GCP Google BigQuery Cost Reporting - Control your costs

GCP Google BigQuery Cost Reporting - Control your costs

Setting up the BigQuery audit logs export within GCS Monitor Your BigQuery Costs in GCP Google Cloud Platform Instructions G...

GCS HADOOP/Hive to Google Big Query Migrate Data Quickly ORC Format

GCS HADOOP/Hive to Google Big Query Migrate Data Quickly ORC Format

GCS Dataproc Hadoop(Hive) to GCS Big Query (BQ) Quick Transfer ORC File Formats Software Used Google Dataproc - Google...

Yarn - Long Running Jobs Alerts for Hive TEZ , Application Containers

Yarn - Long Running Jobs Alerts for Hive TEZ , Application Containers

Hadoop / Hive / Yarn / Applications Long running Jobs alert script Currently at a client where their are some long running jobs...

Hive HPLSQL setup on Google DataProc

Hive HPLSQL setup on Google DataProc

Hive HPLSQL setup on Google DataProc Google Dataproc Hadoop and Hive Hive Version : 2.3.2 (Version Supports Tez Engine) ...

Big Data Processing with Hadoop and Hive on top of the Google DataProc Service

Big Data Processing with Hadoop and Hive on top of the Google DataProc Service

Big Data Processing with Hadoop and Hive on top of the Google DataProc Service Offering Business Scenario One of our cl...