Data Engineer for ETL Migration to BigQuery
Headquarters: Los Angeles
URL: https://accusales.webflow.io/
Project:
We are looking for a data engineer to migrate our existing ETL workflows to Google BigQuery. We want to optimize our data handling processes to increase efficiency and scalability for any data aggregation tasks. This role requires someone with a deep understanding and experience with big query, data pipeline optimization and testing.
We are in the process of evaluating what cloud database to go with. Currently, we're using postgres and TimescaleDB extension. We have a custom incremental materialized view-like system where we have a table with raw source data (flattened JSON object). We had prior queries written to create build tables that represent the final version of the aggregated data. Long story short, the issue is that the build takes a very long time and functions un-useable.
Deadline is set for 2 weeks.
We are looking for a data engineer to migrate our existing ETL workflows to Google BigQuery. We want to optimize our data handling processes to increase efficiency and scalability for any data aggregation tasks. This role requires someone with a deep understanding and experience with big query, data pipeline optimization and testing.
We are in the process of evaluating what cloud database to go with. Currently, we're using postgres and TimescaleDB extension. We have a custom incremental materialized view-like system where we have a table with raw source data (flattened JSON object). We had prior queries written to create build tables that represent the final version of the aggregated data. Long story short, the issue is that the build takes a very long time and functions un-useable.
Deadline is set for 2 weeks.
Hours: No Set Schedule (You Manage Your Time)
What We Need from You:
- A self-starter.
- Ability to work remotely with no minimal supervision
- Meticulous attention to detail and a passion for delivering high-quality work.
- Willingness to take short-term PAY for long-term gain.
- Ability to work in the PST timezone.
This role is a PROJECT-BASED position and has potential for a full-time position.
To apply: https://weworkremotely.com/remote-jobs/accusales-data-engineer-for-etl-migration-to-bigquery
GoLang Remotely
We are a part of the Go Remotely group, specialized in recruiting anywhere in the world.
Copyright © 2024 GoLang Remotely | Privacy policy