The Opportunity:

Our Data Engineering team, within our Data Services Organization, builds and maintains the infrastructure essential to delivering high-volume, business critical data to the organization to enable data-driven decisions.

We are focused on expanding our curated and modeled data that unify sources of truth across our multiple products and domains. You’ll have the opportunity to learn new tools and contribute to how we interface with data with modern distributed data tools like Snowflake, Spark, Kafka, and dbt (Data build tool).

This is an ideal opportunity for someone that wants to contribute to our growing data platform and warehouse by writing and implementing production data pipelines. You will roll up your sleeves with lots of data and make a large impact with delivering datasets and tools to stakeholders.

Who you are:

● A minimum of 3+ Years of IT Experience with Education/Degree in computer science, engineering, data science or similar fields

● Experience in SQL development on RDBMS (Snowflake and Postgres preferred)

● Familiarity with Database design and data warehouse concepts

● Experience with streaming & real-time data processing using a technology like Spark, Kafka, ksqlDB, or Databricks, etc.

● Experience with dimensional data modeling/data workflow diagrams (conceptual, logical, and physical)

● Knowledge of software development lifecycle and source control (github, gitlab, TeamCity, etc.)

● Solid understanding of ELT (Extract, Load, Transform) pipeline development and orchestration (dbt, airflow, python, Fivetran, Stitch, etc.) and how to deploy them

● Some knowledge of cloud services such as AWS DynamoDB, Glue, Lambda, Step Functions, S3, CloudFormation or similar Azure/ GCP services

What you’ll own:

● Contribute to Data Warehouse models and curation

● Support the evolution of data environment to deliver high-quality data, speed, and availability

● Assist in the curation of source-system data to deliver trusted data sets

● Provide input and involvement on data cataloging and data management efforts

● Be involved in production ELT (Extract, Load, Transform)performance tuning and environment-level resource consumption and management

● Drive the migration of POC pipelines to production data processes

Experience you’ll need:

● Strong programming skills in Python, Scala or SQL (Python or Scala is added advantage)

● Experience in any Data streaming Tool like Spark, Data bricks tool is preferred.

● Capability to manipulate, understand, and analyze complex, high-volume data

● Understanding of how and why data pipelines are built

● Design , Build, Test and Maintain efficient and reliable data pipelines. See Less