logo

Data Engineer (Terraform/AWS/Pyspark)

Project Description

Created to help higher education institutions take on the issues that matter most. Whether it’s sexual assault and harassment, alcohol and substance misuse, wellness and mental health, or diversity and inclusion. Here advance their safety, well-being, and inclusion initiatives and elevate their impact on student and institutional success.

Responsibilities

  • Building Data pipeline, data modeling and familiatiry with data architecture
  • ML related programming
  • BI reporting and dashboards
  • Mapping from existing platforms to canonical models and piping the models to Datawarehouse

Requirements

  • Have AWS Glue Pyspark development experience. Just having Python isn't sufficient
  • Should have AWS pipeline/warehouse experience
  • Should have experience in python programming
  • Should be aware of data processing architecture like Lambda
  • Amazon S3 and Terraform
  • SQL expertise with PostgreSQL, MySQL

 

Have some questions about this position?

We are happy to support you and respond any questions you have.

Talk to the recruiter