Senior Data Engineer - Mortgage Lender Company (ID: 2036)
Truelogic is a leading provider of nearshore staff augmentation services, located in New York. Our team of 500 tech talents is driving digital disruption from Latin America to the top projects in U.S. companies.Truelogic has been helping companies of all sizes to achieve their digital transformation goals.
Would you like to make innovation happen? Have you ever dreamed of building Products that impact millions of users? Nice! Then we have a seat for you on our team!
What are you going to do?
You will have the opportunity to work in a forward-thinking and growth-oriented environment, at a top American mortgage lender with over 4 million lifetime customers where you will:
- Design, develop and maintain data pipelines and ETL processes using Snowflake.
- Build data pipelines to ingest data from various sources such as databases, APIs, or streaming platforms. Integrating and transforming data to ensure its compatibility with the target data model or format.
- Design and optimize data storage architectures, including data lakes, data warehouses, or distributed file systems. Implementing techniques like partitioning, compression, or indexing to optimize data storage and retrieval.
- Identify and resolve bottlenecks, tuning queries, and implement strategies to enhance data retrieval speed and overall system efficiency.
- Design and implement data models that support efficient data storage, retrieval, and analysis.
- Collaborate with data scientists and analysts to understand their requirements and provide them with well-structured and optimized data for analysis and modeling purposes.
- Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to understand their requirements and provide technical solutions.
- Communicate complex technical concepts to non-technical stakeholders in a clear and concise manner.
- Work under Agile and Scrum development methodologies.
What will help you succeed
-
The candidate should have a deep understanding of Snowflake data warehousing platform and be proficient in using Snowpark for data processing and analytics
-
AWS services Lambda Proficiency in AWS Lambda for serverless computing and event driven architecture is essential for this role.
-
Strong programming skills in Python are required for developing data pipelines, data transformations and automation tasks.
-
DBT Experience with DBT Data Build Tool for modeling data and creating data transformation pipelines is a plus
-
Bachelor's degree in Computer Science Engineering or related field.
-
Proven experience in data engineering roles with a focus on Snowflake AWS services.
-
Very good level of communication, the ability to clearly and specifically convey information
-
Experience working in the Agile (Scrum) methodology, Jira is a plus.
-
Experience or familiarity with other cloud technologies, knowledge of PowerBI, data warehouses, data governance, and business analysis is a plus.