Typical Day in Role:
• Develop and maintain robust data pipelines for data ingestion and distribution of large datasets for processing and consuming.
• Utilize SaaS services and tools to build, configure and automate data workflows and streamline the data engineering process.
• Collaborate with stakeholders and product managers to analyze data requirements, and build ingestion patterns to bring in new data sources to the data platform.
• Build and monitor application services and pipeline performance.
• Conduct data quality checks
• Experience building data pipelines, and composable cloud-based data platforms in Google Cloud Provider (GCP).
• Experience configuring and using data ingestion tools such as Fivetran, and Qlik Replicate
• Have prior experience with data engineering, programming, ETL, ELT, processes for data integration and ingestion.
• Experience in data modelling, manipulating large data sets and handling raw data, and other cleaning techniques.
• Experience working with structured, semi-structured, and unstructured data.
• Experience collaborating and working with DevOps and Scrum Teams
• Demonstrated team player with strong communication skills and a track record of successful delivery of product development.
• Expert at problem solving.
• Strong scripting skills (SQL, Python)
• Strong knowledge of cloud infrastructure
Candidate Requirements/Must Have Skills:
1) 3-4 years of experience creating ELT / ETL data pipelines from scratch, working with structured, semi-structured, and unstructured data
2) 2-4 years of experience configuring and using data ingestion/ replication tools such as Qlik
3) 2-4 years of experience with Cloud: GCP
4) 2-4 years of experience with Airflow scheduling tool
5) 3+ years of experience working on continuous integrations and continuous deployment pipeline (CI/CD) and working with source control systems such as Github, Bitbucket, and Terraform
Nice-To-Have Skills:
1) Bilingual: English Spanish will be prioritized
2) Power BI experience
3) 3+ years of experience building Data Warehouse / Data Platforms
4) FI/banking experience
Soft Skills Required:
• Ability to work independently and as part of a team.
• Strong attention to detail and organizational skills.
• Strong analytical and problem-solving skills.
• Good communication skills
Education:
• Bachelor’s Degree in Computer Science, IT, or a related field: Advanced degrees or relevant certifications (e.g., Cloud Engineer) are a plus.