Quick Summary
This Senior Data Engineer role focuses on building and optimizing ingestion/ETL/ELT pipelines to centralize data from various business scopes and modeling the Data Lake for efficient performance. Requires advanced proficiency in relational databases (MySQL, PostgreSQL) for tuning and modeling, experience with distributed processing (Spark), messaging systems (Kafka/RabbitMQ), and Cloud technologies (AWS, GCP, or Azure). Experience in E-commerce or FinTech and knowledge of Infrastructure as Code (Terraform/CloudFormation) are preferred.
Senior Data Engineer (Remote)
Required Skills & Experience
- Advanced proficiency in relational databases, specifically MySQL and PostgreSQL (tuning, modeling, and extraction).
- Knowledge of messaging systems and distributed queues, such as Kafka and RabbitMQ, for large-scale event processing.
- Experience with distributed processing (e.g., Spark) and both relational and non-relational databases.
- Proficiency in programming languages (PHP desirable).
- Experience with Cloud technologies (AWS, GCP, or Azure).
Preferred Qualifications
- Experience as a Data Engineer in E-commerce or FinTech environments.
- Knowledge of Infrastructure as Code (Terraform or CloudFormation).
- Cloud or Data Engineering certifications.
Key Responsibilities
- Build ingestion and ETL/ELT processes to centralize data from various scopes and applications (Store, Purchase Flow, Backoffice, and Integrations).
- Model and structure the Data Lake, ensuring that information from different services connects logically and performs efficiently.
- Collaborate with product teams to map events and ensure data integrity at the source.