Lead Software Engineer, Data Engineering

We are searching for a skilled Lead Software Engineer specializing in Data Engineering. This leadership role involves creating scalable systems and robust data pipelines to manage and process complex datasets, supporting insightful analysis and innovative data-driven applications.

Responsibilities

• Design backend services and data pipelines to handle and process large-scale datasets from diverse sources.
• Collaborate with Product Managers and Engineers to create ML/AI-driven systems for actionable insights and workflow automation.
• Build APIs and internal tools to facilitate analytics, reporting, and real-time data visualizations.
• Define data models, governance policies, and standards to maintain data integrity and accessibility across teams.
• Optimize pipelines using techniques like indexing, caching, and asynchronous processing.
• Shape architectural decisions on event-driven systems, distributed workflows, and scalable job orchestration.
• Enhance CI/CD workflows, monitoring, and automation to ensure reliable and available data infrastructure.
• Contribute to discussions, code reviews, and retrospectives to encourage innovation and improvement.

Required Skills & Experience

• 5+ years of experience in backend development using Python, Golang, or PHP.
• 5+ years of experience building and designing backend platforms and services.
• 3+ years of experience with data engineering tools such as Airflow, dbt, Spark, or Kafka.
• Knowledge of relational databases like MySQL, including data modeling, schema design, and performance tuning.
• Background in deploying ML/AI-based solutions for extensive data operations.
• Expertise in handling distributed systems and utilizing message queues or stream frameworks.
• Competency in developing APIs or services for advanced analytics and reporting.
• Proficiency in tools like Redis or Memcached and in technologies such as Docker for containerization.
• Familiarity with Linux environments and best practices in DevOps.
• Understanding of observability platforms like New Relic or Datadog.

We Offer

• Career plan and real growth opportunities.
• Unlimited access to LinkedIn learning solutions.
• Constant training, mentoring, online corporate courses, and eLearning.
• English classes with a certified teacher.
• Support for employee’s initiatives (Algorithms club, toastmasters, agile club, and more).
• Enjoyable working environment (Gaming room, napping area, amenities, events, sport teams, and more).
• Flexible work schedule and dress code.
• Collaborate in a multicultural environment and share best practices from around the globe.
• Hired directly by EPAM & 100% under payroll.
• Law benefits (IMSS, INFONAVIT, 25% vacation bonus).
• Major medical expenses insurance: Life, Major medical expenses with dental & visual coverage (for the employee and direct family members).
• 13 % employee savings fund, capped to the law limit.
• Grocery coupons.
• 30 days December bonus.
• Employee Stock Purchase Plan.
• 12 vacations days.
• Official Mexican holidays, plus 5 extra holidays (Maundry Thursday and Friday, November 2nd, December 24th & 31st).
• Monthly non-taxable amount for the electricity and internet bills.

About EPAM

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

By applying to our role, you are agreeing that your personal data may be used as in set out in EPAM´s Privacy Notice and Policy.