Mercertech dnai platform engineering team is seeking candidates for the following position based in the cdmx office and be onsite 3 days a week: sr. Data platform engineer
mercertech dnai platform engineering team is seeking an experienced mid-level data platform engineer with experience in data with aws cloud who has expertise in the administration, development, and implementation of large-scale data projects in the hybrid data platform (on-prem and cloud both).
what can you expect?
* you will be responsible for overseeing the design, implementation, and maintenance of the data platform built on kubernetes, aws services, and other saas solutions.
* you will be responsible for setting up the platform and its toolkit like databricks, snowflake, and idmc with the best possible standards for different projects to work on it.
* you will also collaborate with project business teams to understand their requirements, technical needs, and help the team design their architecture using a combination of data tools aligning with mmc’s technology standards and security.
* you will also be involved in onboarding new technologies onto the platform and ensuring smooth operations through regular maintenance, governance, and guideline definition.
* you should be an expert in etl processing toolsets to guide the developers to optimize their jobs.
what is in it for you?
* a company with a strong brand and strong results to match.
* culture of internal mobility, collaboration, and valued partnership from the business.
* employee resource groups which provide access to leaders, relevant volunteer and mentoring opportunities, and interactions with counterparts in industry groups and client organizations.
* entitled to vacation, floating holidays, time off to give back to your community, sick days, and national holidays (with early dismissal).
we will count on you to:
* work with our partners to understand business and technology problems or opportunities.
* conceptualize and implement the setup and management of the data platform built on kubernetes, aws services, and other cloud saas solutions like databricks, snowflake, idmc, mongo atlas across different regions.
* configure and optimize the tech stack including spark, nifi, python, r, databricks, idmc by informatica, snowflake, aws s3, glue, and athena for efficient performance and scalability to create the best-in-class data ingestion and processing data platform.
* understand the data landscape i.e., tooling, tech stack, source systems, etc., and work closely with development teams to improve data collection, quality, reporting, and analytics capabilities.
* provide guidance on selecting the appropriate tools in appropriate aws regions to meet project objectives and performance requirements.
* setup the skilled team who can support the projects to build efficient data pipelines.
* collaborate with analytics and business teams to suggest and improve the data platform that supports business intelligence tools, increasing data accessibility, and fostering data-driven decision-making across the organization.
* collaborate with different stakeholders like mmc infra, mmc security, and mmc architecture teams to achieve high availability and scalability over the data platform.
* continuous learning and implementation of the latest technologies.
* troubleshoot incidents, identify root causes, fix, and document problems, and implement preventive measures.
* setup processes, guidance, and documentation necessary to share the best practices guidelines for others to follow.
* work with the data governance team on technology obsolescence, component re-use, and platform modernization.
* crisis management and problem-solving.
* be innovative in your design thinking and use your expertise to influence the mmc technology roadmap.
* take your architectural designs through our onboarding processes to ensure they meet mmc’s standards and conventions.
* empower the development teams to deliver your architectural designs.
what you need to have:
* bachelor's or master's degree in computer science, engineering, or related field.
* extensive experience in data engineering roles with a focus on building and managing data platforms.
* exposure to big data / data lake frameworks like spark, spark streaming, python, r, nifi, aws s3, redshift, glue, athena, etc., and tools like databricks, idmc, snowflake, mongodb.
* understanding of bi tools like powerbi, qlik is an added advantage.
* excellent communication and collaboration skills with the ability to work effectively with cross-functional teams.
* ability to design and architect the solution when provided with the business requirement.
* an inquisitive mindset with a track record of seeking out and implementing new technologies and architectural patterns.
* self-motivated to excel in a remote position, collaborating effectively with a remote team.
* you are a self-starter; you can take initiative without waiting for direction.
* ability to take decisions during a crisis.
* the ability to work in a fast-paced environment with changing priorities and deadlines.
* you are used to working and communicating with both business and technical stakeholders at varying levels of seniority.
what makes you stand out?
* strong aws experience.
* experience in either one of databricks or snowflake.
* experience in informatica data quality and governance tools (idmc).
salary: $15,300.00 - $15,301.00
#j-18808-ljbffr