* you will be responsible for overseeing the design, implementation, and maintenance of the data platform built on kubernetes, aws services and other saas solutions.
* you will be responsible to setup the platform and its toolkit like databricks, snowflake, idmc with best possible standards for different projects to work on it.
* you will also collaborate with projects’ business teams to understand their requirements, technical needs and help the team design their architecture using the combination of data tools aligning with mmc’s technology standards and security.
* you will also be involved in onboarding new technologies onto the platform and ensuring smooth operations through regular maintenance, governance, and guideline definition.
* you should be an expert in etl processing toolsets to have the capability to guide the developers to optimize their jobs.
what is in it for you?
* a company with a strong brand and strong results to match.
* culture of internal mobility, collaboration and valued partnership from the business.
* employee resource groups which provide access to leaders, relevant volunteer and mentoring opportunities and interactions with counterparts in industry groups and client organizations.
* entitled to vacation, floating holidays, time off to give back to your community, sick days, and national holidays (with early dismissal).
we will count on you to:
* work with our partners to understand business and technology problems or opportunities.
* conceptualize and implement the setup and management of the data platform built on kubernetes, aws services and other cloud saas solutions like databricks, snowflake, idmc, mongo atlas across different regions.
* configure and optimize the tech stack including spark, nifi, python, r, databricks, idmc by informatica, snowflake aws s3, glue, and athena for efficient performance and scalability to create the best-in-class data ingestion and processing data platform.
* understand data landscape i.e., tooling, tech stack, source systems etc. and work closely with development teams to improve data collection, quality, reporting and analytics capabilities.
* provide guidance on selecting the appropriate tools in appropriate aws regions to meet project objectives and performance requirements.
* setup the skilled team who can support the projects to build efficient data pipelines.
* collaborate with analytics and business teams to suggest and improve data platform that supports business intelligence tools, increasing data accessibility, and fostering data-driven decision-making across the organization.
* collaborate with different stakeholders like mmc infra, mmc security, mmc architecture teams to achieve high availability and scalability over the data platform.
* continuous learning and implementation of latest technologies.
* troubleshoot incidents, identify root causes, fix, and document problems, and implement preventive measures.
* setup process, guidance, and documentation necessary to share the best practices guidelines for others to follow.
* work with data governance team on technology obsolescence, component re-use and platform modernization.
* crisis management and problem-solving.
* be innovative in your design thinking and use your expertise to influence the mmc technology roadmap.
* take your architectural designs through our onboarding processes to ensure they meet mmc’s standards and conventions.
* empower the development teams to deliver your architectural designs.
what you need to have:
* bachelor's or master's degree in computer science, engineering, or related field.
* extensive experience in data engineering roles with a focus on building and managing data platforms.
* exposure to big data / data lake frameworks like spark, spark streaming, python, r, nifi, aws s3, redshift, glue, athena etc. and tools like databricks, idmc, snowflake, mongodb.
* understanding of bi tools like powerbi, qlik is an added advantage.
* excellent communication and collaboration skills with the ability to work effectively with cross-functional teams.
* ability to design and architect the solution when provided with the business requirement.
* an inquisitive mindset with a track record of seeking out and implementing new technologies and architectural patterns.
* self-motivated to excel in a remote position, collaborating effectively with a remote team.
* you are a self-starter; you can take initiative without waiting for direction.
* ability to take decisions during crises.
* the ability to work in a fast-paced environment with changing priorities and deadlines.
* you are used to working and communicating with both business and technical stakeholders at varying levels of seniority.
what makes you stand out?
* strong aws experience.
* experience in either one of databricks or snowflake.
* experience in informatica data quality and governance tools (idmc).
if you are interested, please send your cv in english.
#j-18808-ljbffr