*data ops lead engineer*:
*what you'll do*:
you will be one of the senior technical engineers in the data engineering service team serving our global partners, data engineers, business analysts, data scientists and mlops engineers building innovative analytical solutions for astrazeneca.
we are looking for a hardworking individual who can effectively partner with enterprise architects and key stakeholders to develop a clear vision for the service line, build and maintain roadmaps, and provide data engineering services.
*roles & responsibilities*:
- provide databricks platform engineering design, build and support in a multi-tenant environment.
- workspace creation and maintenance.
- workspace feature rollout, enablement, and governance.
- build and maintain sso, and role-based access configurations.
- support iam policies, ec2 instances profiles, and data lake backup and restore.
- collaborate with ets teams to configure and maintain cloudtrail, databricks vpc subnet, direct connect and network acl aspects.
- configure and setup streaming and delta sharing.
- spin up serverless sql warehouses and ensure their efficient configuration to support high efficiency and peak performance use cases.
- platform access provisioning and improve user experience through self-service and automation.
- compute and workflow provisioning, resource efficiency and performance monitoring.
- databricks platform upgrades and maintain platform logging configurations.
- tackle platform issues, raise support cases, prioritize, and call out databricks issues.
- maintain audit logs, build platform usage and governance dashboards.
- maintain customer led encryption keys, participate in platform security audits, and support security issue investigations.
- acting as a platform sme, provide support for power bi and knowledge graph connector integrations.
- secure platform through appropriate use of customer led keys, data encryption mechanisms and governance controls.
*required skills and education*:
- experience providing support for large scale enterprise etl or analytical platforms.
- working experience in data lakes and spark based etl solutions.
- working experience in aws cloud.
- iam policies, creating and governing s3 buckets, cloudtrail, glue and instance profiles.
- business stakeholder engagement and experience rendering platform support to wide variety of stakeholders.
- working knowledge of python and deep understanding of package dependency management is essential.
- strong experience in sql including dml and ddl is required.
- experience working with hive, glue or unity catalog is required.
- familiarity with active directory driven user's access management to platform and data.
- familiarity with databricks, aws emr or hadoop is required.
- solid knowledge in data partitioning, schema evolution and i/o optimization.
- experience building docker containers and deploying.
*desired skills*:
- experience in supporting databricks platform is a huge plus.
- solid understanding of r programming is helpful.
- familiarity with sagemaker and mlflow.
- linux shell scripts and experience working with apis.
- experience working with ci/cd and github/bitbucket.
- experience working with redshift or snowflake solutions is a plus.
- data governance tools like collibra is a plus.
- experience working within a scaled agile framework is a huge plus.
- familiarity with servicenow.
- cloud infrastructure cost and budget management.
- familiarity with data virtualization and query federation.
why astrazeneca?
at astrazeneca when we see an opportunity for change, we seize it and make it happen, because any opportunity no matter how small, can be the start of something big.
delivering life-changing medicines is about being entrepreneurial - finding those moments and recognizing their potential.
join us on our journey of building a new kind of organization to reset expectations of what a bio-pharmaceutical company can be.
this means we're opening new ways to work, pioneering innovative methods and bringing unexpected teams together.
interested?
come and join our journey.
*so, what's next!
*
are you already imagining yourself joining our team?
good, because we can't wait to hear from you.
are you ready to bring new ideas and fresh thinking to the table?
brilliant!
we have one seat available, and we hope it's yours.
*where can i find out more?
*
follow astrazeneca on facebook