.we are seeking a highly skilled and motivated *senior cloud data engineer* with a strong backend development focus and experience in cloud platforms (aws/gcp).as a member of our team, you will be responsible for the design, implementation, and maintenance of our data-centric, cloud-hosted backend infrastructure and services.
you will play a critical role in building and scaling our data processing pipelines and apis, ensuring high availability, security, and performance.responsibilities- build and optimize data pipelines using elt frameworks such as fivetran, dbt, airflow, and pyspark, ensuring efficient data movement and transformation.
experience with schema design and data modeling is essential- design, develop, and maintain high-throughput, low-latency backend services for data ingestion, processing, and transformation using languages such as python and java- develop and maintain robust, scalable, and secure restful apis using frameworks such as spring boot (java) or flask/fastapi (python).
experience with api gateway services (e.g., apigee, kong) a plus- advise/design odata apis- implement and manage security protocols such as oauth, sso, and ssl- design and implement event-driven architectures leveraging technologies like kafka or pub/sub- develop and implement ci/cd pipelines using tools like jenkins, gitlab ci, or similar, to automate the deployment and scaling of backend services- write and maintain infrastructure-as-code (iac) using tools such as pulumi, terraform or cloudformation- collaborate with architects and security teams to ensure that the cloud infrastructure and services are secure and compliant with industry standards (e.g., soc 2, hipaa, gdpr)- troubleshoot and resolve service-related issues, providing timely and efficient solutions- stay up to date with the latest developments in cloud technology, backend development best practices, and security vulnerabilities- mentor and provide guidance to other team members as needed*requirements*:- bachelor's degree in computer science, computer engineering, or a related field- at least 5 years of experience in backend development in a cloud environment (aws or gcp preferred)- at least 3 years of experience in data engineering in a cloud environment- strong proficiency in python and java; sql proficiency is required- extensive experience with restful api design, implementation, and testing using relevant frameworks.
experience with openapi/swagger specifications a plus- experience with event-driven architectures and message queues (e.g