Job Role: DataOps Engineer Role Overview The DataOps Engineer will be pivotal in developing, deploying, and maintaining our enterprise data platform. You will work closely with data scientists, engineers, and analysts to ensure data availability, quality, and security. Your expertise will help streamline data processes, enhance data observability, and support scalable data solutions in the cloud. This role requires a blend of technical skills, strategic thinking, and collaborative mindset to drive continuous improvement in our data engineering processes. This is What You Will do in This Role: • Design creative solutions to expand or improve the platform's capabilities with a focus on security, data privacy, maintainability, and scalability. • Continuously improve team processes, infrastructure, and codebase. • Encourage team growth through questioning, challenging ideas, and proposing alternatives. • Administer the platform and support users with access, deployments, and research. • Identify opportunities for automation and improvements. • Ensure SLAs are met by monitoring alerts and responding to issues. • Partner with other engineers or dependent teams to resolve issues. • Participate in oncall rotations with teammates to address problems. What We are Looking For: Tasks and Qualifications • A minimum of 8+ years of Data Operations experience. • Strong experience with GCP services (BigQuery, Dataflow, PubSub, CloudComposer, Dataform, CloudRun, GCS, Alerts and Monitoring services). • Strong experience with Terraform. • Experience with Cloud Resources administration and Python programming. • Experience with Docker, Docker Compose, Kunernetes • Experience with CI/CD tools like GitLab, GitHub Actions. • Experience with observability tooling such as Grafana, Datadog. • Experience with Release Management, managing data and build pipelines. • Excellent organization and communication skills due to the high incident response nature of the role.
Job Title
Edstem Technologies | DataOps Engineer