Job Title

Job Title: Senior Data EngineerLocation: Bangalore/NCR/Hyderabad/ChennaiAbout Straive : Straive is a trusted leader in building and operationalizing enterprise data and AI solutions for top global brands and corporations. Our key differentiators include extensive domain expertise across multiple industry verticals, coupled with cutting-edge data analytics and AI capabilities that have consistently driven measurable ROI for our clients. With a global footprint spanning 30+ countries, Straive serves hundreds of clients, supported by a team of 18,000+ seasoned professionals in data, analytics, AI, and operations. Our offices are strategically located across India, the Philippines, the USA, Nicaragua, Vietnam, the UK, Canada, and Singapore, where our headquarters are based.Website: Linkedin Role Overview:We are seeking a highly skilled and experienced Azure Data Engineer with a minimum of 10+ years of hands-on experience in building, managing, and optimizing large-scale data solutions. In this role, you will design, implement, and maintain data architectures on Microsoft Azure, ensuring seamless data pipelines and analytics capabilities. As a lead of our data engineering team, you will collaborate closely with data scientists, analysts, and other engineering teams to drive impactful business insights and innovation along with leading a team of junior data engineers & guiding them to achieve the project deliverablesKey Responsibilities:● Design, develop, and maintain robust, scalable, and efficient data pipelines and ETL processes on Azure.● Implement and manage data warehousing solutions (Azure Synapse Analytics, Azure SQL Data Warehouse).● Collaborate with data scientists and business teams to define data requirements and develop strategies to collect, process, and analyse large datasets.● Leverage industry best practices to optimize platform workloads and identify opportunities for automating workloads.● Collaborate with Data Architects to design and build optimal data models for analytics team● Collaborate with Data Management leadership for quarterly planning● Leverage Azure services like Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure SQL Database to automate and optimize data workflows.● Build and deploy solutions that ensure high performance, reliability, and security of data solutions.● Monitor and troubleshoot data pipelines and workflows for performance bottlenecks and resolve issues in a timely manner.● Develop and enforce data governance best practices to ensure quality, integrity, and compliance of data.● Perform data integration tasks across multiple sources and formats (structured, semi-structured, and unstructured data).● Work in an Agile environment, collaborating with cross-functional teams to meet project deadlines and milestones.● Stay on the leading edge of data engineering practices and remain well aware of new technologies, available vendor packages and proactively take on initiative to optimize legacy data services/applications● Provide mentorship to junior team members and guide them to follow the best practices in data engineering as well as making sure of compliance adherence● Manage the KPIs for data engineers & senior data engineers in the team ensuring on time completion of project/client deliverablesRequired Skills and Qualifications:● 10+ years of experience in data engineering, with at least 5+ years of experience working with Azure-based solutions in delivering mid to high scale projects● Strong hands-on expertise in Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure SQL Database, and Azure Databricks.● Proven experience in designing and implementing end-to-end data pipelines, including ingestion, transformation, and storage in the cloud.● In-depth knowledge of SQL, data warehousing, and ETL processes.● Experience with data security, data privacy, and governance standards within the Azure cloud platform.● Proficiency in programming languages like Python & Pyspark● Good understanding of Azure DevOps, version control, and CI/CD pipelines for automation.● Experience with big data technologies such as Hadoop, Spark, and their integration into Azure-based environments.● Proven experience implementing large scale data platforms using Databricks lakehouse and medallion architecture● Experience working with Delta, Parquet, Avero, and ORC file formats● Experience implementing near real-time streaming analytics using Azure Event Hubs / Kafka, Spark Structured Streaming and PowerBI● Ability to work with diverse data types and sources, including relational, NoSQL, and flat-file data systems.● Knowledge of cloud architecture principles and best practices for scalability and high availability in Azure.● Excellent communication skills and the ability to collaborate effectively with internal teams and stakeholders.● Experience working in a consulting set-up● Understanding of data models and data pipelines required for Tableau and PowerBI implementations Preferred Skills:● Experience with machine learning models and deployment in Azure (Azure Machine Learning).● Knowledge of Power BI for data visualization and reporting.● Understanding of containerization and orchestration technologies like Docker and Kubernetes.● Certifications in Azure Data Engineering (Azure DP-203) or relevant Azure certifications.Educational Qualifications: Bachelor's or Master’s degree in Computer Science, Information Technology, Data Science, or a related field.