Position Overview:We are looking for an experienced Azure Architect specializing in data solutions to lead the design and implementation of robust, scalable, and efficient cloud-based architectures. The ideal candidate will have extensive experience working with Azure Data Factory (ADF), Databricks (Python Notebooks), and Python, along with a deep understanding of Azure microservices and data components. This role focuses exclusively on data management, transformation, and analytics.Key Responsibilities:Architecting Azure-Based Data Solutions:Design and implement Azure cloud architectures for data integration, processing, and analytics.Develop scalable, secure, and cost-efficient pipelines using Azure Data Factory and Databricks.Ensure seamless data flow and transformation across data lakes, warehouses, and analytics platforms.Microservices Development:Build and manage Azure Microservices, including Functions, Service Bus, Event Grids, and Event Hubs.Implement API Management (APIM) for secure and efficient data access and communication.Collaborate with development teams to integrate microservices into larger data ecosystems.Advanced Python Usage:Develop and optimize Python-based solutions for data engineering and analytics within Databricks Notebooks.Write clean, efficient, and modular Python code for ETL, data transformation, and integration tasks.Leverage Python libraries for advanced data manipulation, machine learning, and visualization.Azure Data Components Management:Oversee the configuration and optimization of Azure data services such as Azure Data Lake, Synapse Analytics, and Azure Storage.Monitor and enhance the performance of data workflows and pipelines.Troubleshoot and resolve issues related to data ingestion, processing, and storage.Collaboration and Stakeholder Management:Work closely with business and technical teams to understand data requirements and translate them into technical solutions.Provide guidance and mentorship to development teams on Azure best practices.Ensure alignment of solutions with business goals and compliance with data governance policies.Documentation and Innovation:Prepare comprehensive documentation for architecture, design, and implementation processes.Stay updated on the latest Azure features and emerging trends in cloud data solutions.Propose innovative approaches to enhance system performance and data utilization.Required Qualifications:Experience:10+ years in data engineering/architecture with at least 3 years of hands-on Azure experience.Proven expertise in Azure Data Factory, Databricks, and Python.Technical Skills:Strong knowledge of Azure microservices: Functions, Service Bus, Event Grids, Event Hubs, and APIM.Deep understanding of Azure data components: Data Lake, Synapse Analytics, and related services.Proficiency in Python for data manipulation, analytics, and building reusable modules.Familiarity with CI/CD pipelines and Azure DevOps for deployment.Soft Skills:Excellent problem-solving and analytical abilities.Strong communication and collaboration skills with diverse stakeholders.Ability to work in a fast-paced, agile environment.Preferred Qualifications:Certifications: Microsoft Certified: Azure Solutions Architect Expert or Microsoft Certified: Azure Data Engineer Associate.Experience in big data processing and analytics tools like Spark.Knowledge of data governance, security, and compliance in Azure.
Job Title
Marx Enterprise Transformation Architecture | Cloud Architect