Job Description:We are seeking an experienced Data Engineer with a strong background in AWS (EMR & Athena), Python, PySpark and Apache Airflow to join our technology team. The ideal candidate will be responsible for developing, optimizing, and maintaining our Snowflake data warehouse environment to support financial data analysis and reporting needs. The role requires a deep knowledge of Snowflakes unique capabilities, as well as proficiency in advanced SQL techniques and a comprehensive understanding of financial data.Responsibilities: Design, build, and maintain scalable and efficient Snowflake data warehouse solutions tailored for financial industry applications.Develop complex SQL queries, stored procedures, and scripts for data manipulation and retrieval.Optimize Snowflake performance through effective data modeling, partitioning, and indexing strategies.Collaborate with financial analysts and business stakeholders to understand data requirements and deliver precise reporting and analytical solutions.Ensure data integrity and security within the Snowflake environment, complying with industry regulations and standards.Manage data migration projects from legacy systems to Snowflake, ensuring minimal disruption to business operations.Provide technical expertise and support for Snowflake to internal teams, including troubleshooting and resolving issues.Stay up to date with Snowflake features and updates, continuously improving and expanding our data warehouse capabilities.Requirements: Proven 8+ years of experience in AWS (EMR & Athena), Python, PySpark and Apache AirflowStrong expertise in Strong SQL and SQL query optimization skillsStrong knowledge of data warehousing concepts and best practices.Familiarity with Snowflakes architecture, features, and best practices.Experience with data modeling, ETL development, and data integration techniques.Experience with Azure Data Factory (ADF) and other Azure services.Knowledge of financial industry standards, regulatory requirements, and data security protocols.Proficiency in Python for data processing and automation.Preferred Qualifications:Experience with financial reporting, risk management, or investment analytics.Familiarity with other data integration tools and BI platforms.Relevant certifications.
Job Title
Data Engineer