Summary:Responsible for providing high-level consulting services to clients and preparing programming assignments. Designs, plans and supervises implementation of complex, large-scale system projects. Reviews, analyses, and modifies programming systems including encoding, testing, debugging and installing for a complex, large-scale computer system. Assists in supervising the daily activities of the project team members.EducationBachelor’s DegreeEssential Duties and Responsibilities:Very strong on SQL. Must have 8+ years of experience working with SQL on large scale datasets.Must have at least 5+ years of experience in cloud-based Data Engineering with design, implementation and operationalization of large-scale data and analytics solutions on AWS.Must have at least 4+ years of experience in Snowflake architecture, design, implementation, and operationalization of large-scale data and analytics solutions on Snowflake Cloud Data Warehouse.Must have 1+ years of experience in deploying IAC code via Terraform.Must have proficiency with programming languages like Python.At least 4 years of production grade coding experience. Experience with PySpark/Hadoop and/or AWS Glue ETL and/or Databricks w/ python is preferred.Must have experience on ETL development life cycle, best practices of ETL pipelines, thorough work experience on data warehouses using a combination of Python, Snowflake, and AWS services.Data engineering experience with AWS Services (S3, Lambda, Glue, Lake Formation, EMR), Kafka, Streaming, and Databricks is highly preferred.Experience in Astronomer and/or Airflow is preferred.Certification on AWS Associates and Snowflake Pro is preferred.Understanding data pipelines and modern ways of automating data pipeline using cloud-based testing and clearly documenting implementations so others can easily understand the requirements, implementation, and test conditions.General Responsibilities:Provides high-level consulting services to client personnel (e.g., advises client on complex issues involving new regulation, technology or system functionality; evaluates various technical and business solutions and makes recommendations to client; troubleshoots errors and inefficiencies related to the application(s) and related processes; advises client on technical direction and specific business issues).Maintains project estimates and project management timelines for multiple major projects.Verifies completeness and accuracy of specifications for multiple major projects to be estimated (e.g., report changes, control file changes, file fixes).Determines programming requirements for multiple major projects (e.g., product updates, conversions).Researches and designs system modules, program enhancements and modifications to existing programs or modules.Creates documents to communicate complex technical information to audiences of all levels.Conducts research and documents findings and recommendations by using analytical problem solving.Provides client support, training, testing and vendor relations.Develops technical designs that will meet system objectives and minimize the impact on operations.Maintains and develops on-line and batch application programs.Codes programs that interface with multiple applications.Trains new employees on all aspects of an application or system product.Develops complex procedural language routines.Provides applications development and support and utilizes troubleshooting and diagnostic tools.Monitors, measures, and optimizes individual and combined utilization of hardware, software, and telecommunications components.Responsible for software installation and maintenance. May act as project leader.Develops and implements a disaster recovery plan.Good communicator and ability to work independently as well as part of a team.Performs other related duties as assigned.Technologies:• Cloud Architectures/solutions in AWS/Azure• Snowflake• Python• Astronomer• Airflow• TeraformNarwal is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. For more information please visit:
Job Title
Senior Data Engineer