Skip to Main Content

Job Title


Data Engineer - W2 Contract


Company : RiVi Consulting Group L.L.C


Location : new york city, NY


Created : 2024-07-01


Job Type : Full Time


Job Description

Note : W2 Contract Opportunity. Must Pass Level 2 BackgroundTop Skills' DetailsPython - ensuring data reliability, and creating consistent, machine-readable formats using Python. You'll also develop and test architectures for data extraction and transformation, supporting predictive or prescriptive modelling.AWS - assist in the support of the migration from on prem to cloud by creating the infrastructure needed (lambda, glue, s3, flyway)Databricks - cloud-based platform built on Apache Spark that provides a collaborative environment for big data processing and analytics. It simplifies the use of Spark, allowing data engineers, data scientists, and analysts to work together effectively. Job DescriptionThis role sits within the Data and Analytics Office which directs all aspects of data management within the Bank, and coordinates policies that will get promoted across the Federal Reserve System. Serves as a coordinating and centralizing body for data and analytics, organizing data access, establishing data foundations, while also driving innovation through advanced analytics.The ideal candidate will be a Senior with experience with- 7+ years Python- 7+ years Data Engineering- 5+ years AWS (ideally migration work)- Native technologies such as lambda, glue, s3, flyway- 5+ years Databricks- experience with Gitlab- ETL experienceThe environment is set up with Databricks and Starburst, and the ideal candidate will understand how AWS can relateAdditional Skills & QualificationsCloud Infrastructure Design:Collaborate with cross-functional teams to plan and design cloud infrastructure solutions using AWS services.Apply best practices for scalability, reliability, and security.Data Engineering Integration:Leverage your data engineering expertise to integrate data pipelines, ETL processes, and analytics workflows within the AWS ecosystem.Optimize data storage, retrieval, and processing using services like Amazon S3, Redshift, Glue, and Athena.Employee Value Proposition (EVP)Contribute to the critical infrastructure by leveraging cutting edge cloud technologies to enhance the efficiency of the global financial system.Work EnvironmentCollaborative and fast paced atmosphere, where team members work diligently to uphold the highest standard of reliability and security while fostering innovation and continuous improvement to meet the needs of the FS industry. The team is set up in Scrum ceremonies and will report directly to the product managerBusiness DriversCustomer ImpactNew users are trying to onboard into the data platform and the platform needs to modernize and shift into the cloudWhy is the position open(provide details)new headcount as this AWS migration is heavily fundedExternal Communities Job DescriptionOur financial services client is seeing an AWS Engineer to join the team. The ideal candidate will have experience with Python, Data Engineering, AWS, and databricks