We are looking for ETL Architect || Immediate Joiner Duration: Permanent-Fulltime.Primary Skills : AWS, PySpark, AWS services, including S3, Redshift, Athena, EMR, and Glue.Qualification, Knowledge & Experience:-Bachelor's or Master's degree in Computer Science, Information Technology, or a related field. Proven experience as an ETL Technical Architect with a strong focus on AWS and PySpark. In-depth knowledge of AWS services, including but not limited to S3, Redshift, Athena, EMR, and Glue. Proficiency in PySpark and related Big Data technologies for ETL processing. Strong SQL skills for data manipulation and querying. Familiarity with data warehousing concepts and dimensional modeling. Experience with data governance, data quality, and data security practices. Excellent problem-solving skills and attention to detail.Requirements:-Architect ETL solutions: Design end-to-end ETL solutions that align with business requirements, ensuring scalability, reliability, and performance. Data Modeling: Define and implement data models, schemas, and structures to support efficient data processing and storage. ETL Pipeline Development: Develop, optimize, and maintain ETL pipelines using PySpark, leveraging AWS Glue or other relevant AWS services. AWS Integration: Integrate ETL processes with various AWS services, such as S3, Redshift, Athena, and EMR, to create a comprehensive data ecosystem. Performance Optimization: Identify and resolve performance bottlenecks in ETL processes, optimizing data extraction, transformation, and loading for efficiency. Data Quality and Governance: Implement data quality checks and governance policies to ensure data accuracy and compliance with industry standards and regulations. Monitoring and Troubleshooting: Set up monitoring and alerting systems to proactively identify and address issues within the ETL pipelines. Collaboration: Work closely with data engineers, data scientists, and other stakeholders to understand their data requirements and ensure successful data delivery. Documentation: Create and maintain technical documentation, including architecture diagrams, data flow diagrams, and standard operating procedures. Stay Current: Keep up-to-date with the latest ETL, AWS, and PySpark developments and best practices, and apply them to enhance existing processes.You can read more about us on our company career pagefollow us on Linkedinget the latest updates.For any query or clarification , you can connect me on email:-geeta.harchandani@About IGT Solutions Pvt LtdIGT Solutions is a next-gen customer experience (CX) company, defining and delivering transformative experiences for the global and most innovative brands using digital technologies. With the combination of Digital and Human Intelligence, IGT becomes the preferred partner for managing end-to-end CX journeys across Travel and High Growth Tech industries. We have a global delivery footprint, spread across 30 delivery centers in China, Colombia, Egypt, India, Indonesia, Malaysia, Philippines, Romania, South Africa, Spain, UAE, the US, and Vietnam, with 25000+ CX and Technology experts from 35+ nationalities.IGT's Digital team collaborates closely with our customer’s business & technology teams to take solutions faster to market while sustaining quality while focusing on business value and improving overall end-Customer ExperienceOur offerings include industry solutions as well as Digital services. We work with leading global enterprise customers to improve synergies between business & technology by enabling rapid business value realization leveraging Digital Technologies. These include lifecycle transformation & rapid development / technology solution delivery services delivered leveraging traditional as well as Digital Technologies, deep functional understanding and software engineering expertise.IGT is ISO 27001:2013, CMMI SVC Level 5 and ISAE-3402 compliant for IT, and COPC® Certified v6.0, ISO 27001:2013 and PCI DSS 3.2 certified for BPO processes. The organization follows Six Sigma rigor for process improvements.It is our policy to provide equal employment opportunities to all individuals based on job-related qualifications and ability to perform a job, without regard to age, gender, gender identity, sexual orientation, race, color, religion, creed, national origin, disability, genetic information, veteran status, citizenship or marital status, and to maintain a non-discriminatory environment free from intimidation, harassment or bias based upon these grounds.
Job Title
ETL Architect