Job Title

Job Title: QA Automation Engineer with Gen AILocation: New York City, NY. We areAt Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our FinLabs we develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more. Over the last 20+ years, our company has been honoured with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of 14,000+, and has 55 offices in 20 countries within key global markets.Our challengeWe are seeking a highly skilled and motivated Quality Engineer for Generative AI will be responsible for ensuring the quality and reliability of the AI systems. This role will involve working closely with the development team and key groups to understand the project requirements and develop comprehensive test plans. Additional Information*The base salary for this position will vary based on geography and other factors. In accordance with law, the base salary for this role if filled within New York, NYC is $110K - $120Kyear & benefits (see below).The RoleResponsibilities:Work as part of a DBA fleet, on QE processes with heavy focus on execution of automation with various automation tools and techniques. Develops test strategies and plans for Generative AI implementations. Design and execute test cases to validate the functionality, performance, and reliability of Generative AI solutions. Collaborate with stakeholders to identify testing requirements and priorities.Identify and document defects, issues, and risks related to Generative AI implementations. Work closely with developers and program managers to prioritize and resolve issues in a timely manner. Develop and maintain automated test scripts and frameworks for efficient and effective testing. Drive continuous improvement and best practices in testing methodologies and processes for Generative AI implementations. Stay up to date with new testing approaches, tools, and test strategies. Requirements:You are:8+ years of proven work experience in Quality Engineering. Integrate LLM automation tests into the continuous integration and continuous deployment pipelines. Hands-on experience in prompt engineering concepts. Proven experience in developing and implementing automation frameworks for Large Language Models. Strong programming skills in languages such as Python, Java, or similar. Experience with popular testing tools and frameworks (e.g., Selenium, JUnit, TestNG). Knowledge of NLP (Natural Language Processing) concepts and techniques. Familiarity with CICD pipelines and version control systems (e.g., Jenkins, Git).Strong problem-solving and analytical skills. Experience in automation technologies including Selenium, Junit, Gherkin, JMeter etc. and scripting languages including java. Proficiency in usage of PostgreSQL and Vector databases (ReDis) or large datasets. Team player with good communication skills to work effectively in a global team. Desired Skills Working knowledge of cloud-based application architecture and principles. Prior experience working in the Financial Services Industry Familiarity with building large-scale AI products or platforms for NLP, or recommendation systems serving millions of users. Knowledge in Graph or Network Theory and Graph Machine Learning (Graph ML). They are familiar with relevant frameworks and libraries, including Deep Graph Learning (DGL) and Natural Language Processing (NER). Additionally, understand algorithms such as Levenshtein Distance, which is used for measuring the similarity between two strings.It would be great if you also had:Experience in the financial services industry.Familiarity with Agile methodologiesWe can offer you:A highly competitive compensation and benefits packageA multinational organization with 55 offices in 20 countries and the possibility to work abroadLaptop and a mobile phone10 days of paid annual leave (plus sick leave and national holidays)Maternity & Paternity leave plansA comprehensive insurance plan including: medical, dental, vision, life insurance, and long-short-term disability (plans vary by region)Retirement savings plansA higher education certification policyCommuter benefits (varies by region)Extensive training opportunities, focused on skills, substantive knowledge, and personal development.On-demand Udemy for Business for all Synechron employees with free access to more than 5000 curated coursesCoaching opportunities with experienced colleagues from our Financial Innovation Labs (FinLabs) and Center of Excellences (CoE) groupsCutting edge projects at the world's leading tier-one banks, financial institutions and insurance firmsA flat and approachable organizationA truly diverse, fun-loving and global work cultureS"‹YNECHRON'S DIVERSITY & INCLUSION STATEMENTDiversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative "˜Same Difference' is committed to fostering an inclusive culture - promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant's gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.Candidate Application Notice