Designation - Principal EngineerLocation - Bangalore ( 3 days from office )Experience - 15+Skills - Scala, Spark, SQL, HiveSkillsScala Proficiency - Extensive experience in Scala programming, including in-depth knowledge of its intricacies.SQL Expertise - Proficient in SQL, with the ability to write and optimize complex queries for efficient data processing.Functional Programming - Strong background in functional programming paradigms.Integration Testing - Experience in designing and implementing integration tests to ensure the reliability of data pipelines.Big Data and Hive - Skilled in handling big data queries and utilizing Hive for data warehousing and analysis.Summary: Join a dynamic and innovative educational technology organization and play a pivotal role in developing impactful software solutions. We are seeking a Senior Software Engineer with robust experience in Scala, database systems, and Big Data technologies. This position emphasizes both individual technical contributions and collaborative efforts within an Agile environment to deliver scalable and efficient solutions that address complex business needs. Responsibilities : Lead technical initiatives and contribute as a senior team member to achieve project goals and deadlines. Collaborate with team members to design, implement, and optimize software solutions aligned with organizational objectives. Build scalable, efficient, and high-performance pipelines and workflows for processing large amounts of batch and real-time data. Perform multidisciplinary work, supporting real-time streams, ETL pipelines, data warehouses, and reporting services. Recommend and advocate for technology upgrades to company leaders to ensure infrastructure remains robust and competitive. Design and develop microservices and data applications while ensuring seamless integration with other systems. Leverage Big Data technologies like Kafka, AWS S3, EMR, and Spark to handle data ingestion, transformation, and querying. Follow coding best practices, including unit testing, code reviews, code coverage, and maintaining comprehensive documentation. Conduct thorough code reviews to maintain quality, mentor junior team members, and promote continuous learning within the team. Enhance system performance through analysis and capacity planning, ensuring efficient and reliable software releases. Actively bring new and innovative solutions to address challenging software issues that arise throughout the product lifecycle. Implement and promote security protocols and data governance standards across development projects. Actively engage in Agile processes to foster collaboration and innovation within the team. Preferred qualifications: Knowledge in advanced database technologies like SingleStore DB and SnowFlake Educational domain background
Job Title
Principal Engineer