Roles and responsibilities:Proficient with Java, Scala/Spark, API, and Streaming Primary.Proficient with PySpark, Python, and SQL.Experience in Azure cloud platform.Expertise in various connectors and pipelines for batch and real-time data collection/delivery.Performance tuning - table partitioning and indexing, process threading.Should have worked in Agile.Experience of working in JIRA and Confluence. #J-18808-Ljbffr
Job Title
Big Data Engineer