WE ARE HIRING!! Role: Senior Data Engineer Location: Bangalore. Years Of experience: - 5 + We’re excited if you have- - Proficiency in Python and pyspark. - Deep understanding of Apache Spark, Spark tuning, creating RDDs, and building data frames. Create Java/Scala Spark jobs for data transformation and aggregation. - Experience in big data technologies like HDFS, YARN, Map-Reduce, Hive, Kafka, Spark, Airflow, Presto, etc. - Experience in building distributed environments using any of Kafka, Spark, Hive, Hadoop, etc. - Good understanding of the architecture and functioning of Distributed database systems - Experience working with various file formats like Parquet, Avro, etc for large volumes of data - Experience with one or more NoSQL databases - Experience with AWS, GCP - 5+ years of professional experience as a data or software engineer.
Job Title
Senior Data Engineer