Scala + AWS(NCS/Job/ 1690)

Skill: Scala with AWS

Grade-C2

Location: Pan India

NP: Immediate to 15 Days Joiners Only

Job Summary:

We are seeking a skilled Big Data Engineer with strong hands-on experience in Apache Spark, Scala, and AWS cloud services. The ideal candidate will be responsible for developing scalable data pipelines, processing large datasets, and deploying efficient Spark-based solutions on the AWS ecosystem.

Key Responsibilities:
• Design and develop distributed data processing pipelines using Apache Spark and Scala.
• Optimize Spark jobs for performance and scalability on AWS infrastructure.
• Integrate Spark applications with AWS services such as S3, EMR, Lambda, Glue, RDS, Athena, and Redshift.
• Write clean, reusable, and production-grade Scala code.
• Work with large-scale structured and unstructured data in real-time and batch modes.
• Ensure data quality, reliability, and consistency through monitoring and validations.
• Collaborate with data scientists, analysts, and business teams to understand requirements and deliver insights.
• Implement best practices for data engineering in a cloud-native environment.

Required Skills:
• Strong programming skills in Scala
• 3+ years of hands-on experience with Apache Spark (RDD/DataFrame/SQL APIs)
• Experience working on AWS services like EMR, S3, Glue, Lambda, EC2, etc.
• Proficient in writing and optimizing complex Spark transformations and actions.
• Experience in working with large-scale data processing and distributed systems.

Preferred Skills:
• Experience with Kafka, Airflow, or similar orchestration tools.
• Working knowledge of Python 
• Experience with containerized deployments (Docker, Kubernetes).
• AWS certification (e.g., AWS Certified Data Analytics – Specialty) is a plus.