Thursday, 15 October 2026

RE: Job Opportunity...! Scala Sparks Developer / Big Data Developer...! NYC, NY (Hybrid)

Posted On

Hi,
Greetings of the day…!
Please go through JD and revert ASAP

Title: Scala Sparks Developer / Big Data Developer

Location: NYC, NY (Hybrid)

Duration: 6 months

Job Summary:

Key Responsibilities

Develop, test, and maintain scalable data processing pipelines using Scala and Apache Spark.
Implement data transformation and ETL workflows to handle structured and unstructured data.
Utilize Python for data processing, scripting, and integrating Spark workflows.
Optimize performance of Spark applications through tuning, partitioning, and caching strategies.
Participate in code reviews, design discussions, and ensure adherence to best practices.
Document workflows, architecture, and solutions for internal knowledge sharing.

Required Qualifications

Strong experience in Scala and Apache Spark (Spark Core, Spark SQL, Data Frames, RDDs).
Proficiency in Python for data manipulation, scripting, and automation.
Proven experience with distributed computing concepts and large-scale data processing.
Knowledge of ETL development, data warehousing, and data modelling techniques.
Familiarity with Big Data ecosystems such as Hadoop, Hive, Kafka, or HBase is a plus.
Excellent communication and collaboration skills.

Preferred Qualifications

Experience with cloud platforms such as AWS, GCP, or Azure (particularly with Spark services).
Familiarity with streaming data processing using Spark Streaming or Structured Streaming.
Knowledge of data governance, security, and compliance practices.
Basic understanding of machine learning workflows is advantageous.