PySpark Developer W2 Contracts Hybrid positions in Iselin, NJ Job at CDRP Technologies, Iselin, NJ

cDlnVkdvUkdRWVF1SkExd093eXErV2FsRVE9PQ==
  • CDRP Technologies
  • Iselin, NJ

Job Description

Responsibilities:

  • Develop, maintain, and optimize data processing pipelines using PySpark on Azure Cloud.
  • Collaborate with cross-functional teams to understand data requirements and translate business needs into technical specifications.
  • Design and implement scalable data models and data architecture to support analytical and reporting needs.
  • Perform data cleansing, transformation, and enrichment processes to enhance data quality and usability.
  • Monitor and troubleshoot data processing jobs, ensuring high availability and performance.
  • Implement best practices for data governance and security within Azure Cloud.
  • Stay up-to-date with emerging technologies in big data, cloud computing, and the financial services industry.

Requirements:

  • Minimum of 9 years of experience in PySpark development.
  • Proven experience working with Azure Cloud services (Azure Data Factory, Azure Databricks, etc.).
  • Prior experience in the banking, investment banking, or financial services sector is mandatory.
  • Proficient in PySpark for data processing and ETL tasks.
  • Experience with SQL and NoSQL databases.
  • Familiarity with data warehousing concepts and tools.
  • Knowledge of Azure services related to big data and analytics.

Preferred, but not required:

  • Experience with containerization technologies (e.g., Docker, Kubernetes).
  • Familiarity with machine learning frameworks (e.g., MLlib, TensorFlow).

Job Tags

Similar Jobs

DataAnnotation

Chemistry Teacher Job at DataAnnotation

 ...logic, and solve problems to improve the quality of each model. In this role you will need to hold an expert understanding of chemistry- a completed or in progress Masters/PhD is preferred but not required. Other related fields include, but are not limited to: Research... 

Empire Cake

Kitchen Porter Job at Empire Cake

 ...complete work without supervision - Knowledge of cleaning and sanitation standards preferred -Storage of incoming food, paper, and linendeliveries, ensuring all food items are rotated (FIFO) properly Required Documents: - Valid ID - Social Security Card To... 

SecurityScorecard

Head of Government Affairs Job at SecurityScorecard

 ...key advisor to executive leadership, supporting complex federal, state, and local government opportunities by navigating the evolving regulatory landscape...  ...on regulatory and compliance requirements related to U.S. federal, state, and local government cybersecurity procurements... 

Aureon

Customer Support Representative / Contact Center Agent (Remote) Job at Aureon

 ...perform as scheduled. Answer and complete all assigned messages or contacts; ensure that all customer questions and issues are addressed in...  ..., development, and advancement within the organization ~100% remote working employment model ~ Comprehensive training on hardware... 

Girling Health Care of New York

Physical Therapist - Russian Speaking - Brooklyn Job at Girling Health Care of New York

 ...home care Physical Therapist to conduct home visits in South Brooklyn. *The ideal candidate for this position would be bilingual Russian. The physical therapist contracted or employed through our organization provides physical therapy services to patients according...