Remote : Sr. Lead Data Engineer (Bloomberg, Databricks, Python)

Hi,

Title:  Sr. Lead  Data Engineer (Bloomberg, Databricks, Python)

Location: Remote, New York, NY 10055

12+ Years atleast

Mandatory Skills:

Azure Data Bricks

Azure Data Lake
Python

Pyspark

Bloomberg ,data acquisition and transformation

JD:

• Design, develop, and maintain scalable data pipelines using Azure Databricks and Azure Data Lake.
• Integrate data from various sources into the Databricks platform.
• Implement data integration and ETL processes using Azure Data Factory.
• Develop and optimize data processing workflows and pipelines using PySpark.
• Support solving business use cases involving Bloomberg data acquisition and transformation.
• Collaborate with data scientists and analysts to support data-driven decision-making.
• Ensure data quality and integrity across various data sources and storage solutions.
• Monitor and troubleshoot data pipeline performance and reliability.

Assist with dashboarding and data visualization using Power BI.

--
You received this message because you are subscribed to the Google Groups "Latest C2C Requirements2" group.
To unsubscribe from this group and stop receiving emails from it, send an email to latest-c2c-requirements2+unsubscribe@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/latest-c2c-requirements2/CABPbW4BX_32oi2XxNxxOnSVswYXZSjcw7EOAHtTVjx6PjO9yng%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.