Role: Data Engineer with Databricks
Location: Tampa FL (Need locals)
100% ONSITE ROLE
Experience: 5+
Send profiles to: mkodumunja@sageitinc.net
Job Summary:
We are seeking a talented Data Engineer with hands-on experience in Databricks to join our dynamic data team. The ideal candidate will design, build, and optimize scalable data pipelines on the Databricks platform to support advanced analytics and data-driven decision-making. You will work closely with data scientists, analysts, and cross-functional teams to ensure the availability, quality, and security of data.
Key Responsibilities:
Design, develop, and maintain scalable ETL/ELT pipelines on the Databricks platform using Apache Spark.
Build and optimize batch and streaming data pipelines to process large volumes of structured and unstructured data.
Collaborate with data scientists and business stakeholders to understand data requirements and translate them into technical solutions.
Monitor and troubleshoot data processing workflows ensuring high reliability and performance.
Implement data governance, security, and compliance standards in data pipelines.
Optimize Databricks clusters for cost-efficiency and performance.
Maintain documentation related to data architecture and pipeline processes.
-- Location: Tampa FL (Need locals)
100% ONSITE ROLE
Experience: 5+
Send profiles to: mkodumunja@sageitinc.net
Job Summary:
We are seeking a talented Data Engineer with hands-on experience in Databricks to join our dynamic data team. The ideal candidate will design, build, and optimize scalable data pipelines on the Databricks platform to support advanced analytics and data-driven decision-making. You will work closely with data scientists, analysts, and cross-functional teams to ensure the availability, quality, and security of data.
Key Responsibilities:
Design, develop, and maintain scalable ETL/ELT pipelines on the Databricks platform using Apache Spark.
Build and optimize batch and streaming data pipelines to process large volumes of structured and unstructured data.
Collaborate with data scientists and business stakeholders to understand data requirements and translate them into technical solutions.
Monitor and troubleshoot data processing workflows ensuring high reliability and performance.
Implement data governance, security, and compliance standards in data pipelines.
Optimize Databricks clusters for cost-efficiency and performance.
Maintain documentation related to data architecture and pipeline processes.
You received this message because you are subscribed to the Google Groups "US IT and Non-IT Requirements - Pandit - 2" group.
To unsubscribe from this group and stop receiving emails from it, send an email to us-it-and-non-it-requirements-pandit-2+unsubscribe@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/us-it-and-non-it-requirements-pandit-2/CAHOi7Hv7W%2BjgfMqbpSN3PL1G-34fsxANYFXjg4CeQqgkJekatA%40mail.gmail.com.
