C2C- Remote -AWS Data Architect -AI/ML. DataBricks, AWS (18495-1)

Hi ,



I hope this email finds you well.



My name is Yashasvi, and I am a Technical Recruiter from Empower
Professionals Inc. We are sourcing for a Data Architect (18495-1) role
with one of our clients based in Remote and it's a long-term contract
with possible extensions.



If you have any suitable profiles, please share their updated resumes
with the candidate's location, work authorization and expected rate so
that we can proceed.



Role: AWS Data Architect -AI/ML. DataBricks, AWS (18495-1)
Location: Remote
Duration: 12+ Months
Linkedin Is must

Must have – AWS in Recent Project , Data Bricks , AI/ML.

Note: Candidate must have Hands on experience in Databricks



Requirements:

Data Strategy & Architecture Development



Define and implement the data architecture and data strategy aligned
with business goals.
Design scalable, cost-effective, and high-performance data solutions
using Databricks on AWS, Azure, or GCP.
Establish best practices for Lakehouse Architecture and Delta Lake
for optimized data storage, processing, and analytics.



Data Engineering & Integration Architect ETL/ELT pipelines
leveraging Databricks Spark, Delta Live Tables, and Databricks
Workflows.

Optimize data ingestion from sources like Oracle Fusion Middleware,
Web Methods, MuleSoft, and Informatica into Databricks.
Ensure real-time and batch data processing with Apache Spark and
Delta Lake.
Work on data integration strategies, ensuring seamless connectivity
with enterprise systems (e.g., Salesforce, SAP, ERP, CRM).



Data Governance, Security & Compliance Implement data governance
frameworks leveraging Unity Catalog for data lineage, metadata
management, and access control.

Ensure compliance with HIPAA, GDPR, and other regulatory standards
in life sciences.
Define RBAC (Role-Based Access Control) and enforce data security
best practices using Databricks SQL and access policies.
Enable data stewardship and ensure data cataloging for self-service
data democratization.



Performance Optimization & Cost Management Optimize Databricks
compute clusters (DBU usage) for cost efficiency and performance tuning.



Define and implement query optimization techniques using Photon
Engine, Adaptive Query Execution (AQE), and caching strategies.
Monitor Databricks workspace health, job performance, and cost
analytics.



AI/ML Enablement & Advanced Analytics Design and support ML
pipelines leveraging Databricks ML flow for model tracking and
deployment.

Enable AI-driven analytics in genomics, drug discovery, and clinical
data processing.
Collaborate with data scientists to operationalize AI/ML models in
Databricks.



Collaboration & Stakeholder Alignment Work with business teams, data
engineers, AI/ML teams, and IT leadership to align data strategy with
enterprise goals.



Collaborate with platform vendors (Databricks, AWS, Azure, GCP,
Informatica, Oracle, MuleSoft) for solution architecture and support.
Provide technical leadership, conduct PoCs, and drive Databricks
adoption across the organization.



Data Democratization & Self-Service Enablement Implement data
sharing frameworks for self-service analytics using Databricks SQL and
BI integrations (Power BI, Tableau).

Promote data literacy and empower business users with self-service
analytics.
Establish data lineage and cataloging to improve data
discoverability and governance.



Migration & Modernization Lead the migration of legacy data
platforms (Informatica, Oracle, Hadoop, etc.) to Databricks Lakehouse.

Design a roadmap for cloud modernization, ensuring seamless data
transition with minimal disruption.



Mandatory Key Skills:

Databricks & Spark Expertise Strong knowledge of Databricks
Lakehouse architecture (Delta Lake, Unity Catalog, Photon Engine).

Expertise in Apache Spark (PySpark, Scala, SQL) for large-scale data
processing.
Experience with Databricks SQL and Delta Live Tables (DLT) for
real-time and batch processing.
Understanding of Databricks Workflows, Job Clusters, and Task
Orchestration.



Cloud & Infrastructure Knowledge Hands-on experience with Databricks
on AWS, Azure, or GCP (preferred AWS Databricks).

Strong understanding of cloud storage (ADLS, S3, GCS) and cloud
networking (VPC, IAM, Private Link).
Experience with Infrastructure as Code (Terraform, ARM,
CloudFormation) for Databricks setup.



Data Modeling & Architecture Expertise in data modeling
(Dimensional, Star Schema, Snowflake, Data Vault).

Experience with Lakehouse, Data Mesh, and Data Fabric architectures.
Knowledge of data partitioning, indexing, caching, and query
optimization.



ETL/ELT & Data Integration Experience designing scalable ETL/ELT
pipelines using Databricks, Informatica, MuleSoft, or Apache NiFi.

Strong knowledge of batch and streaming ingestion (Kafka, Kinesis,
Event Hubs, Auto Loader).
Expertise in Delta Lake & Change Data Capture (CDC) for real-time
updates.



Data Governance & Security Deep understanding of Unity Catalog,
RBAC, and ABAC for data access control.

Experience with data lineage, metadata management, and compliance
(HIPAA, GDPR, SOC 2).
Strong skills in data encryption, masking, and role-based access
control (RBAC).



Performance Optimization & Cost Management Ability to optimize
Databricks clusters (DBU usage, Auto Scaling, Photon Engine) for cost
efficiency.

Knowledge of query tuning, caching, and performance profiling.
Experience monitoring Databricks job performance using Ganglia,
CloudWatch, or Azure Monitor.



AI/ML & Advanced Analytics

Experience integrating Databricks ML flow for model tracking and
deployment.
Knowledge of AI-driven analytics, Genomics, and Drug Discovery in
life sciences.



--
Thanks

Yashasvi Hasija

Technical Recruiter | Empower Professionals

......................................................................................................................................

Yashasvi@empowerprofessionals.com |

LinkedIn: linkedin.com/in/yashasvi-hasija-6a745625b

100 Franklin Square Drive – Suite 104 | Somerset, NJ 08873

www.empowerprofessionals.com

Certified NJ and NY Minority Business Enterprise (NMSDC)

Empower Professionals firmly opposes e-mail "spamming". We apologize to
those who do not wish to receive this e-mail and also to those who have
accidentally received it again. Please reply with "REMOVE" in the
subject listing, with all aliases email addresses that you would want
removed and any inconvenience caused is highly regretted. We appreciate
your patience and cooperation. This e-mail and any files transmitted
with it are for the sole use of the intended recipient(s) and may
contain confidential and privileged information. If you are not the
intended recipient(s), please reply to the sender and destroy all copies
of the original message. Any unauthorized review, use, disclosure,
dissemination, forwarding, printing or copying of this email, and/or any
action taken in reliance on the contents of this e-mail is strictly
prohibited and may be unlawful.
To subscribe or unsubscribe: https://send.empowerprofessionals.com/newsletter/subscribe/647186e8-bcb0-4f73-8f80-cb3daff9ad90