Opening Title : Data Engineer -
Location : Portland, OR
Job Description : This is identical to all of Amit"s reqs. Spark, AWS, Python, SQL with Database management experience.
Experience 8+yrs
Visa::GC,USC,H4EAD,H1B
Good understanding and application of modern data processing technology stacks. For example, Snowflake, SQL, Spark, Airflow, and others
Design and build product features in collaboration with business and IT
Design reusable components, frameworks, and code
Use and contribute to continuous integration pipelines
Performance/scalability tuning, algorithms and computational complexity
Develop architecture and design patterns to process and store high volume data sets
Participate in an Agile / Scrum methodology to deliver high - quality software releases every 2 weeks through Sprints
Troubleshoot production support issues post - deployment and come up with solutions as required
2+ years" experience in a professional organization collaborating across multiple functions
Familiarity with Agile project delivery methods
Experience with AWS components and services (E.G. EMR, S3, and Lambda)
Experience with Jenkins, Bitbucket/GitHub and scheduling tools like Airflow
Strong programming, Python, shell scripting and SQL
Good understanding of file formats including JSON, Parquet, Avro, and others
Experience with data warehouses/RDBMS like Oracle, Teradata, Snowflake
Experience with data warehousing, dimensional modeling and ETL development
Demonstrable ability to quickly learn new tools and technologies
Machine learning frameworks & statistical analysis with Python, R or similar
Exceptional interpersonal and communication skills (written and verbal)
Passion for data with demonstrated ability to use data to tell a story and influence decision making
Thanks,
Anvesh
Mergen IT Services
