Monday 1 August 2022

3264-1 – Senior Python Developer - 6 months - Remote(NYC)

0 comments

I hope you are doing well. I wanted to reach out to you and see if you have suitable candidates for

3264-1 - Senior Python Developer opportunity with one of our clients

 

Senior Python Developer

 

PLEASE NOTE THIS POSITION WILL ALLOW CONSULTANT TO WORK REMOTELY. (VERY HIGH EXPECTATION THAT CONSULTANT WILL BE PROFESSIONAL, RELIABLE, REACHABLE AND ABLE TO WORK PRODUCTIVELY WHILE REMOTE). WILL COME ONSITE ONLY AS NEEDED BY THEIR MANAGER/TEAM (AT THEIR OWN EXPENSE).

 

Please find the below JD

 

Job Title: 3264-1 - Senior Python Developer

Duration: 6 months

Location: Remote(NYC)

 

REQUIREMENTS:

Skills and experience in using Synapse or a demonstrated ability to learn quickly

Skills and experience programming in Python and SQL – 2+ years

Skills and experience using PowerBI

Ability to clearly document all work (commented code, readme files, diagrams, etc.) so that work is easily transferred back to internal employees

Excellent attention to detail and QC skills to ensure errors are found and corrected before they appear in our public reporting

Good verbal and written communication abilities for internal collaboration

 

BACKGROUND:

Client is migrating a large portion of its performance management and reporting system from a custom, multi-pipeline arrangement to a more unified and efficient data lake setup using Synapse. The data and performance reporting covers wide variety of agency operations:

- service quality tracking at the vehicle level, weighted for ridership

- ridership and fare evasion

- employee workhours and overtime use

- many other functions

Some data sets add a million or more records each day and current data infrastructure is constrained in ways that will be resolved by the migration to Synapse. In addition, new technologies and enhanced reporting have provided opportunities and needs for enhancements to reporting systems

 

AIM:

Our transition process requires skills in data engineering, coding in Python and other languages, and report/dashboard development in PowerBI and other data visualization tools. Specific tasks include:

1. Develop data lake architecture and set up Synapse:

a. Setting up automated jobs to bring in external, raw data sources. In some cases, we will be duplicating current functions. In other cases, new sources and thus new functions must be developed.

b. Setting up automated tasks to transform raw data into processed (generally not final) form. We will be duplicating processes in some cases and enhancing or adding processes in other cases.

A key element of this work will be deciphering processes with limited notation and creating new code with complete notation for the use of future programmers.

 

2. Program in Python and SQ to develop refined data tables for feed into dashboard and recurring reports. This work will generally transform data that has been cleaned and/or transformed in simple ways from raw to generate more complex and calculation-based tables.

a. Porting scripts over to Synapse.

b. Re-writing particularly difficult scripts from current pipeline process in Python (i.e., looking through old code, inputs and outputs to rewrite for use in Synapse).

c. Creating code to transform new data sources that replace older sources that are simpler or less accurate.

d. Adding code notation as needed to explain processes for future users.

e. Carrying out testing process to check results and improve quality of new and existing processes.

 

3. Generate new data visualization outputs

a. Building out many PowerBI dashboards, many relatively simple

b. Developing Streamlit sites

c. Migrating and enhancing daily email reports in PowerBI Report Builder and other tools

Specific tasks will be defined as priorities and needs dictate. The consultant’s charge is to take on and complete one specific task as a time.

 

Regards

Ranga Reddy, Account Manager

1149 Bloomfield Ave. Clifton, NJ 07012

 ranga@sprucetech.com  sprucetech.com

No comments:

Post a Comment