I hope you are doing well. I wanted to reach out to you and see if you have suitable candidates for 3264-1 - Senior Python Developer opportunity with one of our clients Senior Python Developer PLEASE NOTE THIS POSITION WILL ALLOW CONSULTANT TO WORK REMOTELY. (VERY HIGH EXPECTATION THAT CONSULTANT WILL BE PROFESSIONAL, RELIABLE, REACHABLE AND ABLE TO WORK PRODUCTIVELY WHILE REMOTE). WILL COME ONSITE ONLY AS NEEDED BY THEIR MANAGER/TEAM (AT THEIR OWN EXPENSE). Please find the below JD Job Title: 3264-1 - Senior Python Developer Duration: 6 months Location: Remote(NYC) REQUIREMENTS: Skills and experience in using Synapse or a demonstrated ability to learn quickly Skills and experience programming in Python and SQL – 2+ years Skills and experience using PowerBI Ability to clearly document all work (commented code, readme files, diagrams, etc.) so that work is easily transferred back to internal employees Excellent attention to detail and QC skills to ensure errors are found and corrected before they appear in our public reporting Good verbal and written communication abilities for internal collaboration BACKGROUND: Client is migrating a large portion of its performance management and reporting system from a custom, multi-pipeline arrangement to a more unified and efficient data lake setup using Synapse. The data and performance reporting covers wide variety of agency operations: - service quality tracking at the vehicle level, weighted for ridership - ridership and fare evasion - employee workhours and overtime use - many other functions Some data sets add a million or more records each day and current data infrastructure is constrained in ways that will be resolved by the migration to Synapse. In addition, new technologies and enhanced reporting have provided opportunities and needs for enhancements to reporting systems AIM: Our transition process requires skills in data engineering, coding in Python and other languages, and report/dashboard development in PowerBI and other data visualization tools. Specific tasks include: 1. Develop data lake architecture and set up Synapse: a. Setting up automated jobs to bring in external, raw data sources. In some cases, we will be duplicating current functions. In other cases, new sources and thus new functions must be developed. b. Setting up automated tasks to transform raw data into processed (generally not final) form. We will be duplicating processes in some cases and enhancing or adding processes in other cases. A key element of this work will be deciphering processes with limited notation and creating new code with complete notation for the use of future programmers. 2. Program in Python and SQ to develop refined data tables for feed into dashboard and recurring reports. This work will generally transform data that has been cleaned and/or transformed in simple ways from raw to generate more complex and calculation-based tables. a. Porting scripts over to Synapse. b. Re-writing particularly difficult scripts from current pipeline process in Python (i.e., looking through old code, inputs and outputs to rewrite for use in Synapse). c. Creating code to transform new data sources that replace older sources that are simpler or less accurate. d. Adding code notation as needed to explain processes for future users. e. Carrying out testing process to check results and improve quality of new and existing processes. 3. Generate new data visualization outputs a. Building out many PowerBI dashboards, many relatively simple b. Developing Streamlit sites c. Migrating and enhancing daily email reports in PowerBI Report Builder and other tools Specific tasks will be defined as priorities and needs dictate. The consultant’s charge is to take on and complete one specific task as a time. Regards Ranga Reddy, Account Manager 1149 Bloomfield Ave. Clifton, NJ 07012 ranga@sprucetech.com | sprucetech.com |