Sr Data Engineer

Company: Softworld Inc
Location: Revere
Posted on: June 21, 2022

Job Description:

Sr. Data Engineer

12+month Remote contract (must work EST schedule)

Responsibilities:

Design and build out data pipelines and perform ETL on large scale financial data sets
Leverage ETL programming skills in open source languages including Python, Scala, and SQL on various frameworks
Deploy DevOps techniques and practices like Continuous Integration, Continuous Deployment, Test Automation, Build Automation and Test-Driven Development to enable the rapid delivery of working code utilizing tools like Jenkins, Nexus, GitHub, and Docker
Experience with Cloud computing, preferably AWS and its services including S3, EMR/EC2 and Lambda functions
Manage multiple responsibilities in an unstructured environment where you're empowered to make a difference. In that context, you will be expected to research and develop cutting edge technologies to accomplish your goals
Must have a firm understanding of delivering large-scale data sets solutions and SDLC best practices
Be a champion of business partners' needs and provide inputs into design and development of broader strategic solutions
Participate in onboarding new datasets and supporting day to day data needs of investors and researchers
Research and develop cutting edge technologies to accomplish organization's goals
Timely communicate progress and any impediments of backlog items to various stakeholders
Comply to IT InfoSec standards and mandates while providing data solutions to our business partners

Basic Qualifications:

Bachelor's or Master's Degree in a technology related field
Solid AWS infrastructure experience with focus on data engineering services
At least 2 years of hands-on coding skills in python
At least 3 years of experience in data engineering (ETL, SQL, data pipelines)
At least 3 years of experience delivering data solutions using open-source languages
At least 3 years of experience utilizing SQL in complex solutions
Experience with CI/CD tools (Jenkins or equivalent), version control(Git), Orchestration tools(Airflow or equivalent)
Experience working with Agile methodologies
Excellent communications and collaboration skills to work across teams and organizations

Preferred Qualifications:

2+ years of experience developing, deploying, testing in AWS public cloud
2+ years of experience in C# or Java
3+ years of experience delivering data solutions using open-source languages
3+ years of experience utilizing scripting languages
5+ years of experience developing ETL solutions
5+ years of experience utilizing SQL in complex solutions
2+ years of experience developing, deploying, testing in AWS public cloud
AWS certification
Working experience with a financial asset management firm is preferred

Keywords: Softworld Inc, Revere , Sr Data Engineer, Engineering , Revere, Massachusetts