Sr Data Engineer
Company: Softworld Inc
Location: Revere
Posted on: June 21, 2022
|
|
Job Description:
Sr. Data Engineer
12+month Remote contract (must work EST schedule)
Responsibilities:
Design and build out data pipelines and perform ETL on large scale
financial data sets
Leverage ETL programming skills in open source languages including
Python, Scala, and SQL on various frameworks
Deploy DevOps techniques and practices like Continuous Integration,
Continuous Deployment, Test Automation, Build Automation and
Test-Driven Development to enable the rapid delivery of working
code utilizing tools like Jenkins, Nexus, GitHub, and Docker
Experience with Cloud computing, preferably AWS and its services
including S3, EMR/EC2 and Lambda functions
Manage multiple responsibilities in an unstructured environment
where you're empowered to make a difference. In that context, you
will be expected to research and develop cutting edge technologies
to accomplish your goals
Must have a firm understanding of delivering large-scale data sets
solutions and SDLC best practices
Be a champion of business partners' needs and provide inputs into
design and development of broader strategic solutions
Participate in onboarding new datasets and supporting day to day
data needs of investors and researchers
Research and develop cutting edge technologies to accomplish
organization's goals
Timely communicate progress and any impediments of backlog items to
various stakeholders
Comply to IT InfoSec standards and mandates while providing data
solutions to our business partners
Basic Qualifications:
Bachelor's or Master's Degree in a technology related field
Solid AWS infrastructure experience with focus on data engineering
services
At least 2 years of hands-on coding skills in python
At least 3 years of experience in data engineering (ETL, SQL, data
pipelines)
At least 3 years of experience delivering data solutions using
open-source languages
At least 3 years of experience utilizing SQL in complex
solutions
Experience with CI/CD tools (Jenkins or equivalent), version
control(Git), Orchestration tools(Airflow or equivalent)
Experience working with Agile methodologies
Excellent communications and collaboration skills to work across
teams and organizations
Preferred Qualifications:
2+ years of experience developing, deploying, testing in AWS public
cloud
2+ years of experience in C# or Java
3+ years of experience delivering data solutions using open-source
languages
3+ years of experience utilizing scripting languages
5+ years of experience developing ETL solutions
5+ years of experience utilizing SQL in complex solutions
2+ years of experience developing, deploying, testing in AWS public
cloud
AWS certification
Working experience with a financial asset management firm is
preferred
Keywords: Softworld Inc, Revere , Sr Data Engineer, Engineering , Revere, Massachusetts
Click
here to apply!
|