Data Engineer
Pinnacle Partners is assisting our client in search for a Data Engineer to join their team remotely. This successful resource will be responsible for maintaining Azure Data Factory ETL jobs and interacting with other teams to deliver data in usable formats.
RESPONSIBILITIES:
- Participate in Agile ceremonies to help design, plan, build, test, develop and support data products and platforms
- Design and planning of data services solutions on the Data Platform
- Build and deliver Python/Docker feed framework data pipeline jobs and services
- Contribute to the team delivery framework including building of re-usable code, implementing industry best practices, and maintain a common delivery framework
- Monitor, maintain and document incident resolution of schedule production data jobs
REQUIREMENTS:
- 3+ years of experience in Python development including working with data science packages
- Experience planning and designing maintainable data schemas
- Experience with Azure and ADF cloud based DW
- Experience with GIT
PREFERRED SKILLS:
- Experience using Azure DevOps (CI/CD)/Artifactory/PyPy or comparable delivery stacks
- Knowledge and experience with Docker, Kubernetes, and data warehouse environments
- Kinnesis/Kafka knowledge
- Experience with large enterprise data lakes/Snowflake
TERMS:
This position is a direct hire with a wage up to $130K based on experience. They offer benefits including full medical, dental, and vision along with 401K matching, FSA, PTO, and other benefits.
{{notification.msg}}