Azure Data Engineer

** NO THIRD-PARTY RESUMES **

We are hiring an Azure Data Engineer. Interested in building a large scale, modern data ecosystem as a member of a transformation focused consulting company that is working with one of the largest financial service companies in the US? Join us as we transform and modernize our clients' data environment into a robust and intelligent data ecosystem. This is a fast-moving, forward-leaning initiative to build a full featured platform which will serve as the backbone for their big data and data analytics innovations. We are looking for modern data enthusiasts who want to make a big impact, deliver great technology, and work on an exciting team.

What You'll Be Doing

• Work in a team using cutting edge technologies to solve challenging business problems and build solutions
• Interact directly with our client(s) to understand their needs and meet, or exceed their expectations by meeting delivery deadlines
• Work in an agile environment with participation in daily stand-ups/scrum
• Design, write, test, troubleshoot, and document data transformations
• Learn new technologies and be aware of industry standards, best practices, and trends.
• Design, implement, and data transformation and loading services
• Design tests for new data source ingestion
• Design, implement and test APIs, Reports, or services
• Design, implement and test data mart schemas and databases
• Design, implement and test Data Platform Services

Profile of Success

• 3+ years of experience working with Scala
• Hands on Programming experience in Scala with Spark for ETL
• Advanced SQL skills
• Experience with Snowflake big data SaaS platform
• Experience in working with the Azure storage technologies (Azure Data Lake, Azure SQL Data Warehouse, Azure SQL Database)
• Experience in working with YAML
• Experience in working with of Azure data movement and transformation capabilities (Azure Data Factory, Data Lake Analytics, Data Bricks, Stream Analytics)
• Experience in designing efficient and robust ETL/ELT workflows, schedulers, and event-based triggers
• Experience with Spark core and Spark SQL
• Experience with working with data models developed using the Data Vault 2.0 methodology Experience as a Big Data Developer
• Exposure to Data Mining, Data Engineering and Data Modeling
• Data source management and Data ingestion
• Proven ability to work with clients to understand requirements and envision data ingestion solutions
• Experience in working with Azure DevOps and Git for source control management
• Experience in working with Azure DevOps build release pipelines for release deployments

Desirable Skills

• Experience with Data Build Tool (dbt)
• Experience with dbtvault tool
• Experience with NoSQL DB
• Knowledge of Talend ETL
• Possess Hive skills with HiveQL.
• Microsoft related certifications such as the MCSD/MCSE
• Experience with Agile Project Management Tools (Azure DevOps, JIRA)
• Data Operations and Security - experience with tools like Collibra, able to establish data standards and policies
• Experience with Ab Initio, MDM

Job Types: Full-time, Contract

Pay: From $50.00 per hour

Schedule:

• Monday to Friday

Education:

• Bachelor's (Preferred)

Experience:

• Scala with Spark for ETL: 4 years (Preferred)
• Azure storage technologies: 4 years (Preferred)
• Azure data movement and transformation: 4 years (Preferred)
• YAML: 2 years (Preferred)
• Spark core and Spark SQL: 2 years (Preferred)
• Advanced SQL skills: 4 years (Preferred)

Work Location:

• Fully Remote

This Job Is Ideal for Someone Who Is:

• Dependable -- more reliable than spontaneous
• People-oriented -- enjoys interacting with people and working on group projects
• Adaptable/flexible -- enjoys doing work that requires frequent shifts in direction
• Achievement-oriented -- enjoys taking on challenges, even if they might fail
• Autonomous/Independent -- enjoys working with little direction

COVID-19 Precaution(s):

• Remote interview process
• Virtual meetings