Azure Data Engineer

** NO THIRD-PARTY RESUMES **

We are hiring an Azure Data Engineer. Interested in building a large scale, modern data ecosystem as a member of a transformation focused consulting company that is working with one of the largest financial service companies in the US? Join us as we transform and modernize our clients' data environment into a robust and intelligent data ecosystem. This is a fast-moving, forward-leaning initiative to build a full featured platform which will serve as the backbone for their big data and data analytics innovations. We are looking for modern data enthusiasts who want to make a big impact, deliver great technology, and work on an exciting team.

What You'll Be Doing

  • Work in a team using cutting edge technologies to solve challenging business problems and build solutions
  • Interact directly with our client(s) to understand their needs and meet, or exceed their expectations by meeting delivery deadlines
  • Work in an agile environment with participation in daily stand-ups/scrum
  • Design, write, test, troubleshoot, and document data transformations
  • Learn new technologies and be aware of industry standards, best practices, and trends.
  • Design, implement, and data transformation and loading services
  • Design tests for new data source ingestion
  • Design, implement and test APIs, Reports, or services
  • Design, implement and test data mart schemas and databases
  • Design, implement and test Data Platform Services

Profile of Success

  • 3+ years of experience working with Scala
  • Hands on Programming experience in Scala with Spark for ETL
  • Advanced SQL skills
  • Experience with Snowflake big data SaaS platform
  • Experience in working with the Azure storage technologies (Azure Data Lake, Azure SQL Data Warehouse, Azure SQL Database)
  • Experience in working with YAML
  • Experience in working with of Azure data movement and transformation capabilities (Azure Data Factory, Data Lake Analytics, Data Bricks, Stream Analytics)
  • Experience in designing efficient and robust ETL/ELT workflows, schedulers, and event-based triggers
  • Experience with Spark core and Spark SQL
  • Experience with working with data models developed using the Data Vault 2.0 methodology Experience as a Big Data Developer
  • Exposure to Data Mining, Data Engineering and Data Modeling
  • Data source management and Data ingestion
  • Proven ability to work with clients to understand requirements and envision data ingestion solutions
  • Experience in working with Azure DevOps and Git for source control management
  • Experience in working with Azure DevOps build release pipelines for release deployments

Desirable Skills

  • Experience with Data Build Tool (dbt)
  • Experience with dbtvault tool
  • Experience with NoSQL DB
  • Knowledge of Talend ETL
  • Possess Hive skills with HiveQL.
  • Microsoft related certifications such as the MCSD/MCSE
  • Experience with Agile Project Management Tools (Azure DevOps, JIRA)
  • Data Operations and Security - experience with tools like Collibra, able to establish data standards and policies
  • Experience with Ab Initio, MDM

Job Types: Full-time, Contract

Pay: From $50.00 per hour

Schedule:

  • Monday to Friday

Education:

  • Bachelor's (Preferred)

Experience:

  • Scala with Spark for ETL: 4 years (Preferred)
  • Azure storage technologies: 4 years (Preferred)
  • Azure data movement and transformation: 4 years (Preferred)
  • YAML: 2 years (Preferred)
  • Spark core and Spark SQL: 2 years (Preferred)
  • Advanced SQL skills: 4 years (Preferred)

Work Location:

  • Fully Remote

This Job Is Ideal for Someone Who Is:

  • Dependable -- more reliable than spontaneous
  • People-oriented -- enjoys interacting with people and working on group projects
  • Adaptable/flexible -- enjoys doing work that requires frequent shifts in direction
  • Achievement-oriented -- enjoys taking on challenges, even if they might fail
  • Autonomous/Independent -- enjoys working with little direction

COVID-19 Precaution(s):

  • Remote interview process
  • Virtual meetings

Let us know

Help us maintain the quality of jobs posted on RemoteTechJobs and let us know if:

Loading...
Success
Error on reporting

Related jobs

Boston Pioneer Solutions
Yesterday