Senior Big Data Engineer with Azure
Posted on Indeed on Feb 27, 2021
  • Hands-on experience using Databricks -Delta Lake , PySpark/Scala-Spark on Azure cloud
  • Experience loading data to Azure ADLS G2 and performing transformations using Azure Databricks
  • Expert with using the larger Hadoop eco system using Hive/HDFS/Spark
  • Experienced in creating and submitting Spark jobs
  • Experienced with Kafka and real-time analytics
  • Experienced working with Apache Nifi and Snowflake DB a plus
  • Familiarity on Azure PAAS services like Azure event hub, Azure functions and Azure Redis
  • Experience in high performance tuning and scalability
  • Core Java and Python/Spark background and their related libraries and frameworks
  • Experienced with Spring Framework and Spring Boot
  • Unix/Linux expertise; comfortable with Linux operating system and Shell Scripting
  • PL/SQL, RDBMS background with Oracle/MySQL
  • Design, Development, Unit and Integration testing of complex data pipelines and to handle data volumes to derive insights
  • Ability to optimize code to be able to run efficiently with stipulated SLA
  • Excellent problem-solving skills, with attention to detail, focus on quality and timely delivery of assigned tasks
  • Databricks Spark Developer Certification is big plus

Job Type: Full-time

Pay: $100,000.00 - $120,000.00 per year


  • 8 hour shift


  • Bachelor's (Preferred)


  • SQL: 1 year (Preferred)
  • Data Warehouse: 1 year (Preferred)

Work Location:

  • Fully Remote

Company's website:


Let us know

Help us maintain the quality of jobs posted on RemoteTechJobs and let us know if:

Error on reporting

Related jobs

Boston Pioneer Solutions