Senior Big Data Engineer with Azure at ACHNET

Hands-on experience using Databricks -Delta Lake , PySpark/Scala-Spark on Azure cloud
Experience loading data to Azure ADLS G2 and performing transformations using Azure Databricks
Expert with using the larger Hadoop eco system using Hive/HDFS/Spark
Experienced in creating and submitting Spark jobs
Experienced with Kafka and real-time analytics
Experienced working with Apache Nifi and Snowflake DB a plus
Familiarity on Azure PAAS services like Azure event hub, Azure functions and Azure Redis
Experience in high performance tuning and scalability
Core Java and Python/Spark background and their related libraries and frameworks
Experienced with Spring Framework and Spring Boot
Unix/Linux expertise; comfortable with Linux operating system and Shell Scripting
PL/SQL, RDBMS background with Oracle/MySQL
Design, Development, Unit and Integration testing of complex data pipelines and to handle data volumes to derive insights
Ability to optimize code to be able to run efficiently with stipulated SLA
Excellent problem-solving skills, with attention to detail, focus on quality and timely delivery of assigned tasks
Databricks Spark Developer Certification is big plus

Job Type: Full-time

Pay: $100,000.00 - $120,000.00 per year

Schedule:

Education:

Experience:

Work Location:

Company's website: