Big Data Engineer (Spark/Apache)

Published date Posted on Indeed on Aug 29, 2021 (57 d ago)

Piper Companies is looking for Big Data Engineer for a leading health sciences company. This role is 100% remote.


Responsibilities for the Big Data Engineer:

  • Design and build large data processing systems leveraging the market’s most prominent data ingestion technologies
  • Build streaming data processing systems

Qualifications for the Big Data Engineer:

  • 5+ years working with Big Data technologies like Hadoop, MadReduce, and HDFS for data processing
  • Proficient in object oriented programming – Java/Python
  • Expertise in leverage Apache Spark for stream data and querying tools like Pig/Hive
  • Knowledge of Azure Storage ideal (Blob Storage, Data Lake, Cosmos)
  • Capable of leading/mentoring other data engineers
  • Knowledge of Lambda/Kappa architecture


Compensation/Benefits for Big Data Engineer:

  • $130,000 - $155,000
  • 100% remote
  • Comprehensive benefit package; Medical, Dental, Vision, 401k, and Paid Time Off

Keywords:

big data engineer, big data developer, hadoop developer, hadoop engineer, big data, hadoop, madreduce, hdfs, pig, hive, mongodb, cassandra, dynamodb, nosql, java, python, spark, apache, pyspark, clustering, ETL, azure, data lake, data factory, database, data mining, data lake, stream processing, data warehouse, benefits, vacation, holiday, 401k


Let us know

Help us maintain the quality of jobs posted on RemoteTechJobs and let us know if:

Loading...
Success
Error on reporting

Related jobs

Zynga is looking for an experienced data-driven professional to join our growing Ad monetization team. In this role, the ideal candidate will develop and lead programs designed to drive Zynga revenue and yield on our digital advertising inventory across a wide array of ad formats

Project DescriptionApplying to the position, you may join one of the most respected and fastest growing institutional investors in the world. Our client is a professional investment management organization that globally invests the funds to ensure long-term sustainability. The co

The Associate Product & Strategy Dir is responsible for the development and strategic direction of IQVIA’s new and emerging gross-to-net platform. The role will exhibit a high degree of market access and contracting strategy subject matter expertise within the Life Scie

Knit Knit |
Yesterday

Who we’re looking for…Role: StrategistTeam: Customer SuccessReports To: VP of OperationsSupervisory Responsibility: This role will not have direct reports, unless occasionally managing a contractor to support high-volume projects.Location: We have a remote working po

CitiusTech CitiusTech |
2 d ago

Sr Manager-I / Scrum MasterLong Term, Remote [can work from your current location]Key Skill /Skill Specialization – Scrum MasterMandatory Skills – Scrum MasterDesired Skills - Azure DevOps, JIRA, Data AnalyticsDescription:Mandatory:Lead the scrum team in using Agile m

More jobs by this company

100% remote positionTechnical Skills1. You have strong development skills in Ruby, with familiarity in JavaScript, React, Angular, and/or Java2. You have a strong DevSecOps understanding and experience3. You have experience with front-end technologies such as JavaScript٫ HT

Piper Companies Piper Companies |
Today

Piper Companies is looking for a Sr. Full Stack Developer for a FInTech organization in 100% Remote Full Time position- no sponsorshipKey Job FunctionsDesign, write, test, debug, and maintain software applicationsApply software design principles, methods, and approaches to create

Piper Companies Piper Companies |
Yesterday

Piper Companies is seeking a Manager of Data Engineering for a growing technology driven organization. The Manager of Data Engineering role is a 100% remote role that can reside anywhere in the United States. The Manager of Data Engineering will be working with a team primarily b

Piper Companies Piper Companies |
Yesterday

Piper Companies is seeking a REMOTE Network SRE for a world leading technology organization. The REMOTE Network SRE will need to work east coast based hours and will have the opportunity work fully remote. The REMOTE Network SRE will have more networking responsibilities to begin

Piper Companies is seeking a REMOTE Full Stack Javascript Developer for an award winning software organization based in the Charlotte, North Carolina area. The REMOTE Full Stack Javascript Developer will join a growing team building out highly scalable and secure cloud native app

Piper Companies Piper Companies |
Yesterday

Piper Companies is seeking a Remote Sr. Java Developer for a growing software company. The Remote Sr. Java Developer can sit 100% remote and will be contributing towards greenfield development.Responsibilities for the Remote Sr. Java Developer include: Design, develop, and implem

Piper Companies Piper Companies |
2 d ago

Piper Companies is currently seeking a Senior UI Software Engineer for a contract to hire remote opportunity! As a Senior UI Software Engineer, you will be on the leading edge of UI product design and implementation. The Senior UI Software Engineer will have the opportunity to be

Piper Companies Piper Companies |
2 d ago

Piper Companies is looking for a SQL Developer for a leading financial lender located in Oaks, PA.This position is 100% remote.Essential Functions/Responsibilities: Can help in defining, documenting and developing software, software applications, as well as contributes to

Piper Companies Piper Companies |
2 d ago

Piper Companies is looking for a Data Analyst in Horsham, PA (100% remote) for a leading Mortgage solutions company.This position is 100% remote.Key responsibilities for the Data Analyst include:Analyze data, identify, and document PII in the databases.Writing complex SQL queries

Piper Companies Piper Companies |
2 d ago

Piper Enterprise Solutions is looking for an experienced and enthusiastic Technical Sourcer for an exciting, remote opportunity with one of the leading home furnishing companies in the nation. The Technical Recruiter role is tasked with designing, building, and executing strategi

Piper Companies Piper Companies |
|
2 d ago

Piper Companies is currently seeking a Lead Software Engineer for a remote fulltime opportunity for an international financial SaaS company. The Lead Software Engineer will participate in the creation and delivery of cloud-based software for web applications, build and integrate.

Piper Companies is seeking a Fully Remote Information Technology Manager to support a Debt Collection and Recovery Solutions provider. The IT Manager will report directly to the CEO and serve as the process owner for all corporate systems.Responsibilities of the Fully Remote Info

Piper Companies Piper Companies |
4 d ago

Piper Companies is currently seeking a Sr. Java Developer for a full-time, fully remote 12 month contract opportunity with the Federal Government . The Sr. Java Developer will partake in engineering and developing features of an existing platform. The incumbent can be based anywh

Piper Companies is currently seeking a Sr. Front End Engineer for a full-time opportunity with a leading Banking provider based in North Carolina (NC). The Sr. Front End Engineer will partake in engineering and developing features of an existing platform.*FULLY REMOTE* Responsibi

Piper Enterprise Solutions is searching for a Data Security Engineer for a financial services company. This is a 100% remote position.Responsibilities for the Data Security Engineer:Responsible for developing routines and creating reconciliation processes to assure data securityW

Piper Companies Piper Companies |
9 d ago

Piper Companies is looking for a Manager, Front-End Engineering who would like to join an industry leader in the financial services sector located in Philadelphia, PAThis is a Remote Opportunity!Responsibilities for the Manager, Front-End Engineering include:You will be responsib

Piper Enterprise Solutions is searching for Software Engineers for multiple positions with a client in the financial service industry. These are 100% remote positions.Responsibilities for the Software Engineers:Responsible for the design, deployment, testing and overall managemen

Piper Companies Piper Companies |
9 d ago

Piper Enterprise Solutions is searching for an QA Analyst for a financial services company. This is a 100% Remote position.Responsibilities for QA Analyst: Responsible for created and executing backend test plans, querying data, and testing backend data changes Responsible for bi

Piper Companies Piper Companies |
9 d ago

UX/UI Designer (remote position)My client, a financial services provider, is in need of a UX/UI Developer for a 6-month contract to potential hire opportunity. This project will include a new product launch. This role can sit 100% remote from home.Qualifications:3-5 years of expe

Piper Companies Piper Companies |
11 d ago

Piper Companies is looking for a Database Architect who would like to join an industry leader in the financial services sector located in Philadelphia, PAThis is a Remote Opportunity!Responsibilities for the Database Architect include:You will be responsible for providing leaders

Piper Companies Piper Companies |
11 d ago

Piper Companies is currently seeking a Python Developer for a new project supporting a federal client. This position will be 100% remote.Duties of the Python Developer:Designing and Developing new software systems to meet client requirements.Performing QA work on the code for pee

Piper Companies Piper Companies |
11 d ago

Piper Companies is currently seeking a React Software Engineer for a full time position with a Remote first, innovative and modern SaaS company based out of San Francisco, CA. The React Engineer will help support the main application. Responsibilities of the React Software Engine

Piper Companies Piper Companies |
13 d ago

Piper Companies is looking for a ColdFusion Developer for a Cloud Services company.Responsibilities for the .ColdFusion DeveloperMust have significant experience with ColdFusion, should also have Lucee (open source CFML-generator), ideally experience migrating ColdFusion to Lucee

Piper Companies Piper Companies |
13 d ago

Piper Companies is presently looking for a Technical Sourcing Specialist for a large commercial retail organization to represent their Software Engineering and Product Management departments. The Technical Sourcing Specialist will create Boolean searches to recruit candidates who

Piper Companies Piper Companies |
13 d ago

Piper Companies is seeking a 100% remote- Sr. Front End Software Engineer for an opportunity based in San Francisco, California! The Sr. Front End Software Engineer will be responsible for supporting and being a technical lead in an agile environment!Responsibilities of the Sr. F

Piper Companies is currently seeking a Senior Business Intelligence Analyst for a fully remote opportunity in the EST time zone. The BI Analyst will design and implement data reports and visualization, build dashboards for executive leadership, and collaborate with internal teams

Piper Companies Piper Companies |
14 d ago

Piper Companies is currently seeking a Senior Software Engineer for a 100% remote opportunity! As a Senior Software Engineer, you will utilize your extensive background in web development (C#, and ASP.NET) to contribute to a company culture where change is welcomed and there is c

Piper Companies Piper Companies |
16 d ago

Piper Companies is seeking a Remote Full Stack Developer for a well-known technology organization in the Raleigh-Durham, NC area. The Full Stack Developer will be responsible for developing and maintaining internal applications. The ideal candidate for the Full Stack Developer ro

Piper Companies Piper Companies |
16 d ago

Piper Companies has an opportunity for a Java Developer supporting our client who specializes in the development of advanced software solutions for customers across a broad range of industries, from Logistics, Maritime and Aviation to Metals and Manufacturing.Responsibilities for

Piper Companies is seeking a Remote Sr. Digital Applications Developer for a well-known technology organization in the Raleigh-Durham, NC area. The Sr. Digital Applications Developer will be responsible for designing and implementing web applications. The ideal candidate for the.