Senior Big Data Engineer
Integrant, Egypt

Responsibilities

• Design, develop, and maintain end to end data solutions using open source, modern data lake, and enterprise data warehouse technologies (Hadoop, Spark, HBase, MapR, Cloudera)
• Contribute to multiple data solutions throughout their entire lifecycle (conception to launch)
• Partner with business stakeholders to understand and meet their data requirements
• Design, build, and maintain machine learning data pipelines
• Participate in an Agile development environment Cloud/AWS
• Collect, store, process, and support the analysis of huge sets of data, both structured and unstructured
• Choosing optimal solutions to use in big data use cases, then maintain, implement, monitor and integrate them with the data and IT architecture used across the company
• Build and teach the company about big data technologies, participate actively in the journey setup, from the discovery phase until the corporate data-centric transformation

Requirements

• Bachelor’s degree in Computer Science, Engineering, or Information Management (or equivalent)
• 5+ years of professional experience, preferred in development.
• 3+ years of building data pipelines experience or equivalent
• Professional experience optimizing machine learning workflows and maintaining data pipelines
• Hands-on experience with Cloudera and Hadoop is a must
• Experience with Spark , HBase , MapR and machine learning technologies is a plus
• Experience with object-oriented scripting languages: Python / Scala
• Experience with Eco-Systems Kafka, Impala and kudu is a must
• Advanced knowledge of SQL and experience with relational databases
• Experience with UNIX shell scripts and commands
• Experience with version control (Git / GitHub)
• Ability to clearly document operational procedures and solution designs
• Ability to communicate effectively (both verbal and written)
• Ability to work collaboratively in a team environment
• Ability to balance competing priorities and expectations.

Benefits

Why Integrant?

Competitive compensation package

PTO, full medical and dental coverage, etc.

Opportunity to travel and work onsite with U.S. customers

In-house Technical and English training programs

Dedicated learning time (check out our 4Plus1 Program) [link]

Interest free loans

Flexible work schedules

Perks: events, sponsored lunch, game area, rooftop hangout + more!

Job Rewards and Benefits