Principal Data Engineer (SQL Server, Azure)
Integrant, Egypt

• Design, develop, and maintain end to end data analytical solutions using Microsoft on-premises and cloud technologies.
• Engage in activities of requirement elicitation with our clientele.
• Mentor junior members on the team in data engineering.
• Deliver analytical solutions to clients and contribute in knowledge transfer.

Requirements

• 4 years of experience as a data engineer.
• Familiarity with analytical architectures including Data Warehouses, Data Lakes and Data Lakehouses.
• Knowledge of Microsoft relational engines available both on-premises (MS SQL Server) and on the cloud (Azure SQL, Azure Synapse Analytics Dedicated Pools).
• Knowledge of query and workload optimization.
• Knowledge of administrating and managing analytical solutions both on premises and on the cloud.
• Knowledge of NoSQL offerings on Azure (e.g. CosmosDB).
• Knowledge of setting up Data Lakes on ADLS gen 2 and Azure Synapse Analytics.
• Knowledge of using SSIS and Azure Data Factory to set up ETL jobs.
• Knowledge of setting up OLAP solutions using SSAS.
• Familiarity with Azure Data Catalog to manage data lake metadata.
• Familiarity with Azure HD Insight.
• Familiarity with the Hadoop ecosystems, including tools like Hive, Spark and Kafka.
• Familiarity with Azure Functions to perform lightweight transformations.
• Knowledge of governance over Azure based analytical solutions including using tools such as Purview, Active Directory, Key Vault, Azure DevOps, etc.
• Knowledge of using Azure Stream Analytics to capture and analyze data in real time.
• Knowledge of setting up data warehouse solutions both on-premises (using MS SQL Server) and on the cloud (using Azure Synapse Analytics).
• Knowledge of Dimensional Modeling (Dimensions, Facts, Slowly Changing Dimensions, Outriggers, Role Playing Dimensions, Junk Dimensions, Degenerate Dimensions, Multi-valued Dimensions, Transactional Facts, Periodic Snapshot Facts and Accumulating Snapshot Facts).
• Knowledge of implementing common ETL patterns to support data warehouse workloads.
• Knowledge of using U-SQL, PolyBase and Azure Data Lake Analytics to perform federated querying.
• Knowledge of PowerBI.
• Familiarity with SSRS.
• Strong knowledge of Python
• Nice to Have:
• An MSc in Computer Science or other relevant field.
• Familiarity with Azure Databricks.
• Familiarity with DataOps
• Familiarity with Machine Learning concepts and frameworks (Scikit-Learn,
• Keras, Tensorflow, HuggingFace, etc.)
• Familiarity with Azure Cognitive Services.
• Familiarity with Azure ML.
• Familiarity with MLOps.
• Familiarity of containerization tools and frameworks (Docker, Kubernetes,
• etc.)

Benefits

• Why Integrant?
• Competitive compensation package
• PTO, full medical and dental coverage, etc.
• Opportunity to travel and work onsite with U.S. customers
• In-house Technical and English training programs
• Dedicated learning time (check out our 4Plus1 Program) [link]
• Interest free loans
• Flexible work schedules
• Perks: events, sponsored lunch, game area, rooftop hangout + more!

Job Rewards and Benefits