126 Big Data Hadoop jobs in Egypt

We go beyond the obvious, using intelligence, passion and creativity to inspire new thinking and shape the world we live in.

To start a career that is out of the ordinary, please apply.

Job Details

Data Processing Specialist. Sk40

Kantar

Cairo, Egypt

Kantar is the world's leading data, insights, and consulting company. We understand more about how people think, feel, shop, share, vote and view than anyone else. Combining our expertise in human understanding with advanced technologies. Kantar's 30,000 people based in more than 100 countries help the world's leading organizations succeed and grow.

Nobody knows people better than Kantar. We provide insight and inspiration to help our clients, our people and society to create and flourish in an extraordinary world. Our insights colleagues are experts in human understanding. With expertise covering brand, innovation, creative, media, commerce, and customer experience, they help clients define what brands should stand for, how to disrupt and renew their offer, how to connect with audiences and how to win with consumers and customers.

About the role

Kantar is looking for a highly competent and technical individual with excellent communication skills.

Responsible for programming the various utilities/scripts using platforms/tools in the company to collect, analyse, and visualize the data which provides insights and inspiration to help our clients across 100 countries flourish.

This person should be able to rapidly learn new technologies either through self-learning, mentorship, or training. This individual is required to support, execute, and document all assigned projects

Technical skills:

College Graduate, preferably Computer-related courses such as Computer Management, Computer Engineering, Computer Science, Information Technology, etc.

• Other preferred courses are Statistics, Mathematics, Engineering and the like.
• Strong knowledge in Programming
• Exposure to SPSS or other statistical software is an advantage.
• 0-2 years of background in programming

Mandatory

• Experience and knowledge of using MS Office

Optional

• Proficient knowledge in Quantum/SPSS/Dimensions Software
• Script Writing (Platforms: IOM & NField)
• Exporting and working on different Data Format (ex: SPSS, ASCII datamap .)
• Awareness of SQL and relational databases
• SQL and some database knowledge MS Access, linking databases for DP purpose
• Python and R

Soft Skills and Behaviours:

• Problem Solving and Critical Thinking
• Good written and verbal communication skills
• Makes good decisions based upon a mixture of analysis, wisdom, experience and judgment
• Developing good working relationships with Key Stakeholders
• Flexibility to adjust to the changing work environment and needs to the team
• Positive attitude. Should be able to take feedback positively and work on them to improve
• Can be counted on to exceed goals successfully
• Ability to manage own time and workload effectively
• Able to work in a global cross cultural matrix environment. Knowledgeable of other regions and considerate of different cultural norms/appropriate business conduct.
• Project management skills
• Understanding of end-to-end research needs
• Client focus and ability to work directly with clients, strong consultancy skill
• Ability to self learn new tools and technologies
• Eye to detail
• Collaborates to deliver the best outcome. Is seen as team player and cooperative
• Ability to make decisions based upon wisdom, experience and judgment
• Should be able to think effectively from analysis, to solution, to action

Kantar is an Equal Opportunities Provider

Why join Kantar?

We go beyond the obvious, using intelligence, passion and creativity to inspire new thinking and shape the world we live in. We understand more about how people think, feel, shop, share, vote and view than anyone else. Combining our expertise in human understanding with advanced technologies, nobody knows people better than Kantar.

And because we know people, we like to make sure our people are looked after as well. Equality of opportunity for our people are our highest priority, and we encourage our people to work in a way that supports their health and wellbeing. While we encourage our colleagues to spend part of their working week in the office, we understand no one size fits all, and we're flexible in our approach to ensure people feel included and accepted.

We're committed to creating an inclusive culture and value the diversity of our people, clients, suppliers and communities, which is why we welcome applications from all background and sections of society. Even if you feel like you're not a perfect fit, we'd love to receive your application and talk to you about this job or others at Kantar.

Interested?

Send us your application (including CV) today

Kantar is an equal opportunities provider

Location

Cairo, 4 Noor El Deen Bahgat St - Secondary OfficeEgypt

Kantar Rewards Statement

At Kantar we have an integrated way of rewarding our people based around a simple, clear and consistent set of principles. Our approach helps to ensure we are market competitive and also to support a pay for performance culture, where your reward and career progression opportunities are linked to what you deliver.

We go beyond the obvious, using intelligence, passion and creativity to inspire new thinking and shape the world we live in. Apply for a career that's out of the ordinary and join us.

We want to create an equality of opportunity in a fair and supportive working environment where people feel included, accepted and are allowed to flourish in a space where their mental health and well being is taken into consideration.

We want to create a more diverse community to expand our talent pool, be locally representative, drive diversity of thinking and better commercial outcomes.

Kantar is the world's leading data, insights and consulting company. We understand more about how people think, feel, shop, share, vote and view than anyone else. Combining our expertise in human understanding with advanced technologies, Kantar's 30,000 people help the world's leading organisations succeed and grow.

Envision Employment Solutions
is currently looking for a
Data Engineer
for one of our partners, a global leader in consulting, digital transformation, technology and engineering services.

This position requires flexibility to work on US times and flexibility to travel abroad when needed.

Responsibilities:

Cloud Solutions:

• Develop, deploy, and manage cloud-based applications and solutions using cloud services.
• Optimize cloud infrastructure for performance, scalability, and cost-effectiveness.

Data Management:

• Ensure data quality and consistency through data cleaning, transformation, and validation processes.
• Perform complex data analysis and preprocessing on large datasets.
• Design and implement scalable and robust data pipelines to support analytics and data processing needs.
• Build data products
• Write optimized SQL queries for data retrieval, manipulation, and reporting.

CI/CD Pipeline Management:

• Design and implement CI/CD pipelines to automate application builds, testing, and deployment.
• Maintain and improve existing pipelines for efficiency and reliability.

Requirements:

• 4 to 6 years of experience in deploying machine learning models in production environments
• Hands-on experience with large datasets and data preprocessing.
• Proficiency in Python: Extensive experience in building and maintaining scalable, efficient applications.
• Proficiency in SQL: Strong knowledge of SQL for data manipulation and querying.
• Solid, in-depth knowledge of cloud services (Azure, AWS, GCP), with hands-on experience in developing, deploying, and managing applications.
• Experience with AI and machine learning frameworks and tools.
• Experience using Git for version control in collaborative development environments.
• Experience in integrating and managing CI/CD pipelines.
• Excellent written and verbal communication skills to collaborate effectively with cross-functional teams.
• Fluent in Qatari Arabic & English, both spoken and written.

Responsibilities

• Develop, maintain, and optimize data pipelines for efficient data processing.
• Design and implement scalable data architectures.
• Ensure data integrity, quality, and security across various sources.
• Collaborate with data scientists, and to support business needs.
• Perform data cleansing, transformation, and integration from multiple sources.
• Monitor and troubleshoot data-related issues and optimize performance.
• Work with cloud-based and on-premises data storage solutions.
• Implement data governance policies and best practices.

Qualifications

• Strong proficiency in SQL and database management.
• Experience with ETL (Extract, Transform, Load) processes.
• Knowledge of programming languages like Python, Java, or Scala.
• Familiarity with cloud platforms (AWS, Azure, Google Cloud).
• Understanding of big data technologies (Hadoop, Spark).
• Strong analytical and problem-solving skills.
• Experience with data warehousing and data modeling.

Standort
Cairo, EG

Stellen-ID
: 5268

At the earliest date possible we are looking for support for our #teamsonnen

Clean and affordable energy for all is one of the greatest challenges of our time. Sonnen has been committed to this mission since 2010 and is now represented in Europe, the USA and Australia with over 1,000 team members globally. In Germany, our offices are located in the beautiful Wildpoldsried (Allgäu) and the vibrating heart of Berlin Kreuzberg.

At sonnen, we are building the energy system of the future. To this end, we are developing new technologies and business models that have not existed before. Whether intelligent power storage, virtual power plants or digital services - we set the trends of a new energy world. That means, among other things, the inexpensive production and storage of renewable energy and the intelligent networking of producers and consumers. sonnen thereby gives people around the world the opportunity to become independent of fossil fuels and conventional energy supplier.

We are growing steadily and are looking for people who want to join us in our vision of clean and affordable energy for all while making a positive impact on climate change.

We are seeking for a Data Engineer who will empower sonnen's business with data-driven insights, services and products with the help of sonnen's AWS-based analytics platform and by provisioning data from various sources from within and outside the company.

We're looking for someone who shares our values, who isn't afraid to challenge existing processes, and who would like to work on innovative solutions in a fast-moving environment. If this sounds like you, then don't hesitate to get in touch.

What you will do to help drive the energy transition:

• You develop and maintain data analysis processes with a variety of structured and unstructured data sources.
• You implement, test, and maintain infrastructural components of sonnen's analytics platform and deploy and maintain data models.
• You implement data quality checks and monitoring mechanisms to ensure accuracy, completeness, and consistency of data.
• You collaborate with the business SMEs and stakeholders to understand their data requirements and support their analysis and modeling needs.
• You adhere to stringent quality assurance and documentation standards using version control and code repositories (e.g., Gitlab).
• You stay up-to-date with emerging trends and technologies in data engineering, and assess their potential applications to our business needs.

What You Will Need On That Journey

• You hold a bachelor's degree in Computer Science or a related technical field
• You have 3+ years of relevant employment experience (Data Scientist, Engineer or Architect)
• You have experience with data architecture and warehousing solutions (e.g. AWS Redshift, Databricks)
• You continue to enhance the existing platform, creating the technical foundation for scalable processes. Both data and result quality are important to you.
• You have good knowledge of Python, Pandas, SQL, NoSQL, RestAPI
• You are fluent in English. German is a plus.

Stellensegment:
Computer Science, Quality Assurance, SQL, Database, Technology

Standort
Cairo, EG

Stellen-ID
: 4758

At the earliest date possible we are looking for support for our #teamsonnen

Clean and affordable energy for all is one of the greatest challenges of our time. Sonnen has been committed to this mission since 2010 and is now represented in Europe, the USA and Australia with over 1,000 team members globally. In Germany, our offices are located in the beautiful Wildpoldsried (Allgäu) and the vibrating heart of Berlin Kreuzberg.

At sonnen, we are building the energy system of the future. To this end, we are developing new technologies and business models that have not existed before. Whether intelligent power storage, virtual power plants or digital services - we set the trends of a new energy world. That means, among other things, the inexpensive production and storage of renewable energy and the intelligent networking of producers and consumers. sonnen thereby gives people around the world the opportunity to become independent of fossil fuels and conventional energy supplier.

We are growing steadily and are looking for people who want to join us in our vision of clean and affordable energy for all while making a positive impact on climate change.

We are seeking a Data Engineer (m/f/d) to join our team and play a pivotal role in enabling our Business Intelligence and Data Science teams. As a Data Engineer, you will be responsible for maintaining and enhancing our AWS-based analytics platform, provisioning data from various sources, and enabling the development and stable operation of analytical solutions. We're looking for someone who shares our values, who isn't afraid to challenge existing processes, and who would like to work on innovative solutions in a fast-moving environment. If this sounds like you, then don't hesitate to get in touch.

What you will do to help drive the energy transition:

• (Senior) Define and design the architecture of our analytics platform, ensuring scalability, performance, and reliability.
• You design and build scalable data pipelines, ETL processes, and data lake and data warehousing solutions to support our analytics solutions.
• You develop and maintain data integration processes with a variety of structured and unstructured data sources.
• You implement, test, and maintain infrastructural components of sonnen's analytics platform and deploy and maintain data models.
• You implement data quality checks and monitoring mechanisms to ensure accuracy, completeness, and consistency of data.
• You define coding principles and support data scientists and analysts in implementing algorithms into operational solutions.
• Adhere to stringent quality assurance and documentation standards, utilizing version control and code repositories such as Gitlab.
• You stay up to date with emerging trends and technologies in data engineering and assess their potential applications to our business needs.
• (Senior) Share your knowledge by coaching/pair coding with more junior engineers.

What You Will Need On That Journey

• Bachelor's degree in computer science or a related technical field.
• +3 years of relevant employment experience in roles such as Data Scientist, Data Engineer, or Data Architect.
• +3 years of experience with ETL tools, Data Modeling, and Data Architecture.
• Experience with Big Data technologies such as Hadoop, Hive, and Spark.
• Ability to translate organizational goals into technical solutions.
• Experience with Infrastructure as Code (experience in Terraform and Ansible are a plus).
• Proficiency in Python, SQL, and NoSQL.
• Excellent communication and project management skills.

Stellensegment:
Computer Science, Database, Quality Assurance, Data Warehouse, Business Intelligence, Technology

JOB OBJECTIVE
As a Data Engineer at blnk, you will be responsible for building and maintaining data pipelines, ensuring the availability and quality of data that supports business decision-making and product development. You will work closely with data analysts, scientists, and engineers to collect, clean, and transform data into usable formats. Your role will involve developing ETL processes, managing databases, and supporting analytics initiatives to help the company become more data driven.

KEY ACCOUNTABILITIES (Including But Not Limited To)

• Build, maintain, and optimize ETL processes and data pipelines.
• Support data modeling and database design to enable efficient reporting and analysis.
• Collaborate with analysts and data scientists to provide clean and well-structured datasets.
• Ensure data quality and consistency across different systems and sources.
• Monitor and troubleshoot data workflows to ensure reliability.
• Integrate data from multiple sources into centralized platforms.
• Document processes and data flows for transparency and reusability.
• Stay updated with modern data tools and suggest improvements where relevant.
• Collaborate with product and engineering teams to ensure data solutions meet business needs.

Education
QUALIFICATIONS, EXPERIENCE, SKiLLs
Bachelor's degree in computer science, Information Systems, or a related technical field.

Experience

• 1-2 years of relevant experience in data
• engineering or software engineering with data exposure.
• Solid understanding of SQL and relational databases.
• Experience with ETL tools or frameworks.
• Basic knowledge of cloud platforms (AWS, GCP, or Azure).
• Familiarity with Python or another programming language used in data processing.
• Understanding of data modeling and warehousing concepts.
• Strong problem-solving and analytical skills.
• Good communication and teamwork abilities.
• Eagerness to learn new tools and technologies.
• Strong analytical and problem-solving skills.
• Excellent written and verbal communication abilities.
• Ability to work effectively in a collaborative, fast-paced environment.
• Eagerness to learn and adapt to new technologies.

Why Join

• Technology-Driven Scale: is a tech-driven company that employs 140+ Business Analysts and 100+ software engineers working in AI and tech from 8+ countries.
• Fast Growth Path: A high-performance culture where impact is rewarded and growth is fast-tracked. 20% of our team members move into management within one year; one team member became CEO in just five years.
• Hub for Talent: Techies from Microsoft, Meta, Alshaya, Gymshark, Murex, and CMA CGM have joined us. We're also proud to have graduates from AUB, LAU, AUC, and CU powering our operations.
• Market Leader: With 26,000+ employees, we're the The UAE's #1 domestic worker provider and the second-largest employer in the country.

Join our AI‐driven company to build and scale a data infrastructure that powers every

decision.

What You'll Do

• Design and build the core data infrastructure. Develop and own data models and pipelines on Snowflake; create robust architectures that collect, store and process data to support analysis and decision‐making.
• Ensure data quality and governance. Implement data quality monitoring systems and anomaly detection to validate source‐to‐target transformations.
• Manage ingestion and transformation. Automate ingestion from APIs and internal systems, manage DBT projects, and orchestrate incremental pipelines.
• Collaborate across the business. Partner with security, product and enterprise teams to align on data governance requirements and use data to inform product decisions.
• Build analytics tools. Produce dashboards and internal tools that allow leadership to monitor performance and availability.
• Solve complex problems. Think creatively to find optimal solutions to unstructured data challenges.

What We're Looking For

• 0–3 years' experience designing and building large‐scale data pipelines in cloud environments.
• Proficiency SQL and Python; Experience integrating data across multiple systems, SnowFlake, and Dbt is a plus.
• Understanding of data products and how to support data science and machine‐learning initiatives.
• Strong communication and documentation skills; ability to translate business problems into technical solutions.
• BS/MS in Computer Science, Engineering or a related field.

What You'll Get

• Competitive salary and performance‐driven rewards.
• Hands‐on experience with AI, automation and real‐world business systems.
• A culture where high performance is recognized and career growth is accelerated.

Responsibilities (Functionalities And Activities)

• Data Engineering & Quality Develop and maintain ELT/ETL pipelines and SQL models, ensuring accurate data lineage and validation.
• Labeling & Feature Management Design labeling strategies and manage a structured feature catalog to support model development.
• Modeling & Experimentation Train and evaluate machine learning models, conduct A/B testing, and assess build-versus-buy decisions.
• Deployment & Integration Deploy models as services or APIs and integrate them into applications, low-code workflows, and chat systems.
• Monitoring & Lifecycle Management Monitor model performance (drift, latency, cost), schedule retraining, and manage rollbacks when necessary.

Qualifications

• 1-3 yrs building & deploying ML models in Python (sklearn, TensorFlow or PyTorch)
• Solid SQL & data-pipelines (ETL, Airflow or similar)
• Familiar with cloud services (GCP preferred; AWS/Azure fine)
• Basic REST API design & consumption.
• Hands-on with at least one of: fraud analytics, recommender systems, conversational AI
• Experience with low-/no-code automation (Google AppSheet, Power Automate, Zapier, etc.)
• Strong stakeholder communication.
• Able to balance quick wins with scalable architectures.
• B.Sc. or higher in Data Science, CS, Engineering, Statistics, or related.

Preferred

• Exposure to WhatsApp Business Cloud API, Twilio, or similar messaging platforms.
• Real-time data streaming (Kafka, Pub/Sub, Kinesis)
• MLOps tooling (Docker, Kubernetes, Kubeflow, MLflow)
• Experience with feature stores & vector databases for personalization.
• Arabic & English fluency.