24 Big Data jobs in Egypt

**Position:**
Data Engineer
**Job Description:**
**ESSENTIAL DUTIES & RESPONSIBILITIES**
+ Apply the knowledge of engineering on electronic products to develop the newly introduced parts with technical parameters in different areas daily.
+ Apply the knowledge of engineering in different data development stages, including but not limited to Part number decoding, Electrical/ performance characteristics, compliance, and Lifecycle data collection.
+ Apply the knowledge of engineering on electronic products to track updates in technical Documents revisions and identify the high technical changes to update on the Database.
+ Develop Customer requests after handling them to enter in the Database.
+ Apply a checklist to keep and maintain our data with high quality.
**SKILLS & EXPERIENCE REQUIREMENTS:**
+ Bachelor's degree in Electrical or Electronics Engineering.
+ 0 to 1 year of relevant experience.
+ Familiarity with electronic components and systems.
+ Strong English language skills (written, read, and spoken).
+ Good knowledge of at least one programming language (Python or Java).
+ Proficient in data analysis using Excel, Power BI, or Python.
+ Ability to write code and scripts to automate data processes using languages such as Python, Java, or Scala.
+ Commitment to continuously optimizing data processes for improved efficiency and scalability.
+ Experience in implementing data quality checks and monitoring systems to proactively detect and resolve issues.
+ Proven experience working on projects utilizing technologies such as Python, Power BI, or related tools.
**Location:**
EG-Banha, Egypt (EI Corniche Street)
**Time Type:**
Full time
**Job Category:**
Engineering and Technology
Arrow Electronics, Inc.'s policy is to provide equal employment opportunities to all qualified employees and applicants without regard to race, color, religion, age, sex, marital status, gender identity or expression, sexual orientation, national origin, disability, citizenship, veran status, genetic information, or any other characteristics protected by applicable state, federal or local laws. Our policy of equal employment opportunity and affirmative action applies to all employment decisions personnel policies and practices, or programs.

We're an online doctor service and currently one of the largest digital healthcare players in Europe offering fast, convenient and reliable access to medical advice, testing and treatment. Since 2011 we've provided over 6 million paid consultations to patients across Germany, France, UK and Ireland but we're on a mission to do so much more! We want to break down barriers to health and provide accessible, dependable healthcare to even more patients. That means finding smart, curious people to help us significantly expand our services and patient offering as well as exploring how to support statutory healthcare systems.

**About the role**

We're looking for a Data Engineer to help us take our systems to the next level with a focus on data ingestion and processing. This is an exciting chance to join a growing data team consisting of engineers and analysts as we move from solving everyday business intelligence questions to more advanced analytics on a varied and fast-growing dataset.

**What can you expect from working with us?**
- **Knowledge Sharing -** We're learning all the time (mostly from each other) because we don't work in silos. We talk, teach and ask questions - sharing knowledge so that we can all develop new skills.
- **Make an impact -** Leading a collaborative problem-solving process to define meaningful, relevant and easily understood KPIs around product performance, you will see the impact of your insights and the overall value to the business.
- **Trust and autonomy - **You'll have the freedom to manage your own schedule and will be trusted to run projects from end-to-end.
- **Competitive salary, flexible working and other benefits -** aside from salary we offer a company-wide bonus scheme, training budget, 10% R&D and learning time and flexible working (working pattern can be discussed).

**Key accountabilities**
- prepare data pipelines for scale
- ensure accuracy and integrity of data
- working in a cloud based environment (we use AWS)
- database performance improvements and optimisation
- identify existing bottlenecks and potential areas for improvement in our current data architecture
- work alongside our senior data engineer to introduce new cutting edge technologies
- assist with the implementation of new data storage methods (such as data lakes)
- develop Python scripts to perform complex transformations and aggregations to enable analysts to surface valuable insights

**Requirements**:

- Python/SQL knowledge (1-2 years experience minimum of both)
- Track record of working with ETL pipelines (both transactional and event-driven) and data warehouses (preferably Redshift)
- Experience delivering data engineering projects end-to-end (from design through to implementation)
- Data Lake experience
- Cloud architecture (preferably AWS)
- Previous experience working with CI/CD (preferably with Jenkins)
- Version control (git) and test-driven development

**Benefits**:

- 33 days holiday (inc bank holidays) + Birthday day off
- £500 training budget per year
- Healthcare cash plan
- Company sabbatical after 2 years
- Remote flexible working
- Macbook pro
- Office Food & drinks
- Dog-friendly office

Company Description

Visa is a world leader in digital payments, facilitating more than 215 billion payments transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable and secure payments network, enabling individuals, businesses and economies to thrive.

When you join Visa, you join a culture of purpose and belonging - where your growth is priority, your identity is embraced, and the work you do matters. We believe that economies that include everyone everywhere, uplift everyone everywhere. Your work will have a direct impact on billions of people around the world - helping unlock financial access to enable the future of money movement.

**Join Visa: A Network Working for Everyone.**

**Job Description**:
We are looking for an individual contributor with deep expertise in building large-scale data processing systems by using the latest database and data processing technologies. This position plays a critical role in enabling the foundations through which Data Scientists, Analysts, and BI Users drive solutions for our Visa clients. The Data Engineer takes responsibility for building and running data pipelines, designing local data frameworks, and catering for different data presentation techniques in order to enable scalable Solution development for the CEMEA region.

The Global Data Science team is the engine of analytics at Visa, this is a high-performing team of data scientists, data analysts, statisticians, and business analysts from a variety of countries - serving the Asia Pacific, Central Europe, Middle East and Africa geographies.

As a Data Engineer you will be responsible for designing, developing and delivering data solutions through best in class architected solutions to enable the development of the Visa Portfolio Health Check. This is an individual contributor role and currently has no line management responsibility.

Principal Responsibilities
- Create and maintain optimal data pipelines based on our Global Technology Stack
- Contribute to the technical design, architecture and development of data artifacts to support building new scalable solutions for our clients
- Continuous improvement and maintenance of existing pipelines based on business need and changes in our technology landscape
- Integration of analytical solution output with downstream corporate systems to facilitate delivery and consumption
- Executing medium to large analytic projects along with rest of the stakeholders in the Visa data science team and Client team

Leadership Competencies
- Exhibits intellectual curiosity and a desire for continuous learning
- Demonstrates integrity, maturity and a constructive approach to business challenges
- Role model for the organization and implementing core Visa Values
- Respect for the Individuals at all levels in the workplace
- Strive for Excellence and extraordinary results
- Use sound insights and judgments to make informed decisions in line with business strategy and needs
- Leadership skills include an ability to allocate tasks and resources across multiple lines of businesses and geographies. Leadership extends to ability to influence senior management within and outside Analytics groups
- Ability to successfully persuade/influence internal stakeholders for building best-in-class solutions

**Qualifications**:
Professional Experience
- Experience creating production software/systems in Python and/or Scala, and a proven track record of identifying and resolving performance bottlenecks for production systems.
- Experience with complex, high volume, multi-dimensional data.
- Good understanding of the Payments and Banking Industry including aspects such as consumer credit, consumer debit, prepaid, small business, commercial, co-branded and merchant
- Demonstrated ability to incorporate new techniques to solve business problems

Technical Expertise
- Qualification in Computer Science or Engineering ideal.
- Certification in Hadoop (Cloudera or Hortonworks) and Apache Spark ideal.
- Experience in developing production systems, with software engineering governance practices in place e.g, Object orientation, functional programming, unit testing frameworks, CI/CD and job scheduling technologies
- Data acquisition and provisioning through various modes and channels, e.g., Batch, real-time, event-driven architecture, APIs, etc.
- Working knowledge of Hadoop ecosystem and associated technologies, e.g., Hadoop, Hive, Apache Spark, Kubernetes, Kafka, etc.
- Advanced experience in writing and optimizing efficient SQL queries and scripts, Scala experience is ideal
- Excellent communication skills in both spoken and written English (upper intermediate plus)

Business Experience
- Results-oriented with strong problem solving skills and demonstrated intellectual and analytical rigor
- Good business acumen with a track record i

Company Description

Visa is a world leader in digital payments, facilitating more than 215 billion payments transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable and secure payments network, enabling individuals, businesses and economies to thrive.

When you join Visa, you join a culture of purpose and belonging - where your growth is priority, your identity is embraced, and the work you do matters. We believe that economies that include everyone everywhere, uplift everyone everywhere. Your work will have a direct impact on billions of people around the world - helping unlock financial access to enable the future of money movement.

**Join Visa: A Network Working for Everyone.**

**Job Description**:
We are looking for an individual contributor with deep expertise in building large-scale data processing systems by using the latest database and data processing technologies. This position plays a critical role in enabling the foundations through which Data Scientists, Analysts, and BI Users drive solutions for our Visa clients. The Data Engineer takes responsibility for building and running data pipelines, designing local data frameworks, and catering for different data presentation techniques in order to enable scalable Solution development for the CEMEA region.

The Global Data Science team is the engine of analytics at Visa, this is a high-performing team of data scientists, data analysts, statisticians, and business analysts from a variety of countries - serving the Asia Pacific, Central Europe, Middle East and Africa geographies.

As a Data Engineer you will be responsible for designing, developing and delivering data solutions through best in class architected solutions to enable the development of the Visa Portfolio Health Check. This is an individual contributor role and currently has no line management responsibility.

Principal Responsibilities
- Create and maintain optimal data pipelines based on our Global Technology Stack
- Contribute to the technical design, architecture and development of data artifacts to support building new scalable solutions for our clients
- Continuous improvement and maintenance of existing pipelines based on business need and changes in our technology landscape
- Integration of analytical solution output with downstream corporate systems to facilitate delivery and consumption
- Executing medium to large analytic projects along with rest of the stakeholders in the Visa data science team and Client team

Leadership Competencies
- Exhibits intellectual curiosity and a desire for continuous learning
- Demonstrates integrity, maturity and a constructive approach to business challenges
- Role model for the organization and implementing core Visa Values
- Respect for the Individuals at all levels in the workplace
- Strive for Excellence and extraordinary results
- Use sound insights and judgments to make informed decisions in line with business strategy and needs
- Leadership skills include an ability to allocate tasks and resources across multiple lines of businesses and geographies. Leadership extends to ability to influence senior management within and outside Analytics groups
- Ability to successfully persuade/influence internal stakeholders for building best-in-class solutions

**Qualifications**:
Professional Experience
- Experience creating production software/systems in Python and/or Scala, and a proven track record of identifying and resolving performance bottlenecks for production systems.
- Experience with complex, high volume, multi-dimensional data.
- Good understanding of the Payments and Banking Industry including aspects such as consumer credit, consumer debit, prepaid, small business, commercial, co-branded and merchant
- Demonstrated ability to incorporate new techniques to solve business problems

Technical Expertise
- Qualification in Computer Science or Engineering ideal.
- Certification in Hadoop (Cloudera or Hortonworks) and Apache Spark ideal.
- Experience in developing production systems, with software engineering governance practices in place e.g, Object orientation, functional programming, unit testing frameworks, CI/CD and job scheduling technologies
- Data acquisition and provisioning through various modes and channels, e.g., Batch, real-time, event-driven architecture, APIs, etc.
- Working knowledge of Hadoop ecosystem and associated technologies, e.g., Hadoop, Hive, Apache Spark, Kubernetes, Kafka, etc.
- Advanced experience in writing and optimizing efficient SQL queries and scripts, Scala experience is ideal
- Excellent communication skills in both spoken and written English (upper intermediate plus)

Business Experience
- Results-oriented with strong problem solving skills and demonstrated intellectual and analytical rigor
- Good business acumen with a track record i

Our Client is the largest digital classifieds and marketplace in Sudan.

We need a self-driven leader who can execute quickly in a startup environment. You will have freedom and responsibility as the first person in that role. Your work will help us make better business decisions thanks to your insights visualized using dashboards. You will collaborate enthusiastically with diverse teams and stakeholders.

Key responsibilities:

- Analyze data and produce reports for different stakeholders, including the CEO, Board of

Directors, Finance, and Engineering.
- Find insights and correlations in the data to drive better business decisions.
- Own data processes, ensuring the quality and accuracy of data, and troubleshooting and

solving problems as needed.
- Build dashboards to track key performance indicators (KPIs) of the business.
- Optimize queries, data structures, and the data pipeline.

Key responsibilities:

- Analyze the data and be able to produce reports for different stakeholders CEO, Board

of Directors, Finance and Engineering.
- Find insights and correlation in the data to drive better business decisions.
- Be the owner of data processes. Ensure the quality and accuracy of data. Troubleshoot

and solve problems.
- Build dashboards to track Key Performance Indicators of the business.
- Optimize the queries, data structures and the data pipeline.

**Requirements**:
Key responsibilities:

- Analyze data and produce reports for different stakeholders, including the CEO, Board of

Directors, Finance, and Engineering.
- Find insights and correlations in the data to drive better business decisions.
- Own data processes, ensuring the quality and accuracy of data, and troubleshooting and

solving problems as needed.
- Build dashboards to track key performance indicators (KPIs) of the business.
- Optimize queries, data structures, and the data pipeline.

Key responsibilities:

- Analyze the data and be able to produce reports for different stakeholders CEO, Board

of Directors, Finance and Engineering.
- Find insights and correlation in the data to drive better business decisions.
- Be the owner of data processes. Ensure the quality and accuracy of data. Troubleshoot

and solve problems.
- Build dashboards to track Key Performance Indicators of the business.
- Optimize the queries, data structures and the data pipeline.

**Introduction**
In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe.
You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio; including Software and Red Hat.
Curiosity and a constant quest for knowledge serve as the foundation to success in IBM Consulting. In your role, you'll be encouraged to challenge the norm, investigate ideas outside of your role, and come up with creative solutions resulting in ground breaking impact for a wide network of clients. Our culture of evolution and empathy centers on long-term career growth and development opportunities in an environment that embraces your unique skills and experience.
**Your role and responsibilities**
Designs and builds solutions to move data from operational and external environments to the business intelligence, data warehouse and data lake environments using Snowflake and Azure/Fabirc, DBT and BW. Skills include designing and developing extract, transform and load (ETL) and extract, load and transform (ELT) pipelines. Experience includes full lifecycle implementation of the technical components of a data warehouse, data lake and business intelligence solutions.
Position Keywords
#snowflake #dbt #azure #python #sql #modeling
**Required technical and professional expertise**
* 5-7 years of full-time working experience in Data Engineering domain.
* Expertise in Snowflake, Azure/Fabric, DBT, BW, Python, SQL and must have excellent understanding of databases.
* Must have experience with Cloud data integration.
* Good knowledge of Data Modeling, industrial modeling, Analytic model, data architecture, dimensional modeling, 3rd normal form model, Kimball model, Inmon model, Data Integration and Business Intelligence.
* Demonstrated ability in solutioning covering data ingestion, data cleansing, ETL, data mart creation and exposing data for consumers.
**Preferred technical and professional experience**
* SnowPro Advanced: Data Engineer Certification.
* Microsoft Certified: Fabric Data Engineer Associate Certification.
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

**Introduction**
In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe.
You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio; including Software and Red Hat.
Curiosity and a constant quest for knowledge serve as the foundation to success in IBM Consulting. In your role, you'll be encouraged to challenge the norm, investigate ideas outside of your role, and come up with creative solutions resulting in ground breaking impact for a wide network of clients. Our culture of evolution and empathy centers on long-term career growth and development opportunities in an environment that embraces your unique skills and experience.
**Your role and responsibilities**
Designs and builds solutions to move data from operational and external environments to the business intelligence, data warehouse and data lake environments using Snowflake and Azure/Fabirc, DBT and BW. Skills include designing and developing extract, transform and load (ETL) and extract, load and transform (ELT) pipelines. Experience includes full lifecycle implementation of the technical components of a data warehouse, data lake and business intelligence solutions.
Position Keywords
#snowflake #dbt #azure #python #sql #modeling
**Required technical and professional expertise**
* 5-7 years of full-time working experience in Data Engineering domain.
* Expertise in Snowflake, Azure/Fabric, DBT, BW, Python, SQL and must have excellent understanding of databases.
* Must have experience with Cloud data integration.
* Good knowledge of Data Modeling, industrial modeling, Analytic model, data architecture, dimensional modeling, 3rd normal form model, Kimball model, Inmon model, Data Integration and Business Intelligence.
* Demonstrated ability in solutioning covering data ingestion, data cleansing, ETL, data mart creation and exposing data for consumers.
**Preferred technical and professional experience**
* SnowPro Advanced: Data Engineer Certification.
* Microsoft Certified: Fabric Data Engineer Associate Certification.
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

**Introduction**
At IBM, work is more than a job - it's a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you've never thought possible. Are you ready to lead in this new era of technology and solve some of the world's most challenging problems? If so, lets talk.

**Your Role and Responsibilities**
Designs and builds solutions to move data from operational and external environments to the business intelligence environment using Informatica, Ab Initio software and DataStage (formerly Ascential) - IBM's WebSphere Data Integration Suite. Skills include designing and developing extract, transform and load (ETL) processes. Experience includes full lifecycle implementation of the technical components of a business intelligence solution.

**Required Technical and Professional Expertise**
4-7 Years of experience

**Preferred Technical and Professional Expertise**
NA

**About Business Unit**

IBM Consulting is IBM’s consulting and global professional services business, with market leading capabilities in business and technology transformation. With deep expertise in many industries, we offer strategy, experience, technology, and operations services to many of the most innovative and valuable companies in the world. Our people are focused on accelerating our clients’ businesses through the power of collaboration. We believe in the power of technology responsibly used to help people, partners and the planet.

In a world where technology never stands still, we understand that, dedication to our clients success, innovation that matters, and trust and personal responsibility in all our relationships, lives in what we do as IBMers as we strive to be the catalyst that makes the world work better.
Being an IBMer means you’ll be able to learn and develop yourself and your career, you’ll be encouraged to be courageous and experiment everyday, all whilst having continuous trust and support in an environment where everyone can thrive whatever their personal or professional background.

Our IBMers are growth minded, always staying curious, open to feedback and learning new information and skills to constantly transform themselves and our company. They are trusted to provide on-going feedback to help other IBMers grow, as well as collaborate with colleagues keeping in mind a team focused approach to include different perspectives to drive exceptional outcomes for our customers. The courage our IBMers have to make critical decisions everyday is essential to IBM becoming the catalyst for progress, always embracing challenges with resources they have to hand, a can-do attitude and always striving for an outcome focused approach within everything that they do.

Are you ready to be an IBMer?

This job requires you to provide your COVID-19 vaccination status with supporting documentation, where legally permissible.

**About IBM**

Restlessly reinventing since 1911, we are not only one of the largest corporate organizations in the world, we’re also one of the biggest technology and consulting employers, with many of the Fortune 50 companies relying on the IBM Cloud to run their business.

At IBM, we pride ourselves on being an early adopter of artificial intelligence, quantum computing and blockchain. Now it’s time for you to join us on our journey to being a responsible technology innovator and a force for good in the world.

**Location Statement**

IBM wants you to bring your whole self to work and for you this might mean the ability to work flexibly. If you are interested in a flexible working pattern, please talk to our recruitment team to find out if this is possible in the current working environment.

IBM is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

**Introduction**
At IBM, work is more than a job - it's a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you've never thought possible. Are you ready to lead in this new era of technology and solve some of the world's most challenging problems? If so, lets talk.

**Your Role and Responsibilities**
Designs and builds solutions to move data from operational and external environments to the business intelligence environment using Informatica, Ab Initio software and DataStage (formerly Ascential) - IBM's WebSphere Data Integration Suite. Skills include designing and developing extract, transform and load (ETL) processes. Experience includes full lifecycle implementation of the technical components of a business intelligence solution.

**Required Technical and Professional Expertise**
0-1 Years of Experience

Bachelor of Computer science

**Preferred Technical and Professional Expertise**
NA

**About Business Unit**

IBM Consulting is IBM’s consulting and global professional services business, with market leading capabilities in business and technology transformation. With deep expertise in many industries, we offer strategy, experience, technology, and operations services to many of the most innovative and valuable companies in the world. Our people are focused on accelerating our clients’ businesses through the power of collaboration. We believe in the power of technology responsibly used to help people, partners and the planet.

In a world where technology never stands still, we understand that, dedication to our clients success, innovation that matters, and trust and personal responsibility in all our relationships, lives in what we do as IBMers as we strive to be the catalyst that makes the world work better.
Being an IBMer means you’ll be able to learn and develop yourself and your career, you’ll be encouraged to be courageous and experiment everyday, all whilst having continuous trust and support in an environment where everyone can thrive whatever their personal or professional background.

Our IBMers are growth minded, always staying curious, open to feedback and learning new information and skills to constantly transform themselves and our company. They are trusted to provide on-going feedback to help other IBMers grow, as well as collaborate with colleagues keeping in mind a team focused approach to include different perspectives to drive exceptional outcomes for our customers. The courage our IBMers have to make critical decisions everyday is essential to IBM becoming the catalyst for progress, always embracing challenges with resources they have to hand, a can-do attitude and always striving for an outcome focused approach within everything that they do.

Are you ready to be an IBMer?

This job requires you to provide your COVID-19 vaccination status with supporting documentation, where legally permissible.

**About IBM**

Restlessly reinventing since 1911, we are not only one of the largest corporate organizations in the world, we’re also one of the biggest technology and consulting employers, with many of the Fortune 50 companies relying on the IBM Cloud to run their business.

At IBM, we pride ourselves on being an early adopter of artificial intelligence, quantum computing and blockchain. Now it’s time for you to join us on our journey to being a responsible technology innovator and a force for good in the world.

**Location Statement**

IBM wants you to bring your whole self to work and for you this might mean the ability to work flexibly. If you are interested in a flexible working pattern, please talk to our recruitment team to find out if this is possible in the current working environment.

IBM is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.