30 Data Engineering jobs in Egypt
Data Engineering Senior
DXC Technology
Posted today
Job Viewed
Job Description
**Job Summary**
The Data Engineer will develop, implement & test programs and scripts to automate tasks and data processing as well as utilize SQL for operation use. Responsibilities include performing data analysis, managing and monitoring data security & document procedures and best practices.
**Duties and Responsibilities**
- Optimize and enhance data processing performance by identifying and resolving performance issues.
- Develop, implement & test scripts and programs in Python to automate data processing and analysis tasks.
- Utilize complex SQL for data extraction, manipulation, transformation, loading, optimizing performance and efficiency.
- Design, model and optimize data models and data structure for efficient reporting analysis, data visualization and data sharing.
- Perform data analysis and profiling to identify data quality issues anomalies and opportunities for improvement.
- Participate in managing and monitoring data security and access anomalies.
- Document and keep up to date procedures and best practices related to Python, libraries, algorithms, and related data processing technologies and propose innovative solutions.
**Requirements and Qualifications**
- Degree in computer science, data engineering, statistics/mathematics, or a related field. (Master's degree preferred).
- ** Strong experience in designing** **developing and managing databases in Python, including creating data schemas, tables, complex SQL queries, and algorithms.
- In-depth knowledge of data security and compliance best practices using Python
- Experience in optimizing scripts/programs/algorithms SQL queries and resolving performance issues.
- Excellent communication skills and the ability to work collaboratively in a team-oriented environment.
- Relevant certifications in Python are a plus.
- Fluent in written and spoken English and Arabic
- Understand and have worked with the government, and enterprises to implement analytical projects using Python.
- Process good analytical, and troubleshooting skills.
- Comfortable working in an agile dynamic environment.
- Team player with strong communication skills who realizes that excellence can only be achieved as a team.
- Conscious of your role and understand how the value chain and business processes work.
- Combine intellectual curiosity with creativity to turn bright ideas into brighter solutions.
- ** Please read the Job Description very well before applying
The Data Engineer will develop, implement & test programs and scripts to automate tasks and data processing as well as utilize SQL for operation use. Responsibilities include performing data analysis, managing and monitoring data security & document procedures and best practices.
**Duties and Responsibilities**
- Optimize and enhance data processing performance by identifying and resolving performance issues.
- Develop, implement & test scripts and programs in Python to automate data processing and analysis tasks.
- Utilize complex SQL for data extraction, manipulation, transformation, loading, optimizing performance and efficiency.
- Design, model and optimize data models and data structure for efficient reporting analysis, data visualization and data sharing.
- Perform data analysis and profiling to identify data quality issues anomalies and opportunities for improvement.
- Participate in managing and monitoring data security and access anomalies.
- Document and keep up to date procedures and best practices related to Python, libraries, algorithms, and related data processing technologies and propose innovative solutions.
**Requirements and Qualifications**
- Degree in computer science, data engineering, statistics/mathematics, or a related field. (Master's degree preferred).
- ** Strong experience in designing** **developing and managing databases in Python, including creating data schemas, tables, complex SQL queries, and algorithms.
- In-depth knowledge of data security and compliance best practices using Python
- Experience in optimizing scripts/programs/algorithms SQL queries and resolving performance issues.
- Excellent communication skills and the ability to work collaboratively in a team-oriented environment.
- Relevant certifications in Python are a plus.
- Fluent in written and spoken English and Arabic
- Understand and have worked with the government, and enterprises to implement analytical projects using Python.
- Process good analytical, and troubleshooting skills.
- Comfortable working in an agile dynamic environment.
- Team player with strong communication skills who realizes that excellence can only be achieved as a team.
- Conscious of your role and understand how the value chain and business processes work.
- Combine intellectual curiosity with creativity to turn bright ideas into brighter solutions.
- ** Please read the Job Description very well before applying
This advertiser has chosen not to accept applicants from your region.
0
Sr. Data Architecture and Modelling
MigrationIT
Posted today
Job Viewed
Job Description
**Job Information**:
Field
- Applications & DataField / Area
- Data & Data ManagementIndustry
- BankingJob Category
- Data WarehouseWork Experience
- 5+ yearsSalary
- 75000City
- New CairoState/Province
- AI QahirahCountry
- EgyptZip/Postal Code
- 11311- Job Description:
- Maintain the data architecture and logical data models for the bank’s ODS and different legacy considering data integration and systems interfaces.
- Define and maintain the logical data models and information assets within the shared data dictionaries in business terms, the content of which is defined and validated by the Data
- Owner (such as the representation of entities, attributes, and relationships for all data available in all bank’s legacy or governance systems).- Define the model and the internal regulations related to data management, ensuring the distribution and implementation, coordinating the activities of those involved and ensure coherence and effectiveness over time.
- Define and maintain the Logical Data Model for the Data warehouse and or Data Lake and its presentation layers.
- Research architect and define advanced analytics and Business Intelligence capabilities and strategies for information delivery and data exploration to support business functions fulfilling their business needs and achieve their goals.
- Managing and monitoring data transformation and transmission through the Data Linage Tools to have an overview on the data acquisition across all layers “end to end” from source systems till presentation and reporting layers.
- Manage and oversee the daily ETL transformation mappings and integration programs ensuring its proper execution while loading data into the Data warehouse and or Data Lake with no errors before any new business day starts; notifying the impacted data owner(s) or data user(s) to take into their consideration.
- Coordinate with different data actors the development, implementation and the management of the enterprise business and technical metadata over the ETL integration tools including data linage and all associated metadata initiatives
**Requirements**:
- Bachelor’s degree in computer science, commerce, business administration or its equivalent.
- 1 -3 years of Experience for the Analyst
- Min of 3 - 5 years of Experience in Data Field; not less than 3 years banking field
- Excellent command of English language (Read / Write)
- Data Governance tools (Informatica, SaaS or familiar with any other similar tool)
- MS SQL Management Studio. (SSDB, SSIS, SSRS, SSAS, Data Quality Services (DQS) & Data Profiling).
- Oracle (PL/SQL Developer, Toad 9.5, Sybase Data Model Designer)
- ERWIN Data Modelling.
- Unified Modelling Language.
- Data integration tools (such as Informatica Power center).
- Enterprise Data Catalogues tools.
- Microsoft Visual Studio (C++, VB.NET, C#, ASP.NET, XML, Crystal Reports) is a plus.
- Very good leadership & communications skills.
- Very good analytical abilities and problem solver
**Benefits**:
Field
- Applications & DataField / Area
- Data & Data ManagementIndustry
- BankingJob Category
- Data WarehouseWork Experience
- 5+ yearsSalary
- 75000City
- New CairoState/Province
- AI QahirahCountry
- EgyptZip/Postal Code
- 11311- Job Description:
- Maintain the data architecture and logical data models for the bank’s ODS and different legacy considering data integration and systems interfaces.
- Define and maintain the logical data models and information assets within the shared data dictionaries in business terms, the content of which is defined and validated by the Data
- Owner (such as the representation of entities, attributes, and relationships for all data available in all bank’s legacy or governance systems).- Define the model and the internal regulations related to data management, ensuring the distribution and implementation, coordinating the activities of those involved and ensure coherence and effectiveness over time.
- Define and maintain the Logical Data Model for the Data warehouse and or Data Lake and its presentation layers.
- Research architect and define advanced analytics and Business Intelligence capabilities and strategies for information delivery and data exploration to support business functions fulfilling their business needs and achieve their goals.
- Managing and monitoring data transformation and transmission through the Data Linage Tools to have an overview on the data acquisition across all layers “end to end” from source systems till presentation and reporting layers.
- Manage and oversee the daily ETL transformation mappings and integration programs ensuring its proper execution while loading data into the Data warehouse and or Data Lake with no errors before any new business day starts; notifying the impacted data owner(s) or data user(s) to take into their consideration.
- Coordinate with different data actors the development, implementation and the management of the enterprise business and technical metadata over the ETL integration tools including data linage and all associated metadata initiatives
**Requirements**:
- Bachelor’s degree in computer science, commerce, business administration or its equivalent.
- 1 -3 years of Experience for the Analyst
- Min of 3 - 5 years of Experience in Data Field; not less than 3 years banking field
- Excellent command of English language (Read / Write)
- Data Governance tools (Informatica, SaaS or familiar with any other similar tool)
- MS SQL Management Studio. (SSDB, SSIS, SSRS, SSAS, Data Quality Services (DQS) & Data Profiling).
- Oracle (PL/SQL Developer, Toad 9.5, Sybase Data Model Designer)
- ERWIN Data Modelling.
- Unified Modelling Language.
- Data integration tools (such as Informatica Power center).
- Enterprise Data Catalogues tools.
- Microsoft Visual Studio (C++, VB.NET, C#, ASP.NET, XML, Crystal Reports) is a plus.
- Very good leadership & communications skills.
- Very good analytical abilities and problem solver
**Benefits**:
This advertiser has chosen not to accept applicants from your region.
1
Data Engineer
Arrow Electronics
Posted 11 days ago
Job Viewed
Job Description
**Position:**
Data Engineer
**Job Description:**
**ESSENTIAL DUTIES & RESPONSIBILITIES**
+ Apply the knowledge of engineering on electronic products to develop the newly introduced parts with technical parameters in different areas daily.
+ Apply the knowledge of engineering in different data development stages, including but not limited to Part number decoding, Electrical/ performance characteristics, compliance, and Lifecycle data collection.
+ Apply the knowledge of engineering on electronic products to track updates in technical Documents revisions and identify the high technical changes to update on the Database.
+ Develop Customer requests after handling them to enter in the Database.
+ Apply a checklist to keep and maintain our data with high quality.
**SKILLS & EXPERIENCE REQUIREMENTS:**
+ Bachelor's degree in Electrical or Electronics Engineering.
+ 0 to 1 year of relevant experience.
+ Familiarity with electronic components and systems.
+ Strong English language skills (written, read, and spoken).
+ Good knowledge of at least one programming language (Python or Java).
+ Proficient in data analysis using Excel, Power BI, or Python.
+ Ability to write code and scripts to automate data processes using languages such as Python, Java, or Scala.
+ Commitment to continuously optimizing data processes for improved efficiency and scalability.
+ Experience in implementing data quality checks and monitoring systems to proactively detect and resolve issues.
+ Proven experience working on projects utilizing technologies such as Python, Power BI, or related tools.
**Location:**
EG-Banha, Egypt (EI Corniche Street)
**Time Type:**
Full time
**Job Category:**
Engineering and Technology
Arrow Electronics, Inc.'s policy is to provide equal employment opportunities to all qualified employees and applicants without regard to race, color, religion, age, sex, marital status, gender identity or expression, sexual orientation, national origin, disability, citizenship, veran status, genetic information, or any other characteristics protected by applicable state, federal or local laws. Our policy of equal employment opportunity and affirmative action applies to all employment decisions personnel policies and practices, or programs.
Data Engineer
**Job Description:**
**ESSENTIAL DUTIES & RESPONSIBILITIES**
+ Apply the knowledge of engineering on electronic products to develop the newly introduced parts with technical parameters in different areas daily.
+ Apply the knowledge of engineering in different data development stages, including but not limited to Part number decoding, Electrical/ performance characteristics, compliance, and Lifecycle data collection.
+ Apply the knowledge of engineering on electronic products to track updates in technical Documents revisions and identify the high technical changes to update on the Database.
+ Develop Customer requests after handling them to enter in the Database.
+ Apply a checklist to keep and maintain our data with high quality.
**SKILLS & EXPERIENCE REQUIREMENTS:**
+ Bachelor's degree in Electrical or Electronics Engineering.
+ 0 to 1 year of relevant experience.
+ Familiarity with electronic components and systems.
+ Strong English language skills (written, read, and spoken).
+ Good knowledge of at least one programming language (Python or Java).
+ Proficient in data analysis using Excel, Power BI, or Python.
+ Ability to write code and scripts to automate data processes using languages such as Python, Java, or Scala.
+ Commitment to continuously optimizing data processes for improved efficiency and scalability.
+ Experience in implementing data quality checks and monitoring systems to proactively detect and resolve issues.
+ Proven experience working on projects utilizing technologies such as Python, Power BI, or related tools.
**Location:**
EG-Banha, Egypt (EI Corniche Street)
**Time Type:**
Full time
**Job Category:**
Engineering and Technology
Arrow Electronics, Inc.'s policy is to provide equal employment opportunities to all qualified employees and applicants without regard to race, color, religion, age, sex, marital status, gender identity or expression, sexual orientation, national origin, disability, citizenship, veran status, genetic information, or any other characteristics protected by applicable state, federal or local laws. Our policy of equal employment opportunity and affirmative action applies to all employment decisions personnel policies and practices, or programs.
This advertiser has chosen not to accept applicants from your region.
2
Data Engineer
Cairo, Al Qahirah
AXA Egypt
Posted today
Job Viewed
Job Description
Key Responsibilities:
Develop, construct, test and maintain architectures
Align architecture with business requirements
Data acquisition
Develop data set processes
Use programming language and tools
Identify ways to improve data reliability, efficiency and quality
Conduct research for industry and business questions
Use large data sets to address business issues
Deploy sophisticated analytics programs, machine learning and statistical methods
Prepare data for predictive and prescriptive modeling
Find hidden patterns using data
Use data to discover tasks that can be automated
Deliver updates to stakeholders based on analytics
Assemble large, complex data sets that meet functional / non-functional business requirements.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Any ETL Tool.
Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
Keep our data separated and secure across national boundaries through multiple data centers and Cloud.
Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
Work with data and analytics experts to strive for greater functionality in our data systems.
Business Knowledge/Technical Skills:
Bachelor of Computer Science or Engineering
2+ Years’ Experience
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
Strong analytic skills related to working with unstructured datasets.
Build processes supporting data transformation, data structures, metadata, dependency and workload management.
A successful history of manipulating, processing and extracting value from large disconnected datasets.
Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
Strong project management and organizational skills.
Experience supporting and working with cross-functional teams in a dynamic environment.
**Skills**:
For experience Data engineer
For experience Data engineer
Experience with big data tools: Hadoop, Spark, Kafka, etc.
Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
Experience with AWS cloud services: EC2, EMR, RDS, Redshift
Experience with stream-processing systems: Storm, Spark-Streaming, etc.
Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc
**Education**:
Bachelor degree of Engineering
**Job Details**:
- Job Location
- Cairo, Egypt
- Job Role
- Information Technology
- Employment Status
- Full time
- Employment Type
- Employee
- Number of Vacancies
- 1
- Career Level
- Entry Level
- Years of Experience
- Min: 2 Max: 5
- Residence Location
- Cairo, Egypt
- Nationality
- Egypt
- Degree
- Bachelor's degree
Develop, construct, test and maintain architectures
Align architecture with business requirements
Data acquisition
Develop data set processes
Use programming language and tools
Identify ways to improve data reliability, efficiency and quality
Conduct research for industry and business questions
Use large data sets to address business issues
Deploy sophisticated analytics programs, machine learning and statistical methods
Prepare data for predictive and prescriptive modeling
Find hidden patterns using data
Use data to discover tasks that can be automated
Deliver updates to stakeholders based on analytics
Assemble large, complex data sets that meet functional / non-functional business requirements.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Any ETL Tool.
Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
Keep our data separated and secure across national boundaries through multiple data centers and Cloud.
Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
Work with data and analytics experts to strive for greater functionality in our data systems.
Business Knowledge/Technical Skills:
Bachelor of Computer Science or Engineering
2+ Years’ Experience
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
Strong analytic skills related to working with unstructured datasets.
Build processes supporting data transformation, data structures, metadata, dependency and workload management.
A successful history of manipulating, processing and extracting value from large disconnected datasets.
Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
Strong project management and organizational skills.
Experience supporting and working with cross-functional teams in a dynamic environment.
**Skills**:
For experience Data engineer
For experience Data engineer
Experience with big data tools: Hadoop, Spark, Kafka, etc.
Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
Experience with AWS cloud services: EC2, EMR, RDS, Redshift
Experience with stream-processing systems: Storm, Spark-Streaming, etc.
Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc
**Education**:
Bachelor degree of Engineering
**Job Details**:
- Job Location
- Cairo, Egypt
- Job Role
- Information Technology
- Employment Status
- Full time
- Employment Type
- Employee
- Number of Vacancies
- 1
- Career Level
- Entry Level
- Years of Experience
- Min: 2 Max: 5
- Residence Location
- Cairo, Egypt
- Nationality
- Egypt
- Degree
- Bachelor's degree
This advertiser has chosen not to accept applicants from your region.
3
Data Engineer
Government Consulting Solutions, LLC
Posted today
Job Viewed
Job Description
We are seeking a full-time Data Engineer in the Northern Virginia area to join our team. you will work with other motivated, talented individuals who inspire one another in a dynamic team environment. The position is an exciting opportunity to grow and be challenged in a role using cutting edge technologies to address exciting problems.
**Key Responsibilities**:
- Create software tools that enable data scientists and transform their tradecraft into agile, accurate, data-driven decisions based upon relationships and correlations in vast amounts of data.
- Support an engineering team dedicated to designing, developing, and maintaining an analytic environment.
- Develop on both AWS unclassified and AWS classified development and production compute environments.
**Basic Qualifications**:
- Bachelor of Science degree in the Mathematics, the Physical Science, Software Engineering, Computer Science or related field with 3-5 years of experience.
- Experience developing and optimizing complex SQL queries to query, join, or filter diverse data sets.
- Familiarity with industry best-practices for software-hardware optimization when processing large sets of data.
- Experience with Agile software development methodologies and tools, including Git and Jira.
- Demonstrated knowledge with some of the following software/tools: Apache NiFi, AWS Cloud environment, Java, Python, NodeJS, SQL, R, Hadoop, PySpark, Java, Git, Bash, Linux/Unix based OS.
**Preferred Qualifications**:
- Creativity and innovation in solving complex problems.
- Organize relevant information using data management tools.
- Experience with deploying Docker containers.
- Understanding of X.509 and PKI security solutions.
- Have developed and used RESTful APIs.
- Motivated to work collaboratively and effectively in a team environment.
**Key Responsibilities**:
- Create software tools that enable data scientists and transform their tradecraft into agile, accurate, data-driven decisions based upon relationships and correlations in vast amounts of data.
- Support an engineering team dedicated to designing, developing, and maintaining an analytic environment.
- Develop on both AWS unclassified and AWS classified development and production compute environments.
**Basic Qualifications**:
- Bachelor of Science degree in the Mathematics, the Physical Science, Software Engineering, Computer Science or related field with 3-5 years of experience.
- Experience developing and optimizing complex SQL queries to query, join, or filter diverse data sets.
- Familiarity with industry best-practices for software-hardware optimization when processing large sets of data.
- Experience with Agile software development methodologies and tools, including Git and Jira.
- Demonstrated knowledge with some of the following software/tools: Apache NiFi, AWS Cloud environment, Java, Python, NodeJS, SQL, R, Hadoop, PySpark, Java, Git, Bash, Linux/Unix based OS.
**Preferred Qualifications**:
- Creativity and innovation in solving complex problems.
- Organize relevant information using data management tools.
- Experience with deploying Docker containers.
- Understanding of X.509 and PKI security solutions.
- Have developed and used RESTful APIs.
- Motivated to work collaboratively and effectively in a team environment.
This advertiser has chosen not to accept applicants from your region.
4
Data Engineer
Government Consulting Solutions, LLC
Posted today
Job Viewed
Job Description
We are seeking a full-time Data Engineer in the Northern Virginia area to join our team. you will work with other motivated, talented individuals who inspire one another in a dynamic team environment. The position is an exciting opportunity to grow and be challenged in a role using cutting edge technologies to address exciting problems.
**Key Responsibilities**:
- Create software tools that enable data scientists and transform their tradecraft into agile, accurate, data-driven decisions based upon relationships and correlations in vast amounts of data.
- Support an engineering team dedicated to designing, developing, and maintaining an analytic environment.
- Develop on both AWS unclassified and AWS classified development and production compute environments.
**Basic Qualifications**:
- Bachelor of Science degree in the Mathematics, the Physical Science, Software Engineering, Computer Science or related field with 3-5 years of experience.
- Experience developing and optimizing complex SQL queries to query, join, or filter diverse data sets.
- Familiarity with industry best-practices for software-hardware optimization when processing large sets of data.
- Experience with Agile software development methodologies and tools, including Git and Jira.
- Demonstrated knowledge with some of the following software/tools: Apache NiFi, AWS Cloud environment, Java, Python, NodeJS, SQL, R, Hadoop, PySpark, Java, Git, Bash, Linux/Unix based OS.
**Preferred Qualifications**:
- Creativity and innovation in solving complex problems.
- Organize relevant information using data management tools.
- Experience with deploying Docker containers.
- Understanding of X.509 and PKI security solutions.
- Have developed and used RESTful APIs.
- Motivated to work collaboratively and effectively in a team environment.
**Key Responsibilities**:
- Create software tools that enable data scientists and transform their tradecraft into agile, accurate, data-driven decisions based upon relationships and correlations in vast amounts of data.
- Support an engineering team dedicated to designing, developing, and maintaining an analytic environment.
- Develop on both AWS unclassified and AWS classified development and production compute environments.
**Basic Qualifications**:
- Bachelor of Science degree in the Mathematics, the Physical Science, Software Engineering, Computer Science or related field with 3-5 years of experience.
- Experience developing and optimizing complex SQL queries to query, join, or filter diverse data sets.
- Familiarity with industry best-practices for software-hardware optimization when processing large sets of data.
- Experience with Agile software development methodologies and tools, including Git and Jira.
- Demonstrated knowledge with some of the following software/tools: Apache NiFi, AWS Cloud environment, Java, Python, NodeJS, SQL, R, Hadoop, PySpark, Java, Git, Bash, Linux/Unix based OS.
**Preferred Qualifications**:
- Creativity and innovation in solving complex problems.
- Organize relevant information using data management tools.
- Experience with deploying Docker containers.
- Understanding of X.509 and PKI security solutions.
- Have developed and used RESTful APIs.
- Motivated to work collaboratively and effectively in a team environment.
This advertiser has chosen not to accept applicants from your region.
5
Data Engineer
AUMET Inc.
Posted today
Job Viewed
Job Description
AUMET is the leading B2B marketplace to sell medical products between healthcare providers and distributors. We are innovating how distributors of medical supplies do business with consumer selling points such as pharmacies.
With 500,000 transactions per month, AUMET marketplace is a fast growing product that is capturing market share and is on a road to achieve its vision. And as we grow we need talented people to help us grow!
As a Data Engineer at Aumet, you will play a crucial role in building and maintaining our data infrastructure to support our business intelligence and analytics needs.
**Responsibilities**:
- Design, develop, and maintain data pipelines and ETL processes to ensure efficient and reliable data extraction, transformation, and loading from various sources into our data warehouse.
- Collaborate with cross-functional teams to understand data requirements and implement data solutions that align with business needs.
- Develop and optimize data models and schemas to support data analytics, reporting, and visualization.
- Implement data governance and security measures to ensure data quality, integrity, and compliance.
- Monitor and troubleshoot data pipelines, identifying and resolving performance and scalability issues.
- Continuously evaluate and recommend improvements to our data infrastructure, tools, and processes to enhance data accessibility and efficiency.
**Requirements**:
- Bachelor's or higher degree in Computer Science, Data Science, or a related field.
- 1-2 years Proven experience as a Data Engineer or in a similar role, with a strong focus on data integration and ETL processes.
- Proficient in programming languages such as Python and SQL
- Experience working with large-scale databases and data warehouses (e.g., SQL Server, PostgreSQL, Redshift).
- Familiarity with cloud-based data platforms and services (e.g., AWS, Azure, Google Cloud).
- Strong understanding of data modeling, data warehousing, and data pipeline architecture.
- Knowledge of data governance, data security, and privacy regulations (e.g., GDPR) is a plus.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills, with the ability to work effectively in a team-oriented environment.
With 500,000 transactions per month, AUMET marketplace is a fast growing product that is capturing market share and is on a road to achieve its vision. And as we grow we need talented people to help us grow!
As a Data Engineer at Aumet, you will play a crucial role in building and maintaining our data infrastructure to support our business intelligence and analytics needs.
**Responsibilities**:
- Design, develop, and maintain data pipelines and ETL processes to ensure efficient and reliable data extraction, transformation, and loading from various sources into our data warehouse.
- Collaborate with cross-functional teams to understand data requirements and implement data solutions that align with business needs.
- Develop and optimize data models and schemas to support data analytics, reporting, and visualization.
- Implement data governance and security measures to ensure data quality, integrity, and compliance.
- Monitor and troubleshoot data pipelines, identifying and resolving performance and scalability issues.
- Continuously evaluate and recommend improvements to our data infrastructure, tools, and processes to enhance data accessibility and efficiency.
**Requirements**:
- Bachelor's or higher degree in Computer Science, Data Science, or a related field.
- 1-2 years Proven experience as a Data Engineer or in a similar role, with a strong focus on data integration and ETL processes.
- Proficient in programming languages such as Python and SQL
- Experience working with large-scale databases and data warehouses (e.g., SQL Server, PostgreSQL, Redshift).
- Familiarity with cloud-based data platforms and services (e.g., AWS, Azure, Google Cloud).
- Strong understanding of data modeling, data warehousing, and data pipeline architecture.
- Knowledge of data governance, data security, and privacy regulations (e.g., GDPR) is a plus.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills, with the ability to work effectively in a team-oriented environment.
This advertiser has chosen not to accept applicants from your region.
Be The First To Know
About the latest Data engineering Jobs in Egypt !
6
Data Engineer
Evolvice GmbH
Posted today
Job Viewed
Job Description
Location: Egypt / Cairo
- Employment Type: Full Time
- Job ID: 33695
**Who we are**:
Evolvice is a German nearshore service provider with branches in Egypt and Ukraine. Founded in 2012, Evolvice has a strong technical background and business domain knowledge, combining software engineering and Agile methodology, leading its’ clients path to digital transformation. Headquartered in the heart of the automobile industry, Stuttgart (Germany), our expertise stretches from automotive, healthcare, travel, financial, governmental, insurance to manufacturing industries.
Our team is over 50 people including web (C#/.NET, Java, JS) & mobile (iOS/Android/Ionic) developers together with business analysts, project managers, QA and support staff. Our corporate culture is characterized by agile processes, autonomous teams without hierarchies, as well as openness and transparency - both internally and with our clients. Currently, we are searching for Senior Business Analyst to join the big team of professional in Cairo. We are looking for an active, responsive, and devoted person.
**Our Culture**:
Our teams include +**25** talented Developers & QA that come from a variety of backgrounds. We’re Keen on building an inclusive culture based on trust and innovation and value every skill set while maintaining a family-like environment where everyone is heard and appreciated.
- So, if you are searching for a new challenging role where you can use all of your Software development skills and work closely with International Organizations and Up to date Technologies, We are Looking For You!
**Your Profile**:
- ETL pipelines and tools (Informatica, Denodo)
- Data Integrations
- Advanced skills in SQL (e.g. Complex SQL queries optimization)
- Big data processing
- Feature Engineering
- Data quality evaluation and enhancement
- Data migration
- Knowledge in BI tools (Tableau)
- Strong Experience in Data Warehousing and Data lake (Cloudera and Hive)
**Your Mission**:
- Design, build, and maintain scalable and robust data pipelines for extracting, transforming, and loading data from various sources into our data warehouse.
- Optimize and tune existing data pipelines for performance, reliability, and scalability.
- Develop and implement data integration solutions to enable seamless data flow between different systems and platforms.
- Collaborate with cross-functional teams to understand data requirements and provide technical expertise in designing data models and schemas.
- Evaluate and select appropriate technologies and tools to support data infrastructure needs, keeping abreast of industry trends and best practices.
- Ensure data quality and integrity by implementing data validation and cleansing processes.
- Monitor and troubleshoot data infrastructure issues, performing root cause analysis and implementing preventive measures.
- Document data processes, workflows, and infrastructure components to facilitate knowledge sharing and maintain system documentation.
**Work Setup**:
- Location: #Maadi
- Work Model: Hybrid (2 days from office-3 from home)
- Working Hours: Flexible
- Fridays and Saturdays are off
**Perks and Benefits**:
- A basic monthly net salary determined by the experience in Euro
- Social and Medical Insurance
- Salary reviews after Trial Period based on performance
- Unlimited drinks at the office
- An amazing accessible office in Maadi.
- Career and skills development
- Last but not least an AMAZING team!
- Employment Type: Full Time
- Job ID: 33695
**Who we are**:
Evolvice is a German nearshore service provider with branches in Egypt and Ukraine. Founded in 2012, Evolvice has a strong technical background and business domain knowledge, combining software engineering and Agile methodology, leading its’ clients path to digital transformation. Headquartered in the heart of the automobile industry, Stuttgart (Germany), our expertise stretches from automotive, healthcare, travel, financial, governmental, insurance to manufacturing industries.
Our team is over 50 people including web (C#/.NET, Java, JS) & mobile (iOS/Android/Ionic) developers together with business analysts, project managers, QA and support staff. Our corporate culture is characterized by agile processes, autonomous teams without hierarchies, as well as openness and transparency - both internally and with our clients. Currently, we are searching for Senior Business Analyst to join the big team of professional in Cairo. We are looking for an active, responsive, and devoted person.
**Our Culture**:
Our teams include +**25** talented Developers & QA that come from a variety of backgrounds. We’re Keen on building an inclusive culture based on trust and innovation and value every skill set while maintaining a family-like environment where everyone is heard and appreciated.
- So, if you are searching for a new challenging role where you can use all of your Software development skills and work closely with International Organizations and Up to date Technologies, We are Looking For You!
**Your Profile**:
- ETL pipelines and tools (Informatica, Denodo)
- Data Integrations
- Advanced skills in SQL (e.g. Complex SQL queries optimization)
- Big data processing
- Feature Engineering
- Data quality evaluation and enhancement
- Data migration
- Knowledge in BI tools (Tableau)
- Strong Experience in Data Warehousing and Data lake (Cloudera and Hive)
**Your Mission**:
- Design, build, and maintain scalable and robust data pipelines for extracting, transforming, and loading data from various sources into our data warehouse.
- Optimize and tune existing data pipelines for performance, reliability, and scalability.
- Develop and implement data integration solutions to enable seamless data flow between different systems and platforms.
- Collaborate with cross-functional teams to understand data requirements and provide technical expertise in designing data models and schemas.
- Evaluate and select appropriate technologies and tools to support data infrastructure needs, keeping abreast of industry trends and best practices.
- Ensure data quality and integrity by implementing data validation and cleansing processes.
- Monitor and troubleshoot data infrastructure issues, performing root cause analysis and implementing preventive measures.
- Document data processes, workflows, and infrastructure components to facilitate knowledge sharing and maintain system documentation.
**Work Setup**:
- Location: #Maadi
- Work Model: Hybrid (2 days from office-3 from home)
- Working Hours: Flexible
- Fridays and Saturdays are off
**Perks and Benefits**:
- A basic monthly net salary determined by the experience in Euro
- Social and Medical Insurance
- Salary reviews after Trial Period based on performance
- Unlimited drinks at the office
- An amazing accessible office in Maadi.
- Career and skills development
- Last but not least an AMAZING team!
This advertiser has chosen not to accept applicants from your region.
7
Data Engineer
NorthBay Solutions
Posted today
Job Viewed
Job Description
**Our Tech Stack**:
- ** Languages**: SQL & Python
- ** Pipeline Orchestration Tool**: Dagster (Legacy: Airflow)
- ** Data Stores**: Snowflake, Clickhouse
- ** Platforms & Services**: Docker, Kubernetes
- ** PaaS**: AWS (ECS/EKS, DMS, Kinesis, Glue, Athena, S3, and others)
- ** ETL**: FiveTran & DBT for transformation
- ** IaC**: Terraform (with Terragrunt)
**Key Responsibilities**:
- Develop and maintain ETL pipelines using SQL and/or Python.
- Use tools like Dagster/Airflow for pipeline orchestration.
- Collaborate with cross-functional teams to understand and deliver data requirements.
- Ensure a consistent flow of high-quality data using stream, batch, and CDC processes.
- Use data transformation tools like DBT to prepare datasets for business users to self-service.
- Ensure data quality and consistency across all data stores.
- Monitor and troubleshoot data pipelines for performance and reliability.
**Essential Experience**:
- 3+ years of experience as a data engineer.
- Proficiency in SQL.
- Experience with modern cloud data warehousing and data lake solutions like Snowflake, BigQuery, Redshift, Azure Synapse.
- Experience with ETL/ELT, batch, and streaming data processing pipelines.
- Excellent ability to investigate and troubleshoot data issues, providing fixes and proposing both short and long-term solutions.
- Knowledge of AWS services (such as S3, DMS, Glue, Athena, etc.).
- Familiarity with dbt or other data transformation tools.
**Other Desired Experience**:
- Experience with AWS services and concepts (such as EC2, ECS, EKS, VPC, IAM, etc.).
- Familiarity with Terraform and Terragrunt.
- Experience with Python.
- Experience with orchestration tools like Dagster, Airflow, AWS Step Functions, etc.
- Experience with pub-sub, queuing, and streaming frameworks such as AWS Kinesis, Kafka, SQS, SNS.
- Familiarity with CI/CD pipelines and automation.
**Equal Opportunity Employer**: We are an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
ekAWInNxf2
- ** Languages**: SQL & Python
- ** Pipeline Orchestration Tool**: Dagster (Legacy: Airflow)
- ** Data Stores**: Snowflake, Clickhouse
- ** Platforms & Services**: Docker, Kubernetes
- ** PaaS**: AWS (ECS/EKS, DMS, Kinesis, Glue, Athena, S3, and others)
- ** ETL**: FiveTran & DBT for transformation
- ** IaC**: Terraform (with Terragrunt)
**Key Responsibilities**:
- Develop and maintain ETL pipelines using SQL and/or Python.
- Use tools like Dagster/Airflow for pipeline orchestration.
- Collaborate with cross-functional teams to understand and deliver data requirements.
- Ensure a consistent flow of high-quality data using stream, batch, and CDC processes.
- Use data transformation tools like DBT to prepare datasets for business users to self-service.
- Ensure data quality and consistency across all data stores.
- Monitor and troubleshoot data pipelines for performance and reliability.
**Essential Experience**:
- 3+ years of experience as a data engineer.
- Proficiency in SQL.
- Experience with modern cloud data warehousing and data lake solutions like Snowflake, BigQuery, Redshift, Azure Synapse.
- Experience with ETL/ELT, batch, and streaming data processing pipelines.
- Excellent ability to investigate and troubleshoot data issues, providing fixes and proposing both short and long-term solutions.
- Knowledge of AWS services (such as S3, DMS, Glue, Athena, etc.).
- Familiarity with dbt or other data transformation tools.
**Other Desired Experience**:
- Experience with AWS services and concepts (such as EC2, ECS, EKS, VPC, IAM, etc.).
- Familiarity with Terraform and Terragrunt.
- Experience with Python.
- Experience with orchestration tools like Dagster, Airflow, AWS Step Functions, etc.
- Experience with pub-sub, queuing, and streaming frameworks such as AWS Kinesis, Kafka, SQS, SNS.
- Familiarity with CI/CD pipelines and automation.
**Equal Opportunity Employer**: We are an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
ekAWInNxf2
This advertiser has chosen not to accept applicants from your region.
8
Data Engineer-Data Integration
Cairo, Al Qahirah
IBM
Posted 5 days ago
Job Viewed
Job Description
**Introduction**
As a Data Engineer, you will lead IBM into the future by translating system requirements into the design and development of customized systems in an agile environment. The success of IBM is in your hands as you transform vital business needs into code and drive innovation. Your work will power IBM and its clients globally, collaborating and integrating code into enterprise systems. You will have access to the latest education, tools and technology, and a limitless career path with the world's technology leader. Come to IBM and make a global impact!
**Your role and responsibilities**
A Data Engineer with expertise in Data Integration is responsible for designing and building solutions to transfer data from operational and external environments to the business intelligence environment. They utilize tools such as Informatica, Ab Initio software, and DataStage (formerly Ascential) - IBM's WebSphere Data Integration Suite. This role involves creating and implementing Extract, Transform, and Load (ETL) processes, ensuring the seamless flow of data throughout the business intelligence solution's lifecycle.
**Required technical and professional expertise**
A Data Engineer with expertise in Data Integration is responsible for designing and building solutions to transfer data from operational and external environments to the business intelligence environment. They utilize tools such as Informatica, Ab Initio software, and DataStage (formerly Ascential) - IBM's WebSphere Data Integration Suite. This role involves creating and implementing Extract, Transform, and Load (ETL) processes, ensuring the seamless flow of data throughout the business intelligence solution's lifecycle.
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
As a Data Engineer, you will lead IBM into the future by translating system requirements into the design and development of customized systems in an agile environment. The success of IBM is in your hands as you transform vital business needs into code and drive innovation. Your work will power IBM and its clients globally, collaborating and integrating code into enterprise systems. You will have access to the latest education, tools and technology, and a limitless career path with the world's technology leader. Come to IBM and make a global impact!
**Your role and responsibilities**
A Data Engineer with expertise in Data Integration is responsible for designing and building solutions to transfer data from operational and external environments to the business intelligence environment. They utilize tools such as Informatica, Ab Initio software, and DataStage (formerly Ascential) - IBM's WebSphere Data Integration Suite. This role involves creating and implementing Extract, Transform, and Load (ETL) processes, ensuring the seamless flow of data throughout the business intelligence solution's lifecycle.
**Required technical and professional expertise**
A Data Engineer with expertise in Data Integration is responsible for designing and building solutions to transfer data from operational and external environments to the business intelligence environment. They utilize tools such as Informatica, Ab Initio software, and DataStage (formerly Ascential) - IBM's WebSphere Data Integration Suite. This role involves creating and implementing Extract, Transform, and Load (ETL) processes, ensuring the seamless flow of data throughout the business intelligence solution's lifecycle.
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
This advertiser has chosen not to accept applicants from your region.
9