28 Reporting Engineer jobs in Egypt
Data Engineer
Arrow Electronics
Posted 11 days ago
Job Viewed
Job Description
**Position:**
Data Engineer
**Job Description:**
**ESSENTIAL DUTIES & RESPONSIBILITIES**
+ Apply the knowledge of engineering on electronic products to develop the newly introduced parts with technical parameters in different areas daily.
+ Apply the knowledge of engineering in different data development stages, including but not limited to Part number decoding, Electrical/ performance characteristics, compliance, and Lifecycle data collection.
+ Apply the knowledge of engineering on electronic products to track updates in technical Documents revisions and identify the high technical changes to update on the Database.
+ Develop Customer requests after handling them to enter in the Database.
+ Apply a checklist to keep and maintain our data with high quality.
**SKILLS & EXPERIENCE REQUIREMENTS:**
+ Bachelor's degree in Electrical or Electronics Engineering.
+ 0 to 1 year of relevant experience.
+ Familiarity with electronic components and systems.
+ Strong English language skills (written, read, and spoken).
+ Good knowledge of at least one programming language (Python or Java).
+ Proficient in data analysis using Excel, Power BI, or Python.
+ Ability to write code and scripts to automate data processes using languages such as Python, Java, or Scala.
+ Commitment to continuously optimizing data processes for improved efficiency and scalability.
+ Experience in implementing data quality checks and monitoring systems to proactively detect and resolve issues.
+ Proven experience working on projects utilizing technologies such as Python, Power BI, or related tools.
**Location:**
EG-Banha, Egypt (EI Corniche Street)
**Time Type:**
Full time
**Job Category:**
Engineering and Technology
Arrow Electronics, Inc.'s policy is to provide equal employment opportunities to all qualified employees and applicants without regard to race, color, religion, age, sex, marital status, gender identity or expression, sexual orientation, national origin, disability, citizenship, veran status, genetic information, or any other characteristics protected by applicable state, federal or local laws. Our policy of equal employment opportunity and affirmative action applies to all employment decisions personnel policies and practices, or programs.
Data Engineer
**Job Description:**
**ESSENTIAL DUTIES & RESPONSIBILITIES**
+ Apply the knowledge of engineering on electronic products to develop the newly introduced parts with technical parameters in different areas daily.
+ Apply the knowledge of engineering in different data development stages, including but not limited to Part number decoding, Electrical/ performance characteristics, compliance, and Lifecycle data collection.
+ Apply the knowledge of engineering on electronic products to track updates in technical Documents revisions and identify the high technical changes to update on the Database.
+ Develop Customer requests after handling them to enter in the Database.
+ Apply a checklist to keep and maintain our data with high quality.
**SKILLS & EXPERIENCE REQUIREMENTS:**
+ Bachelor's degree in Electrical or Electronics Engineering.
+ 0 to 1 year of relevant experience.
+ Familiarity with electronic components and systems.
+ Strong English language skills (written, read, and spoken).
+ Good knowledge of at least one programming language (Python or Java).
+ Proficient in data analysis using Excel, Power BI, or Python.
+ Ability to write code and scripts to automate data processes using languages such as Python, Java, or Scala.
+ Commitment to continuously optimizing data processes for improved efficiency and scalability.
+ Experience in implementing data quality checks and monitoring systems to proactively detect and resolve issues.
+ Proven experience working on projects utilizing technologies such as Python, Power BI, or related tools.
**Location:**
EG-Banha, Egypt (EI Corniche Street)
**Time Type:**
Full time
**Job Category:**
Engineering and Technology
Arrow Electronics, Inc.'s policy is to provide equal employment opportunities to all qualified employees and applicants without regard to race, color, religion, age, sex, marital status, gender identity or expression, sexual orientation, national origin, disability, citizenship, veran status, genetic information, or any other characteristics protected by applicable state, federal or local laws. Our policy of equal employment opportunity and affirmative action applies to all employment decisions personnel policies and practices, or programs.
This advertiser has chosen not to accept applicants from your region.
0
Data Engineer
Cairo, Al Qahirah
AXA Egypt
Posted today
Job Viewed
Job Description
Key Responsibilities:
Develop, construct, test and maintain architectures
Align architecture with business requirements
Data acquisition
Develop data set processes
Use programming language and tools
Identify ways to improve data reliability, efficiency and quality
Conduct research for industry and business questions
Use large data sets to address business issues
Deploy sophisticated analytics programs, machine learning and statistical methods
Prepare data for predictive and prescriptive modeling
Find hidden patterns using data
Use data to discover tasks that can be automated
Deliver updates to stakeholders based on analytics
Assemble large, complex data sets that meet functional / non-functional business requirements.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Any ETL Tool.
Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
Keep our data separated and secure across national boundaries through multiple data centers and Cloud.
Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
Work with data and analytics experts to strive for greater functionality in our data systems.
Business Knowledge/Technical Skills:
Bachelor of Computer Science or Engineering
2+ Years’ Experience
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
Strong analytic skills related to working with unstructured datasets.
Build processes supporting data transformation, data structures, metadata, dependency and workload management.
A successful history of manipulating, processing and extracting value from large disconnected datasets.
Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
Strong project management and organizational skills.
Experience supporting and working with cross-functional teams in a dynamic environment.
**Skills**:
For experience Data engineer
For experience Data engineer
Experience with big data tools: Hadoop, Spark, Kafka, etc.
Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
Experience with AWS cloud services: EC2, EMR, RDS, Redshift
Experience with stream-processing systems: Storm, Spark-Streaming, etc.
Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc
**Education**:
Bachelor degree of Engineering
**Job Details**:
- Job Location
- Cairo, Egypt
- Job Role
- Information Technology
- Employment Status
- Full time
- Employment Type
- Employee
- Number of Vacancies
- 1
- Career Level
- Entry Level
- Years of Experience
- Min: 2 Max: 5
- Residence Location
- Cairo, Egypt
- Nationality
- Egypt
- Degree
- Bachelor's degree
Develop, construct, test and maintain architectures
Align architecture with business requirements
Data acquisition
Develop data set processes
Use programming language and tools
Identify ways to improve data reliability, efficiency and quality
Conduct research for industry and business questions
Use large data sets to address business issues
Deploy sophisticated analytics programs, machine learning and statistical methods
Prepare data for predictive and prescriptive modeling
Find hidden patterns using data
Use data to discover tasks that can be automated
Deliver updates to stakeholders based on analytics
Assemble large, complex data sets that meet functional / non-functional business requirements.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Any ETL Tool.
Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
Keep our data separated and secure across national boundaries through multiple data centers and Cloud.
Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
Work with data and analytics experts to strive for greater functionality in our data systems.
Business Knowledge/Technical Skills:
Bachelor of Computer Science or Engineering
2+ Years’ Experience
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
Strong analytic skills related to working with unstructured datasets.
Build processes supporting data transformation, data structures, metadata, dependency and workload management.
A successful history of manipulating, processing and extracting value from large disconnected datasets.
Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
Strong project management and organizational skills.
Experience supporting and working with cross-functional teams in a dynamic environment.
**Skills**:
For experience Data engineer
For experience Data engineer
Experience with big data tools: Hadoop, Spark, Kafka, etc.
Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
Experience with AWS cloud services: EC2, EMR, RDS, Redshift
Experience with stream-processing systems: Storm, Spark-Streaming, etc.
Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc
**Education**:
Bachelor degree of Engineering
**Job Details**:
- Job Location
- Cairo, Egypt
- Job Role
- Information Technology
- Employment Status
- Full time
- Employment Type
- Employee
- Number of Vacancies
- 1
- Career Level
- Entry Level
- Years of Experience
- Min: 2 Max: 5
- Residence Location
- Cairo, Egypt
- Nationality
- Egypt
- Degree
- Bachelor's degree
This advertiser has chosen not to accept applicants from your region.
1
Data Engineer
Government Consulting Solutions, LLC
Posted today
Job Viewed
Job Description
We are seeking a full-time Data Engineer in the Northern Virginia area to join our team. you will work with other motivated, talented individuals who inspire one another in a dynamic team environment. The position is an exciting opportunity to grow and be challenged in a role using cutting edge technologies to address exciting problems.
**Key Responsibilities**:
- Create software tools that enable data scientists and transform their tradecraft into agile, accurate, data-driven decisions based upon relationships and correlations in vast amounts of data.
- Support an engineering team dedicated to designing, developing, and maintaining an analytic environment.
- Develop on both AWS unclassified and AWS classified development and production compute environments.
**Basic Qualifications**:
- Bachelor of Science degree in the Mathematics, the Physical Science, Software Engineering, Computer Science or related field with 3-5 years of experience.
- Experience developing and optimizing complex SQL queries to query, join, or filter diverse data sets.
- Familiarity with industry best-practices for software-hardware optimization when processing large sets of data.
- Experience with Agile software development methodologies and tools, including Git and Jira.
- Demonstrated knowledge with some of the following software/tools: Apache NiFi, AWS Cloud environment, Java, Python, NodeJS, SQL, R, Hadoop, PySpark, Java, Git, Bash, Linux/Unix based OS.
**Preferred Qualifications**:
- Creativity and innovation in solving complex problems.
- Organize relevant information using data management tools.
- Experience with deploying Docker containers.
- Understanding of X.509 and PKI security solutions.
- Have developed and used RESTful APIs.
- Motivated to work collaboratively and effectively in a team environment.
**Key Responsibilities**:
- Create software tools that enable data scientists and transform their tradecraft into agile, accurate, data-driven decisions based upon relationships and correlations in vast amounts of data.
- Support an engineering team dedicated to designing, developing, and maintaining an analytic environment.
- Develop on both AWS unclassified and AWS classified development and production compute environments.
**Basic Qualifications**:
- Bachelor of Science degree in the Mathematics, the Physical Science, Software Engineering, Computer Science or related field with 3-5 years of experience.
- Experience developing and optimizing complex SQL queries to query, join, or filter diverse data sets.
- Familiarity with industry best-practices for software-hardware optimization when processing large sets of data.
- Experience with Agile software development methodologies and tools, including Git and Jira.
- Demonstrated knowledge with some of the following software/tools: Apache NiFi, AWS Cloud environment, Java, Python, NodeJS, SQL, R, Hadoop, PySpark, Java, Git, Bash, Linux/Unix based OS.
**Preferred Qualifications**:
- Creativity and innovation in solving complex problems.
- Organize relevant information using data management tools.
- Experience with deploying Docker containers.
- Understanding of X.509 and PKI security solutions.
- Have developed and used RESTful APIs.
- Motivated to work collaboratively and effectively in a team environment.
This advertiser has chosen not to accept applicants from your region.
2
Data Engineer
Government Consulting Solutions, LLC
Posted today
Job Viewed
Job Description
We are seeking a full-time Data Engineer in the Northern Virginia area to join our team. you will work with other motivated, talented individuals who inspire one another in a dynamic team environment. The position is an exciting opportunity to grow and be challenged in a role using cutting edge technologies to address exciting problems.
**Key Responsibilities**:
- Create software tools that enable data scientists and transform their tradecraft into agile, accurate, data-driven decisions based upon relationships and correlations in vast amounts of data.
- Support an engineering team dedicated to designing, developing, and maintaining an analytic environment.
- Develop on both AWS unclassified and AWS classified development and production compute environments.
**Basic Qualifications**:
- Bachelor of Science degree in the Mathematics, the Physical Science, Software Engineering, Computer Science or related field with 3-5 years of experience.
- Experience developing and optimizing complex SQL queries to query, join, or filter diverse data sets.
- Familiarity with industry best-practices for software-hardware optimization when processing large sets of data.
- Experience with Agile software development methodologies and tools, including Git and Jira.
- Demonstrated knowledge with some of the following software/tools: Apache NiFi, AWS Cloud environment, Java, Python, NodeJS, SQL, R, Hadoop, PySpark, Java, Git, Bash, Linux/Unix based OS.
**Preferred Qualifications**:
- Creativity and innovation in solving complex problems.
- Organize relevant information using data management tools.
- Experience with deploying Docker containers.
- Understanding of X.509 and PKI security solutions.
- Have developed and used RESTful APIs.
- Motivated to work collaboratively and effectively in a team environment.
**Key Responsibilities**:
- Create software tools that enable data scientists and transform their tradecraft into agile, accurate, data-driven decisions based upon relationships and correlations in vast amounts of data.
- Support an engineering team dedicated to designing, developing, and maintaining an analytic environment.
- Develop on both AWS unclassified and AWS classified development and production compute environments.
**Basic Qualifications**:
- Bachelor of Science degree in the Mathematics, the Physical Science, Software Engineering, Computer Science or related field with 3-5 years of experience.
- Experience developing and optimizing complex SQL queries to query, join, or filter diverse data sets.
- Familiarity with industry best-practices for software-hardware optimization when processing large sets of data.
- Experience with Agile software development methodologies and tools, including Git and Jira.
- Demonstrated knowledge with some of the following software/tools: Apache NiFi, AWS Cloud environment, Java, Python, NodeJS, SQL, R, Hadoop, PySpark, Java, Git, Bash, Linux/Unix based OS.
**Preferred Qualifications**:
- Creativity and innovation in solving complex problems.
- Organize relevant information using data management tools.
- Experience with deploying Docker containers.
- Understanding of X.509 and PKI security solutions.
- Have developed and used RESTful APIs.
- Motivated to work collaboratively and effectively in a team environment.
This advertiser has chosen not to accept applicants from your region.
3
Data Engineer
AUMET Inc.
Posted today
Job Viewed
Job Description
AUMET is the leading B2B marketplace to sell medical products between healthcare providers and distributors. We are innovating how distributors of medical supplies do business with consumer selling points such as pharmacies.
With 500,000 transactions per month, AUMET marketplace is a fast growing product that is capturing market share and is on a road to achieve its vision. And as we grow we need talented people to help us grow!
As a Data Engineer at Aumet, you will play a crucial role in building and maintaining our data infrastructure to support our business intelligence and analytics needs.
**Responsibilities**:
- Design, develop, and maintain data pipelines and ETL processes to ensure efficient and reliable data extraction, transformation, and loading from various sources into our data warehouse.
- Collaborate with cross-functional teams to understand data requirements and implement data solutions that align with business needs.
- Develop and optimize data models and schemas to support data analytics, reporting, and visualization.
- Implement data governance and security measures to ensure data quality, integrity, and compliance.
- Monitor and troubleshoot data pipelines, identifying and resolving performance and scalability issues.
- Continuously evaluate and recommend improvements to our data infrastructure, tools, and processes to enhance data accessibility and efficiency.
**Requirements**:
- Bachelor's or higher degree in Computer Science, Data Science, or a related field.
- 1-2 years Proven experience as a Data Engineer or in a similar role, with a strong focus on data integration and ETL processes.
- Proficient in programming languages such as Python and SQL
- Experience working with large-scale databases and data warehouses (e.g., SQL Server, PostgreSQL, Redshift).
- Familiarity with cloud-based data platforms and services (e.g., AWS, Azure, Google Cloud).
- Strong understanding of data modeling, data warehousing, and data pipeline architecture.
- Knowledge of data governance, data security, and privacy regulations (e.g., GDPR) is a plus.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills, with the ability to work effectively in a team-oriented environment.
With 500,000 transactions per month, AUMET marketplace is a fast growing product that is capturing market share and is on a road to achieve its vision. And as we grow we need talented people to help us grow!
As a Data Engineer at Aumet, you will play a crucial role in building and maintaining our data infrastructure to support our business intelligence and analytics needs.
**Responsibilities**:
- Design, develop, and maintain data pipelines and ETL processes to ensure efficient and reliable data extraction, transformation, and loading from various sources into our data warehouse.
- Collaborate with cross-functional teams to understand data requirements and implement data solutions that align with business needs.
- Develop and optimize data models and schemas to support data analytics, reporting, and visualization.
- Implement data governance and security measures to ensure data quality, integrity, and compliance.
- Monitor and troubleshoot data pipelines, identifying and resolving performance and scalability issues.
- Continuously evaluate and recommend improvements to our data infrastructure, tools, and processes to enhance data accessibility and efficiency.
**Requirements**:
- Bachelor's or higher degree in Computer Science, Data Science, or a related field.
- 1-2 years Proven experience as a Data Engineer or in a similar role, with a strong focus on data integration and ETL processes.
- Proficient in programming languages such as Python and SQL
- Experience working with large-scale databases and data warehouses (e.g., SQL Server, PostgreSQL, Redshift).
- Familiarity with cloud-based data platforms and services (e.g., AWS, Azure, Google Cloud).
- Strong understanding of data modeling, data warehousing, and data pipeline architecture.
- Knowledge of data governance, data security, and privacy regulations (e.g., GDPR) is a plus.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills, with the ability to work effectively in a team-oriented environment.
This advertiser has chosen not to accept applicants from your region.
4
Data Engineer
Evolvice GmbH
Posted today
Job Viewed
Job Description
Location: Egypt / Cairo
- Employment Type: Full Time
- Job ID: 33695
**Who we are**:
Evolvice is a German nearshore service provider with branches in Egypt and Ukraine. Founded in 2012, Evolvice has a strong technical background and business domain knowledge, combining software engineering and Agile methodology, leading its’ clients path to digital transformation. Headquartered in the heart of the automobile industry, Stuttgart (Germany), our expertise stretches from automotive, healthcare, travel, financial, governmental, insurance to manufacturing industries.
Our team is over 50 people including web (C#/.NET, Java, JS) & mobile (iOS/Android/Ionic) developers together with business analysts, project managers, QA and support staff. Our corporate culture is characterized by agile processes, autonomous teams without hierarchies, as well as openness and transparency - both internally and with our clients. Currently, we are searching for Senior Business Analyst to join the big team of professional in Cairo. We are looking for an active, responsive, and devoted person.
**Our Culture**:
Our teams include +**25** talented Developers & QA that come from a variety of backgrounds. We’re Keen on building an inclusive culture based on trust and innovation and value every skill set while maintaining a family-like environment where everyone is heard and appreciated.
- So, if you are searching for a new challenging role where you can use all of your Software development skills and work closely with International Organizations and Up to date Technologies, We are Looking For You!
**Your Profile**:
- ETL pipelines and tools (Informatica, Denodo)
- Data Integrations
- Advanced skills in SQL (e.g. Complex SQL queries optimization)
- Big data processing
- Feature Engineering
- Data quality evaluation and enhancement
- Data migration
- Knowledge in BI tools (Tableau)
- Strong Experience in Data Warehousing and Data lake (Cloudera and Hive)
**Your Mission**:
- Design, build, and maintain scalable and robust data pipelines for extracting, transforming, and loading data from various sources into our data warehouse.
- Optimize and tune existing data pipelines for performance, reliability, and scalability.
- Develop and implement data integration solutions to enable seamless data flow between different systems and platforms.
- Collaborate with cross-functional teams to understand data requirements and provide technical expertise in designing data models and schemas.
- Evaluate and select appropriate technologies and tools to support data infrastructure needs, keeping abreast of industry trends and best practices.
- Ensure data quality and integrity by implementing data validation and cleansing processes.
- Monitor and troubleshoot data infrastructure issues, performing root cause analysis and implementing preventive measures.
- Document data processes, workflows, and infrastructure components to facilitate knowledge sharing and maintain system documentation.
**Work Setup**:
- Location: #Maadi
- Work Model: Hybrid (2 days from office-3 from home)
- Working Hours: Flexible
- Fridays and Saturdays are off
**Perks and Benefits**:
- A basic monthly net salary determined by the experience in Euro
- Social and Medical Insurance
- Salary reviews after Trial Period based on performance
- Unlimited drinks at the office
- An amazing accessible office in Maadi.
- Career and skills development
- Last but not least an AMAZING team!
- Employment Type: Full Time
- Job ID: 33695
**Who we are**:
Evolvice is a German nearshore service provider with branches in Egypt and Ukraine. Founded in 2012, Evolvice has a strong technical background and business domain knowledge, combining software engineering and Agile methodology, leading its’ clients path to digital transformation. Headquartered in the heart of the automobile industry, Stuttgart (Germany), our expertise stretches from automotive, healthcare, travel, financial, governmental, insurance to manufacturing industries.
Our team is over 50 people including web (C#/.NET, Java, JS) & mobile (iOS/Android/Ionic) developers together with business analysts, project managers, QA and support staff. Our corporate culture is characterized by agile processes, autonomous teams without hierarchies, as well as openness and transparency - both internally and with our clients. Currently, we are searching for Senior Business Analyst to join the big team of professional in Cairo. We are looking for an active, responsive, and devoted person.
**Our Culture**:
Our teams include +**25** talented Developers & QA that come from a variety of backgrounds. We’re Keen on building an inclusive culture based on trust and innovation and value every skill set while maintaining a family-like environment where everyone is heard and appreciated.
- So, if you are searching for a new challenging role where you can use all of your Software development skills and work closely with International Organizations and Up to date Technologies, We are Looking For You!
**Your Profile**:
- ETL pipelines and tools (Informatica, Denodo)
- Data Integrations
- Advanced skills in SQL (e.g. Complex SQL queries optimization)
- Big data processing
- Feature Engineering
- Data quality evaluation and enhancement
- Data migration
- Knowledge in BI tools (Tableau)
- Strong Experience in Data Warehousing and Data lake (Cloudera and Hive)
**Your Mission**:
- Design, build, and maintain scalable and robust data pipelines for extracting, transforming, and loading data from various sources into our data warehouse.
- Optimize and tune existing data pipelines for performance, reliability, and scalability.
- Develop and implement data integration solutions to enable seamless data flow between different systems and platforms.
- Collaborate with cross-functional teams to understand data requirements and provide technical expertise in designing data models and schemas.
- Evaluate and select appropriate technologies and tools to support data infrastructure needs, keeping abreast of industry trends and best practices.
- Ensure data quality and integrity by implementing data validation and cleansing processes.
- Monitor and troubleshoot data infrastructure issues, performing root cause analysis and implementing preventive measures.
- Document data processes, workflows, and infrastructure components to facilitate knowledge sharing and maintain system documentation.
**Work Setup**:
- Location: #Maadi
- Work Model: Hybrid (2 days from office-3 from home)
- Working Hours: Flexible
- Fridays and Saturdays are off
**Perks and Benefits**:
- A basic monthly net salary determined by the experience in Euro
- Social and Medical Insurance
- Salary reviews after Trial Period based on performance
- Unlimited drinks at the office
- An amazing accessible office in Maadi.
- Career and skills development
- Last but not least an AMAZING team!
This advertiser has chosen not to accept applicants from your region.
5
Data Engineer
NorthBay Solutions
Posted today
Job Viewed
Job Description
**Our Tech Stack**:
- ** Languages**: SQL & Python
- ** Pipeline Orchestration Tool**: Dagster (Legacy: Airflow)
- ** Data Stores**: Snowflake, Clickhouse
- ** Platforms & Services**: Docker, Kubernetes
- ** PaaS**: AWS (ECS/EKS, DMS, Kinesis, Glue, Athena, S3, and others)
- ** ETL**: FiveTran & DBT for transformation
- ** IaC**: Terraform (with Terragrunt)
**Key Responsibilities**:
- Develop and maintain ETL pipelines using SQL and/or Python.
- Use tools like Dagster/Airflow for pipeline orchestration.
- Collaborate with cross-functional teams to understand and deliver data requirements.
- Ensure a consistent flow of high-quality data using stream, batch, and CDC processes.
- Use data transformation tools like DBT to prepare datasets for business users to self-service.
- Ensure data quality and consistency across all data stores.
- Monitor and troubleshoot data pipelines for performance and reliability.
**Essential Experience**:
- 3+ years of experience as a data engineer.
- Proficiency in SQL.
- Experience with modern cloud data warehousing and data lake solutions like Snowflake, BigQuery, Redshift, Azure Synapse.
- Experience with ETL/ELT, batch, and streaming data processing pipelines.
- Excellent ability to investigate and troubleshoot data issues, providing fixes and proposing both short and long-term solutions.
- Knowledge of AWS services (such as S3, DMS, Glue, Athena, etc.).
- Familiarity with dbt or other data transformation tools.
**Other Desired Experience**:
- Experience with AWS services and concepts (such as EC2, ECS, EKS, VPC, IAM, etc.).
- Familiarity with Terraform and Terragrunt.
- Experience with Python.
- Experience with orchestration tools like Dagster, Airflow, AWS Step Functions, etc.
- Experience with pub-sub, queuing, and streaming frameworks such as AWS Kinesis, Kafka, SQS, SNS.
- Familiarity with CI/CD pipelines and automation.
**Equal Opportunity Employer**: We are an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
ekAWInNxf2
- ** Languages**: SQL & Python
- ** Pipeline Orchestration Tool**: Dagster (Legacy: Airflow)
- ** Data Stores**: Snowflake, Clickhouse
- ** Platforms & Services**: Docker, Kubernetes
- ** PaaS**: AWS (ECS/EKS, DMS, Kinesis, Glue, Athena, S3, and others)
- ** ETL**: FiveTran & DBT for transformation
- ** IaC**: Terraform (with Terragrunt)
**Key Responsibilities**:
- Develop and maintain ETL pipelines using SQL and/or Python.
- Use tools like Dagster/Airflow for pipeline orchestration.
- Collaborate with cross-functional teams to understand and deliver data requirements.
- Ensure a consistent flow of high-quality data using stream, batch, and CDC processes.
- Use data transformation tools like DBT to prepare datasets for business users to self-service.
- Ensure data quality and consistency across all data stores.
- Monitor and troubleshoot data pipelines for performance and reliability.
**Essential Experience**:
- 3+ years of experience as a data engineer.
- Proficiency in SQL.
- Experience with modern cloud data warehousing and data lake solutions like Snowflake, BigQuery, Redshift, Azure Synapse.
- Experience with ETL/ELT, batch, and streaming data processing pipelines.
- Excellent ability to investigate and troubleshoot data issues, providing fixes and proposing both short and long-term solutions.
- Knowledge of AWS services (such as S3, DMS, Glue, Athena, etc.).
- Familiarity with dbt or other data transformation tools.
**Other Desired Experience**:
- Experience with AWS services and concepts (such as EC2, ECS, EKS, VPC, IAM, etc.).
- Familiarity with Terraform and Terragrunt.
- Experience with Python.
- Experience with orchestration tools like Dagster, Airflow, AWS Step Functions, etc.
- Experience with pub-sub, queuing, and streaming frameworks such as AWS Kinesis, Kafka, SQS, SNS.
- Familiarity with CI/CD pipelines and automation.
**Equal Opportunity Employer**: We are an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
ekAWInNxf2
This advertiser has chosen not to accept applicants from your region.
Be The First To Know
About the latest Reporting engineer Jobs in Egypt !
6
Data Engineer-Data Integration
Cairo, Al Qahirah
IBM
Posted 5 days ago
Job Viewed
Job Description
**Introduction**
As a Data Engineer, you will lead IBM into the future by translating system requirements into the design and development of customized systems in an agile environment. The success of IBM is in your hands as you transform vital business needs into code and drive innovation. Your work will power IBM and its clients globally, collaborating and integrating code into enterprise systems. You will have access to the latest education, tools and technology, and a limitless career path with the world's technology leader. Come to IBM and make a global impact!
**Your role and responsibilities**
A Data Engineer with expertise in Data Integration is responsible for designing and building solutions to transfer data from operational and external environments to the business intelligence environment. They utilize tools such as Informatica, Ab Initio software, and DataStage (formerly Ascential) - IBM's WebSphere Data Integration Suite. This role involves creating and implementing Extract, Transform, and Load (ETL) processes, ensuring the seamless flow of data throughout the business intelligence solution's lifecycle.
**Required technical and professional expertise**
A Data Engineer with expertise in Data Integration is responsible for designing and building solutions to transfer data from operational and external environments to the business intelligence environment. They utilize tools such as Informatica, Ab Initio software, and DataStage (formerly Ascential) - IBM's WebSphere Data Integration Suite. This role involves creating and implementing Extract, Transform, and Load (ETL) processes, ensuring the seamless flow of data throughout the business intelligence solution's lifecycle.
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
As a Data Engineer, you will lead IBM into the future by translating system requirements into the design and development of customized systems in an agile environment. The success of IBM is in your hands as you transform vital business needs into code and drive innovation. Your work will power IBM and its clients globally, collaborating and integrating code into enterprise systems. You will have access to the latest education, tools and technology, and a limitless career path with the world's technology leader. Come to IBM and make a global impact!
**Your role and responsibilities**
A Data Engineer with expertise in Data Integration is responsible for designing and building solutions to transfer data from operational and external environments to the business intelligence environment. They utilize tools such as Informatica, Ab Initio software, and DataStage (formerly Ascential) - IBM's WebSphere Data Integration Suite. This role involves creating and implementing Extract, Transform, and Load (ETL) processes, ensuring the seamless flow of data throughout the business intelligence solution's lifecycle.
**Required technical and professional expertise**
A Data Engineer with expertise in Data Integration is responsible for designing and building solutions to transfer data from operational and external environments to the business intelligence environment. They utilize tools such as Informatica, Ab Initio software, and DataStage (formerly Ascential) - IBM's WebSphere Data Integration Suite. This role involves creating and implementing Extract, Transform, and Load (ETL) processes, ensuring the seamless flow of data throughout the business intelligence solution's lifecycle.
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
This advertiser has chosen not to accept applicants from your region.
7
Data Engineer-Data Integration
Cairo, Al Qahirah
IBM
Posted 5 days ago
Job Viewed
Job Description
**Introduction**
* 5-7 years of full-time working experience in Data Engineering domain.
* Expertise in Snowflake, Azure/Fabric, DBT, BW, Python, SQL and must have excellent understanding of databases.
* Must have experience with Cloud data integration.
* Good knowledge of Data Modeling, industrial modeling, Analytic model, data architecture, dimensional modeling, 3rd normal form model, Kimball model, Inmon model, Data Integration and Business Intelligence.
* Demonstrated ability in solutioning covering data ingestion, data cleansing, ETL, data mart creation and exposing data for consumers.
**Your role and responsibilities**
Designs and builds solutions to move data from operational and external environments to the business intelligence, data warehouse and data lake environments using Snowflake and Azure/Fabirc, DBT and BW. Skills include designing and developing extract, transform and load (ETL) and extract, load and transform (ELT) pipelines. Experience includes full lifecycle implementation of the technical components of a data warehouse, data lake and business intelligence solutions.
Position Keywords
#snowflake #dbt #azure #python #sql #modeling
**Required technical and professional expertise**
* SnowPro Advanced: Data Engineer Certification.
* Microsoft Certified: Fabric Data Engineer Associate Certification.
**Preferred technical and professional experience**
Hiring manager and Recruiter should collaborate to create the relevant verbiage.
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
* 5-7 years of full-time working experience in Data Engineering domain.
* Expertise in Snowflake, Azure/Fabric, DBT, BW, Python, SQL and must have excellent understanding of databases.
* Must have experience with Cloud data integration.
* Good knowledge of Data Modeling, industrial modeling, Analytic model, data architecture, dimensional modeling, 3rd normal form model, Kimball model, Inmon model, Data Integration and Business Intelligence.
* Demonstrated ability in solutioning covering data ingestion, data cleansing, ETL, data mart creation and exposing data for consumers.
**Your role and responsibilities**
Designs and builds solutions to move data from operational and external environments to the business intelligence, data warehouse and data lake environments using Snowflake and Azure/Fabirc, DBT and BW. Skills include designing and developing extract, transform and load (ETL) and extract, load and transform (ELT) pipelines. Experience includes full lifecycle implementation of the technical components of a data warehouse, data lake and business intelligence solutions.
Position Keywords
#snowflake #dbt #azure #python #sql #modeling
**Required technical and professional expertise**
* SnowPro Advanced: Data Engineer Certification.
* Microsoft Certified: Fabric Data Engineer Associate Certification.
**Preferred technical and professional experience**
Hiring manager and Recruiter should collaborate to create the relevant verbiage.
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
This advertiser has chosen not to accept applicants from your region.
8
Data Engineer-Data Integration
Cairo, Al Qahirah
IBM
Posted 9 days ago
Job Viewed
Job Description
**Introduction**
In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe.
You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio; including Software and Red Hat.
Curiosity and a constant quest for knowledge serve as the foundation to success in IBM Consulting. In your role, you'll be encouraged to challenge the norm, investigate ideas outside of your role, and come up with creative solutions resulting in ground breaking impact for a wide network of clients. Our culture of evolution and empathy centers on long-term career growth and development opportunities in an environment that embraces your unique skills and experience.
**Your role and responsibilities**
Designs and builds solutions to move data from operational and external environments to the business intelligence, data warehouse and data lake environments using Snowflake and Azure/Fabirc, DBT and BW. Skills include designing and developing extract, transform and load (ETL) and extract, load and transform (ELT) pipelines. Experience includes full lifecycle implementation of the technical components of a data warehouse, data lake and business intelligence solutions.
Position Keywords
#snowflake #dbt #azure #python #sql #modeling
**Required technical and professional expertise**
* 5-7 years of full-time working experience in Data Engineering domain.
* Expertise in Snowflake, Azure/Fabric, DBT, BW, Python, SQL and must have excellent understanding of databases.
* Must have experience with Cloud data integration.
* Good knowledge of Data Modeling, industrial modeling, Analytic model, data architecture, dimensional modeling, 3rd normal form model, Kimball model, Inmon model, Data Integration and Business Intelligence.
* Demonstrated ability in solutioning covering data ingestion, data cleansing, ETL, data mart creation and exposing data for consumers.
**Preferred technical and professional experience**
* SnowPro Advanced: Data Engineer Certification.
* Microsoft Certified: Fabric Data Engineer Associate Certification.
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe.
You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio; including Software and Red Hat.
Curiosity and a constant quest for knowledge serve as the foundation to success in IBM Consulting. In your role, you'll be encouraged to challenge the norm, investigate ideas outside of your role, and come up with creative solutions resulting in ground breaking impact for a wide network of clients. Our culture of evolution and empathy centers on long-term career growth and development opportunities in an environment that embraces your unique skills and experience.
**Your role and responsibilities**
Designs and builds solutions to move data from operational and external environments to the business intelligence, data warehouse and data lake environments using Snowflake and Azure/Fabirc, DBT and BW. Skills include designing and developing extract, transform and load (ETL) and extract, load and transform (ELT) pipelines. Experience includes full lifecycle implementation of the technical components of a data warehouse, data lake and business intelligence solutions.
Position Keywords
#snowflake #dbt #azure #python #sql #modeling
**Required technical and professional expertise**
* 5-7 years of full-time working experience in Data Engineering domain.
* Expertise in Snowflake, Azure/Fabric, DBT, BW, Python, SQL and must have excellent understanding of databases.
* Must have experience with Cloud data integration.
* Good knowledge of Data Modeling, industrial modeling, Analytic model, data architecture, dimensional modeling, 3rd normal form model, Kimball model, Inmon model, Data Integration and Business Intelligence.
* Demonstrated ability in solutioning covering data ingestion, data cleansing, ETL, data mart creation and exposing data for consumers.
**Preferred technical and professional experience**
* SnowPro Advanced: Data Engineer Certification.
* Microsoft Certified: Fabric Data Engineer Associate Certification.
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
This advertiser has chosen not to accept applicants from your region.
9