22 Big Data Hadoop jobs in Egypt
Data Engineer
Arrow Electronics
Posted 10 days ago
Job Viewed
Job Description
**Position:**
Data Engineer
**Job Description:**
**ESSENTIAL DUTIES & RESPONSIBILITIES**
+ Apply the knowledge of engineering on electronic products to develop the newly introduced parts with technical parameters in different areas daily.
+ Apply the knowledge of engineering in different data development stages, including but not limited to Part number decoding, Electrical/ performance characteristics, compliance, and Lifecycle data collection.
+ Apply the knowledge of engineering on electronic products to track updates in technical Documents revisions and identify the high technical changes to update on the Database.
+ Develop Customer requests after handling them to enter in the Database.
+ Apply a checklist to keep and maintain our data with high quality.
**SKILLS & EXPERIENCE REQUIREMENTS:**
+ Bachelor's degree in Electrical or Electronics Engineering.
+ 0 to 1 year of relevant experience.
+ Familiarity with electronic components and systems.
+ Strong English language skills (written, read, and spoken).
+ Good knowledge of at least one programming language (Python or Java).
+ Proficient in data analysis using Excel, Power BI, or Python.
+ Ability to write code and scripts to automate data processes using languages such as Python, Java, or Scala.
+ Commitment to continuously optimizing data processes for improved efficiency and scalability.
+ Experience in implementing data quality checks and monitoring systems to proactively detect and resolve issues.
+ Proven experience working on projects utilizing technologies such as Python, Power BI, or related tools.
**Location:**
EG-Banha, Egypt (EI Corniche Street)
**Time Type:**
Full time
**Job Category:**
Engineering and Technology
Arrow Electronics, Inc.'s policy is to provide equal employment opportunities to all qualified employees and applicants without regard to race, color, religion, age, sex, marital status, gender identity or expression, sexual orientation, national origin, disability, citizenship, veran status, genetic information, or any other characteristics protected by applicable state, federal or local laws. Our policy of equal employment opportunity and affirmative action applies to all employment decisions personnel policies and practices, or programs.
Data Engineer
**Job Description:**
**ESSENTIAL DUTIES & RESPONSIBILITIES**
+ Apply the knowledge of engineering on electronic products to develop the newly introduced parts with technical parameters in different areas daily.
+ Apply the knowledge of engineering in different data development stages, including but not limited to Part number decoding, Electrical/ performance characteristics, compliance, and Lifecycle data collection.
+ Apply the knowledge of engineering on electronic products to track updates in technical Documents revisions and identify the high technical changes to update on the Database.
+ Develop Customer requests after handling them to enter in the Database.
+ Apply a checklist to keep and maintain our data with high quality.
**SKILLS & EXPERIENCE REQUIREMENTS:**
+ Bachelor's degree in Electrical or Electronics Engineering.
+ 0 to 1 year of relevant experience.
+ Familiarity with electronic components and systems.
+ Strong English language skills (written, read, and spoken).
+ Good knowledge of at least one programming language (Python or Java).
+ Proficient in data analysis using Excel, Power BI, or Python.
+ Ability to write code and scripts to automate data processes using languages such as Python, Java, or Scala.
+ Commitment to continuously optimizing data processes for improved efficiency and scalability.
+ Experience in implementing data quality checks and monitoring systems to proactively detect and resolve issues.
+ Proven experience working on projects utilizing technologies such as Python, Power BI, or related tools.
**Location:**
EG-Banha, Egypt (EI Corniche Street)
**Time Type:**
Full time
**Job Category:**
Engineering and Technology
Arrow Electronics, Inc.'s policy is to provide equal employment opportunities to all qualified employees and applicants without regard to race, color, religion, age, sex, marital status, gender identity or expression, sexual orientation, national origin, disability, citizenship, veran status, genetic information, or any other characteristics protected by applicable state, federal or local laws. Our policy of equal employment opportunity and affirmative action applies to all employment decisions personnel policies and practices, or programs.
This advertiser has chosen not to accept applicants from your region.
0
Data Engineer
Mansoura
Qsource Business Services
Posted today
Job Viewed
Job Description
Qsource is hiring Data Engineer for a well-known company working in the Financial Solution field located in 6th October City.
Working Hours: 9 to 5
Day off: Friday, Saturday
Duties:
Working on developing data pipelines, ETL jobs, automation, data preparation;
- Analyzing user requirements and translating them into Data Engineering problems;
- Designing, development and maintaining robust, production-ready analytics pipelines - from data ingestion to data service;
- Working with different architectures based on streaming and batch data;
- Researching and testing new concepts and technologies for data manipulation;
- Working with different databases (both SQL and NoSQL) and object storage;
- Working in a cross-functional team in order to deliver values to the client;
- Collaboration with the clients in order to understand and satisfy the business requirements.
Qualifications:
- Bachelor or master’s degree in computer science, information technologies, or related field is required
- English: Very Good to Fluent
- 1+ year of relevant experience in development or data engineering
- Relevant knowledge of Python, SQL/NoSQL, microservices, and GIT
- Understand UNIX based systems
- Basic knowledge of software development and programming languages
- especially the understanding of data structures and data types
- knowledge of Pandas, Spark, Bash scripting, Hadoop, Elastic, Kafka, Scala will be considered an advantage
- Experience with containerization technologies: Docker, Kubernetes will be considered an advantage
- Organized, proactive, fast learner
- Strong problem-solving and analytical skills
Working Hours: 9 to 5
Day off: Friday, Saturday
Duties:
Working on developing data pipelines, ETL jobs, automation, data preparation;
- Analyzing user requirements and translating them into Data Engineering problems;
- Designing, development and maintaining robust, production-ready analytics pipelines - from data ingestion to data service;
- Working with different architectures based on streaming and batch data;
- Researching and testing new concepts and technologies for data manipulation;
- Working with different databases (both SQL and NoSQL) and object storage;
- Working in a cross-functional team in order to deliver values to the client;
- Collaboration with the clients in order to understand and satisfy the business requirements.
Qualifications:
- Bachelor or master’s degree in computer science, information technologies, or related field is required
- English: Very Good to Fluent
- 1+ year of relevant experience in development or data engineering
- Relevant knowledge of Python, SQL/NoSQL, microservices, and GIT
- Understand UNIX based systems
- Basic knowledge of software development and programming languages
- especially the understanding of data structures and data types
- knowledge of Pandas, Spark, Bash scripting, Hadoop, Elastic, Kafka, Scala will be considered an advantage
- Experience with containerization technologies: Docker, Kubernetes will be considered an advantage
- Organized, proactive, fast learner
- Strong problem-solving and analytical skills
This advertiser has chosen not to accept applicants from your region.
1
Data Engineer
Nagwa
Posted today
Job Viewed
Job Description
**Summary**
**Responsibilities**
- Work with stakeholders as well as the Product and Business Teams to assist with data-related technical issues and support their data infrastructure needs
- Assist in building the required infrastructure for optimal extraction, transformation, and data loading from a wide variety of data sources using AWS big data technologies
- Develop and implement databases and data collection systems and undertake preprocessing of structured and unstructured data
- Work with data to solve business problems and build and maintain the infrastructure to answer the stakeholders’ questions and improve our processes
- Use analytical tools that utilize and visualize data and report this to provide actionable insights
**Qualifications & Work Experience**
- 0 to 2 years of relevant experience in a relevant position
- Bachelor’s degree in computer science, computer software, information technology, or any relevant discipline
- Familiarity with AWS (AWS Redshift, AWS Glue, AWS S3, AWS kinesis and Data Lake) is a necessity
- Background in data warehouse design (e.g., dimensional modelling) and data mining
- Experience with reporting tools like Tableau, AWS QuickSight, Looker, and Power BI is a necessity
- Good knowledge of programming languages
**Behavioural Competencies**
- Excellent communicator
- Excellent organizational skills
- Accuracy and attention to detail
- Multi-tasking
aue3pzb29J
**Responsibilities**
- Work with stakeholders as well as the Product and Business Teams to assist with data-related technical issues and support their data infrastructure needs
- Assist in building the required infrastructure for optimal extraction, transformation, and data loading from a wide variety of data sources using AWS big data technologies
- Develop and implement databases and data collection systems and undertake preprocessing of structured and unstructured data
- Work with data to solve business problems and build and maintain the infrastructure to answer the stakeholders’ questions and improve our processes
- Use analytical tools that utilize and visualize data and report this to provide actionable insights
**Qualifications & Work Experience**
- 0 to 2 years of relevant experience in a relevant position
- Bachelor’s degree in computer science, computer software, information technology, or any relevant discipline
- Familiarity with AWS (AWS Redshift, AWS Glue, AWS S3, AWS kinesis and Data Lake) is a necessity
- Background in data warehouse design (e.g., dimensional modelling) and data mining
- Experience with reporting tools like Tableau, AWS QuickSight, Looker, and Power BI is a necessity
- Good knowledge of programming languages
**Behavioural Competencies**
- Excellent communicator
- Excellent organizational skills
- Accuracy and attention to detail
- Multi-tasking
aue3pzb29J
This advertiser has chosen not to accept applicants from your region.
2
Data Engineer-Data Integration
Cairo, Al Qahirah
IBM
Posted 4 days ago
Job Viewed
Job Description
**Introduction**
As a Data Engineer, you will lead IBM into the future by translating system requirements into the design and development of customized systems in an agile environment. The success of IBM is in your hands as you transform vital business needs into code and drive innovation. Your work will power IBM and its clients globally, collaborating and integrating code into enterprise systems. You will have access to the latest education, tools and technology, and a limitless career path with the world's technology leader. Come to IBM and make a global impact!
**Your role and responsibilities**
A Data Engineer with expertise in Data Integration is responsible for designing and building solutions to transfer data from operational and external environments to the business intelligence environment. They utilize tools such as Informatica, Ab Initio software, and DataStage (formerly Ascential) - IBM's WebSphere Data Integration Suite. This role involves creating and implementing Extract, Transform, and Load (ETL) processes, ensuring the seamless flow of data throughout the business intelligence solution's lifecycle.
**Required technical and professional expertise**
A Data Engineer with expertise in Data Integration is responsible for designing and building solutions to transfer data from operational and external environments to the business intelligence environment. They utilize tools such as Informatica, Ab Initio software, and DataStage (formerly Ascential) - IBM's WebSphere Data Integration Suite. This role involves creating and implementing Extract, Transform, and Load (ETL) processes, ensuring the seamless flow of data throughout the business intelligence solution's lifecycle.
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
As a Data Engineer, you will lead IBM into the future by translating system requirements into the design and development of customized systems in an agile environment. The success of IBM is in your hands as you transform vital business needs into code and drive innovation. Your work will power IBM and its clients globally, collaborating and integrating code into enterprise systems. You will have access to the latest education, tools and technology, and a limitless career path with the world's technology leader. Come to IBM and make a global impact!
**Your role and responsibilities**
A Data Engineer with expertise in Data Integration is responsible for designing and building solutions to transfer data from operational and external environments to the business intelligence environment. They utilize tools such as Informatica, Ab Initio software, and DataStage (formerly Ascential) - IBM's WebSphere Data Integration Suite. This role involves creating and implementing Extract, Transform, and Load (ETL) processes, ensuring the seamless flow of data throughout the business intelligence solution's lifecycle.
**Required technical and professional expertise**
A Data Engineer with expertise in Data Integration is responsible for designing and building solutions to transfer data from operational and external environments to the business intelligence environment. They utilize tools such as Informatica, Ab Initio software, and DataStage (formerly Ascential) - IBM's WebSphere Data Integration Suite. This role involves creating and implementing Extract, Transform, and Load (ETL) processes, ensuring the seamless flow of data throughout the business intelligence solution's lifecycle.
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
This advertiser has chosen not to accept applicants from your region.
3
Data Engineer-Data Integration
Cairo, Al Qahirah
IBM
Posted 4 days ago
Job Viewed
Job Description
**Introduction**
* 5-7 years of full-time working experience in Data Engineering domain.
* Expertise in Snowflake, Azure/Fabric, DBT, BW, Python, SQL and must have excellent understanding of databases.
* Must have experience with Cloud data integration.
* Good knowledge of Data Modeling, industrial modeling, Analytic model, data architecture, dimensional modeling, 3rd normal form model, Kimball model, Inmon model, Data Integration and Business Intelligence.
* Demonstrated ability in solutioning covering data ingestion, data cleansing, ETL, data mart creation and exposing data for consumers.
**Your role and responsibilities**
Designs and builds solutions to move data from operational and external environments to the business intelligence, data warehouse and data lake environments using Snowflake and Azure/Fabirc, DBT and BW. Skills include designing and developing extract, transform and load (ETL) and extract, load and transform (ELT) pipelines. Experience includes full lifecycle implementation of the technical components of a data warehouse, data lake and business intelligence solutions.
Position Keywords
#snowflake #dbt #azure #python #sql #modeling
**Required technical and professional expertise**
* SnowPro Advanced: Data Engineer Certification.
* Microsoft Certified: Fabric Data Engineer Associate Certification.
**Preferred technical and professional experience**
Hiring manager and Recruiter should collaborate to create the relevant verbiage.
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
* 5-7 years of full-time working experience in Data Engineering domain.
* Expertise in Snowflake, Azure/Fabric, DBT, BW, Python, SQL and must have excellent understanding of databases.
* Must have experience with Cloud data integration.
* Good knowledge of Data Modeling, industrial modeling, Analytic model, data architecture, dimensional modeling, 3rd normal form model, Kimball model, Inmon model, Data Integration and Business Intelligence.
* Demonstrated ability in solutioning covering data ingestion, data cleansing, ETL, data mart creation and exposing data for consumers.
**Your role and responsibilities**
Designs and builds solutions to move data from operational and external environments to the business intelligence, data warehouse and data lake environments using Snowflake and Azure/Fabirc, DBT and BW. Skills include designing and developing extract, transform and load (ETL) and extract, load and transform (ELT) pipelines. Experience includes full lifecycle implementation of the technical components of a data warehouse, data lake and business intelligence solutions.
Position Keywords
#snowflake #dbt #azure #python #sql #modeling
**Required technical and professional expertise**
* SnowPro Advanced: Data Engineer Certification.
* Microsoft Certified: Fabric Data Engineer Associate Certification.
**Preferred technical and professional experience**
Hiring manager and Recruiter should collaborate to create the relevant verbiage.
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
This advertiser has chosen not to accept applicants from your region.
4
Data Engineer-Data Integration
Cairo, Al Qahirah
IBM
Posted 8 days ago
Job Viewed
Job Description
**Introduction**
In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe.
You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio; including Software and Red Hat.
Curiosity and a constant quest for knowledge serve as the foundation to success in IBM Consulting. In your role, you'll be encouraged to challenge the norm, investigate ideas outside of your role, and come up with creative solutions resulting in ground breaking impact for a wide network of clients. Our culture of evolution and empathy centers on long-term career growth and development opportunities in an environment that embraces your unique skills and experience.
**Your role and responsibilities**
Designs and builds solutions to move data from operational and external environments to the business intelligence, data warehouse and data lake environments using Snowflake and Azure/Fabirc, DBT and BW. Skills include designing and developing extract, transform and load (ETL) and extract, load and transform (ELT) pipelines. Experience includes full lifecycle implementation of the technical components of a data warehouse, data lake and business intelligence solutions.
Position Keywords
#snowflake #dbt #azure #python #sql #modeling
**Required technical and professional expertise**
* 5-7 years of full-time working experience in Data Engineering domain.
* Expertise in Snowflake, Azure/Fabric, DBT, BW, Python, SQL and must have excellent understanding of databases.
* Must have experience with Cloud data integration.
* Good knowledge of Data Modeling, industrial modeling, Analytic model, data architecture, dimensional modeling, 3rd normal form model, Kimball model, Inmon model, Data Integration and Business Intelligence.
* Demonstrated ability in solutioning covering data ingestion, data cleansing, ETL, data mart creation and exposing data for consumers.
**Preferred technical and professional experience**
* SnowPro Advanced: Data Engineer Certification.
* Microsoft Certified: Fabric Data Engineer Associate Certification.
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe.
You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio; including Software and Red Hat.
Curiosity and a constant quest for knowledge serve as the foundation to success in IBM Consulting. In your role, you'll be encouraged to challenge the norm, investigate ideas outside of your role, and come up with creative solutions resulting in ground breaking impact for a wide network of clients. Our culture of evolution and empathy centers on long-term career growth and development opportunities in an environment that embraces your unique skills and experience.
**Your role and responsibilities**
Designs and builds solutions to move data from operational and external environments to the business intelligence, data warehouse and data lake environments using Snowflake and Azure/Fabirc, DBT and BW. Skills include designing and developing extract, transform and load (ETL) and extract, load and transform (ELT) pipelines. Experience includes full lifecycle implementation of the technical components of a data warehouse, data lake and business intelligence solutions.
Position Keywords
#snowflake #dbt #azure #python #sql #modeling
**Required technical and professional expertise**
* 5-7 years of full-time working experience in Data Engineering domain.
* Expertise in Snowflake, Azure/Fabric, DBT, BW, Python, SQL and must have excellent understanding of databases.
* Must have experience with Cloud data integration.
* Good knowledge of Data Modeling, industrial modeling, Analytic model, data architecture, dimensional modeling, 3rd normal form model, Kimball model, Inmon model, Data Integration and Business Intelligence.
* Demonstrated ability in solutioning covering data ingestion, data cleansing, ETL, data mart creation and exposing data for consumers.
**Preferred technical and professional experience**
* SnowPro Advanced: Data Engineer Certification.
* Microsoft Certified: Fabric Data Engineer Associate Certification.
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
This advertiser has chosen not to accept applicants from your region.
5
Data Engineer-Data Integration
Cairo, Al Qahirah
IBM
Posted 24 days ago
Job Viewed
Job Description
**Introduction**
In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe.
You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio; including Software and Red Hat.
Curiosity and a constant quest for knowledge serve as the foundation to success in IBM Consulting. In your role, you'll be encouraged to challenge the norm, investigate ideas outside of your role, and come up with creative solutions resulting in ground breaking impact for a wide network of clients. Our culture of evolution and empathy centers on long-term career growth and development opportunities in an environment that embraces your unique skills and experience.
**Your role and responsibilities**
Designs and builds solutions to move data from operational and external environments to the business intelligence, data warehouse and data lake environments using Snowflake and Azure/Fabirc, DBT and BW. Skills include designing and developing extract, transform and load (ETL) and extract, load and transform (ELT) pipelines. Experience includes full lifecycle implementation of the technical components of a data warehouse, data lake and business intelligence solutions.
Position Keywords
#snowflake #dbt #azure #python #sql #modeling
**Required technical and professional expertise**
* 5-7 years of full-time working experience in Data Engineering domain.
* Expertise in Snowflake, Azure/Fabric, DBT, BW, Python, SQL and must have excellent understanding of databases.
* Must have experience with Cloud data integration.
* Good knowledge of Data Modeling, industrial modeling, Analytic model, data architecture, dimensional modeling, 3rd normal form model, Kimball model, Inmon model, Data Integration and Business Intelligence.
* Demonstrated ability in solutioning covering data ingestion, data cleansing, ETL, data mart creation and exposing data for consumers.
**Preferred technical and professional experience**
* SnowPro Advanced: Data Engineer Certification.
* Microsoft Certified: Fabric Data Engineer Associate Certification.
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe.
You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio; including Software and Red Hat.
Curiosity and a constant quest for knowledge serve as the foundation to success in IBM Consulting. In your role, you'll be encouraged to challenge the norm, investigate ideas outside of your role, and come up with creative solutions resulting in ground breaking impact for a wide network of clients. Our culture of evolution and empathy centers on long-term career growth and development opportunities in an environment that embraces your unique skills and experience.
**Your role and responsibilities**
Designs and builds solutions to move data from operational and external environments to the business intelligence, data warehouse and data lake environments using Snowflake and Azure/Fabirc, DBT and BW. Skills include designing and developing extract, transform and load (ETL) and extract, load and transform (ELT) pipelines. Experience includes full lifecycle implementation of the technical components of a data warehouse, data lake and business intelligence solutions.
Position Keywords
#snowflake #dbt #azure #python #sql #modeling
**Required technical and professional expertise**
* 5-7 years of full-time working experience in Data Engineering domain.
* Expertise in Snowflake, Azure/Fabric, DBT, BW, Python, SQL and must have excellent understanding of databases.
* Must have experience with Cloud data integration.
* Good knowledge of Data Modeling, industrial modeling, Analytic model, data architecture, dimensional modeling, 3rd normal form model, Kimball model, Inmon model, Data Integration and Business Intelligence.
* Demonstrated ability in solutioning covering data ingestion, data cleansing, ETL, data mart creation and exposing data for consumers.
**Preferred technical and professional experience**
* SnowPro Advanced: Data Engineer Certification.
* Microsoft Certified: Fabric Data Engineer Associate Certification.
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
This advertiser has chosen not to accept applicants from your region.
Be The First To Know
About the latest Big data hadoop Jobs in Egypt !
6
Senior Data Engineer
Taager
Posted today
Job Viewed
Job Description
**About Taager**
**Our Mission**
Our mission is to empower anyone to start and scale their e-commerce business.
**Our Vision**
**“**We imagine a world where anyone gets the opportunity to sell online, make a living and get rich in an easy and risk-free way. A world where the magic of technology becomes accessible to the most talented of Merchants.”
**Our Top 5 Reasons to work for Taager**:
- You will work with talented, ambitious and caring people. We are very conscious and intentional about our selection process, to make sure we hire people who will help make Taager one of the healthiest work environment to work in.
- Flexible remote work and working hours policy, and unlimited vacations.
- Competitive salary and a stock options program
- We invest in our people, we offer learning programs to elevate our team's skills and performance.
- Development and Training budget.
**About the Job**
You will work closely with Product Management, Software Development, Data Science, and Data Platform teams to develop scalable and innovative analytical solutions, to enable the teams in Taager to build successful, data-driven strategies. You will implement complex data models, build reports and dashboards, and own data presentation and dashboarding tools for the end-users of our data products and systems.
- Design, implement, and improve the analytics platform.
- Develop and improve the current BI architecture, emphasizing data security, data quality and timeliness, scalability, and extensibility
- Deploy and use various big data technologies and run pilots to design low latency data architectures at scale
- Collaborate with business analysts, data scientists, product managers, software development engineers, and other BI teams to develop, implement, and validate KPIs, statistical analyses, data profiling, prediction, forecasting, clustering, and machine learning algorithms
- Work hand-in-hand with our DevOps team to cost-optimize our data usage;
- Build systems to track data quality and consistency, ensuring that our data is accurate and up-to-date;
- Implement monitoring tools to detect issues and measure the performance of Data Pipelines;
- Establish, maintain and monitor information security controls over Data Pipelines, Data Lake, and Data Warehouse
- 3 - 5 years of working experience in a Data Engineer role
- Expert-level skills in writing and optimizing advanced SQL
- Knowledge of data warehousing concepts.
- Experience in data mining, profiling, and analysis
- Experience with data modeling, ETL design, and using large databases in a business environment.
- Experience with languages like Python,
- Experience with Big Data technologies such as Hive/Spark.
- Experience managing data pipelines using orchestrators like Airflow.
- Proven ability to develop unconventional solutions; Sees opportunities to innovate and leads the way
- Excellent verbal and written communication;
- Proven interpersonal skills and ability to convey key insights from complex analyses in summarized business terms; Ability to effectively communicate with technical teams
- Ability to work with shifting deadlines in a fast-paced environment.
**Our Mission**
Our mission is to empower anyone to start and scale their e-commerce business.
**Our Vision**
**“**We imagine a world where anyone gets the opportunity to sell online, make a living and get rich in an easy and risk-free way. A world where the magic of technology becomes accessible to the most talented of Merchants.”
**Our Top 5 Reasons to work for Taager**:
- You will work with talented, ambitious and caring people. We are very conscious and intentional about our selection process, to make sure we hire people who will help make Taager one of the healthiest work environment to work in.
- Flexible remote work and working hours policy, and unlimited vacations.
- Competitive salary and a stock options program
- We invest in our people, we offer learning programs to elevate our team's skills and performance.
- Development and Training budget.
**About the Job**
You will work closely with Product Management, Software Development, Data Science, and Data Platform teams to develop scalable and innovative analytical solutions, to enable the teams in Taager to build successful, data-driven strategies. You will implement complex data models, build reports and dashboards, and own data presentation and dashboarding tools for the end-users of our data products and systems.
- Design, implement, and improve the analytics platform.
- Develop and improve the current BI architecture, emphasizing data security, data quality and timeliness, scalability, and extensibility
- Deploy and use various big data technologies and run pilots to design low latency data architectures at scale
- Collaborate with business analysts, data scientists, product managers, software development engineers, and other BI teams to develop, implement, and validate KPIs, statistical analyses, data profiling, prediction, forecasting, clustering, and machine learning algorithms
- Work hand-in-hand with our DevOps team to cost-optimize our data usage;
- Build systems to track data quality and consistency, ensuring that our data is accurate and up-to-date;
- Implement monitoring tools to detect issues and measure the performance of Data Pipelines;
- Establish, maintain and monitor information security controls over Data Pipelines, Data Lake, and Data Warehouse
- 3 - 5 years of working experience in a Data Engineer role
- Expert-level skills in writing and optimizing advanced SQL
- Knowledge of data warehousing concepts.
- Experience in data mining, profiling, and analysis
- Experience with data modeling, ETL design, and using large databases in a business environment.
- Experience with languages like Python,
- Experience with Big Data technologies such as Hive/Spark.
- Experience managing data pipelines using orchestrators like Airflow.
- Proven ability to develop unconventional solutions; Sees opportunities to innovate and leads the way
- Excellent verbal and written communication;
- Proven interpersonal skills and ability to convey key insights from complex analyses in summarized business terms; Ability to effectively communicate with technical teams
- Ability to work with shifting deadlines in a fast-paced environment.
This advertiser has chosen not to accept applicants from your region.
7
Lead Data Engineer
Taager
Posted today
Job Viewed
Job Description
**About Taager**
**Our Mission**
Our mission is to empower anyone to start and scale their e-commerce business.
**Our Vision**
**“**We imagine a world where anyone gets the opportunity to sell online, make a living and get rich in an easy and risk-free way. A world where the magic of technology becomes accessible to the most talented of Merchants.”
**Our Top 5 Reasons to work for Taager**:
- You will work with talented, ambitious and caring people. We are very conscious and intentional about our selection process, to make sure we hire people who will help make Taager one of the healthiest work environment to work in.
- Flexible remote work and working hours policy, and unlimited vacations.
- Competitive salary and a stock options program
- We invest in our people, we offer learning programs to elevate our team's skills and performance.
- Development and Training budget.
**About the Job**
The Data Engineering lead will work closely with the BI, Data Science & Engineering teams to support in building the data architecture that informs and drives insights. You will serve as the Data technical expert responsible for the implementation of BI, Analytics, & Big Data solutions providing high-value, timely analytics and data solutions to the internal teams. For success in this role, you will be experienced with the Cloud-based Data Solution Architecture, Software Development Life Cycle (including both Agile & Waterfall), Data Engineering and ETL tools/platforms, and data modeling practices.
**Responsibilities**
- Drive the design, building, and launching of new data models and data pipelines in production.
- Manage the development of data resources and support new product launches.
- Drive data quality across the product vertical and related business areas.
- Manage the delivery of high-impact dashboards and data visualizations.
- Define and manage SLA’s for all data sets and processes running in production.
- Analyze and confirm the integrity of source data to be evaluated
- Manage a team of data engineers
- 5 - 7 years of Experience working as a data engineer
- Extensive experience in designing data lakes and data warehouses.
- Extensive experience in developing data integration pipelines using python or any similar language.
- Have hands-on experience developing optimized, complex SQL.
- Experience working with data masking and governance.
- Experience working with data catalogs like Apache Atlas and Amundsen.
- Experience working with data quality tools like great expectations.
- Experience in using git for code management.
- Experience with snowflake or Postgres databases, or any columnar store databases.
- Experience working with SQL transformation tools such as DBT
- Experience using containers to run code such as Docker
- Experience with data pipeline orchestration tools like airflow is a huge plus.
- Experience with message queuing systems like Kafka is a huge plus.
- Strong product sense.
**Our Mission**
Our mission is to empower anyone to start and scale their e-commerce business.
**Our Vision**
**“**We imagine a world where anyone gets the opportunity to sell online, make a living and get rich in an easy and risk-free way. A world where the magic of technology becomes accessible to the most talented of Merchants.”
**Our Top 5 Reasons to work for Taager**:
- You will work with talented, ambitious and caring people. We are very conscious and intentional about our selection process, to make sure we hire people who will help make Taager one of the healthiest work environment to work in.
- Flexible remote work and working hours policy, and unlimited vacations.
- Competitive salary and a stock options program
- We invest in our people, we offer learning programs to elevate our team's skills and performance.
- Development and Training budget.
**About the Job**
The Data Engineering lead will work closely with the BI, Data Science & Engineering teams to support in building the data architecture that informs and drives insights. You will serve as the Data technical expert responsible for the implementation of BI, Analytics, & Big Data solutions providing high-value, timely analytics and data solutions to the internal teams. For success in this role, you will be experienced with the Cloud-based Data Solution Architecture, Software Development Life Cycle (including both Agile & Waterfall), Data Engineering and ETL tools/platforms, and data modeling practices.
**Responsibilities**
- Drive the design, building, and launching of new data models and data pipelines in production.
- Manage the development of data resources and support new product launches.
- Drive data quality across the product vertical and related business areas.
- Manage the delivery of high-impact dashboards and data visualizations.
- Define and manage SLA’s for all data sets and processes running in production.
- Analyze and confirm the integrity of source data to be evaluated
- Manage a team of data engineers
- 5 - 7 years of Experience working as a data engineer
- Extensive experience in designing data lakes and data warehouses.
- Extensive experience in developing data integration pipelines using python or any similar language.
- Have hands-on experience developing optimized, complex SQL.
- Experience working with data masking and governance.
- Experience working with data catalogs like Apache Atlas and Amundsen.
- Experience working with data quality tools like great expectations.
- Experience in using git for code management.
- Experience with snowflake or Postgres databases, or any columnar store databases.
- Experience working with SQL transformation tools such as DBT
- Experience using containers to run code such as Docker
- Experience with data pipeline orchestration tools like airflow is a huge plus.
- Experience with message queuing systems like Kafka is a huge plus.
- Strong product sense.
This advertiser has chosen not to accept applicants from your region.
8
Senior Data Engineer
Envision Employment Solutions
Posted today
Job Viewed
Job Description
**Ready and hungry for a new adventure? You are definitely in the right place!
We at
**Envision Employment Solutions** are always on the look for top talents around the globe and matching them with our partners' hiring needs, to help them build and scale!
- Our partners offer awesome work environment, competitive salaries, full benefits, and many others perks.**Our Hiring Process**:
**2. **During the call we will go through your resume and discuss the opportunities we have for you in details. We would love to learn a little bit about you, about your work experience and your career's goal. We will also be able to answer any questions you might have.
**Please feel free to share our career site with any of your colleagues or anyone you know that might be looking for a job**:
- ___
**Envision Employment Solutions** is currently looking for
**Senior**
**Data Engineers **for one of our partners, a very well-known Company.
**Job Summary**:
As a Senior Data Engineer, you will shape the technical vision of the digital product and build distributed transactional systems. Working alongside peers in design and product, you will bring to life a world-class consumer finance product, driving innovation and creating game-changing experiences for our customers.
If you are passionate about building breakthrough digital products, and if you thrive in a diverse and inclusive team, This is the perfect opportunity for you. Join us at the forefront of digital retail in Egypt and help shape the future of our industry, one breakthrough at a time.
**Responsibilities**:
- Design, develop, and maintain large-scale data pipelines using Python, SQL, and big data technologies such as Spark and Kafka.
- Optimize data pipelines for scalability, performance, and reliability in a distributed environment.
- Develop and implement data storage and retrieval solutions using both relational and NoSQL databases.
- Work closely with cross-functional teams to ensure effective data integration and management.
- Continuously learn and stay abreast of emerging frontend technologies, particularly, and share your knowledge with the team.
- Be part of the foundation team at our fintech squad and play a pivotal role in building Egypt's leading consumer finance product.
- Lead by example and actively promote a safe, collaborative, diverse, and agile company culture, inspiring others to embrace our values.
**Requirements**:
- 5+ years of experience building and maintaining large-scale data pipelines, with expertise in data architecture, data warehousing, and database design.
- Proficiency in Python, SQL, and experience working with both relational and NoSQL databases.
- Familiarity with data integration and ETL tools, as well as big data technologies such as Spark and Kafka.
- Experience with cloud-based data solutions (AWS preferred) and the ability to build and optimize data pipelines in a distributed environment.
- Expertise in creating and executing data engineering strategies in line with business objectives and best practices in the industry.
- Proven ability to design, build, and optimize scalable, secure, and performant data infrastructures.
- Collaborative and agile mindset with strong teamwork skills.
- Willingness to continuously learn and improve skills and stay up-to-date with emerging technologies and industry trends.
**Benefits**:
- Social and Medical insurance.
- Life insurance.
- Pension plan.
- Bonus based on performance.
- Work from home facility.
**Envision Employment Solutions is proud to be an equal opportunity workplace dedicated to pursuing and hiring a diverse workforce. Come join us!
We at
**Envision Employment Solutions** are always on the look for top talents around the globe and matching them with our partners' hiring needs, to help them build and scale!
- Our partners offer awesome work environment, competitive salaries, full benefits, and many others perks.**Our Hiring Process**:
**2. **During the call we will go through your resume and discuss the opportunities we have for you in details. We would love to learn a little bit about you, about your work experience and your career's goal. We will also be able to answer any questions you might have.
**Please feel free to share our career site with any of your colleagues or anyone you know that might be looking for a job**:
- ___
**Envision Employment Solutions** is currently looking for
**Senior**
**Data Engineers **for one of our partners, a very well-known Company.
**Job Summary**:
As a Senior Data Engineer, you will shape the technical vision of the digital product and build distributed transactional systems. Working alongside peers in design and product, you will bring to life a world-class consumer finance product, driving innovation and creating game-changing experiences for our customers.
If you are passionate about building breakthrough digital products, and if you thrive in a diverse and inclusive team, This is the perfect opportunity for you. Join us at the forefront of digital retail in Egypt and help shape the future of our industry, one breakthrough at a time.
**Responsibilities**:
- Design, develop, and maintain large-scale data pipelines using Python, SQL, and big data technologies such as Spark and Kafka.
- Optimize data pipelines for scalability, performance, and reliability in a distributed environment.
- Develop and implement data storage and retrieval solutions using both relational and NoSQL databases.
- Work closely with cross-functional teams to ensure effective data integration and management.
- Continuously learn and stay abreast of emerging frontend technologies, particularly, and share your knowledge with the team.
- Be part of the foundation team at our fintech squad and play a pivotal role in building Egypt's leading consumer finance product.
- Lead by example and actively promote a safe, collaborative, diverse, and agile company culture, inspiring others to embrace our values.
**Requirements**:
- 5+ years of experience building and maintaining large-scale data pipelines, with expertise in data architecture, data warehousing, and database design.
- Proficiency in Python, SQL, and experience working with both relational and NoSQL databases.
- Familiarity with data integration and ETL tools, as well as big data technologies such as Spark and Kafka.
- Experience with cloud-based data solutions (AWS preferred) and the ability to build and optimize data pipelines in a distributed environment.
- Expertise in creating and executing data engineering strategies in line with business objectives and best practices in the industry.
- Proven ability to design, build, and optimize scalable, secure, and performant data infrastructures.
- Collaborative and agile mindset with strong teamwork skills.
- Willingness to continuously learn and improve skills and stay up-to-date with emerging technologies and industry trends.
**Benefits**:
- Social and Medical insurance.
- Life insurance.
- Pension plan.
- Bonus based on performance.
- Work from home facility.
**Envision Employment Solutions is proud to be an equal opportunity workplace dedicated to pursuing and hiring a diverse workforce. Come join us!
This advertiser has chosen not to accept applicants from your region.
9