hero

Middle East Venture Partners
Leverage our network to build your career

Search open roles at our portfolio companies
MEVP
MEVP
27
companies
255
Jobs

Data Engineer

Halan

Halan

Software Engineering, Data Science
Sheikh Zayed City, Giza Governorate, Egypt
Posted on Monday, April 29, 2024

We are seeking a talented and motivated Software Engineer with expertise in Scala and Python to join our dynamic data engineering team.

The ideal candidate has a passion for building scalable and efficient data-driven solutions and is eager to broaden their knowledge base in the entire data engineering stack, including hardware infrastructure, frameworks, technologies, resource consumption, and project development

Key responsibilities:

  • Collaborate with cross-functional teams, including data scientists, data analysts, and software engineers, to design, develop, and maintain data engineering solutions using Scala and Python.
  • Drive the exploration and implementation of new data engineering technologies, frameworks, and tools to enhance performance, scalability, and efficiency.
  • Work closely with infrastructure and operations teams to understand and optimize hardware and resource consumption in data engineering projects.
  • Develop a deep understanding of the underlying hardware infrastructure, including servers, clusters, and distributed systems, to ensure optimal data processing and storage.
  • Participate in the design and architecture of data pipelines, ensuring high performance, fault tolerance, and scalability.
  • Conduct research and stay up-to-date with the latest advancements in data engineering, hardware technologies, and distributed computing paradigms.
  • Mentor and guide junior team members, fostering a culture of continuous learning and skill development.
  • Collaborate with stakeholders to gather requirements, propose technical solutions, and deliver high-quality data engineering projects.

Who you are!

  • 2+ years of professional experience as a Software Engineer, with a focus-on and passion towards data engineering.
  • Strong proficiency in Scala and Python, with hands-on experience in building robust and scalable applications
  • Solid understanding of data structures, algorithms, and object-oriented programming principles.
  • Experience with distributed data processing frameworks such as Apache Spark is highly desirable.
  • Familiarity with Apache Hive, Hadoop HDFS, and other relevant data engineering technologies is a plus.
  • Strong interest in gaining knowledge of hardware infrastructure, resource consumption optimization, and project development in data engineering.
  • Experience with relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra) is beneficial.
  • Demonstrated ability to work in an Agile development environment and manage multiple priorities effectively.
  • Excellent problem-solving and analytical thinking skills.
  • Strong communication and collaboration skills, with the ability to work effectively in a team setting.