Data Engineer

Job Overview:We are seeking a talented and motivated Senior Data Engineer with expertise in Scala and Python to join our data engineering team. This individual will play a key role in the design, development, and optimization of our data infrastructure and data pipelines. The ideal candidate has a passion for building scalable, high-performance systems and is eager to broaden their knowledge across the entire data engineering stack, from hardware infrastructure to project development.Key responsibilities:• Collaborate with cross-functional teams to design, develop, and maintain data engineering solutions using Scala, Python, and Apache Spark.• Implementation of new data engineering technologies, frameworks, and tools, such as HDFS, MongoDB, and PostgreSQL, to enhance performance, scalability, and efficiency.• Understand and optimize hardware and resource consumption for data engineering projects.• Develop a deep understanding of hardware infrastructure, including servers, clusters, and distributed systems, to ensure optimal data processing and storage.• Design and architect high-performance, fault-tolerant, and scalable data pipelines.• Conduct research and stay current with the latest advancements in data engineering, hardware technologies, and distributed computing paradigms.• Mentor and guide junior team members, fostering a culture of continuous learning and skill development.• Collaborate with stakeholders to gather requirements, propose technical solutions, and deliver high-quality data engineering projects.Requirements:• 2-3 years of professional experience as a Software Engineer, with a focus on data engineering.• Keen interest in hardware infrastructure, resource consumption optimization, and data engineering project development.• Proven ability to work effectively in an Agile development environment and manage multiple priorities.• Strong problem-solving, analytical thinking, communication, and collaboration skills.