Data Quality and Reliability: Implement methods to improve data reliability and qualityCombine raw data from different sources to create consistent and machine-readable formatsStructural Development:Develop and test data structure that enable data extraction and transformation for predictive or prescriptive modelingProcess Definition: Define and set development, test, release, update, and support processes for data engineering operations. Troubleshoot and fix code bugsBig Data Models:Develop big data models/use cases based on the data structure and prepare them for data operations end usersQuery Execution:Create and execute queries on structured and unstructured data sources to identify process issues or perform mass updatesFeature Layer: Develop and implement the feature zone with the required features/KPIs required by different stakeholders and that supports building robust machine learning modelsBatch Scheduling and Reporting:Ensure that batch production scheduling and report distribution are accurate and timelyAd Hoc Requests:Perform ad hoc requests from users such as data research, file manipulation/transfer, and research of process issuesRequirementsCore Competencies (Level 1,2):Performance ExcellenceCollab. & Creating SynergyAgility & ResiliencePeople CentricityTechnical Competencies: Basic to Intermediate knowledge in Java, C#, and Python for developing robust applicationsBasic to Moderate Experience with Cloudera or any Big data platform with the complementary service like Apache Hive, Apache Scala, BizSpark, Impala, Apache Spark, Data Security, Kafka, HBase, Sqoop, NiFi, Python for Programming, Python for Data Analysis & ML, ...etcProficiency in handling and processing large datasets using distributed computing frameworksModerate knowledge of SQL for querying and managing relational databasesUnderstanding of data warehousing principles and best practicesProficiency in handling and processing large datasets using distributed computing frameworksModerate experience in data analysis and visualization toolsExpertise in writing shell scripts using Bash, KornShell (ksh), or Bourne Shell (sh)Domain Expertise:Bachelor Degree in Computer Science/Engineering is preferredMaster/ Certificate needed is preferredBanking experience is preferred