Essential Duties and Responsibilities:
Collaborate with stakeholders to understand business requirements;
Responsible for translating business requirements into technology solutions;
To be able to clearly articulate pros and cons of various technologies and platforms;
Define and design appropriate solution architecture in line with overall client IT strategy and its systems architecture;
Define and achieve a strategic roadmap for Data & Analytics including data modeling, implementation and data management for Enterprise Data Warehouse and Advanced Data Analytics system;
Defining, designing, developing and implement DW/BI Big Data components and processes and Business Analytics Solutions, from conception to technical operation;
Design large-scale, real-time and big data analytical solutions in heterogeneous data environments;
Identify risks, assumptions, and develop estimates to achieve the BA solution architecture;
Constantly evolve data models, schema design and services of the Data Warehouse to support self-service and advanced organization needs;
Find innovative solutions through a combination of creative thinking and deep understanding of the problem and business goals;
Qualifications
Proven client experience selecting architecture that services client’s needs with the balance of costs, capability, and risk to meet clients’ business objectives;
Proficient in data modeling, data manipulation, architecture and design of Data Warehouses;
Experience in architecture, design and support of Data Warehouse projects;
Experience building big data analytic systems required, experience building Machine Learning pipelines is a strong plus
Experience with big data tools and distributed clusters: Hadoop, Spark, Kafka, Kinesis, etc.
Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
Experience with stream-processing systems: Flink, Storm, Spark-Streaming etc.
Experience with performance tuning, troubleshooting, and debugging Spark and/or other big data solutions;
Experience designing scalable solutions with data platform leveraging HDFS, Hive, Spark, Kafka using Scala, Java or Python dealing with real-time streaming data, batch data and analytics.
Extensive experience in data analytics, Apache Spark, Event streaming, batch file processing, data ingestion, modelling, NoSQL database and reporting;
Strong written and verbal communication skills, and very good english skills;
Education & Experience:
Bachelor’s or Master’s in a field such as Computer Science, Software Engineering, Management Information Systems, Statistics, or Mathematics.
10+ years in data engineering with 5 years minimum proven industry experience in big data.
Send resume to rh@dw2software.com
