GIT Consult

Data Engineer

Data Engineer Published: 29.04.2022

Description

Global financial institution.

Responsibilities

- You will work with the latest tech stack building and maintaining optimal data pipeline architecture in Data Layer built on cloud technologies in Azure public cloud
- You will be responsible for data ingestion into the CDL to accommodate new business cases and to maintain and support existing business cases
- You will deal with ‘big data’ in Delta Lake on Azure Databricks and perform data cleansing, wrangling, aggregation, and transformation to create datasets re-usable for various business cases
- You will be responsible for optimizing extraction, transformation, and loading of data to assemble large, complex data sets and to build data pipelines to meet functional/non-functional business requirements
- You will collaborate with multiple stakeholders including the Data Product team (data scientists and analysts), Business Owners and Architects to assist with data-related technical issues and support their data infrastructure needs
- You will build processes supporting data transformation, data structures, metadata, dependency, and workload management

Requirements

- You have successfully completed a university degree in the field of Computer Science, Mathematics, Statistics, Physics, Engineering, Information Technology or another relevant quantitative field or possess equivalent professional qualification or experience
- You have excellent analytical skills and the ability to write clear and structured code
- You have hands-on experience building and optimizing ‘big data’ pipelines, preferably using Azure Data Factory and Databricks, and working with cloud technologies in general. Experience working with databases (SQL) and knowledge of Apache Kafka would be a plus
- You have programming experience in Python and PySpark. Experience with pandas, Django and Koala will be an asset
- You have some experience working in an Agile environment, preferably with Scrum methodology, and using version control systems, preferably GitHub
- Proficiency in written and spoken English is required

Advantage::

- Experience with React

We offer

- Bonuses
- Work mostly from home
- Flexible start/end of working hours
- Contributions to the pension / life insurance
- Contribution to sport / culture / leisure
- Education allowance
- Individual budget for personal growth
- Educational courses, trainings
- Transport allowance
- Meal tickets / catering allowance
- Cafeteria
- Refreshments on workplace
- Corporate events
- Holidays 5 weeks
- Sick days
- Notebook


Location
Praha
Region
Category
Job type
Full-time
Contact person
Rastislav Bučko
Drop files here browse files ...