A data engineer is an IT worker whose primary job is to prepare data for analytical or operational uses. These software engineers are typically responsible for building data pipelines to bring together information from different source systems.
Data Engineer
Overview
You will be responsible for:
- Designing and implementing Big Data systems (e.g. data warehouses, data lakes, streaming applications, control systems etc.) while working with multiple Open Source and Cloud technologies
- Building high-quality Big Data products and providing an ongoing support
- Detecting anomalies and recommending data quality solutions
- Engaging and interacting closely with business and IT stakeholders to understand Business requirements
You will be responsible for:
- Good programming skills (Python and SQL are preferred)
- Prior experience in designing and implementing large scale systems based on Big Data technologies
- Prior experience with Hadoop, Spark, Hive, Airflow, Databricks or other related technologies
- Experience or/and knowledge of cloud technologies (Azure and GCP preferred)
- Knowledge of Open Source projects is a plus
You will get:
- 100% remote work with possibility to use office in Warsaw
- Flexible working hours
- Company events
- 1500 PLN for development per year – to be spent at your own discretion
- Money return for passed certifications
- Opportunity to take advantage of Microsoft Azure and Google Cloud Platform training package available only for partners of these providers
- Possibility to use in-house incubator for development of own ventures
- A supportive community with 50+ consultants with 10+ years’ experience in Data Warehouse and Big Data
