You're seeing this page as if you were . The main menu is still yours, though. Exit from immersion
Michał DuraMD

Michał Dura

Data Engineer focused on Big Data and Cloud

€600/day
Berlin, DE
3-7 years

Average response time: 1 hour

About Michał

I am passionate about tools that can help companies make real business value and profit from data. I've worked on different projects where Hadoop, Spark and AWS were used for such purpose. I am well organized and highly motivated person, who always do responsibilities with a great commitment and loves to share knowledge with others.

Always open to new ideas and technologies.
  • English

    Fluent

  • Polish

    Native or bilingual

  • German

    Basic

Remote only
Primarily works remotely

Experience

  • Qoob.dev
    Co-founder and Data Engineer
    DIGITAL AND IT
    April 2021 - Today (5 years and 2 months)
    Wrocław i okolice
    Data Engineer and cofounder focused on building the community of talented Data Engineers in Poland ready to work on challenging, multinational projects
  • Self-Employed Contractor
    Big Data Engineer
    DIGITAL AND IT
    January 2019 - Today (7 years and 5 months)
    Wrocław, Woj. Dolnośląskie, Polska
    I've worked in multiple projects in the area of Big Data and Cloud. My main roles:

    - Big Data Developer in Autonomous Driving project. I was working on design, implementation and performacne tuning of ETL pipelines and data flows implemented on top of Apache Spark, Kafka, HBase, Airflow.

    - DevOps who was working on Apache Airflow setup on top of Openshift / Kubernetes cluster using Celery Executor. I was responsible for initial installation, environment preparation, security design, performance tuning and scaling.

    - Big Data Developer in project related to GPS Data processing and visualization using Apache Spark and ELK stack (Elasticsearch, Kibana)

    - Data Engineer focused on building ETL Pipelines in Apache Spark and Databricks / AWS EMR, Redshift, Glue, orchestrated on top of Airflow.
  • Capgemini
    Senior Big Data Engineer
    January 2018 - December 2018 (11 months)
    Wrocław, woj. dolnośląskie, Polska
    - Big Data Platform to process data from test vehicles for client from automotive industry Analyzing signals from different modules in cars to find answers for science questions via HiveQL-Queries. Preparing data flows on top of Hadoop Environment (Spark, Sqoop, Oozie, Hive, Pig, Shell) Creating and performance tuning of Spark applications - Near Real-Time ETL solution (Apache Kafka, Apache Spark- Structured Streaming, Apache Hive LLAP) - Conducting multiple trainings for Capgemini employees (Big Data Architecture, Apache Hive, Apache Spark) - Anomaly Detection for client from Aerospace & Defence industry. Cleaning and processing data using Python Pandas library Applying clustering algorithms (DBSCAN, HDBSCAN) Building Autoencoder Neural Network model in Tensorflow and Keras on GPU virtual machine

Recommendations

Be the first to recommend Michał

Help this freelancer shine by sharing your experience working together.

These freelancer profiles also match your criteria

AgathaA

Agatha Frydrych

Backend Java Software Engineer

4.7

(3)

2

BaptisteB

Baptiste Duhen

Fullstack developer

4.6

(4)

5

AmedA

Amed Hamou

Senior Lead Developer

4

(2)

7

AudreyA

Audrey Champion

Web developer

4.3

(3)

4

Education

  • Bachelor's degree
    Poznan University of Economics
    2015
  • Bachelor's degree
    Poznan University of Economics
    2014

Certifications

Skill set

Categories