SENIOR BIG DATA ENGINEER

WE ARE

SoftServe is a 10000+ team across the world of most technologies and roles in IT and at the moment we are growing so you can join one of several dozen projects we are developing right now. Our products protect computers against advanced forms of malware. Some malware is straightforward to identify, but antivirus has done that forever.

A big distributed team working with a fantastic customer, a giant in the mining industry, located in Canada. Our customer is a diversified resource company committed to responsible mining and mineral development with business units focused on steelmaking coal, copper, zinc, and energy. Headquartered in Vancouver, British Columbia (B.C.), Canada, they own or have interests in 13 operating mines, a large metallurgical complex, and several major development projects in the Americas. The client has expertise across a wide range of activities related to exploration, development, mining, and minerals processing, including smelting and refining, health and safety, environmental protection, materials stewardship, recycling, and research.

Our customer’s corporate strategy is focused on exploring for, developing, acquiring, and operating world-class, long-life assets in stable jurisdictions that operate through multiple price cycles.

YOU ARE

Professional in the following technologies

• Azure Data Factory
• Databricks (Python and SQL)
• Azure Synapse analytics (Dedicated SQL Pool)
• Azure Blob Storage and Azure Data Lake
• Azure SQL DB/Azure SQL MI/SQL Server
• Event Hubs or similar (Kafka)
• GCP data services (nice to have)
• Apache Airflow

Extra experience comprises

• Hadoop ecosystem (e.g. Hive, Kafka, Spark)
• Streaming platforms and stream ingestion and processing services (Event Hubs, Kafka, or Spark streaming)
• Database modeling, DWH design, and implementation
• ETL/ELT process design and implementation
• Massive-parallel-processing (MPP) systems: Azure SQL DW (Synapse), GCP BigQuery, or AWS Redshift
• Optimization of code, ETL processes, and SQL queries
• Deep knowledge of SQL language and database management techniques (row-level security, built-in database roles, partitioning, index maintenance)
• Python for Data analysis (pandas, NumPy, PySpark, etc.)
• Git and Gitflow
• Understanding and applying best practices for logging and monitoring data pipelines
• CI/CD principles
• Project management methodologies (Agile, Waterfall)
• Successful communication with stakeholders in written and verbal form
• Ability to suggest the best solution among different options and conduct trade-off analysis.
• Strong problem-solving skills
• Upper-Intermediate low English

YOU WANT TO WORK WITH

• Modern technologies popular on the market
• Interesting customers
• Challenging projects
• Either alone on a subproject or in a team
• Both developing new functionality and improving the existing ones
• Remote teams located in Ukraine, Poland & Canada

TOGETHER WE WILL

• Accomplish great things
• Get a great deal of learning and development opportunities along with our structured career path
• Process dynamic projects at a stable place to work
• Take part in internal and external events where you can build and promote your personal brand
• Give you access to experienced specialists willing to share their knowledge
• Care about your individual initiatives we are open for them, just come and share your ideas