Lead Big Data Engineer
| Адрес | Remote |
Описание вакансии
We are seeking a highly skilled Lead Big Data Engineer to lead the design and implementation of innovative analytical solutions using cutting-edge Big Data technologies.
As a key team member, you will assess new features and architectures across Cloud, on-premise, and Hybrid solutions and closely cooperate with product and engineering teams.
The remote option applies only to the Candidates who will be working from any location in Kazakhstan.
As a key team member, you will assess new features and architectures across Cloud, on-premise, and Hybrid solutions and closely cooperate with product and engineering teams.
The remote option applies only to the Candidates who will be working from any location in Kazakhstan.
Требования
- Advanced experience in software development with Big Data (administration, configuration management, monitoring and performance tuning)
- Skills in designing, automating and managing scalable, fault-tolerant cloud systems
- Advanced knowledge of Cloud-based data pipeline development
- Experience With Cloud Service Lines:
- AWS: AWS Glue, EMR, S3, Redshift, Kinesis, Databricks, AWS Lake Formation
- Azure: Data Lake, Databricks, Synapse, Data Factory
- GCP: DataFlow, GCS, BigQuery, Dataproc, Cloud Composer
- Competency in any object-oriented/object function scripting language: Python, Java, Node.js
- Background in Big Data Stacks such as Spark & Spark Streaming
- Strong knowledge of building data ingestion pipelines (simulating Extract, Transform, Load workload), Data Warehouse or Database architecture
- Expert knowledge of data modeling and modern Big Data component development
- Understanding of CI/CD principles and best practices
- Exposure working with Snowflake
- Proficiency in direct customer communications
- Expertise in technology/team leading of data-oriented projects
- In-depth comprehension of distributed computing principles
Обязанности
- Lead and implement innovative analytical solutions using Big Data related technologies, evaluating new features and architecture in Cloud, on premise & Hybrid solutions
- Collaborate with product and engineering teams to understand requirements, evaluate new features and architecture to help drive decisions
- Establish collaborative partnerships with architects and key individuals across various functional groups
- Perform detailed analysis of business problems and technical environments to design quality technical solutions
- Actively participate in code reviews and test solutions for best practice compliance
- Cultivate a high-performance engineering culture, mentor team, and provide necessary tools and motivation
- Write project documentation
Добавлено 12 дней назад
Пожаловаться