Data Engineer
Построение и поддержка data pipelines, хранилищ данных, обеспечение доступности и качества данных
Уровень:
Основы программирования
8 навыков · 40 требований| Навык | Junior | Middle | Senior | Lead | Principal |
|---|---|---|---|---|---|
| Алгоритмы и структуры данных | |||||
| Алгоритмы и сложность | Awareness | Working | Advanced | Expert | Expert |
| Структуры данных | Awareness | Working | Advanced | Expert | Expert |
| ООП и паттерны проектирования | |||||
| Принципы ООП и SOLID | Awareness | Working | Advanced | Expert | Expert |
| Паттерны проектирования | Awareness | Working | Advanced | Expert | Expert |
| Многопоточность и конкурентность | |||||
| Многопоточное программирование | Awareness | Working | Advanced | Expert | Expert |
| Асинхронное программирование | Awareness | Working | Advanced | Expert | Expert |
| Чистый код и рефакторинг | |||||
| Качество кода и рефакторинг | Awareness | Working | Advanced | Expert | Expert |
| Системы типов | |||||
| Типобезопасность и системы типов | Awareness | Working | Advanced | Expert | Expert |
Backend Development
6 навыков · 30 требований| Навык | Junior | Middle | Senior | Lead | Principal |
|---|---|---|---|---|---|
| Веб-фреймворки | |||||
| Python Web Frameworks | Awareness | Working | Advanced | Expert | Expert |
| Очереди сообщений | |||||
| Apache Kafka | Awareness | Working | Advanced | Expert | Expert |
| Кэширование | |||||
| Redis | Awareness | Working | Advanced | Expert | Expert |
| Фоновые задачи | |||||
| Task Queues | Awareness | Working | Advanced | Expert | Expert |
| Поисковые движки | |||||
| Elasticsearch / OpenSearch | Awareness | Working | Advanced | Expert | Expert |
| Файловое и объектное хранилище | |||||
| S3 / Object Storage | Awareness | Working | Advanced | Expert | Expert |
Базы данных
9 навыков · 45 требований| Навык | Junior | Middle | Senior | Lead | Principal |
|---|---|---|---|---|---|
| Реляционные БД | |||||
| PostgreSQL | Awareness | Working | Advanced | Expert | Expert |
| NoSQL базы данных | |||||
| ClickHouse | Awareness | Working | Advanced | Expert | Expert |
| Apache Cassandra | Awareness | Working | Advanced | Expert | Expert |
| Оптимизация БД | |||||
| Индексирование БД | Awareness | Working | Advanced | Expert | Expert |
| Оптимизация запросов | Awareness | Working | Advanced | Expert | Expert |
| Администрирование БД | |||||
| Репликация и High Availability | Awareness | Working | Advanced | Expert | Expert |
| Backup и Disaster Recovery | Awareness | Working | Advanced | Expert | Expert |
| Моделирование данных | |||||
| Проектирование схем данных | Awareness | Working | Advanced | Expert | Expert |
| Миграции БД | Awareness | Working | Advanced | Expert | Expert |
API и интеграции
4 навыков · 20 требований| Навык | Junior | Middle | Senior | Lead | Principal |
|---|---|---|---|---|---|
| REST API | |||||
| REST API Design | Awareness | Working | Advanced | Expert | Expert |
| GraphQL | |||||
| GraphQL Design | Awareness | Working | Advanced | Expert | Expert |
| gRPC | |||||
| gRPC и Protocol Buffers | Awareness | Working | Advanced | Expert | Expert |
| Управление API | |||||
| Документирование API | Awareness | Working | Advanced | Expert | Expert |
Облако и инфраструктура
5 навыков · 23 требований| Навык | Junior | Middle | Senior | Lead | Principal |
|---|---|---|---|---|---|
| Контейнеризация | |||||
| Docker | Awareness | Working | Advanced | Expert | Expert |
| Kubernetes и оркестрация | |||||
| Kubernetes Core | Awareness | Working | Advanced | Expert | Expert |
| Infrastructure as Code | |||||
| Terraform | Awareness | Working | Advanced | Expert | Expert |
| Облачные провайдеры | |||||
| AWS | Awareness | Working | Advanced | Expert | Expert |
| Сети | |||||
| Основы сетей | Awareness | Working | Advanced | — | — |
DevOps и CI/CD
1 навыков · 5 требований| Навык | Junior | Middle | Senior | Lead | Principal |
|---|---|---|---|---|---|
| CI/CD | |||||
| GitHub Actions / GitLab CI | Awareness | Working | Advanced | Expert | Expert |
Тестирование и QA
3 навыков · 15 требований| Навык | Junior | Middle | Senior | Lead | Principal |
|---|---|---|---|---|---|
| Unit-тестирование | |||||
| Unit-тестирование | Awareness | Working | Advanced | Expert | Expert |
| Интеграционное тестирование | |||||
| Интеграционное тестирование | Awareness | Working | Advanced | Expert | Expert |
| E2E-тестирование | |||||
| E2E тестирование | Awareness | Working | Advanced | Expert | Expert |
Безопасность
3 навыков · 15 требований| Навык | Junior | Middle | Senior | Lead | Principal |
|---|---|---|---|---|---|
| Безопасность приложений | |||||
| OWASP и безопасность приложений | Awareness | Working | Advanced | Expert | Expert |
| Практики безопасного кода | Awareness | Working | Advanced | Expert | Expert |
| Аутентификация и авторизация | |||||
| JWT / OAuth2 / OIDC | Awareness | Working | Advanced | Expert | Expert |
Data Engineering
14 навыков · 70 требований| Навык | Junior | Middle | Senior | Lead | Principal |
|---|---|---|---|---|---|
| Batch-обработка данных | |||||
| Apache Spark | Awareness | Working | Advanced | Expert | Expert |
| dbt | Awareness | Working | Advanced | Expert | Expert |
| Pandas / Polars | Awareness | Working | Advanced | Expert | Expert |
| SQL-based ETL | Awareness | Working | Advanced | Expert | Expert |
| Stream-обработка | |||||
| Stream Processing | Awareness | Working | Advanced | Expert | Expert |
| Data Lakehouse | |||||
| Delta Lake / Apache Iceberg | Awareness | Working | Advanced | Expert | Expert |
| Архитектура Data Lake | Awareness | Working | Advanced | Expert | Expert |
| Data Warehousing | |||||
| Data Warehouse Design | Awareness | Working | Advanced | Expert | Expert |
| Управление данными | |||||
| Data Catalog | Awareness | Working | Advanced | Expert | Expert |
| Data Lineage | Awareness | Working | Advanced | Expert | Expert |
| Data Contracts | Awareness | Working | Advanced | Expert | Expert |
| Качество данных | |||||
| Data Quality | Awareness | Working | Advanced | Expert | Expert |
| Оркестрация данных | |||||
| Apache Airflow | Awareness | Working | Advanced | Expert | Expert |
| Dagster / Prefect | Awareness | Working | Advanced | Expert | Expert |
AI-ассистированная разработка
4 навыков · 18 требований| Навык | Junior | Middle | Senior | Lead | Principal |
|---|---|---|---|---|---|
| AI-ассистенты кодирования | |||||
| GitHub Copilot | Awareness | Working | Advanced | Expert | Expert |
| Cursor IDE | Awareness | Working | Advanced | Advanced | — |
| ChatGPT / Claude | Awareness | Working | Advanced | Expert | Expert |
| Prompt Engineering | |||||
| Prompt Engineering для кода | Awareness | Working | Advanced | Expert | — |
Архитектура и проектирование
1 навыков · 5 требований| Навык | Junior | Middle | Senior | Lead | Principal |
|---|---|---|---|---|---|
| System Design | |||||
| Основы System Design | Awareness | Working | Advanced | Expert | Expert |
Observability и мониторинг
4 навыков · 18 требований| Навык | Junior | Middle | Senior | Lead | Principal |
|---|---|---|---|---|---|
| Логирование | |||||
| Структурированное логирование | Awareness | Working | Advanced | Expert | Expert |
| Метрики и мониторинг | |||||
| Prometheus и Grafana | Awareness | Working | Advanced | — | — |
| Distributed Tracing | |||||
| OpenTelemetry | Awareness | Working | Advanced | Expert | Expert |
| Алертинг и on-call | |||||
| SLI / SLO / SLA | Awareness | Working | Advanced | Expert | Expert |
Контроль версий и коллаборация
2 навыков · 10 требований| Навык | Junior | Middle | Senior | Lead | Principal |
|---|---|---|---|---|---|
| Git и workflow | |||||
| Git Advanced | Awareness | Working | Advanced | Expert | Expert |
| Code Review | |||||
| Code Review | Awareness | Working | Advanced | Expert | Expert |