Skip to content
This repository was archived by the owner on Dec 12, 2025. It is now read-only.
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
55 changes: 55 additions & 0 deletions src/archetypes/core-data-engineer-archetype.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,55 @@
---
title: Core Data Engineer Archetype
description: >
The Core Data Engineer represents represents the foundation of data excellence, enabling organizations to leverage the power of data through robust, scalable, and efficient systems. This archetype embodies the essential competencies required to design, build, and maintain data pipelines, storage solutions, data modelling and processing frameworks.

Data Engineers focus on solving real-world problems through data, ensuring reliability, performance, and security while collaborating with data scientists, analysts, and software engineers. Mastery in this role requires not only technical expertise but also a mindset of continuous improvement, automation, and value-driven delivery.

This archetype serves as a roadmap for professionals shaping their careers in data engineering, from foundational skills to advanced mastery.
skill_stages:
- name: "Novice"
topics:
- sql-basics
- data-pipeline-basics
- data-structures
- relational-databases
- name: "Advanced Beginner"
topics:
- advanced-sql
- advanced-data-pipeline
- nosql-databases
- cloud-native-data-platform
- workflow-orchestration
- monitoring-and-observability
- agile-basics
- version-control-systems
- continuous-integration
- name: "Competent"
topics:
- dataops-mindset
- data-modeling-and-databases
- data-quality-and-validation
- distributed-systems-theory-and-practices
- data-streaming-platforms
- metadata-management
- continuous-delivery
- name: "Proficient"
topics:
- ml-engineering-integration
- data-security-compliance
- performance-and-scalability
- cloud-computing
- data-governance
- mentoring-and-coaching
- effective-collaboration
- name: "Expert"
topics:
- profiling-and-performance-tuning
- data-platform-economic-impact-analysis
---

# Core Data Engineer Archetype

{{ render_description() }}

{{ render_skill_stages() }}
17 changes: 17 additions & 0 deletions src/topics/advanced-data-pipeline.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
---
title: Advanced Data Pipeline
description: >
An introduction to mastering your advanced Data Pipeline.
learning_resources:
[]
cross_references:
- data-pipeline-basics
---

# Advanced Data Pipeline

{{ render_description() }}

{{ render_learning_resources() }}

{{ render_cross_references() }}
19 changes: 19 additions & 0 deletions src/topics/advanced-sql.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
---
title: Advanced SQL
description: >
An introduction to mastering your advanced SQL.
learning_resources:
- type: "external_link"
title: "Advanced SQL Tutorial Introduction"
url: "https://datalemur.com/sql-tutorial/advanced-sql-tutorial-intro"
cross_references:
- sql-basics
---

# Advanced SQL

{{ render_description() }}

{{ render_learning_resources() }}

{{ render_cross_references() }}
17 changes: 17 additions & 0 deletions src/topics/cloud-native-data-platform.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
---
title: Cloud Native Data Platform
description: >
An introduction to mastering your Cloud Native Data Platform.
learning_resources:
[]
cross_references:
[]
---

# Cloud Native Data Platform

{{ render_description() }}

{{ render_learning_resources() }}

{{ render_cross_references() }}
17 changes: 17 additions & 0 deletions src/topics/data-governance.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
---
title: Data Governance
description: >
An introduction to mastering your Data Governance.
learning_resources:
[]
cross_references:
[]
---

# Data Governance

{{ render_description() }}

{{ render_learning_resources() }}

{{ render_cross_references() }}
17 changes: 17 additions & 0 deletions src/topics/data-pipeline-basics.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
---
title: Data Pipeline Basics
description: >
An introduction to mastering your Data Pipeline Basics.
learning_resources:
[]
cross_references:
[]
---

# Data Pipeline Basics

{{ render_description() }}

{{ render_learning_resources() }}

{{ render_cross_references() }}
17 changes: 17 additions & 0 deletions src/topics/data-platform-economic-impact-analysis.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
---
title: Data Platform Economic Impact Analysis
description: >
An introduction to mastering your Data Platform Economic Impact Analysis.
learning_resources:
[]
cross_references:
[]
---

# Data Platform Economic Impact Analysis

{{ render_description() }}

{{ render_learning_resources() }}

{{ render_cross_references() }}
17 changes: 17 additions & 0 deletions src/topics/data-quality-and-validation.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
---
title: Data Quality And Validation
description: >
An introduction to mastering your Data Quality And Validation.
learning_resources:
[]
cross_references:
[]
---

# Data Quality And Validation

{{ render_description() }}

{{ render_learning_resources() }}

{{ render_cross_references() }}
17 changes: 17 additions & 0 deletions src/topics/data-security-compliance.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
---
title: Data Security Compliance
description: >
An introduction to mastering your Data Security Compliance.
learning_resources:
[]
cross_references:
[]
---

# Data Security Compliance

{{ render_description() }}

{{ render_learning_resources() }}

{{ render_cross_references() }}
17 changes: 17 additions & 0 deletions src/topics/data-streaming-platforms.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
---
title: Data Streaming Platforms
description: >
An introduction to mastering your Data Streaming Platforms.
learning_resources:
[]
cross_references:
[]
---

# Data Streaming Platforms

{{ render_description() }}

{{ render_learning_resources() }}

{{ render_cross_references() }}
17 changes: 17 additions & 0 deletions src/topics/dataops-mindset.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
---
title: DataOps Mindset
description: >
An introduction to mastering your DataOps Mindset.
learning_resources:
[]
cross_references:
[]
---

# DataOps Mindset

{{ render_description() }}

{{ render_learning_resources() }}

{{ render_cross_references() }}
17 changes: 17 additions & 0 deletions src/topics/metadata-management.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
---
title: Metadata Management
description: >
An introduction to mastering your Metadata Management.
learning_resources:
[]
cross_references:
[]
---

# Metadata Management

{{ render_description() }}

{{ render_learning_resources() }}

{{ render_cross_references() }}
17 changes: 17 additions & 0 deletions src/topics/ml-engineering-integration.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
---
title: ML Engineering Integration
description: >
An introduction to mastering your ML Engineering Integration.
learning_resources:
[]
cross_references:
[]
---

# ML Engineering Integration

{{ render_description() }}

{{ render_learning_resources() }}

{{ render_cross_references() }}
15 changes: 15 additions & 0 deletions src/topics/sql-basics.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
---
title: SQL Basics
description: >
An introduction to mastering your SQL.
learning_resources:
- type: "external_link"
title: "Introduction to SQL (w3schools)"
url: "https://www.w3schools.com/sql/default.asp"
---

# SQL Basics

{{ render_description() }}

{{ render_learning_resources() }}
17 changes: 17 additions & 0 deletions src/topics/workflow-orchestration.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
---
title: Workflow Orchestration
description: >
An introduction to mastering your Workflow Orchestration.
learning_resources:
[]
cross_references:
[]
---

# Workflow Orchestration

{{ render_description() }}

{{ render_learning_resources() }}

{{ render_cross_references() }}