How to DBT Init

1. Create python virtual environment python3 -m venv env
2. Install the requirements.txt python3 -m pip install -r requirements.txt
3. Initialize DBT project dbt init. Identifier account should be : <orgname>-<account_name>
4. Choose keypair auth for more secure way to authenticate
5. Generate key pair and setup public key for specific user in Snowflake https://docs.snowflake.com/en/user-guide/key-pair-auth
6. Run your first model dbt run -s my_first_dbt_model
7. If database not found don't forget to create it first using CREATE DATABASE <DB_NAME>;
8. Setup profiles.yml https://docs.getdbt.com/docs/core/connect-data-platform/snowflake-setup
9. Setup sources https://docs.getdbt.com/docs/build/sources

Hardening profiles.yml

1. Open the profiles.yml
2. For the confidentials params/keys replace the value with "{{ env_var('VAR_NAME') }}"
3. Run Command EXPORT VAR_NAME=<confidential_value>

References :

1. How to structure DBT Project : https://towardsdatascience.com/staging-intermediate-mart-models-dbt-2a759ecc1db1
2. Public dataset Global Climate : https://app.snowflake.com/marketplace/listing/GZSOZ1LLD8/weather-source-llc-global-weather-climate-data-for-bi
3. Sources YAML : https://docs.getdbt.com/docs/build/sources
4. Incremental model : https://docs.getdbt.com/docs/build/incremental-models
5. DBT utils package : https://hub.getdbt.com/dbt-labs/dbt_utils/latest/