Denormalization

Denormalization is the process of reversing normalization in a database. In the denormalization main we integrate these functions:

  • denormalizationStand
  • denormalizationLog
  • denormalizationCOS
  • denormalizationDivide
  • denormalizationMinMaxAndPercentile

Hyper-parameters

The denormalization process takes the hyperParameters from the normalization process that was triggered before.

Payload JSON template example :


{
  "processingKeyword": "denormalization",
  "customer": "hephia",
  "name": "hephia_denormalization",
  "creationTS": 1675333050,
  "latestUpdateTS": 1675333050,
  "status": "1",
  "dataLocations": [
    {
      "role": "parquet",
      "dataLocationId": "63db8494eac14d53c1dce3ed"
    }
  ],
  "processingContext": {
    "processingName": "denormalization",
    "editionContext": "notebook",
    "callingContext": "ds-lab",
    "view": {
      "name": "view_02-02-2023_09:29:56",
      "id": "63db82947926d269918c5113"
    },
    "dataset": {
      "name": "cii_0006"
    },
    "project": {
      "id": 190242736,
      "name": "datasets"
    }
  },
  "stepId": 1,
  "hyperParameters": [
    {
      "columnName": "cp_a_1_bar",
      "preprocessingMethod": "fstand",
      "parameters": [
        {
          "name": "A",
          "value": 0
        }
      ],
      "outPutParameters": [
        {
          "name": "Means",
          "value": 26.985258090298526
        },
        {
          "name": "Standardization",
          "value": 41.44575354738083
        }
      ]
    },
    {
      "columnName": "cp_a_2_bar",
      "preprocessingMethod": "flog",
      "parameters": [
        {
          "name": "B",
          "value": 0.01
        }
      ],
      "outPutParameters": [
        {
          "name": "Means",
          "value": 1.8574562039475868
        },
        {
          "name": "Standardization",
          "value": 1.943555879879925
        }
      ]
    },
    {
      "columnName": "cp_r_bar",
      "preprocessingMethod": "fcos",
      "parameters": [
        {
          "name": "B",
          "value": 1
        }
      ],
      "outPutParameters": [
        {
          "name": ",
          "value": 0
        }
      ]
    }
  ]
}