Projects

Projects

The project is the user's workspace. From here you can manage:

Databases

In this area you can manage your database connections and your environments. Refer to the databases documentation for more information.

Data lists

You can add project data lists to use in the operations of a rule. You can create two types of data lists:

  • TXT: Add a plain text data list by separating the values by commas.
  • CSV: You can create a data list by attaching a CSV and selecting the delimiter and if the file contains headers.

These data lists can be used for anonymization and data synthesis operations.

Variables

You can define two types of variables, text or password, which will be encrypted and will only be visible during the variable creation process.

These variables can be invoked from:

  • Functions: Any variable defined here can be invoked from any custom function.
  • Rules: It is possible to use these variables for Anonymize, Synthesize or, in general, in any text field where Gigantics allows the user to enter a text.

In both cases, the variable will be invoked using:

$(var)

Functions

It is possible to create customized functions to use in data transformations in the model. Like the other configuration items, these functions are available from all the models in the project.

To learn more about how to create a function, see Custom Functions.

Labels

Labels are used to categorize the fields analyzed during the Discover step within a Model.

Gigantics provides a set of labels (internal), however, the user can enable/disable them individually as well as create new ones (custom/ labels).

Custom labels

To create a new label (custom) and that can be used in any project model, it is necessary to indicate or give a hint so that gigantics can assign the label to a field.

In the type field, you specify what type of help or hint is offered:

  • Metadata hint: Matches the entity or the field name to apply the label.
  • Data Matchers: Matches the record value to apply the label.

You can define the label as PII Data and assign it a severity that will be displayed in the discover stage of any model in the project.

In the Masking, it is possible to assign a transformation function to the label. This function has to be defined in the Functions section.

So, for example, we want to create a 'user/gender' tag that is also sensitive data and applies only to certain entities that match a regular expression:

Name: user/gender
Type: Metadata hint
 
Entity (regex): ^employ.*
Field (of the entities that match the regex) (regex): ^gender
 
Entity (text): customers
Field (text): gender

In the case of using the Data Matcher type, the application will go through all the values and assign the label to those fields:

Name: user/gender
Type: Data Matcher
 
Include (regex): ^(M|F)$
Include (text): M

With this configuration, Gigantc will assign the user/gender label to all fields which contain the value M or M or F.

API

API keys are used to share datasets and to execute pipelines.

Here are shown all the API keys that are being used in the project and can be disabled in case you do not want to share the resource. can be disabled in case you do not want to share the resource.

Datasets

In the case of datasets, URL invocation returns the sql file or equivalent of the dataset. In this way, it is possible to include the call in a CI/CD devops system to create databases dynamically during the execution of your continuous integration.

Pipelines

For Pipelines, when calling the URL, it executes the job previously indicated in the pipeline configuration.

The URL has the following structure

http://<gig_server>:<port>/api/pipeline/<API_KEY>

JSON response contains two parameters:

  • job_id: Shows the id of the job generated in Gigatnics when the call is made.
  • job_url: Through the URL shows the status of the job. If the pipeline generates a dataset, the link of the generated dataset will be shown when job status is completed.

On this page