Managing Dataset

Creating New Data Source

Querying your connected database on the Nected Platform is very easy. You must create a new data source on the existing database connector.

Follow this procedure to create a dataset for one of your database connectors:

1. After logging in to your nected dashboard, click Data Sources in the left navigation to open the Data Sources page.

   
2. Click + Create Data Sources button on the Data Source page and select the database connector on which you want to create the data source. Note: You can create multiple data sources with one connector.

   
3. After selecting the integration, a new editor will be open infront of you. Now go to "Add Query" and write your query to create and customize your data source.

   
4. After writing the query, click on the "Test Query" button to test if your query is giving the expected results or not, as shown in the GIF.

5. Finally, after testing the query, you can:

   1. Publish in production: To publish the data source in production click on the "Publish" button on the bottom right corner.

   2. Request for Review: You can assign someone from your workspace to review your data source as an Approver, like this:

      

Note: If you've requested the dataset for a review, then only the reviewer can publish the dataset. Otherwise, you can simply publish the data source by clicking on the Publish button. Read more about it from Approval Flow.

After your dataset is published, you can create rules on the dataset.

Editing Data Source

You can edit the data source if you want to update the query or change the dataset settings.

Editing Query

Follow this procedure to edit an existing dataset:

1. Open the data source editor by clicking on the name:

   
2. After the editor opens, then you can modify the dataset query like this:

   1. First click on the Edit button

   2. Edit the query

   3. Test the query

After testing click on the "Publish" button to publish the dataset. Or if you want to submit it for review,

Settings

1. Click on the gear icon in the right sidebar, and open the Settings tab to update the dataset settings.

2. Inside the settings tab you can edit:

   1. Row limit – Number of rows displayed in the query result.

   2. Cache – Enable or disable the cache for the dataset results. Cached results provide faster query processing.

   3. Time to expire – Cache expiration time.

Version Control

If you edit a published data source and re-publish the updated data source, then it creates a new version of the data source. But for any reason, If you want to check or roll back to a specific previous version, you can do that using the version Control tab. You can do it with two different ways:

1. At the top bar, you can see the Environment tabs with numbers written alongside. These numbers show how many versions you have for that environment. Like in the image, you can see that I've 3 Published versions and 1 Draft version of that Data Source. Now, I can click on the respective environment to access the Version Control section like this:

   
2. The second option is, you can click on the just next icon of the settings icon, and it will open the Version Control section and from there you can access it.

To rollback to a previous version just click on the Rollback button on that version.

Dependency Mapping

So, as discussed in the previous section, if you're editing the data source and then publishing it, then it creates a new version. of the data source. But if you're using the data source in any rule or workflow, and you want to check which version of the dataset they're using, then you can do that using the "Dependency Map" section. To do this follow this:

1. Click on the icon just below the Version Control icon, and it will open the Dependency Map section.

2. Inside the Dependency Map section, you'll have two tabs:

   1. Using: In this tab, you can check which integration, this data source is using.

   2. Used by: In this tab, you can check which rule or workflow is using this data source along with the version, as shown in the GIF.

Deleting DataSet

You can delete a dataset if it is no longer in use.

Follow this procedure to delete an existing dataset:

1. Log into Nected with your Email ID and password.

2. Click Datasets in the left navigation to open the Datasets page.

3. Click the Delete button for the dataset that you want to delete.

   

   The Delete Dataset dialogue box opens.

   
4. Click Delete to confirm the delete operation.

Note: The delete operation will fail if a dataset is used in a rule. You must first remove the dataset from the rule, and then delete the dataset.

Note: All settings like row limit, cache, and time to expire are applicable in terms of data retrieved for that respective rule, at the time of invocation, using this dataset.

Usable States between Integrations, DataSet & Rules

You can refer to integration states, allowed states in the dataset & rules as well as any error to do troubleshooting if you are facing any issues in managing integration.