Managing Datasets
Last updated
Last updated
Querying your connected database on the Nected Platform is very easy. You just need to create a new dataset on the existing database connector.
Follow this procedure to create a dataset for one of your database connectors:
Log into Nected with your Email ID and password.
Click Datasets in the left navigation to open the Datasets page.
Click + Create Dataset button on the Datasets page and select the database connector on which you want to create a dataset. Note: You can create multiple datasets for one connector. The dataset information form opens.
Enter the query information for your dataset:
Name – Name for the dataset. It must be unique throughout the Nected platform and must not contain any spaces.
Dataset type – Staging or Production.
Source – Dataset source interface where you specify the dataset parameters.
Add Query – Database query to retrieve data from the connected database. The query format is different for each connector type.
Schema – List of database schemas retrieved from the source database.
Execute Node – Test the dataset to see the query results. This will mark the dataset tested and will be usable in creating / modifying rules using this dataset
Publish – After a successful test, publish the dataset. In this example, the dataset type is staging, and it will be staged.
Delete – Delete the dataset.
After you successfully test or publish the dataset, you can create rules on the dataset.
You can edit a dataset if you want to update the query or change the dataset settings.
Follow this procedure to edit an existing dataset:
Log into Nected with your Email ID and password.
Click Datasets in the left navigation to open the Datasets page. Click the Edit button for the dataset that you want to update. The dataset query form opens.
Edit the dataset source information as per your requirements and test the updated dataset.
Go to the Settings tab and update the dataset settings.
Click the Publish button to publish the dataset.
After you successfully publish the dataset, you can create rules on the dataset.
Make sure that your new dataset version is backward compatible & won't impact your existing published Rules. If yes, update existing Rules as per changes done in the dataset before re-publishing an already published dataset. If not done, this could break existing Rules in Production.
You can delete a dataset if it is no longer in use.
Follow this procedure to delete an existing dataset:
Log into Nected with your Email ID and password.
Click Datasets in the left navigation to open the Datasets page.
Click the Delete button for the dataset that you want to delete.
The Delete Dataset dialogue box opens.
Click Delete to confirm the delete operation.
Note: The delete operation will fail if a dataset is used in a rule. You must first remove the dataset from the rule, and then delete the dataset.
You can configure dataset settings to configure query caching as well as expiry time along with max row count to be fetched while invoking any rule.
Settings tab – Open this tab to open the settings interface.
Row limit – Number of rows displayed in the query result.
Cache – Enable or disable the cache for the dataset results. Cached results provide faster query processing.
Time to expire – Cache expiration time.
Note: This information will be different for Staging and Production environments.
Note: All settings like row limit, cache, and time to expire are applicable in terms of data retrieved for that respective rule, at the time of invocation, using this dataset.
You can refer to integration states, allowed states in the dataset & rules as well as any error to do troubleshooting if you are facing any issues in managing integration.
