Creating a Test

After registering your AI targets, you can perform tests on them to pinpoint flaws and identify potential vulnerabilities so you can update your security policies accordingly.

To start a test:

1. Go to AI Red Teaming.

2. Click the Test Rounds tab.

3. Click New Test.

4. In the New Test window:

   • Estimated Prompts / Available Prompts: View the estimated number of prompts this test will use and the total number of available prompts for your account. You’re unable to create a test if you max your quota. To increase it, you must contact your Netskope Support.

   • Name: Enter a name for the test.

   • Target: Choose the registered AI targets you want to conduct a test on. You can select up to 3 targets.

   

5. In the Prompt Set tab, select the prompt sets you want to include in the test:

   

   • All: View all available prompt sets.
   • Predefined: View the built-in sets of Netskope prompts. To learn more about each predefined prompt set: Prompt Library.
   • Custom: View the custom prompt sets you’ve created. To create a custom prompt set: Creating a Custom Prompt.
     • Techniques: Enable this toggle to apply manipulation techniques to your custom prompts. This increases the total number of prompts in the set and can impact execution time and cost.

   You can combine predefined and custom prompt sets in the same test.

   

6. In the Advanced Settings tab:

   • Multi-Turn Mode: Enable to run conversational attacks. This mode applies to predefined prompt sets only; it does not apply to custom prompt sets.

     • LLM as Attacker: Enable to use a dynamic LLM attack. This option is available only when Multi-Turn Mode is enabled. Set the Number of turns (ranging from 3 to 5) to define how many conversational exchanges the attacker uses to probe the target. The default value is 4.

   • Sensitive Data Leakage Detection: Enable to leverage Netskope’s DLP engine to detect any sensitive data leakage in LLM responses. Select Response Masking to mask sensitive data in the test reports.

   

7. Click Save & Run to start the test. It takes some time to complete the analysis.

   Netskope can only run 3 tests at a time. Test rounds and all associated report data are automatically deleted after 180 days.