google-cloud/src/e2e-test/features/gcsdelete/GCSDelete.feature at 1933137a19e54739849c31de70e2798c04b69fb2 · cloudsufi/google-cloud · GitHub

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
@GCSDelete
Feature: GCS Delete - Verification of GCS Delete plugin

  @GCS_CSV_TEST
  Scenario: Verify the GCS Delete successfully deletes all objects in the GCS bucket
    Given Open Datafusion Project to configure pipeline
    When Expand Plugin group in the LHS plugins list: "Conditions and Actions"
    When Select plugin: "GCS Delete" from the plugins list as: "Conditions and Actions"
    When Navigate to the properties page of plugin: "GCS Dkjnkjjjelete"
    Then Enter the GCS Delete property projectId "projectId"
    Then Enter the GCS Delete property objects to delete as bucketName
    Then Override Service account details if set in environment variables
    Then Validate "GCS Delete" plugin properties
    Then Close the GCS Delete properties
    Then Save and Deploy Pipeline
    Then Run the Pipeline in Runtime
    Then Wait till pipeline is in running state
    Then Open and capture logs
    Then Verify the pipeline status is "Succeeded"
    Then Verify all the objects in the GCS bucket deleted successfully by GCS Delete action plugin

  @GCS_CSV_TEST
  Scenario: Verify the GCS Delete successfully deletes objects in the GCS bucket path
    Given Open Datafusion Project to configure pipeline
    When Expand Plugin group in the LHS plugins list: "Conditions and Actions"
    When Select plugin: "GCS Delete" from the plugins list as: "Conditions and Actions"
    When Navigate to the properties page of plugin: "GCS Delete"
    Then Enter the GCS Delete property projectId "projectId"
    Then Enter the GCS Delete property objects to delete as path "gcsCsvFile"
    Then Override Service account details if set in environment variables
    Then Validate "GCS Delete" plugin properties
    Then Close the GCS Delete properties
    Then Save and Deploy Pipeline
    Then Run the Pipeline in Runtime
    Then Wait till pipeline is in running state
    Then Open and capture logs
    Then Verify the pipeline status is "Succeeded"
    Then Verify objects in the GCS path "gcsCsvFile" deleted successfully by GCS Delete action plugin

  @GCS_READ_RECURSIVE_TEST @GCSDelete_Required
  Scenario: Verify the GCS Delete successfully deletes multiple objects
    Given Open Datafusion Project to configure pipeline
    When Expand Plugin group in the LHS plugins list: "Conditions and Actions"
    When Select plugin: "GCS Delete" from the plugins list as: "Conditions and Actions"
    When Navigate to the properties page of plugin: "GCS Delete"
    Then Enter the GCS Delete property projectId "projectId"
    Then Enter the GCS Delete property objects to delete as list of objects "gcsDeleteObjectsList"
    Then Override Service account details if set in environment variables
    Then Validate "GCS Delete" plugin properties
    Then Close the GCS Delete properties
    Then Save and Deploy Pipeline
    Then Run the Pipeline in Runtime
    Then Wait till pipeline is in running state
    Then Open and capture logs
    Then Verify the pipeline status is "Succeeded"
    Then Verify multiple objects "gcsDeleteObjectsList" deleted successfully by GCS Delete action plugin

  @GCS_DELETE_WILDCARD_TEST @GCSDelete_Required
  Scenario: Verify the GCS Delete successfully deletes multiple csv file under current directory
    Given Open Datafusion Project to configure pipeline
    When Expand Plugin group in the LHS plugins list: "Conditions and Actions"
    When Select plugin: "GCS Delete" from the plugins list as: "Conditions and Actions"
    When Navigate to the properties page of plugin: "GCS Delete"
    Then Enter the GCS Delete property projectId "projectId"
    Then Enter the GCS Delete property objects to delete as path "gcsWildcardPath1"
    Then Override Service account details if set in environment variables
    Then Validate "GCS Delete" plugin properties
    Then Close the GCS Delete properties
    Then Save and Deploy Pipeline
    Then Run the Pipeline in Runtime
    Then Wait till pipeline is in running state
    Then Open and capture logs
    Then Verify the pipeline status is "Succeeded"
    Then Verify multiple objects "gcsDeleteObjectsList2" deleted successfully by GCS Delete action plugin
    Then Verify objects "gcsKeepObjectsList" still exist after GCS Delete action plugin

  @GCS_DELETE_WILDCARD_TEST @GCSDelete_Required
  Scenario: Verify the GCS Delete successfully deletes multiple objects with prefix wildcard under current directory
    Given Open Datafusion Project to configure pipeline
    When Expand Plugin group in the LHS plugins list: "Conditions and Actions"
    When Select plugin: "GCS Delete" from the plugins list as: "Conditions and Actions"
    When Navigate to the properties page of plugin: "GCS Delete"
    Then Enter the GCS Delete property projectId "projectId"
    Then Enter the GCS Delete property objects to delete as path "gcsWildcardPath2"
    Then Override Service account details if set in environment variables
    Then Validate "GCS Delete" plugin properties
    Then Close the GCS Delete properties
    Then Save and Deploy Pipeline
    Then Run the Pipeline in Runtime
    Then Wait till pipeline is in running state
    Then Open and capture logs
    Then Verify the pipeline status is "Succeeded"
    Then Verify multiple objects "gcsDeleteObjectsList2" deleted successfully by GCS Delete action plugin
    Then Verify objects "gcsKeepObjectsList" still exist after GCS Delete action plugin

  @GCS_DELETE_WILDCARD_TEST
  Scenario: Verify the GCS Delete successfully deletes directory with prefix test under current directory
    Given Open Datafusion Project to configure pipeline
    When Expand Plugin group in the LHS plugins list: "Conditions and Actions"
    When Select plugin: "GCS Delete" from the plugins list as: "Conditions and Actions"
    When Navigate to the properties page of plugin: "GCS Delete"
    Then Enter the GCS Delete property projectId "projectId"
    Then Enter the GCS Delete property objects to delete as path "gcsWildcardPath3"
    Then Override Service account details if set in environment variables
    Then Validate "GCS Delete" plugin properties
    Then Close the GCS Delete properties
    Then Save and Deploy Pipeline
    Then Run the Pipeline in Runtime
    Then Wait till pipeline is in running state
    Then Open and capture logs
    Then Verify the pipeline status is "Succeeded"
    Then Verify multiple objects "gcsDeleteObjectsList3" deleted successfully by GCS Delete action plugin
    Then Verify objects "gcsKeepObjectsList2" still exist after GCS Delete action plugin

  @GCS_DELETE_MULTIPLE_BUCKETS_TEST
  Scenario: Verify the GCS Delete successfully deletes file from multiple buckets
    Given Open Datafusion Project to configure pipeline
    When Expand Plugin group in the LHS plugins list: "Conditions and Actions"
    When Select plugin: "GCS Delete" from the plugins list as: "Conditions and Actions"
    When Navigate to the properties page of plugin: "GCS Delete"
    Then Enter the GCS Delete property projectId "projectId"
    Then Enter the GCS Delete property objects from multiple Buckets to delete as list of objects "gcsMultiBucketsPath1"
    Then Override Service account details if set in environment variables
    Then Validate "GCS Delete" plugin properties
    Then Close the GCS Delete properties
    Then Save and Deploy Pipeline
    Then Run the Pipeline in Runtime
    Then Wait till pipeline is in running state
    Then Open and capture logs
    Then Verify the pipeline status is "Succeeded"
    Then Verify multiple objects "gcsMultiBucketsPath1" from multiple Buckets deleted successfully by GCS Delete action plugin
    Then Verify objects "gcsKeepMultiBucketsPath1" from multiple Buckets still exist after GCS Delete action plugin

  @GCS_DELETE_MULTIPLE_BUCKETS_TEST
  Scenario: Verify the GCS Delete successfully deletes file from multiple buckets use wildcard
    Given Open Datafusion Project to configure pipeline
    When Expand Plugin group in the LHS plugins list: "Conditions and Actions"
    When Select plugin: "GCS Delete" from the plugins list as: "Conditions and Actions"
    When Navigate to the properties page of plugin: "GCS Delete"
    Then Enter the GCS Delete property projectId "projectId"
    Then Enter the GCS Delete property objects from multiple Buckets to delete as list of objects "gcsWildcardMultiBucketsPath1"
    Then Override Service account details if set in environment variables
    Then Validate "GCS Delete" plugin properties
    Then Close the GCS Delete properties
    Then Save and Deploy Pipeline
    Then Run the Pipeline in Runtime
    Then Wait till pipeline is in running state
    Then Open and capture logs
    Then Verify the pipeline status is "Succeeded"
    Then Verify multiple objects "gcsDeleteWildcardMultiBucketsPath1" from multiple Buckets deleted successfully by GCS Delete action plugin
    Then Verify objects "gcsKeepWildcardMultiBucketsPath1" from multiple Buckets still exist after GCS Delete action plugin

  Scenario:Verify GCS Delete properties validation error for mandatory field Objects to Delete
    Given Open Datafusion Project to configure pipeline
    When Expand Plugin group in the LHS plugins list: "Conditions and Actions"
    When Select plugin: "GCS Delete" from the plugins list as: "Conditions and Actions"
    When Navigate to the properties page of plugin: "GCS Delete"
    Then Validate mandatory property error for "paths"

  Scenario:Verify GCS Delete properties validation error for incorrect bucket path
    Given Open Datafusion Project to configure pipeline
    When Expand Plugin group in the LHS plugins list: "Conditions and Actions"
    When Select plugin: "GCS Delete" from the plugins list as: "Conditions and Actions"
    When Navigate to the properties page of plugin: "GCS Delete"
    Then Enter the GCS Delete property objects to delete as path "gcsInvalidBucketName"
    Then Override Service account details if set in environment variables
    Then Verify invalid bucket name error message is displayed for GCS Delete objects to delete path "gcsInvalidBucketName"