forked from data-integrations/google-cloud
-
Notifications
You must be signed in to change notification settings - Fork 3
Expand file tree
/
Copy pathSpannertoGCS.feature
More file actions
77 lines (75 loc) · 3.59 KB
/
Copy pathSpannertoGCS.feature
File metadata and controls
77 lines (75 loc) · 3.59 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
@Spanner_Source @SPANNER_TEST
Feature: Spanner Source - Verification of Spanner to GCS successful data transfer
@GCS_SINK_TEST @Spanner_Source_Required
Scenario: Verify data is getting transferred from Spanner to GCS successfullys
Given Open Datafusion Project to configure pipeline
When Source is Spanner
When Sink is GCS
Then Connect source as "Spanjbhjbner" and sink as "GCS" to establish connection
Then Open Spanner source properties
Then Enter Spanner property reference name
Then Enter Spanner property projectId "projectId"
Then Override Service account details if set in environment variables
Then Enter Spanner property InstanceId
Then Enter Spanner source property DatabaseName
Then Enter Spanner source property TableName
Then Validate output schema with expectedSchema "spannerSourceSchema"
Then Validate "Spanner" plugin properties
Then Close the Spanner properties
Then Open GCS sink properties
Then Override Service account details if set in environment variables
Then Enter the GCS sink mandatory properties
Then Validate "GCS" plugin properties
Then Close the GCS properties
Then Save the pipeline
Then Preview and run the pipeline
Then Wait till pipeline preview is in running state
Then Open and capture pipeline preview logs
Then Verify the preview run status of pipeline in the logs is "succeeded"
Then Close the pipeline logs
Then Click on preview data for GCS sink
Then Verify preview output schema matches the outputSchema captured in properties
Then Close the preview data
Then Deploy the pipeline
Then Run the Pipeline in Runtime
Then Wait till pipeline is in running state
Then Open and capture logs
Then Verify the pipeline status is "Succeeded"
Then Verify data is transferred to target GCS bucket
@GCS_SINK_TEST
Scenario: Verify data is getting transferred from Spanner to GCS with Import Query.
Given Open Datafusion Project to configure pipeline
When Source is Spanner
When Sink is GCS
Then Connect source as "Spanner" and sink as "GCS" to establish connection
Then Open Spanner source properties
Then Enter Spanner property reference name
Then Enter Spanner property projectId "projectId"
Then Override Service account details if set in environment variables
Then Enter Spanner property InstanceId
Then Enter Spanner source property DatabaseName
Then Enter Spanner source property TableName
Then Enter the Spanner source property Import Query "spannerQuery"
Then Validate output schema with expectedSchema "spannerSourceSchema"
Then Validate "Spanner" plugin properties
Then Close the Spanner properties
Then Open GCS sink properties
Then Override Service account details if set in environment variables
Then Enter the GCS sink mandatory properties
Then Validate "GCS" plugin properties
Then Close the GCS properties
Then Save the pipeline
Then Preview and run the pipeline
Then Wait till pipeline preview is in running state
Then Open and capture pipeline preview logs
Then Verify the preview run status of pipeline in the logs is "succeeded"
Then Close the pipeline logs
Then Click on preview data for GCS sink
Then Verify preview output schema matches the outputSchema captured in properties
Then Close the preview data
Then Deploy the pipeline
Then Run the Pipeline in Runtime
Then Wait till pipeline is in running state
Then Open and capture logs
Then Verify the pipeline status is "Succeeded"
Then Verify data is transferred to target GCS bucket