This guide assumes:
- the e6data Workspace (clusters/compute) is installed in a cloud account named Account A.
- the unity catalog & S3 data stores are located in a different cloud account named Account B.
- Both Account A & Account B are in the same AWS region.
Step 1: Create policies to access S3 data sources in Account B
- Sign in to the Account B AWS Console.
- Search for IAM.
- In the navigation pane, choose Roles.
- Click Create role.
- Under Select type of trusted entity, choose AWS account.
- Click on Another AWS account to enter the Account ID.
- Enter the account ID of Account A.
- Click Next: Permissions.
- Attach the below policy to the role.
- Replace the ARN of the S3 bucket/s containing the data.
- Click Next: Add tags.
- Optional: You can add tags to the role. Or leave these fields blank, and click Next: Review.
- Enter a Role name that follows your organization’s naming convention.
- Click Create role.
- Copy the ARN of the newly created role.
Step 2: Configure access in Account A
- In Account B, copy the ARN of the role created in Step 1.
- Sign in to the Account A AWS Console.
- Create a policy and choose the JSON view.
- In the STS policy below, replace the ARN with the ARN of the role created in Account B.
- Copy & paste the edited policy into the JSON editor.
- In Account A, attach this policy to: e6data_engine_role (e6data-workspace-<workspace_name>-engine-role)