Skip to content

Commit 3cb78c9

Browse files
whowutwutwhowutwut
committed
IBM Storage Scale Container Native v6.0.0.0
-------------------------------------------- * IBM Storage Scale Operator v6.0.0.0 * IBM Storage Scale v6.0.0.0 * IBM Storage Scale Container Storage Interface 3.0.0 Signed-off-by: VICTOR K. HU <vhu@us.ibm.com>
1 parent 2052d6d commit 3cb78c9

25 files changed

+3214
-4683
lines changed

‎generated/scale/README.md‎

Lines changed: 40 additions & 41 deletions
Original file line numberDiff line numberDiff line change
@@ -7,36 +7,36 @@ The images that are listed in the following table are the container images that
77

88
| Pod | Container | Repository | Image |
99
|-----|-----------|------------|---------------------|
10-
| ibm-spectrum-scale-controller-manager-XXXXXXXXX-XXXXX | manager | icr.io/cpopen | ibm-spectrum-scale-operator@sha256:948846021d87acbda10af4510fb41c004c85ae778d3b9018c86b67a231511030 |
11-
| ibm-spectrum-scale-csi-operator | operator | icr.io/cpopen | ibm-spectrum-scale-csi-operator@sha256:85b3dcb4f60d0e6b510f98a910d098006732b41a99f6b1e925d50e329c2616dd |
12-
| must-gather-XXXXX | must-gather | icr.io/cpopen | ibm-spectrum-scale-must-gather@sha256:cb4d36939ef903cf4b861b876efb571916f1437ff508c581258129d8665ae8c7 |
10+
| ibm-spectrum-scale-controller-manager-XXXXXXXXX-XXXXX | manager | icr.io/cpopen | ibm-spectrum-scale-operator@sha256:ebbee83e2c15316c6927ad3654be4ff755bef1cdccb7cc0f55c223e7c433b716
11+
| must-gather-XXXXX | must-gather | icr.io/cpopen | ibm-spectrum-scale-must-gather@sha256:2d989634bf3491c81336b2f58c8d27b70eab2a0a5c4ef13048aa83b04afa1728 |
12+
1313

1414
## IBM Storage Scale images that are acquired from entitled IBM Container Repository
1515

1616
The images that are listed in the following table are the container images that are obtained through entitlement to the IBM Container Repository.
1717

1818
| Pod | Container | Repository | Image |
1919
|-----|-----------|------------|---------------------|
20-
| workerX/masterX* | mmbuildgpl | cp.icr.io/cp/gpfs | ibm-spectrum-scale-core-init@sha256:95737415a00be5ffffb4a25d4ca66995d91cd9dfea92f27ae41f9535b11f2556 |
21-
| workerX/masterX* | config | cp.icr.io/cp/gpfs | ibm-spectrum-scale-core-init@sha256:95737415a00be5ffffb4a25d4ca66995d91cd9dfea92f27ae41f9535b11f2556 |
22-
| workerX/masterX* | gpfs (if using Data Access Edition) | cp.icr.io/cp/gpfs/data-access | ibm-spectrum-scale-daemon@sha256:2fda299f4f34fbd8909a18c3c86051ce796daf503a9dbf5f61a98e87525ff130 |
23-
| workerX/masterX* | gpfs (if using Data Management Edition) | cp.icr.io/cp/gpfs/data-management | ibm-spectrum-scale-daemon@sha256:990be071a1e56ecadce595401e7c62b6d2224546a2a1318bd688c42dd9bceb34 |
24-
| workerX/masterX* | logs | cp.icr.io/cp/gpfs | ibm-spectrum-scale-logs@sha256:8a88c9335ad72e51b87a9dff839e1d8a52e00b2206c0b76edc3c5e4165a9c9ab |
25-
| ibm-spectrum-scale-gui-X | liberty | cp.icr.io/cp/gpfs | ibm-spectrum-scale-gui@sha256:de894862e6974e7972674a4738f7d788c16b1571d4b0faa3d60fa7fbcc457017 |
26-
| ibm-spectrum-scale-gui-X | sysmon | cp.icr.io/cp/gpfs | ibm-spectrum-scale-monitor@sha256:81f7781f6e96083dfbe291f9e3be6a7a45952314765b9604dd7324f3d104d4cc |
20+
| workerX/masterX* | mmbuildgpl | cp.icr.io/cp/gpfs | ibm-spectrum-scale-core-init@sha256:393cab9fa078c272b2b0b5b672d07cbfbf6b0f4609bde7ad823c68601e0478ba |
21+
| workerX/masterX* | config | cp.icr.io/cp/gpfs | ibm-spectrum-scale-core-init@sha256:393cab9fa078c272b2b0b5b672d07cbfbf6b0f4609bde7ad823c68601e0478ba |
22+
| workerX/masterX* | gpfs (if using Data Access Edition) | cp.icr.io/cp/gpfs/data-access | ibm-spectrum-scale-daemon@sha256:e7d59b82a30da67a75105048f0c9b0d6fd33f9d2986c7d9a788f340e55e91298 |
23+
| workerX/masterX* | gpfs (if using Data Management Edition) | cp.icr.io/cp/gpfs/data-management | ibm-spectrum-scale-daemon@sha256:eb83a412907a5edd9c68edc9052aabaede79a995df2340214b4a0c2e758de6bd |
24+
| workerX/masterX* | logs | cp.icr.io/cp/gpfs | ibm-spectrum-scale-logs@sha256:4831c36fe2f9de787930a7c6a412276f35dd55e3e07a0cd36c66be196ed6a11a |
25+
| ibm-spectrum-scale-gui-X | liberty | cp.icr.io/cp/gpfs | ibm-spectrum-scale-gui@sha256:4159778c647cbb089ee7f03945e442c8740e744c5e7485211122402c4ff4b6ce |
26+
| ibm-spectrum-scale-gui-X | sysmon | cp.icr.io/cp/gpfs | ibm-spectrum-scale-monitor@sha256:bab6b3f442736129d96cadece1ecf08ca137449586ee9951d3f34e024becbe18 |
2727
| ibm-spectrum-scale-gui-X | postgres | cp.icr.io/cp/gpfs | postgres@sha256:0bcc5bbbb2aa9c9b4c6505845918c7eb55d783cf5c1f434fac33012579fb149d |
28-
| ibm-spectrum-scale-gui-X | logs | cp.icr.io/cp/gpfs | ibm-spectrum-scale-logs@sha256:8a88c9335ad72e51b87a9dff839e1d8a52e00b2206c0b76edc3c5e4165a9c9ab |
29-
| ibm-spectrum-scale-pmcollector-X | pmcollector | cp.icr.io/cp/gpfs | ibm-spectrum-scale-pmcollector@sha256:8b73a06ade5c008c760b49bc120c01f78f5fa53ca01015625343a75cb1cd76dd |
30-
| ibm-spectrum-scale-pmcollector-X | sysmon | cp.icr.io/cp/gpfs | ibm-spectrum-scale-monitor@sha256:81f7781f6e96083dfbe291f9e3be6a7a45952314765b9604dd7324f3d104d4cc |
31-
| ibm-spectrum-scale-csi-snapshotter | csi-snapshotter | cp.icr.io/cp/gpfs/csi | csi-snapshotter@sha256:5f4bb469fec51147ce157329dab598c758da1b018bad6dad26f0ff469326d769 |
32-
| ibm-spectrum-scale-csi-attacher | ibm-spectrum-scale-csi-attacher | cp.icr.io/cp/gpfs/csi | csi-attacher@sha256:69888dba58159c8bc0d7c092b9fb97900c9ca8710d088b0b7ea7bd9052df86f6 |
33-
| ibm-spectrum-scale-csi-provisioner | csi-provisioner | cp.icr.io/cp/gpfs/csi | csi-provisioner@sha256:d5e46da8aff7d73d6f00c761dae94472bcda6e78f4f17b3802dc89d44de0111b |
34-
| ibm-spectrum-scale-csi-driver-XXXXX | liveness-probe | cp.icr.io/cp/gpfs/csi | livenessprobe@sha256:2c5f9dc4ea5ac5509d93c664ae7982d4ecdec40ca7b0638c24e5b16243b8360f |
35-
| ibm-spectrum-scale-csi-driver-XXXXX | driver-registrar | cp.icr.io/cp/gpfs/csi | csi-node-driver-registrar@sha256:d7138bcc3aa5f267403d45ad4292c95397e421ea17a0035888850f424c7de25d |
36-
| ibm-spectrum-scale-csi-resizer-X | ibm-spectrum-scale-csi-resizer | cp.icr.io/cp/gpfs/csi | csi-resizer@sha256:8ddd178ba5d08973f1607f9b84619b58320948de494b31c9d7cd5375b316d6d4 |
37-
| ibm-spectrum-scale-csi-driver-XXXXX | ibm-spectrum-scale-csi | cp.icr.io/cp/gpfs/csi | ibm-spectrum-scale-csi-driver@sha256:47b29442f42f9eea44cee07d7ea78df67325953e66eecb69faeb6b4f9913fc6e |
38-
| ibm-spectrum-scale-grafana-bridge-X | grafanabridge | cp.icr.io/cp/gpfs | ibm-spectrum-scale-grafana-bridge@sha256:0cd51125e115685cc9a8e807f5e7409b6f44c7e104a0056a01d4d92542eea47c |
39-
| coredns-XXXXX | coredns | cp.icr.io/cp/gpfs | ibm-spectrum-scale-coredns@sha256:6a317b23fee629c0b07eb95d34ab7593bb38d41bffc5d1cd4cb2870539c66cd4 |
28+
| ibm-spectrum-scale-gui-X | logs | cp.icr.io/cp/gpfs | ibm-spectrum-scale-logs@sha256:4831c36fe2f9de787930a7c6a412276f35dd55e3e07a0cd36c66be196ed6a11a |
29+
| ibm-spectrum-scale-pmcollector-X | pmcollector | cp.icr.io/cp/gpfs | ibm-spectrum-scale-pmcollector@sha256:b0f5896194bd278b9773d533e2f571874f387b42a5fff001f7e9f0a76964398f |
30+
| ibm-spectrum-scale-pmcollector-X | sysmon | cp.icr.io/cp/gpfs | ibm-spectrum-scale-monitor@sha256:bab6b3f442736129d96cadece1ecf08ca137449586ee9951d3f34e024becbe18 |
31+
| ibm-spectrum-scale-csi-snapshotter | csi-snapshotter | cp.icr.io/cp/gpfs/csi | csi-snapshotter@sha256:bc7be893ecc3ad524194aa6573b2f5c06cd469bdf21a500ab6c99c2ba1c4d64d |
32+
| ibm-spectrum-scale-csi-attacher | ibm-spectrum-scale-csi-attacher | cp.icr.io/cp/gpfs/csi | csi-attacher@sha256:5aaefc24f315b182233c8b6146077f8c32e274d864cb03c632206e78bd0302da |
33+
| ibm-spectrum-scale-csi-provisioner | csi-provisioner | cp.icr.io/cp/gpfs/csi | csi-provisioner@sha256:bb057f866177d5f4139a1527e594499cbe0feeb67b63aaca8679dfdf0a6016f9 |
34+
| ibm-spectrum-scale-csi-driver-XXXXX | liveness-probe | cp.icr.io/cp/gpfs/csi | livenessprobe@sha256:88092d100909918ae0a768956cf78c88bc59cd7232720f7cdbdfb5d2e235001e |
35+
| ibm-spectrum-scale-csi-driver-XXXXX | driver-registrar | cp.icr.io/cp/gpfs/csi | csi-node-driver-registrar@sha256:5244abbe87e01b35adeb8bb13882a74785df0c0619f8325c9e950395c3f72a97 |
36+
| ibm-spectrum-scale-csi-resizer-X | ibm-spectrum-scale-csi-resizer | cp.icr.io/cp/gpfs/csi | csi-resizer@sha256:5e7cbb63fd497fa913caa21fee1a69f727c220c6fa83c5f8bb0995e2ad73a474 |
37+
| ibm-spectrum-scale-csi-driver-XXXXX | ibm-spectrum-scale-csi | cp.icr.io/cp/gpfs/csi | ibm-spectrum-scale-csi-driver@sha256:b367ac63080cf5f544ff3410817ac6a594ac1b2a4f7936eb0c140b2a108d2514 |
38+
| ibm-spectrum-scale-grafana-bridge-X | grafanabridge | cp.icr.io/cp/gpfs | ibm-spectrum-scale-grafana-bridge@sha256:009d20f17bd99f9ca641b7c60733b842897a6f33854a8e058d229fab610a9a55 |
39+
| coredns-XXXXX | coredns | cp.icr.io/cp/gpfs | ibm-spectrum-scale-coredns@sha256:1934b811c6048b364859c60a2df5eec5aeef33b85104a5abb4f2251bcc344135 |
4040

4141
*Pod names that contain the mmbuildgpl, config, and gpfs containers may vary. The pod name is based on the shortname of the node that it was scheduled to.
4242

@@ -50,25 +50,24 @@ When setting up your environment to be air-gapped, use `skopeo` to copy the foll
5050

5151
```bash
5252
# IBM Storage Scale container native images
53-
icr.io/cpopen/ibm-spectrum-scale-operator@sha256:948846021d87acbda10af4510fb41c004c85ae778d3b9018c86b67a231511030
54-
cp.icr.io/cp/gpfs/data-access/ibm-spectrum-scale-daemon@sha256:2fda299f4f34fbd8909a18c3c86051ce796daf503a9dbf5f61a98e87525ff130
55-
cp.icr.io/cp/gpfs/data-management/ibm-spectrum-scale-daemon@sha256:990be071a1e56ecadce595401e7c62b6d2224546a2a1318bd688c42dd9bceb34
56-
cp.icr.io/cp/gpfs/ibm-spectrum-scale-core-init@sha256:95737415a00be5ffffb4a25d4ca66995d91cd9dfea92f27ae41f9535b11f2556
57-
cp.icr.io/cp/gpfs/ibm-spectrum-scale-coredns@sha256:6a317b23fee629c0b07eb95d34ab7593bb38d41bffc5d1cd4cb2870539c66cd4
58-
cp.icr.io/cp/gpfs/ibm-spectrum-scale-grafana-bridge@sha256:0cd51125e115685cc9a8e807f5e7409b6f44c7e104a0056a01d4d92542eea47c
59-
cp.icr.io/cp/gpfs/ibm-spectrum-scale-gui@sha256:de894862e6974e7972674a4738f7d788c16b1571d4b0faa3d60fa7fbcc457017
60-
cp.icr.io/cp/gpfs/ibm-spectrum-scale-logs@sha256:8a88c9335ad72e51b87a9dff839e1d8a52e00b2206c0b76edc3c5e4165a9c9ab
61-
cp.icr.io/cp/gpfs/ibm-spectrum-scale-monitor@sha256:81f7781f6e96083dfbe291f9e3be6a7a45952314765b9604dd7324f3d104d4cc
62-
cp.icr.io/cp/gpfs/ibm-spectrum-scale-pmcollector@sha256:8b73a06ade5c008c760b49bc120c01f78f5fa53ca01015625343a75cb1cd76dd
53+
icr.io/cpopen/ibm-spectrum-scale-operator@sha256:ebbee83e2c15316c6927ad3654be4ff755bef1cdccb7cc0f55c223e7c433b716
54+
cp.icr.io/cp/gpfs/data-access/ibm-spectrum-scale-daemon@sha256:e7d59b82a30da67a75105048f0c9b0d6fd33f9d2986c7d9a788f340e55e91298
55+
cp.icr.io/cp/gpfs/data-management/ibm-spectrum-scale-daemon@sha256:eb83a412907a5edd9c68edc9052aabaede79a995df2340214b4a0c2e758de6bd
56+
cp.icr.io/cp/gpfs/ibm-spectrum-scale-core-init@sha256:393cab9fa078c272b2b0b5b672d07cbfbf6b0f4609bde7ad823c68601e0478ba
57+
cp.icr.io/cp/gpfs/ibm-spectrum-scale-coredns@sha256:1934b811c6048b364859c60a2df5eec5aeef33b85104a5abb4f2251bcc344135
58+
cp.icr.io/cp/gpfs/ibm-spectrum-scale-grafana-bridge@sha256:009d20f17bd99f9ca641b7c60733b842897a6f33854a8e058d229fab610a9a55
59+
cp.icr.io/cp/gpfs/ibm-spectrum-scale-gui@sha256:4159778c647cbb089ee7f03945e442c8740e744c5e7485211122402c4ff4b6ce
60+
cp.icr.io/cp/gpfs/ibm-spectrum-scale-logs@sha256:4831c36fe2f9de787930a7c6a412276f35dd55e3e07a0cd36c66be196ed6a11a
61+
cp.icr.io/cp/gpfs/ibm-spectrum-scale-monitor@sha256:bab6b3f442736129d96cadece1ecf08ca137449586ee9951d3f34e024becbe18
62+
cp.icr.io/cp/gpfs/ibm-spectrum-scale-pmcollector@sha256:b0f5896194bd278b9773d533e2f571874f387b42a5fff001f7e9f0a76964398f
6363
cp.icr.io/cp/gpfs/postgres@sha256:0bcc5bbbb2aa9c9b4c6505845918c7eb55d783cf5c1f434fac33012579fb149d
64-
icr.io/cpopen/ibm-spectrum-scale-must-gather@sha256:cb4d36939ef903cf4b861b876efb571916f1437ff508c581258129d8665ae8c7
64+
icr.io/cpopen/ibm-spectrum-scale-must-gather@sha256:2d989634bf3491c81336b2f58c8d27b70eab2a0a5c4ef13048aa83b04afa1728
6565
# IBM Container Storage Interface (CSI) images
66-
icr.io/cpopen/ibm-spectrum-scale-csi-operator@sha256:85b3dcb4f60d0e6b510f98a910d098006732b41a99f6b1e925d50e329c2616dd
67-
cp.icr.io/cp/gpfs/csi/csi-attacher@sha256:69888dba58159c8bc0d7c092b9fb97900c9ca8710d088b0b7ea7bd9052df86f6
68-
cp.icr.io/cp/gpfs/csi/csi-node-driver-registrar@sha256:d7138bcc3aa5f267403d45ad4292c95397e421ea17a0035888850f424c7de25d
69-
cp.icr.io/cp/gpfs/csi/csi-provisioner@sha256:d5e46da8aff7d73d6f00c761dae94472bcda6e78f4f17b3802dc89d44de0111b
70-
cp.icr.io/cp/gpfs/csi/csi-resizer@sha256:8ddd178ba5d08973f1607f9b84619b58320948de494b31c9d7cd5375b316d6d4
71-
cp.icr.io/cp/gpfs/csi/csi-snapshotter@sha256:5f4bb469fec51147ce157329dab598c758da1b018bad6dad26f0ff469326d769
72-
cp.icr.io/cp/gpfs/csi/ibm-spectrum-scale-csi-driver@sha256:47b29442f42f9eea44cee07d7ea78df67325953e66eecb69faeb6b4f9913fc6e
73-
cp.icr.io/cp/gpfs/csi/livenessprobe@sha256:2c5f9dc4ea5ac5509d93c664ae7982d4ecdec40ca7b0638c24e5b16243b8360f
66+
cp.icr.io/cp/gpfs/csi/csi-attacher@sha256:5aaefc24f315b182233c8b6146077f8c32e274d864cb03c632206e78bd0302da
67+
cp.icr.io/cp/gpfs/csi/csi-node-driver-registrar@sha256:5244abbe87e01b35adeb8bb13882a74785df0c0619f8325c9e950395c3f72a97
68+
cp.icr.io/cp/gpfs/csi/csi-provisioner@sha256:bb057f866177d5f4139a1527e594499cbe0feeb67b63aaca8679dfdf0a6016f9
69+
cp.icr.io/cp/gpfs/csi/csi-resizer@sha256:5e7cbb63fd497fa913caa21fee1a69f727c220c6fa83c5f8bb0995e2ad73a474
70+
cp.icr.io/cp/gpfs/csi/csi-snapshotter@sha256:bc7be893ecc3ad524194aa6573b2f5c06cd469bdf21a500ab6c99c2ba1c4d64d
71+
cp.icr.io/cp/gpfs/csi/ibm-spectrum-scale-csi-driver@sha256:b367ac63080cf5f544ff3410817ac6a594ac1b2a4f7936eb0c140b2a108d2514
72+
cp.icr.io/cp/gpfs/csi/livenessprobe@sha256:88092d100909918ae0a768956cf78c88bc59cd7232720f7cdbdfb5d2e235001e
7473
```

‎generated/scale/cr/cluster/cluster-gke.yaml‎

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -20,6 +20,7 @@ spec:
2020
enforceFilesetQuotaOnRoot: "yes"
2121
ignorePrefetchLUNCount: "yes"
2222
initPrefetchBuffers: "128"
23+
maxTcpConnsPerNodeConn: "4"
2324
maxblocksize: 16M
2425
prefetchPct: "25"
2526
prefetchTimeout: "30"
@@ -56,7 +57,7 @@ spec:
5657
# User must accept the Spectrum Scale license to deploy a CNSA cluster.
5758
# By specifying "accept: true" below, user agrees to the terms and conditions set
5859
# forth by the IBM Spectrum Scale Container Native Data Access/Data Management license located
59-
# at https://www.ibm.com/support/customer/csol/terms/?id=L-RRJF-XWCP3S
60+
# at https://www.ibm.com/support/customer/csol/terms/?id=L-YHGZ-JQ5CU3
6061
#
6162
# Enter either data-access or data-management to the license.license field. Customers entitled to
6263
# the Data Management Edition can use either data-management or data-access. Customers entitled to

‎generated/scale/cr/cluster/cluster-k8s.yaml‎

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -20,6 +20,7 @@ spec:
2020
enforceFilesetQuotaOnRoot: "yes"
2121
ignorePrefetchLUNCount: "yes"
2222
initPrefetchBuffers: "128"
23+
maxTcpConnsPerNodeConn: "4"
2324
maxblocksize: 16M
2425
prefetchPct: "25"
2526
prefetchTimeout: "30"
@@ -53,7 +54,7 @@ spec:
5354
# User must accept the Spectrum Scale license to deploy a CNSA cluster.
5455
# By specifying "accept: true" below, user agrees to the terms and conditions set
5556
# forth by the IBM Spectrum Scale Container Native Data Access/Data Management license located
56-
# at https://www.ibm.com/support/customer/csol/terms/?id=L-RRJF-XWCP3S
57+
# at https://www.ibm.com/support/customer/csol/terms/?id=L-YHGZ-JQ5CU3
5758
#
5859
# Enter either data-access or data-management to the license.license field. Customers entitled to
5960
# the Data Management Edition can use either data-management or data-access. Customers entitled to

‎generated/scale/cr/cluster/cluster.nvidia.yaml‎

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -20,6 +20,7 @@ spec:
2020
enforceFilesetQuotaOnRoot: "yes"
2121
ignorePrefetchLUNCount: "yes"
2222
initPrefetchBuffers: "128"
23+
maxTcpConnsPerNodeConn: "4"
2324
maxblocksize: 16M
2425
prefetchPct: "25"
2526
prefetchTimeout: "30"
@@ -30,7 +31,7 @@ spec:
3031
# -------------------------------------------------------------------------------
3132
# verbsPorts: mlx5_2
3233
# For mixed config scenario, uncomment this next line and delete the line above
33-
# verbsPorts: "mlx5_3/1 mlx5_2/1"
34+
# verbsPorts: mlx5_3/1 mlx5_2/1
3435
# verbsRdma: enable
3536
# verbsRdmaSend: "yes"
3637
# Only enable `verbsRdmaCm` when deploying RoCE - RDMA over Converged Ethernet

‎generated/scale/cr/cluster/cluster.yaml‎

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -20,6 +20,7 @@ spec:
2020
enforceFilesetQuotaOnRoot: "yes"
2121
ignorePrefetchLUNCount: "yes"
2222
initPrefetchBuffers: "128"
23+
maxTcpConnsPerNodeConn: "4"
2324
maxblocksize: 16M
2425
prefetchPct: "25"
2526
prefetchTimeout: "30"
@@ -53,7 +54,7 @@ spec:
5354
# User must accept the Spectrum Scale license to deploy a CNSA cluster.
5455
# By specifying "accept: true" below, user agrees to the terms and conditions set
5556
# forth by the IBM Spectrum Scale Container Native Data Access/Data Management license located
56-
# at https://www.ibm.com/support/customer/csol/terms/?id=L-RRJF-XWCP3S
57+
# at https://www.ibm.com/support/customer/csol/terms/?id=L-YHGZ-JQ5CU3
5758
#
5859
# Enter either data-access or data-management to the license.license field. Customers entitled to
5960
# the Data Management Edition can use either data-management or data-access. Customers entitled to

‎generated/scale/gke/buildgpl.nvidia.yaml‎

Lines changed: 105 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,105 @@
1+
apiVersion: v1
2+
data:
3+
buildgpl: |
4+
#!/bin/bash
5+
#
6+
# When using NVIDIA Network Operator to deploy MOFED drivers in a Kubernetes environment,
7+
# any restart of the MOFED pods will potentially cause the drivers to rebuild. When the build completes
8+
# the MOFED pod will unload the old and load the new driver.
9+
#
10+
# The IBM Storage Scale container native core pods need to wait until the driver build is complete
11+
# before started the daemon so that none of the RDMA libraries are invoked, causing issues with the
12+
# unload of the kernel mod.
13+
#
14+
# This script will wait for the driver to indicate ready before starting the core pod
15+
#
16+
ELAPSED=0
17+
SLEEP_INTERVAL=10
18+
MAX_WAIT=600
19+
TARGET_DIR=/run/mellanox/drivers
20+
TARGET_FILE="${TARGET_DIR}/.driver-ready"
21+
22+
echo "Detected MOFED drivers are in use, waiting $MAX_WAIT seconds for driver to complete building . . ."
23+
while [ "$ELAPSED" -lt "$MAX_WAIT" ]; do
24+
if [ -f "$TARGET_FILE" ]; then
25+
echo "File found!"
26+
ls -ltr "$TARGET_FILE"
27+
break
28+
fi
29+
sleep "$SLEEP_INTERVAL"
30+
ELAPSED=$((ELAPSED + SLEEP_INTERVAL))
31+
echo ". . . waited ${ELAPSED} seconds . . ."
32+
done
33+
34+
# Adjust ELAPSED if kernel modules are taking longer to build than expected
35+
if [ "$ELAPSED" -ge "$MAX_WAIT" ]; then
36+
echo "After $ELAPSED seconds, unable to detect if MOFED driver is ready. Exiting."
37+
exit 1
38+
fi
39+
40+
if ! grep -q loadpin /proc/cmdline
41+
then
42+
echo "Loadpin active. Patching kernel boot parameters with loadpin.enforce=0 and reboot node."
43+
mkdir -p /var/mnt/EFISYS
44+
mount /host/dev/disk/by-label/EFI-SYSTEM /var/mnt/EFISYS
45+
sed -i -e 's/module.sig_enforce=0/module.sig_enforce=0 loadpin.enforce=0/g' /var/mnt/EFISYS/efi/boot/grub.cfg
46+
umount /var/mnt/EFISYS
47+
rmdir /var/mnt/EFISYS
48+
chroot /host reboot
49+
fi
50+
51+
BUILD_DIR=/build
52+
mkdir -p "$BUILD_DIR"
53+
54+
cd $BUILD_DIR
55+
56+
#download google cloud toolkit
57+
curl -O https://dl.google.com/dl/cloudsdk/channels/rapid/downloads/google-cloud-cli-linux-x86_64.tar.gz
58+
tar -xf google-cloud-cli-linux-x86_64.tar.gz
59+
export PATH=google-cloud-sdk/bin:$PATH
60+
61+
BASE=gs://cos-tools
62+
TOOLCHAIN=toolchain.tar.xz.gcs
63+
HEADERS=kernel-headers.tgz
64+
# assuming /host mounts root of host fs
65+
VERSION_ID=$(grep VERSION_ID /host/etc/os-release | cut -d "=" -f 2)
66+
BUILD_ID=$(grep BUILD_ID /host/etc/os-release | cut -d "=" -f 2)
67+
echo "COS version $VERSION_ID build $BUILD_ID"
68+
URL=$BASE/$BUILD_ID/$TOOLCHAIN
69+
70+
#download kernel headers
71+
gsutil cp "$BASE/$BUILD_ID/kernel-headers.tgz" kernel-headers.tgz
72+
73+
#download toolchain
74+
gsutil cp "$BASE/$BUILD_ID/$TOOLCHAIN" bucketinfo
75+
TC_bucket=$(cat bucketinfo | grep ^bucket: | cut -d ' ' -f 2)
76+
TC_path=$(cat bucketinfo | grep ^path: | cut -d ' ' -f 2)
77+
gsutil cp "gs://$TC_bucket/$TC_path" toolchain.tar.xz
78+
79+
80+
tar -xz -C "$BUILD_DIR" -f kernel-headers.tgz
81+
tar -xJ -C "$BUILD_DIR" -f toolchain.tar.xz
82+
83+
kversion=$(uname -r)
84+
85+
ln -s -T $BUILD_DIR/usr/src/linux-headers-$kversion /usr/src/kernels/$kversion
86+
cp -rf /host/lib/modules/$kversion /lib/modules/$kversion
87+
88+
echo "KERNEL_CC=$BUILD_DIR/usr/bin/x86_64-cros-linux-gnu-clang" >> /usr/lpp/mmfs/src/config/site.mk
89+
90+
cd /usr/lpp/mmfs/src/
91+
config/configure linuxdistribution=KERNEL_ORG_LINUX
92+
93+
# mmbuildgpl
94+
make World
95+
make InstallImages
96+
hostPathDirectories: |
97+
/run/mellanox/drivers
98+
/
99+
kind: ConfigMap
100+
metadata:
101+
labels:
102+
app.kubernetes.io/instance: ibm-spectrum-scale
103+
app.kubernetes.io/name: cluster
104+
name: buildgpl
105+
namespace: ibm-spectrum-scale

0 commit comments

Comments
 (0)