Date: Wed, 11 Jun 2025 11:05:13 -0400
Subject: [PATCH 06/11] PR-Review
---
terraform/vmo-cluster/README.md | 83 ++++++++++++-------
terraform/vmo-cluster/cluster_profiles.tf | 40 ++++-----
terraform/vmo-cluster/inputs.tf | 18 +++-
.../manifests/vmo-extras-manifest.yaml | 27 +++++-
terraform/vmo-cluster/terraform.tfvars | 73 ++++++++--------
.../maas-cluster-replace-values.tftest.hcl | 14 +++-
.../tests/maas-cluster-vm.tftest.hcl | 8 ++
.../virtual-machine-missing-values.tftest.hcl | 33 ++++++++
...virtual-machines-replace-values.tftest.hcl | 35 ++++++++
terraform/vmo-cluster/virtual_machines.tf | 18 ++--
10 files changed, 252 insertions(+), 97 deletions(-)
create mode 100644 terraform/vmo-cluster/tests/virtual-machine-missing-values.tftest.hcl
create mode 100644 terraform/vmo-cluster/tests/virtual-machines-replace-values.tftest.hcl
diff --git a/terraform/vmo-cluster/README.md b/terraform/vmo-cluster/README.md
index f62ee05..df72fa0 100644
--- a/terraform/vmo-cluster/README.md
+++ b/terraform/vmo-cluster/README.md
@@ -19,16 +19,14 @@ To get started, open the **terraform.tfvars** file. Toggle the provider variable
|------|---------|
| [terraform](#requirement\_terraform) | >= 1.9 |
| [local](#requirement\_local) | 2.4.1 |
-| [spectrocloud](#requirement\_spectrocloud) | >= 0.22.2 |
+| [spectrocloud](#requirement\_spectrocloud) | 0.23.6 |
| [tls](#requirement\_tls) | 4.0.4 |
## Providers
| Name | Version |
|------|---------|
-| [local](#provider\_local) | 2.4.1 |
-| [spectrocloud](#provider\_spectrocloud) | 0.22.2 |
-| [tls](#provider\_tls) | 4.0.4 |
+| [spectrocloud](#provider\_spectrocloud) | 0.23.6 |
## Modules
@@ -38,37 +36,62 @@ No modules.
| Name | Type |
|------|------|
-| [spectrocloud_cluster_profile.maas-vmo-profile](https://registry.terraform.io/providers/spectrocloud/spectrocloud/latest/docs/resources/cluster_profile) | resource |
-| [spectrocloud_cluster_maas.maas-cluster](https://registry.terraform.io/providers/spectrocloud/spectrocloud/latest/docs/resources/cluster_maas) | resource |
-| [spectrocloud_virtual_machine.virtual-machine](https://registry.terraform.io/providers/spectrocloud/spectrocloud/latest/docs/resources/virtual_machine) | resource |
-| [spectrocloud_cloudaccount_maas.account](https://registry.terraform.io/providers/spectrocloud/spectrocloud/latest/docs/data-sources/cloudaccount_maas) | data source |
-| [spectrocloud_pack.maas_vmo](https://registry.terraform.io/providers/spectrocloud/spectrocloud/latest/docs/data-sources/pack) | data source |
-| [spectrocloud_pack.maas_cni](https://registry.terraform.io/providers/spectrocloud/spectrocloud/latest/docs/data-sources/pack) | data source |
-| [spectrocloud_pack.maas_csi](https://registry.terraform.io/providers/spectrocloud/spectrocloud/latest/docs/data-sources/pack) | data source |
-| [spectrocloud_pack.maas_k8s](https://registry.terraform.io/providers/spectrocloud/spectrocloud/latest/docs/data-sources/pack) | data source |
-| [spectrocloud_pack.maas_ubuntu](https://registry.terraform.io/providers/spectrocloud/spectrocloud/latest/docs/data-sources/pack) | data source |
-| [spectrocloud_cluster.maas_vmo_cluster](https://registry.terraform.io/providers/spectrocloud/spectrocloud/latest/docs/data-sources/cluster) | data source |
-| [spectrocloud_registry.public_registry](https://registry.terraform.io/providers/spectrocloud/spectrocloud/latest/docs/data-sources/registry) | data source |
+| [spectrocloud_cluster_maas.maas-cluster](https://registry.terraform.io/providers/spectrocloud/spectrocloud/0.23.6/docs/resources/cluster_maas) | resource |
+| [spectrocloud_cluster_profile.maas-vmo-profile](https://registry.terraform.io/providers/spectrocloud/spectrocloud/0.23.6/docs/resources/cluster_profile) | resource |
+| [spectrocloud_virtual_machine.virtual-machine](https://registry.terraform.io/providers/spectrocloud/spectrocloud/0.23.6/docs/resources/virtual_machine) | resource |
+| [spectrocloud_cloudaccount_maas.account](https://registry.terraform.io/providers/spectrocloud/spectrocloud/0.23.6/docs/data-sources/cloudaccount_maas) | data source |
+| [spectrocloud_cluster.maas_vmo_cluster](https://registry.terraform.io/providers/spectrocloud/spectrocloud/0.23.6/docs/data-sources/cluster) | data source |
+| [spectrocloud_pack.maas_cni](https://registry.terraform.io/providers/spectrocloud/spectrocloud/0.23.6/docs/data-sources/pack) | data source |
+| [spectrocloud_pack.maas_csi](https://registry.terraform.io/providers/spectrocloud/spectrocloud/0.23.6/docs/data-sources/pack) | data source |
+| [spectrocloud_pack.maas_k8s](https://registry.terraform.io/providers/spectrocloud/spectrocloud/0.23.6/docs/data-sources/pack) | data source |
+| [spectrocloud_pack.maas_metallb](https://registry.terraform.io/providers/spectrocloud/spectrocloud/0.23.6/docs/data-sources/pack) | data source |
+| [spectrocloud_pack.maas_ubuntu](https://registry.terraform.io/providers/spectrocloud/spectrocloud/0.23.6/docs/data-sources/pack) | data source |
+| [spectrocloud_pack.maas_vmo](https://registry.terraform.io/providers/spectrocloud/spectrocloud/0.23.6/docs/data-sources/pack) | data source |
+| [spectrocloud_registry.public_registry](https://registry.terraform.io/providers/spectrocloud/spectrocloud/0.23.6/docs/data-sources/registry) | data source |
## Inputs
| Name | Description | Type | Default | Required |
|------|-------------|------|---------|:--------:|
-| [deploy-maas](#input\_deploy-maas) | A flag for enabling a cluster deployment on MAAS. | `bool` | n/a | yes |
-| [deploy-maas-vm](#input\_deploy-maas-vm) | A flag for enabling a VM creation on a MAAS cluster. | `bool` | n/a | yes |
-| [pcg-name](#input\_pcg-name) | The name of the PCG that will be used to deploy the cluster. | `string` | n/a | yes |
-| [maas-domain](#input\_maas-domain) | The MaaS domain that will be used to deploy the cluster. | `string` | n/a | yes |
-| [maas-worker-nodes](#input\_maas-worker-nodes) | The number of worker nodes that will be used to deploy the cluster. | `number` | 1 | yes |
-| [maas-control-plane-nodes](#input\_maas-control-plane-nodes) | The number of control plane nodes that will be used to deploy the cluster. | `number` | 1 | yes |
-| [maas-worker-resource-pool](#input\_maas-worker-resource-pool) | The resource pool to deploy the worker nodes to. | `string` | n/a | yes |
-| [maas-control-plane-resource-pool](#input\_maas-control-plane-resource-pool) | The resource pool to deploy the control plane nodes to. | `string` | n/a | yes |
-| [maas-worker-azs](#input\_maas-worker-azs) | The set of availability zones to deploy the worker nodes to. | `set(string)` | n/a | yes |
-| [maas-control-plane-azs](#input\_maas-control-plane-azs) | The set of availability zones to deploy the control plane nodes to. | `set(string)` | n/a | yes |
-| [maas-worker-node-tags](#input\_maas-worker-node-tags) | The set of tag values that you want to apply to all nodes in the node worker pool. | `set(string)` | n/a | yes |
-| [maas-control-plane-node-tags](#input\_maas-control-plane-node-tags) | The set of tag values that you want to apply to all nodes in the node control plane pool. | `set(string)` | n/a | yes |
-| [tags](#input\_tags) | The default tags to apply to Palette resources. | `list(string)` | [
"spectro-cloud-education",
"spectrocloud:tutorials",
"terraform_managed:true",
"tutorial:vmo-cluster-deployment"
]
| no |
+| [cluster-profile-type](#input\_cluster-profile-type) | The name of the PCG that will be used to deploy the cluster. | `string` | n/a | yes |
+| [cluster-profile-version](#input\_cluster-profile-version) | The name of the PCG that will be used to deploy the cluster. | `string` | n/a | yes |
+| [cluster-services-CIDR](#input\_cluster-services-CIDR) | CIDR notation subnets for cluster services ex. 192.168.1.0/24. | `set(string)` | n/a | yes |
+| [ctl-node-min-cpu](#input\_ctl-node-min-cpu) | Minimum number of CPU cores allocated to the Control Plane node. | `number` | n/a | yes |
+| [ctl-node-min-memory-mb](#input\_ctl-node-min-memory-mb) | Minimum amount of RAM allocated to the Control Plane node. | `number` | n/a | yes |
+| [deploy-maas](#input\_deploy-maas) | A flag for enabling a deployment on MAAS. | `bool` | n/a | yes |
+| [deploy-maas-vm](#input\_deploy-maas-vm) | A flag for enabling a VM creation on the MAAS cluster. | `bool` | n/a | yes |
+| [host-vlans](#input\_host-vlans) | Node Allowed VLANs | `number` | `1` | no |
+| [maas-control-plane-azs](#input\_maas-control-plane-azs) | Set of AZs for the MAAS control plane nodes. | `set(string)` | n/a | yes |
+| [maas-control-plane-node-tags](#input\_maas-control-plane-node-tags) | Set of node tags for the MAAS control plane nodes. | `set(string)` | n/a | yes |
+| [maas-control-plane-nodes](#input\_maas-control-plane-nodes) | Number of MaaS control plane nodes | `number` | `1` | no |
+| [maas-control-plane-resource-pool](#input\_maas-control-plane-resource-pool) | Resource pool for the MAAS control plane nodes. | `string` | n/a | yes |
+| [maas-domain](#input\_maas-domain) | MAAS domain | `string` | n/a | yes |
+| [maas-worker-azs](#input\_maas-worker-azs) | Set of AZs for the MAAS worker nodes. | `set(string)` | n/a | yes |
+| [maas-worker-node-tags](#input\_maas-worker-node-tags) | Set of node tags for the MAAS worker nodes. | `set(string)` | n/a | yes |
+| [maas-worker-nodes](#input\_maas-worker-nodes) | Number of MaaS worker nodes | `number` | `1` | no |
+| [maas-worker-resource-pool](#input\_maas-worker-resource-pool) | Resource pool for the MAAS worker nodes. | `string` | n/a | yes |
+| [metallb-ip-pool](#input\_metallb-ip-pool) | CIDR notation subnets or IP range ex. 192.168.1.0/24 or 192.168.1.0-192.168.1.255 | `set(string)` | n/a | yes |
+| [node-network](#input\_node-network) | The subnet the Ubuntu nodes will use. | `string` | n/a | yes |
+| [palette-project](#input\_palette-project) | The name of your project in Palette. | `string` | n/a | yes |
+| [palette-user-id](#input\_palette-user-id) | The amount of storage to provision for your VM in Gi. | `string` | n/a | yes |
+| [pcg-name](#input\_pcg-name) | The name of the PCG that will be used to deploy the cluster. | `string` | n/a | yes |
+| [pod-CIDR](#input\_pod-CIDR) | CIDR notation subnets for the pd network ex. 192.168.1.0/24. | `set(string)` | n/a | yes |
+| [tags](#input\_tags) | The default tags to apply to Palette resources. | `list(string)` | [
"spectro-cloud-education",
"spectrocloud:tutorials",
"terraform_managed:true",
"tutorial:vmo-cluster-deployment"
]
| no |
+| [vm-cpu-cores](#input\_vm-cpu-cores) | Number of CPU cores to allocate to your VM. | `number` | `1` | no |
+| [vm-cpu-sockets](#input\_vm-cpu-sockets) | Number of CPU cores to allocate to your VM. | `number` | `1` | no |
+| [vm-cpu-threads](#input\_vm-cpu-threads) | Number of CPU cores to allocate to your VM. | `number` | `1` | no |
+| [vm-deploy-name](#input\_vm-deploy-name) | The namespace where your VMs will be deployed. | `string` | n/a | yes |
+| [vm-deploy-namespace](#input\_vm-deploy-namespace) | The namespace where your VMs will be deployed. | `string` | n/a | yes |
+| [vm-labels](#input\_vm-labels) | The namespace where your VMs will be deployed. | `set(string)` | n/a | yes |
+| [vm-memory-Gi](#input\_vm-memory-Gi) | The amount of storage to provision for your VM in Gi. | `string` | n/a | yes |
+| [vm-storage-Gi](#input\_vm-storage-Gi) | The amount of storage to provision for your VM in Gi. | `string` | n/a | yes |
+| [vm-vlans](#input\_vm-vlans) | VM allowed VLANs. | `number` | `1` | no |
+| [vmo-cluster-name](#input\_vmo-cluster-name) | The name of the cluster. | `string` | n/a | yes |
+| [vmo-network-interface](#input\_vmo-network-interface) | The network interface VMO will use for VM traffic. | `set(string)` | n/a | yes |
+| [wrk-node-min-cpu](#input\_wrk-node-min-cpu) | Minimum number of CPU cores allocated to the Control Plane node. | `number` | n/a | yes |
+| [wrk-node-min-memory-mb](#input\_wrk-node-min-memory-mb) | Minimum amount of RAM allocated to the Control Plane node. | `number` | n/a | yes |
## Outputs
-No outputs.
-
+No outputs.
+
\ No newline at end of file
diff --git a/terraform/vmo-cluster/cluster_profiles.tf b/terraform/vmo-cluster/cluster_profiles.tf
index b923767..c82f549 100644
--- a/terraform/vmo-cluster/cluster_profiles.tf
+++ b/terraform/vmo-cluster/cluster_profiles.tf
@@ -13,24 +13,24 @@ resource "spectrocloud_cluster_profile" "maas-vmo-profile" {
version = var.cluster-profile-version
pack {
- name = data.spectrocloud_pack.maas_ubuntu.name
- tag = data.spectrocloud_pack.maas_ubuntu.version
- uid = data.spectrocloud_pack.maas_ubuntu.id
+ name = data.spectrocloud_pack.maas_ubuntu.name
+ tag = data.spectrocloud_pack.maas_ubuntu.version
+ uid = data.spectrocloud_pack.maas_ubuntu.id
values = templatefile("manifests/ubuntu-values.yaml", {
node-network = var.node-network
})
- type = "spectro"
+ type = "spectro"
}
pack {
- name = data.spectrocloud_pack.maas_k8s.name
- tag = data.spectrocloud_pack.maas_k8s.version
- uid = data.spectrocloud_pack.maas_k8s.id
+ name = data.spectrocloud_pack.maas_k8s.name
+ tag = data.spectrocloud_pack.maas_k8s.version
+ uid = data.spectrocloud_pack.maas_k8s.id
values = templatefile("manifests/k8s-values.yaml", {
- pod-CIDR = var.pod-CIDR,
+ pod-CIDR = var.pod-CIDR,
clusterServicesCIDR = var.cluster-services-CIDR
- type = "spectro"
- })
+ type = "spectro"
+ })
}
pack {
@@ -60,17 +60,17 @@ resource "spectrocloud_cluster_profile" "maas-vmo-profile" {
})
type = "spectro"
}
-
+
pack {
- name = data.spectrocloud_pack.maas_vmo.name
- tag = data.spectrocloud_pack.maas_vmo.version
- uid = data.spectrocloud_pack.maas_vmo.id
+ name = data.spectrocloud_pack.maas_vmo.name
+ tag = data.spectrocloud_pack.maas_vmo.version
+ uid = data.spectrocloud_pack.maas_vmo.id
values = templatefile("manifests/vmo-values.yaml", {
vmo-network-interface = var.vmo-network-interface,
- vm-vlans = var.vm-vlans,
- host-vlans = var.host-vlans
+ vm-vlans = var.vm-vlans,
+ host-vlans = var.host-vlans
})
- type = "spectro"
+ type = "spectro"
}
pack {
@@ -79,8 +79,10 @@ resource "spectrocloud_cluster_profile" "maas-vmo-profile" {
tag = "1.0.0"
values = file("manifests/vmo-extras-values.yaml")
manifest {
- name = "vmo-extras"
- content = file("manifests/vmo-extras-manifest.yaml")
+ name = "vmo-extras"
+ content = templatefile("manifests/vmo-extras-manifest.yaml", {
+ palette-user-id = var.palette-user-id
+ })
}
}
diff --git a/terraform/vmo-cluster/inputs.tf b/terraform/vmo-cluster/inputs.tf
index 7701bf2..348efe7 100644
--- a/terraform/vmo-cluster/inputs.tf
+++ b/terraform/vmo-cluster/inputs.tf
@@ -43,8 +43,8 @@ variable "cluster-profile-type" {
description = "The name of the PCG that will be used to deploy the cluster."
validation {
- condition = var.deploy-maas ? var.cluster-profile-type != "REPLACE ME" && lower(var.cluster-profile-type) == "full" || lower(var.cluster-profile-type) == "infrastructure" || lower(var.cluster-profile-type) == "add-on" : true
- error_message = "Cluster profile type must be 'full', 'infrastructure', 'add-on', or 'app'."
+ condition = var.deploy-maas ? var.cluster-profile-type != "REPLACE ME" && lower(var.cluster-profile-type) == "cluster" || lower(var.cluster-profile-type) == "infra" || lower(var.cluster-profile-type) == "add-on" || lower(var.cluster-profile-type) == "system" : true
+ error_message = "Cluster profile type must be 'cluster', 'infra', 'add-on', or 'system'."
}
}
@@ -342,7 +342,7 @@ variable "vm-storage-Gi" {
description = "The amount of storage to provision for your VM in Gi."
validation {
- condition = var.deploy-maas ? var.vm-storage-Gi != "REPLACE ME" && length(var.vm-storage-Gi) != 0 && endswith((var.vm-storage-Gi), "Gi") : true
+ condition = var.deploy-maas ? var.vm-storage-Gi != "REPLACE ME" && length(var.vm-storage-Gi) != 0 && endswith((var.vm-storage-Gi), "Gi") : true
error_message = "Provide a valid amount of storage for your VM. You must include 'Gi' at the end of your numerical value. Example: '50Gi'."
}
}
@@ -385,7 +385,17 @@ variable "vm-memory-Gi" {
description = "The amount of storage to provision for your VM in Gi."
validation {
- condition = var.deploy-maas ? var.vm-memory-Gi != "REPLACE ME" && length(var.vm-memory-Gi) != 0 && endswith((var.vm-memory-Gi), "Gi") : true
+ condition = var.deploy-maas ? var.vm-memory-Gi != "REPLACE ME" && length(var.vm-memory-Gi) != 0 && endswith((var.vm-memory-Gi), "Gi") : true
error_message = "Provide a valid amount of memory to allocate your VM. You must include 'Gi' at the end of your numerical value. Example: '4Gi'."
}
+}
+
+variable "palette-user-id" {
+ type = string
+ description = "The amount of storage to provision for your VM in Gi."
+
+ validation {
+ condition = var.deploy-maas ? var.palette-user-id != "REPLACE ME" && length(var.palette-user-id) != 0 : true
+ error_message = "Provide a valid Palette user ID."
+ }
}
\ No newline at end of file
diff --git a/terraform/vmo-cluster/manifests/vmo-extras-manifest.yaml b/terraform/vmo-cluster/manifests/vmo-extras-manifest.yaml
index 6244567..4f14d9e 100644
--- a/terraform/vmo-cluster/manifests/vmo-extras-manifest.yaml
+++ b/terraform/vmo-cluster/manifests/vmo-extras-manifest.yaml
@@ -129,4 +129,29 @@ spec:
- accessModes:
- ReadWriteMany
volumeMode: Block
- cloneStrategy: csi-clone
\ No newline at end of file
+ cloneStrategy: csi-clone
+---
+apiVersion: rbac.authorization.k8s.io/v1
+kind: ClusterRoleBinding
+metadata:
+ name: virtual-machine-orchestrator
+roleRef:
+ apiGroup: rbac.authorization.k8s.io
+ kind: ClusterRole
+ name: virtual-machine-orchestrator-admin
+subjects:
+- kind: ServiceAccount
+ name: virtual-machine-orchestrator
+ namespace: vm-dashboard
+#---
+# apiVersion: rbac.authorization.k8s.io/v1
+# kind: RoleBinding
+# metadata:
+# name: cluster-admin
+# subjects:
+# - kind: User
+# name: ${palette-user-id}
+# apiGroup: rbac.authorization.k8s.io
+# roleRef:
+# kind: ClusterRole
+# name: cluster-admin
\ No newline at end of file
diff --git a/terraform/vmo-cluster/terraform.tfvars b/terraform/vmo-cluster/terraform.tfvars
index c23f191..0eee3c6 100644
--- a/terraform/vmo-cluster/terraform.tfvars
+++ b/terraform/vmo-cluster/terraform.tfvars
@@ -4,68 +4,73 @@
#####################
# Palette Settings
#####################
-palette-project = "Default" # The name of your project in Palette.
+palette-project = "Default" # The name of your project in Palette.
############################
# MAAS Deployment Settings
############################
-deploy-maas = true # Set to true to deploy to a new VMO cluster to MAAS.
-deploy-maas-vm = true # Set to true to create a VM on MAAS VMO cluster once deployed.
-pcg-name = "maas-pcg" # Provide the name of the PCG that will be used to deploy the Palette cluster.
-maas-domain = "maas.sc" # Provide the MAAS domain that will be used to deploy the Palette cluster.
-maas-control-plane-nodes = 1 # Provide the number of control plane nodes that will be used for the Palette cluster.
-maas-control-plane-resource-pool = "Palette-Sustaining" # Provide a resource pool for the control plane nodes.
-maas-control-plane-azs = ["az1"] # Provide a set of availability zones for the control plane nodes.
-maas-control-plane-node-tags = ["docs-cp"] # Provide a set of node tags for the control plane nodes.
-ctl-node-min-cpu = 6 # Minimum number of CPU cores required for control plane nodes
-ctl-node-min-memory-mb = 8096 # Minimum amount of RAM (memory) required for control plane nodes
-maas-worker-nodes = 1 # Provide the number of worker nodes that will be used for the Palette cluster.
-maas-worker-resource-pool = "vmo-validation" # Provide a resource pool for the worker nodes.
-maas-worker-azs = ["az1"] # Provide a set of availability zones for the worker nodes.
-maas-worker-node-tags = ["docs"] # Provide a set of node tags for the worker nodes.
-wrk-node-min-cpu = 8 # Minimum number of CPU cores required for worker nodes
-wrk-node-min-memory-mb = 16384 # Minimum amount of RAM (memory) required for worker nodes
+deploy-maas = true # Set to true to deploy to a new VMO cluster to MAAS.
+deploy-maas-vm = false # Set to true to create a VM on MAAS VMO cluster once deployed.
+pcg-name = "maas-pcg" # Provide the name of the PCG that will be used to deploy the Palette cluster.
+maas-domain = "maas.sc" # Provide the MAAS domain that will be used to deploy the Palette cluster.
+maas-control-plane-nodes = 1 # Provide the number of control plane nodes that will be used for the Palette cluster.
+maas-control-plane-resource-pool = "docs" # Provide a resource pool for the control plane nodes.
+maas-control-plane-azs = ["az1"] # Provide a set of availability zones for the control plane nodes.
+maas-control-plane-node-tags = ["docs-cp"] # Provide a set of node tags for the control plane nodes.
+ctl-node-min-cpu = 6 # Minimum number of CPU cores required for control plane nodes
+ctl-node-min-memory-mb = 8096 # Minimum amount of RAM (memory) required for control plane nodes
+maas-worker-nodes = 1 # Provide the number of worker nodes that will be used for the Palette cluster.
+maas-worker-resource-pool = "docs" # Provide a resource pool for the worker nodes.
+maas-worker-azs = ["az1"] # Provide a set of availability zones for the worker nodes.
+maas-worker-node-tags = ["docs"] # Provide a set of node tags for the worker nodes.
+wrk-node-min-cpu = 8 # Minimum number of CPU cores required for worker nodes
+wrk-node-min-memory-mb = 16384 # Minimum amount of RAM (memory) required for worker nodes
#####################
# cluster_profiles.tf
#####################
vmo-cluster-name = "vmo-cluster-maas"
-cluster-profile-type = "Full" # Infrastructure, Full, or Add-on
-cluster-profile-version = "1.0.0 " # Version number for the cluster profile in Palette
+cluster-profile-type = "cluster" # infra, cluster, add-on, or system
+cluster-profile-version = "1.0.0" # Version number for the cluster profile in Palette
#####################
# vmo-values.tf
####################
-vmo-network-interface = ["br0"]
-vm-vlans = 1
-host-vlans = 1
+vmo-network-interface = ["br0"]
+vm-vlans = 1
+host-vlans = 1
###########################
# manifests/k8s-values.yaml
###########################
-pod-CIDR = ["100.64.0.0/18"] # Set the subnet that your pods will run on
-cluster-services-CIDR = ["100.64.64.0/18"]
+pod-CIDR = ["100.64.0.0/18"] # Set the subnet that your pods will run on
+cluster-services-CIDR = ["100.64.64.0/18"]
###############################
# manifests/metallb-values.yaml
###############################
-metallb-ip-pool = ["10.11.130.129-10.11.130.131"] # IP addresses to be assigned for use by MetalLB
+metallb-ip-pool = ["10.11.130.129-10.11.130.131"] # IP addresses to be assigned for use by MetalLB
###############################
# manifests/ubuntu-values.yaml
###############################
-node-network = "10.11.130.129-10.11.130.131" # IP addresses to be assigned for use by MetalLB
+node-network = "10.11.130.129-10.11.130.131" # IP addresses to be assigned for use by MetalLB
#####################
# virtual_machines.tf
#####################
-vm-deploy-namespace = "virtual-machines" # Namespace where your VM will be deployed.
-vm-deploy-name = "vmo-vm" # The name of your VM
-vm-labels = ["my-vmo-vm"] # Labels that will be applied to your VM.
-vm-storage-Gi = "50Gi" # Size of the disk (PVC) that your VM will have.
-vm-cpu-cores = 2 # Number of CPU cores your VM will have.
-vm-cpu-sockets = 1 # Number of physical CPU sockets the CPU cores should be spread over.
-vm-cpu-threads = 2 # Number of CPU threads to use for the VM CPU
-vm-memory-Gi = "4Gi" # Amount of RAM (memory) your VM will have
\ No newline at end of file
+vm-deploy-namespace = "virtual-machines" # Namespace where your VM will be deployed.
+vm-deploy-name = "vmo-vm" # The name of your VM
+vm-labels = ["my-vmo-vm"] # Labels that will be applied to your VM.
+vm-storage-Gi = "50Gi" # Size of the disk (PVC) that your VM will have.
+vm-cpu-cores = 2 # Number of CPU cores your VM will have.
+vm-cpu-sockets = 1 # Number of physical CPU sockets the CPU cores should be spread over.
+vm-cpu-threads = 2 # Number of CPU threads to use for the VM CPU
+vm-memory-Gi = "4Gi" # Amount of RAM (memory) your VM will have
+
+#####################
+# vmo-extras-manifest.yaml
+#####################
+palette-user-id = "kenneth.heaslip@spectrocloud.com"
diff --git a/terraform/vmo-cluster/tests/maas-cluster-replace-values.tftest.hcl b/terraform/vmo-cluster/tests/maas-cluster-replace-values.tftest.hcl
index c89a7b9..6477b41 100644
--- a/terraform/vmo-cluster/tests/maas-cluster-replace-values.tftest.hcl
+++ b/terraform/vmo-cluster/tests/maas-cluster-replace-values.tftest.hcl
@@ -15,6 +15,13 @@ variables {
maas-control-plane-resource-pool = "REPLACE ME"
maas-control-plane-azs = ["REPLACE ME"]
maas-control-plane-node-tags = ["REPLACE ME"]
+ vmo-network-interface = ["REPLACE ME"]
+ vm-vlans = 1
+ host-vlans = 1
+ pod-CIDR = ["REPLACE ME"]
+ cluster-services-CIDR = ["REPLACE ME"]
+ metallb-ip-pool = ["REPLACE ME"]
+ node-network = "REPLACE ME"
}
mock_provider "spectrocloud" {
@@ -32,6 +39,11 @@ run "verify_maas" {
var.maas-worker-node-tags,
var.maas-control-plane-resource-pool,
var.maas-control-plane-azs,
- var.maas-control-plane-node-tags
+ var.maas-control-plane-node-tags,
+ var.vmo-network-interface,
+ var.pod-CIDR,
+ var.cluster-services-CIDR,
+ var.metallb-ip-pool,
+ var.node-network
]
}
diff --git a/terraform/vmo-cluster/tests/maas-cluster-vm.tftest.hcl b/terraform/vmo-cluster/tests/maas-cluster-vm.tftest.hcl
index 60f9ae4..ee6ab91 100644
--- a/terraform/vmo-cluster/tests/maas-cluster-vm.tftest.hcl
+++ b/terraform/vmo-cluster/tests/maas-cluster-vm.tftest.hcl
@@ -15,6 +15,14 @@ variables {
maas-control-plane-resource-pool = "test-cp-pool"
maas-control-plane-azs = ["test-cp-az"]
maas-control-plane-node-tags = ["test-cp-tags"]
+ vm-deploy-namespace = "virtual-machines"
+ vm-deploy-name = "test-vm"
+ vm-labels = ["my-vm"]
+ vm-storage-Gi = "50Gi"
+ vm-cpu-cores = 2
+ vm-cpu-sockets = 1
+ vm-cpu-threads = 2
+ vm-memory-Gi = "4Gi"
}
mock_provider "spectrocloud" {
diff --git a/terraform/vmo-cluster/tests/virtual-machine-missing-values.tftest.hcl b/terraform/vmo-cluster/tests/virtual-machine-missing-values.tftest.hcl
new file mode 100644
index 0000000..bd64f34
--- /dev/null
+++ b/terraform/vmo-cluster/tests/virtual-machine-missing-values.tftest.hcl
@@ -0,0 +1,33 @@
+# Copyright (c) Spectro Cloud
+# SPDX-License-Identifier: Apache-2.0
+# Test case 4 - Verify PCG name, domain, resource pools, AZs and node tags cannot be empty.
+
+variables {
+ deploy-maas = true
+ deploy-maas-vm = false
+ vm-deploy-namespace = ""
+ vm-deploy-name = ""
+ vm-labels = []
+ vm-storage-Gi = ""
+ vm-cpu-cores = 1
+ vm-cpu-sockets = 1
+ vm-cpu-threads = 2
+ vm-memory-Gi = ""
+
+}
+
+mock_provider "spectrocloud" {
+}
+
+run "verify_maas" {
+
+ command = plan
+
+ expect_failures = [
+ var.vm-deploy-namespace,
+ var.vm-deploy-name,
+ var.vm-labels,
+ var.vm-storage-Gi,
+ var.vm-memory-Gi,
+ ]
+}
diff --git a/terraform/vmo-cluster/tests/virtual-machines-replace-values.tftest.hcl b/terraform/vmo-cluster/tests/virtual-machines-replace-values.tftest.hcl
new file mode 100644
index 0000000..e43a404
--- /dev/null
+++ b/terraform/vmo-cluster/tests/virtual-machines-replace-values.tftest.hcl
@@ -0,0 +1,35 @@
+# Copyright (c) Spectro Cloud
+# SPDX-License-Identifier: Apache-2.0
+# Test case 5 - Verify PCG name, domain, resource pools, AZs and node tags cannot have REPLACE ME values.
+
+variables {
+
+vm-deploy-namespace = "REPLACE ME"
+vm-deploy-name = "REPLACE ME"
+vm-labels = ["REPLACE ME"]
+vm-storage-Gi = "REPLACE ME"
+vm-cpu-cores = 2
+vm-cpu-sockets = 1
+vm-cpu-threads = 2
+vm-memory-Gi = "REPLACE ME"
+
+
+
+
+}
+
+mock_provider "spectrocloud" {
+}
+
+run "verify_maas" {
+
+ command = plan
+
+ expect_failures = [
+ var.vm-deploy-namespace,
+ var.vm-deploy-name,
+ var.vm-labels,
+ var.vm-storage-Gi,
+ var.vm-memory-Gi,
+ ]
+}
diff --git a/terraform/vmo-cluster/virtual_machines.tf b/terraform/vmo-cluster/virtual_machines.tf
index 8ac1996..d8c62af 100644
--- a/terraform/vmo-cluster/virtual_machines.tf
+++ b/terraform/vmo-cluster/virtual_machines.tf
@@ -9,9 +9,10 @@ resource "spectrocloud_virtual_machine" "virtual-machine" {
cluster_uid = data.spectrocloud_cluster.maas_vmo_cluster[0].id
cluster_context = data.spectrocloud_cluster.maas_vmo_cluster[0].context
- run_on_launch = true
- namespace = var.vm-deploy-namespace
- name = var.vm-deploy-name
+ #run_on_launch = true
+ run_strategy = "Halted"
+ namespace = var.vm-deploy-namespace
+ name = var.vm-deploy-name
timeouts {
create = "60m"
@@ -20,12 +21,13 @@ resource "spectrocloud_virtual_machine" "virtual-machine" {
labels = {
#var.vm-labels
# "tf" = "spectrocloud-tutorials"
- "kubevirt.io/vm" = "ubuntu-tutorial-vm"
+ "kubevirt.io/vm" = "ubuntu-2204"
}
data_volume_templates {
metadata {
- name = "ubuntu-tutorial-vm"
+ name = "ubuntu-2204"
+ namespace = var.vm-deploy-namespace
}
spec {
source {
@@ -48,10 +50,10 @@ resource "spectrocloud_virtual_machine" "virtual-machine" {
}
volume {
- name = "ubuntu-tutorial-vm"
+ name = "ubuntu-2204"
volume_source {
data_volume {
- name = "ubuntu-tutorial-vm"
+ name = "ubuntu-2204"
}
}
}
@@ -66,7 +68,7 @@ resource "spectrocloud_virtual_machine" "virtual-machine" {
}
disk {
- name = "ubuntu-tutorial-vm"
+ name = "ubuntu-2204"
disk_device {
disk {
bus = "virtio"
From 50b11bbf6d4f82da5082de566bcb528bb5fc6574 Mon Sep 17 00:00:00 2001
From: kenheaslip-sc
Date: Mon, 16 Jun 2025 13:47:58 -0400
Subject: [PATCH 07/11] Draft-RC1
---
terraform/vmo-cluster/cluster_profiles.tf | 7 +-
terraform/vmo-cluster/inputs.tf | 10 -
.../vmo-cluster/manifests/ubuntu-values.yaml | 6 +-
.../manifests/vmo-extras-manifest copy.yaml | 132 ++
.../manifests/vmo-extras-manifest.yaml | 27 +-
.../vmo-cluster/manifests/vmo-values.yaml | 1313 ++++++++---------
terraform/vmo-cluster/terraform.tfvars | 8 +-
...virtual-machines-replace-values.tftest.hcl | 5 -
.../vmo-cluster/virtual-machines/cloud-init | 16 +-
terraform/vmo-cluster/virtual_machines.tf | 4 +-
terraform/vmo-cluster/vm-test.yaml | 87 ++
11 files changed, 895 insertions(+), 720 deletions(-)
create mode 100644 terraform/vmo-cluster/manifests/vmo-extras-manifest copy.yaml
create mode 100644 terraform/vmo-cluster/vm-test.yaml
diff --git a/terraform/vmo-cluster/cluster_profiles.tf b/terraform/vmo-cluster/cluster_profiles.tf
index c82f549..9becb9b 100644
--- a/terraform/vmo-cluster/cluster_profiles.tf
+++ b/terraform/vmo-cluster/cluster_profiles.tf
@@ -1,4 +1,3 @@
-
##########################
# MAAS VMO Cluster Profile
##########################
@@ -29,8 +28,8 @@ resource "spectrocloud_cluster_profile" "maas-vmo-profile" {
values = templatefile("manifests/k8s-values.yaml", {
pod-CIDR = var.pod-CIDR,
clusterServicesCIDR = var.cluster-services-CIDR
- type = "spectro"
})
+ type = "spectro"
}
pack {
@@ -80,9 +79,7 @@ resource "spectrocloud_cluster_profile" "maas-vmo-profile" {
values = file("manifests/vmo-extras-values.yaml")
manifest {
name = "vmo-extras"
- content = templatefile("manifests/vmo-extras-manifest.yaml", {
- palette-user-id = var.palette-user-id
- })
+ content = file("manifests/vmo-extras-manifest.yaml")
}
}
diff --git a/terraform/vmo-cluster/inputs.tf b/terraform/vmo-cluster/inputs.tf
index 348efe7..b7ee3eb 100644
--- a/terraform/vmo-cluster/inputs.tf
+++ b/terraform/vmo-cluster/inputs.tf
@@ -388,14 +388,4 @@ variable "vm-memory-Gi" {
condition = var.deploy-maas ? var.vm-memory-Gi != "REPLACE ME" && length(var.vm-memory-Gi) != 0 && endswith((var.vm-memory-Gi), "Gi") : true
error_message = "Provide a valid amount of memory to allocate your VM. You must include 'Gi' at the end of your numerical value. Example: '4Gi'."
}
-}
-
-variable "palette-user-id" {
- type = string
- description = "The amount of storage to provision for your VM in Gi."
-
- validation {
- condition = var.deploy-maas ? var.palette-user-id != "REPLACE ME" && length(var.palette-user-id) != 0 : true
- error_message = "Provide a valid Palette user ID."
- }
}
\ No newline at end of file
diff --git a/terraform/vmo-cluster/manifests/ubuntu-values.yaml b/terraform/vmo-cluster/manifests/ubuntu-values.yaml
index 427d5dc..26d80be 100644
--- a/terraform/vmo-cluster/manifests/ubuntu-values.yaml
+++ b/terraform/vmo-cluster/manifests/ubuntu-values.yaml
@@ -6,12 +6,12 @@ kubeadmconfig:
- apt install -y grepcidr
- |
# Enter as a CIDR '10.11.130.0/24'
- NETWORKS=${node-network}
+ NETWORKS="10.11.130.0/24"
IPS=$(hostname -I)
for IP in $IPS
do
- echo "$IP" | grepcidr "$NETWORKS" >/dev/null && echo " --node-ip=$IP" >> /etc/default/kubelet
- if [ $? == 0 ]; then break; fi
+ echo "$IP" | grepcidr "$NETWORKS" >/dev/null && echo " --node-ip=$IP" >> /etc/default/kubelet
+ if [ $? == 0 ]; then break; fi
done
# Increase audit_backlog_limit
- sed -i 's/GRUB_CMDLINE_LINUX=""/GRUB_CMDLINE_LINUX="audit_backlog_limit=256"/g' /etc/default/grub
diff --git a/terraform/vmo-cluster/manifests/vmo-extras-manifest copy.yaml b/terraform/vmo-cluster/manifests/vmo-extras-manifest copy.yaml
new file mode 100644
index 0000000..6244567
--- /dev/null
+++ b/terraform/vmo-cluster/manifests/vmo-extras-manifest copy.yaml
@@ -0,0 +1,132 @@
+apiVersion: spectrocloud.com/v1
+kind: VmTemplate
+metadata:
+ name: ubuntu-2204
+spec:
+ description: Ubuntu 22.04
+ displayName: Ubuntu 22.04
+ icon: https://s3.amazonaws.com/manifests.spectrocloud.com/logos/ubuntu.png
+ dataVolumeTemplates:
+ - metadata:
+ name: ubuntu-2204
+ spec:
+ source:
+ pvc:
+ name: template-ubuntu-2204
+ namespace: vmo-golden-images
+ pvc:
+ accessModes:
+ - ReadWriteMany
+ resources:
+ requests:
+ storage: 50Gi
+ volumeMode: Block
+ storageClassName: ceph-block
+ template:
+ metadata:
+ annotations:
+ descheduler.alpha.kubernetes.io/evict: "true"
+ labels:
+ kubevirt.io/size: small
+ kubevirt.io/domain: hellouni
+ spec:
+ domain:
+ cpu:
+ cores: 2
+ sockets: 1
+ threads: 1
+ devices:
+ disks:
+ - disk:
+ bus: virtio
+ name: datavolume-os
+ - disk:
+ bus: virtio
+ name: cloudinitdisk
+ interfaces:
+ - masquerade: {}
+ name: default
+ model: virtio
+ #macAddress: '00:5e:ab:cd:ef:01'
+ machine:
+ type: q35
+ resources:
+ limits:
+ memory: 2Gi
+ requests:
+ memory: 2Gi
+ networks:
+ - name: default
+ pod: {}
+ volumes:
+ - dataVolume:
+ name: ubuntu-2204
+ name: datavolume-os
+ - cloudInitNoCloud:
+ userData: |
+ #cloud-config
+ ssh_pwauth: True
+ chpasswd: { expire: False }
+ password: spectro
+ disable_root: false
+ runcmd:
+ - apt-get update
+ - apt-get install -y qemu-guest-agent
+ - systemctl start qemu-guest-agent
+ - |
+ apt-get -y install ca-certificates curl
+ install -m 0755 -d /etc/apt/keyrings
+ curl -fsSL https://download.docker.com/linux/ubuntu/gpg -o /etc/apt/keyrings/docker.asc
+ chmod a+r /etc/apt/keyrings/docker.asc
+ echo \
+ "deb [arch=$(dpkg --print-architecture) signed-by=/etc/apt/keyrings/docker.asc] https://download.docker.com/linux/ubuntu \
+ $(. /etc/os-release && echo "$VERSION_CODENAME") stable" | \
+ tee /etc/apt/sources.list.d/docker.list > /dev/null
+ apt-get update
+ apt-get install -y docker-ce docker-ce-cli containerd.io docker-buildx-plugin docker-compose-plugin
+ groupadd docker
+ gpasswd -a ubuntu docker
+ name: cloudinitdisk
+---
+apiVersion: cdi.kubevirt.io/v1beta1
+kind: DataVolume
+metadata:
+ name: "template-ubuntu-2204"
+ namespace: "vmo-golden-images"
+ annotations:
+ cdi.kubevirt.io/storage.deleteAfterCompletion: "false"
+ cdi.kubevirt.io/storage.bind.immediate.requested: ""
+spec:
+ storage:
+ accessModes:
+ - ReadWriteMany
+ resources:
+ requests:
+ storage: 50Gi
+ volumeMode: Block
+ storageClassName: ceph-block
+ source:
+ registry:
+ url: "docker://gcr.io/spectro-images-public/release/vm-dashboard/os/ubuntu-container-disk:22.04"
+---
+apiVersion: cdi.kubevirt.io/v1beta1
+kind: StorageProfile
+metadata:
+ name: ceph-filesystem
+spec:
+ claimPropertySets:
+ - accessModes:
+ - ReadWriteMany
+ volumeMode: Filesystem
+ cloneStrategy: csi-clone
+---
+apiVersion: cdi.kubevirt.io/v1beta1
+kind: StorageProfile
+metadata:
+ name: ceph-block
+spec:
+ claimPropertySets:
+ - accessModes:
+ - ReadWriteMany
+ volumeMode: Block
+ cloneStrategy: csi-clone
\ No newline at end of file
diff --git a/terraform/vmo-cluster/manifests/vmo-extras-manifest.yaml b/terraform/vmo-cluster/manifests/vmo-extras-manifest.yaml
index 4f14d9e..6244567 100644
--- a/terraform/vmo-cluster/manifests/vmo-extras-manifest.yaml
+++ b/terraform/vmo-cluster/manifests/vmo-extras-manifest.yaml
@@ -129,29 +129,4 @@ spec:
- accessModes:
- ReadWriteMany
volumeMode: Block
- cloneStrategy: csi-clone
----
-apiVersion: rbac.authorization.k8s.io/v1
-kind: ClusterRoleBinding
-metadata:
- name: virtual-machine-orchestrator
-roleRef:
- apiGroup: rbac.authorization.k8s.io
- kind: ClusterRole
- name: virtual-machine-orchestrator-admin
-subjects:
-- kind: ServiceAccount
- name: virtual-machine-orchestrator
- namespace: vm-dashboard
-#---
-# apiVersion: rbac.authorization.k8s.io/v1
-# kind: RoleBinding
-# metadata:
-# name: cluster-admin
-# subjects:
-# - kind: User
-# name: ${palette-user-id}
-# apiGroup: rbac.authorization.k8s.io
-# roleRef:
-# kind: ClusterRole
-# name: cluster-admin
\ No newline at end of file
+ cloneStrategy: csi-clone
\ No newline at end of file
diff --git a/terraform/vmo-cluster/manifests/vmo-values.yaml b/terraform/vmo-cluster/manifests/vmo-values.yaml
index cd4752f..8e66e80 100644
--- a/terraform/vmo-cluster/manifests/vmo-values.yaml
+++ b/terraform/vmo-cluster/manifests/vmo-values.yaml
@@ -1,668 +1,667 @@
pack:
- content:
- images:
- - image: us-docker.pkg.dev/palette-images/palette/spectro-vm-dashboard:4.6.3
- - image: us-docker.pkg.dev/palette-images/third-party/kubevirt-ui:v19
- - image: us-docker.pkg.dev/palette-images/palette/kubevirt/virt-operator:v1.4.0
- - image: registry.k8s.io/sig-storage/snapshot-validation-webhook:v8.1.0
- - image: registry.k8s.io/sig-storage/snapshot-controller:v8.1.0
- - image: registry.k8s.io/descheduler/descheduler:v0.32.0
- - image: ghcr.io/k8snetworkplumbingwg/multus-cni:v4.1.4-thick
- - image: ghcr.io/k8snetworkplumbingwg/multus-dynamic-networks-controller:latest-amd64
- - image: quay.io/kubevirt/cdi-operator:v1.61.0
- - image: quay.io/kubevirt/cdi-uploadproxy:v1.61.0
- - image: quay.io/kubevirt/cdi-controller:v1.61.0
- - image: quay.io/kubevirt/cdi-apiserver:v1.61.0
- - image: quay.io/kubevirt/cdi-importer:v1.61.0
- - image: quay.io/kubevirt/cdi-uploadserver:v1.61.0
- - image: quay.io/kubevirt/cdi-cloner:v1.61.0
- - image: us-docker.pkg.dev/palette-images/palette/kubevirt/virt-handler:v1.4.0
- - image: us-docker.pkg.dev/palette-images/palette/kubevirt/virt-launcher:v1.4.0
- - image: us-docker.pkg.dev/palette-images/palette/kubevirt/virt-exportproxy:v1.4.0
- - image: us-docker.pkg.dev/palette-images/palette/kubevirt/virt-exportserver:v1.4.0
- - image: us-docker.pkg.dev/palette-images/palette/kubevirt/virt-controller:v1.4.0
- - image: us-docker.pkg.dev/palette-images/palette/kubevirt/virt-api:v1.4.0
- - image: us-docker.pkg.dev/palette-images/palette/virtual-machine-orchestrator/os/ubuntu-container-disk:22.04
- - image: us-docker.pkg.dev/palette-images/palette/virtual-machine-orchestrator/os/fedora-container-disk:37
- - image: us-docker.pkg.dev/palette-images/palette/virtual-machine-orchestrator/vlan-filtering/ubuntu:latest
- - image: us-docker.pkg.dev/palette-images/palette/spectro-cleanup:1.0.3
- - image: us-docker.pkg.dev/palette-images/palette/spectro-kubectl:v1.31.5-vmo
- namespace: vm-dashboard
- palette:
- config:
- dashboard:
- access: private
- spectrocloud.com/install-priority: "10"
+ content:
+ images:
+ - image: us-docker.pkg.dev/palette-images/palette/spectro-vm-dashboard:4.6.3
+ - image: us-docker.pkg.dev/palette-images/third-party/kubevirt-ui:v19
+ - image: us-docker.pkg.dev/palette-images/palette/kubevirt/virt-operator:v1.4.0
+ - image: registry.k8s.io/sig-storage/snapshot-validation-webhook:v8.1.0
+ - image: registry.k8s.io/sig-storage/snapshot-controller:v8.1.0
+ - image: registry.k8s.io/descheduler/descheduler:v0.32.0
+ - image: ghcr.io/k8snetworkplumbingwg/multus-cni:v4.1.4-thick
+ - image: ghcr.io/k8snetworkplumbingwg/multus-dynamic-networks-controller:latest-amd64
+ - image: quay.io/kubevirt/cdi-operator:v1.61.0
+ - image: quay.io/kubevirt/cdi-uploadproxy:v1.61.0
+ - image: quay.io/kubevirt/cdi-controller:v1.61.0
+ - image: quay.io/kubevirt/cdi-apiserver:v1.61.0
+ - image: quay.io/kubevirt/cdi-importer:v1.61.0
+ - image: quay.io/kubevirt/cdi-uploadserver:v1.61.0
+ - image: quay.io/kubevirt/cdi-cloner:v1.61.0
+ - image: us-docker.pkg.dev/palette-images/palette/kubevirt/virt-handler:v1.4.0
+ - image: us-docker.pkg.dev/palette-images/palette/kubevirt/virt-launcher:v1.4.0
+ - image: us-docker.pkg.dev/palette-images/palette/kubevirt/virt-exportproxy:v1.4.0
+ - image: us-docker.pkg.dev/palette-images/palette/kubevirt/virt-exportserver:v1.4.0
+ - image: us-docker.pkg.dev/palette-images/palette/kubevirt/virt-controller:v1.4.0
+ - image: us-docker.pkg.dev/palette-images/palette/kubevirt/virt-api:v1.4.0
+ - image: us-docker.pkg.dev/palette-images/palette/virtual-machine-orchestrator/os/ubuntu-container-disk:22.04
+ - image: us-docker.pkg.dev/palette-images/palette/virtual-machine-orchestrator/os/fedora-container-disk:37
+ - image: us-docker.pkg.dev/palette-images/palette/virtual-machine-orchestrator/vlan-filtering/ubuntu:latest
+ - image: us-docker.pkg.dev/palette-images/palette/spectro-cleanup:1.0.3
+ - image: us-docker.pkg.dev/palette-images/palette/spectro-kubectl:v1.31.5-vmo
+ namespace: vm-dashboard
+ palette:
+ config:
+ dashboard:
+ access: private
+ spectrocloud.com/install-priority: "10"
charts:
- virtual-machine-orchestrator:
+ virtual-machine-orchestrator:
+ image:
+ repository: us-docker.pkg.dev/palette-images/palette/spectro-vm-dashboard
+ tag: "4.6.3"
+ service:
+ type: "ClusterIP"
+ appConfig:
+ clusterInfo:
+ consoleBaseAddress: ""
+ fullnameOverride: "virtual-machine-orchestrator"
+ serviceAccount:
+ # Specifies whether a service account should be created
+ create: true
+ # Annotations to add to the service account
+ annotations: {}
+ # The name of the service account to use.
+ # If not set and create is true, a name is generated using the fullname template
+ name: "virtual-machine-orchestrator"
+ sampleTemplates:
+ fedora37: false
+ ubuntu2204: false
+ ubuntu2204WithVol: false
+ ubuntu2204staticIP: false
+ fedora37staticIP: false
+ # To create additional vm templates refer to https://docs.spectrocloud.com/vm-management/create-manage-vm/create-vm-template
+ # This namespace used to store golden images.
+
+ goldenImagesNamespace: "vmo-golden-images"
+ # These namespaces are created and set up to deploy VMs into
+ vmEnabledNamespaces:
+ - "default"
+ - "virtual-machines"
+ - ns-adv
+ - ns-edge
+ - ns-product
+ - ns-packs
+ grafana:
+ namespace: monitoring
+ vlanFiltering:
+ enabled: true
+ namespace: kube-system
+ image:
+ repository: us-docker.pkg.dev/palette-images/palette/virtual-machine-orchestrator/vlan-filtering/ubuntu
+ pullPolicy: IfNotPresent
+ tag: "latest"
+ env:
+ # Which bridge interface to control
+ bridgeIF: "br0"
+ # Beginning of VLAN range to enable
+ allowedVlans: "1"
+ # Set to "true" to enable VLANs on the br0 interface for the host to use itself
+ allowVlansOnSelf: "true"
+ # Beginning of VLAN range to enable for use by the node itself
+ allowedVlansOnSelf: "1"
+ snapshot-controller:
+ enabled: true
+ replicas: 1
+ # controller image and policies
+ image:
+ repository: registry.k8s.io/sig-storage/snapshot-controller
+ pullPolicy: IfNotPresent
+ tag: "v8.1.0"
+ # A list/array of extra args to use
+ # when running the controller. Default args include log verbose level
+ # and leader election
+ extraArgs: []
+ # snapshot webhook config
+ webhook:
+ # all below values take effect only if webhook is enabled
+ enabled: true
+ # webhook controller image and policies
image:
- repository: us-docker.pkg.dev/palette-images/palette/spectro-vm-dashboard
- tag: "4.6.3"
+ # change the image if you wish to use your own custom validation server image
+ repository: registry.k8s.io/sig-storage/snapshot-validation-webhook
+ pullPolicy: IfNotPresent
+ # Overrides the image tag whose default is the chart appVersion.
+ tag: "v8.1.0"
+ validatingWebhook:
+ failurePolicy: Fail
+ timeoutSeconds: 2
+ # Validating webhook is exposed on an HTTPS endpoint, and so
+ # TLS certificate is required. This Helm chart relies on
+ # cert-manager.io for managing TLS certificates.
+ tls:
+ # If not empty, this issuer is used to sign the certificate.
+ # If none is provided, a new, self-signing issuer is created.
+ issuerRef: {}
+ # name:
+ # kind:
+ # group: cert-manager.io
+
+ # Certificate duration. The generated certificate is automatically
+ # renewed 1/3 of `certDuration` before its expiry.
+ # Value must be in units accepted by Go time.ParseDuration.
+ # See https://golang.org/pkg/time/#ParseDuration for allowed formats.
+ # Minimum accepted duration is `1h`.
+ # This option may be ignored/overridden by some issuer types.
+ certDuration: 8760h
service:
- type: "ClusterIP"
- appConfig:
- clusterInfo:
- consoleBaseAddress: ""
- fullnameOverride: "virtual-machine-orchestrator"
+ type: ClusterIP
+ port: 443
serviceAccount:
- # Specifies whether a service account should be created
- create: true
- # Annotations to add to the service account
- annotations: {}
- # The name of the service account to use.
- # If not set and create is true, a name is generated using the fullname template
- name: "virtual-machine-orchestrator"
- sampleTemplates:
- fedora37: false
- ubuntu2204: false
- ubuntu2204WithVol: false
- ubuntu2204staticIP: false
- fedora37staticIP: false
- # To create additional vm templates refer to https://docs.spectrocloud.com/vm-management/create-manage-vm/create-vm-template
- # This namespace used to store golden images.
+ # Specifies whether a service account should be created.
+ create: true
+ # Annotations to add to the service account.
+ annotations: {}
+ # The name of the service account to use.
+ # If not set and create is true, a name is generated using the fullname template.
+ name: ""
+ # Log verbosity level.
+ # See https://github.com/kubernetes/community/blob/master/contributors/devel/sig-instrumentation/logging.md
+ # for description of individual verbosity levels.
+ logVerbosityLevel: 2
+ podAnnotations: {}
+ resources: {}
+ nodeSelector: {}
+ tolerations: []
+ affinity: {}
+ nameOverride: ""
+ fullnameOverride: ""
+ imagePullSecrets: []
+ nameOverride: ""
+ fullnameOverride: ""
+ resources: {}
+ # We usually recommend not to specify default resources and to leave this as a conscious
+ # choice for the user. This also increases chances charts run on environments with little
+ # resources, such as Minikube. If you do want to specify resources, uncomment the following
+ # lines, adjust them as necessary, and remove the curly braces after 'resources:'.
+ # limits:
+ # cpu: 100m
+ # memory: 128Mi
+ # requests:
+ # cpu: 100m
+ # memory: 128Mi
- goldenImagesNamespace: "vmo-golden-images"
- # These namespaces are created and set up to deploy VMs into
- vmEnabledNamespaces:
- - "default"
- - "virtual-machines"
- - ns-adv
- - ns-edge
- - ns-product
- - ns-packs
- grafana:
- namespace: monitoring
- vlanFiltering:
- enabled: true
- namespace: kube-system
- image:
- repository: us-docker.pkg.dev/palette-images/palette/virtual-machine-orchestrator/vlan-filtering/ubuntu
- pullPolicy: IfNotPresent
- tag: "latest"
- env:
- # Which bridge interface to control
- bridgeIF: "br0"
- # Beginning of VLAN range to enable
- allowedVlans: "1"
- # Set to "true" to enable VLANs on the br0 interface for the host to use itself
- allowVlansOnSelf: "true"
- # Beginning of VLAN range to enable for use by the node itself
- allowedVlansOnSelf: "1"
- snapshot-controller:
- enabled: true
- replicas: 1
- # controller image and policies
- image:
- repository: registry.k8s.io/sig-storage/snapshot-controller
- pullPolicy: IfNotPresent
- tag: "v8.1.0"
- # A list/array of extra args to use
- # when running the controller. Default args include log verbose level
- # and leader election
- extraArgs: []
- # snapshot webhook config
- webhook:
- # all below values take effect only if webhook is enabled
- enabled: true
- # webhook controller image and policies
- image:
- # change the image if you wish to use your own custom validation server image
- repository: registry.k8s.io/sig-storage/snapshot-validation-webhook
- pullPolicy: IfNotPresent
- # Overrides the image tag whose default is the chart appVersion.
- tag: "v8.1.0"
- validatingWebhook:
- failurePolicy: Fail
- timeoutSeconds: 2
- # Validating webhook is exposed on an HTTPS endpoint, and so
- # TLS certificate is required. This Helm chart relies on
- # cert-manager.io for managing TLS certificates.
- tls:
- # If not empty, this issuer is used to sign the certificate.
- # If none is provided, a new, self-signing issuer is created.
- issuerRef: {}
- # name:
- # kind:
- # group: cert-manager.io
-
- # Certificate duration. The generated certificate is automatically
- # renewed 1/3 of `certDuration` before its expiry.
- # Value must be in units accepted by Go time.ParseDuration.
- # See https://golang.org/pkg/time/#ParseDuration for allowed formats.
- # Minimum accepted duration is `1h`.
- # This option may be ignored/overridden by some issuer types.
- certDuration: 8760h
- service:
- # when running in cluster webhook service is recommended to be of type ClusterIP
- type: ClusterIP
- port: 443
- serviceAccount:
- # Specifies whether a service account should be created.
- create: true
- # Annotations to add to the service account.
- annotations: {}
- # The name of the service account to use.
- # If not set and create is true, a name is generated using the fullname template.
- name: ""
- # Log verbosity level.
- # See https://github.com/kubernetes/community/blob/master/contributors/devel/sig-instrumentation/logging.md
- # for description of individual verbosity levels.
- logVerbosityLevel: 2
- podAnnotations: {}
- resources: {}
- nodeSelector: {}
- tolerations: []
- affinity: {}
- nameOverride: ""
- fullnameOverride: ""
- imagePullSecrets: []
- nameOverride: ""
- fullnameOverride: ""
- resources: {}
- # We usually recommend not to specify default resources and to leave this as a conscious
- # choice for the user. This also increases chances charts run on environments with little
- # resources, such as Minikube. If you do want to specify resources, uncomment the following
- # lines, adjust them as necessary, and remove the curly braces after 'resources:'.
- # limits:
- # cpu: 100m
- # memory: 128Mi
- # requests:
- # cpu: 100m
- # memory: 128Mi
-
- nodeSelector: {}
- tolerations: []
- affinity: {}
- # create a default volume snapshot class
- volumeSnapshotClass:
- create: true
- name: "ceph-block-snapshot-class"
- driver: "rook-ceph.rbd.csi.ceph.com"
- # deletionPolicy determines whether a VolumeSnapshotContent created through
- # the VolumeSnapshotClass should be deleted when its bound VolumeSnapshot is deleted.
- # Supported values are "Retain" and "Delete".
- deletionPolicy: "Delete"
- # params is a key-value map with storage driver specific parameters for creating snapshots.
- params:
- clusterID: rook-ceph
- csi.storage.k8s.io/snapshotter-secret-name: csi-rbd-secret
- csi.storage.k8s.io/snapshotter-secret-namespace: rook-ceph
- # key-value pair of extra labels to apply to the volumesnapshotclass
- extraLabels:
- velero.io/csi-volumesnapshot-class: "true"
- # time for sleep hook in seconds
- hooksleepTime: 12
- kubevirt:
- enabled: true
- # defaults to kubevirt
- namespace: kubevirt
- namespaceLabels:
- pod-security.kubernetes.io/enforce: privileged
- pod-security.kubernetes.io/enforce-version: v{{ .spectro.system.kubernetes.version | substr 0 4 }}
- replicas: 1
- service:
- type: LoadBalancer
- port: 443
- targetPort: 8443
- image:
- repository: us-docker.pkg.dev/palette-images/palette/kubevirt/virt-operator
- pullPolicy: IfNotPresent
- # Overrides the image tag whose default is the chart appVersion.
- tag: "v1.4.0"
- ## The Kubevirt CR that gets created
- kubevirtResource:
- name: kubevirt
- useEmulation: false
- # below gates are required for virtual machine orchestrator pack, users can append additional gates
- additionalFeatureGates:
- - LiveMigration
- - HotplugVolumes
- - Snapshot
- - VMExport
- - ExpandDisks
- - HotplugNICs
- - VMLiveUpdateFeatures
- - VMPersistentState
- - VolumesUpdateStrategy
- - VolumeMigration
- - CPUManager
- - Sidecar
- #- VMPersistentState
- # for additional feature gates refer to https://docs.spectrocloud.com/vm-management#featuregates
- config:
- evictionStrategy: "LiveMigrate"
- # additionalConfig lets you define any configuration other than developerConfiguration and evictionStrategy
- additionalConfig:
- vmStateStorageClass: "ceph-filesystem"
- #vmStateStorageClass: "" #fileSystem-based storageclass for persistent TPM
- migrations:
- allowAutoConverge: true
- completionTimeoutPerGiB: 800
- # additionalDevConfig lets you define dev config other than emulation and feature gate
- additionalDevConfig: {}
- # vmRolloutStrategy lets you define how changes to a VM object propagate to its VMI objects
- vmRolloutStrategy: LiveUpdate
- certificateRotateStrategy: {}
- customizeComponents:
- # flags:
- # api:
- # v:
- # "5"
- # port:
- # "8443"
- imagePullPolicy: IfNotPresent
- infra: {}
- # The name of the Prometheus service account that needs read-access to KubeVirt endpoints
- monitorAccount: "prometheus-operator-prometheus"
- # The namespace Prometheus is deployed in
- monitorNamespace: "monitoring"
- # The namespace the service monitor is deployed to. Either specify this or the monitorNamespace
- serviceMonitorNamespace: "monitoring"
- workloads: {}
- workloadsUpdateStrategy:
- workloadUpdateMethods:
- - LiveMigrate
- # uninstallStrategy to use, options are RemoveWorkloads, BlockUninstallIfWorkloadsExist
- uninstallStrategy: ""
- ingress:
- enabled: false
- ingressClassName: nginx
- annotations:
- cert-manager.io/issuer: kubevirt-selfsigned-issuer
- nginx.ingress.kubernetes.io/backend-protocol: "HTTPS"
- labels: {}
- hosts:
- - host: virt-exportproxy.maas.sc
- paths:
- - path: /
- pathType: ImplementationSpecific
- # tls:
- # - secretName: chart-example-tls
- # hosts:
- # - virt-exportproxy.maas.sc
- cdi:
- enabled: true
- namespaceLabels:
- pod-security.kubernetes.io/enforce: privileged
- pod-security.kubernetes.io/enforce-version: v{{ .spectro.system.kubernetes.version | substr 0 4 }}
- replicas: 1
- image:
- repository: quay.io/kubevirt/cdi-operator
- pullPolicy: IfNotPresent
- # Overrides the image tag whose default is the chart appVersion.
- tag: "v1.61.0"
- # set enabled to true and add private registry details to bring up VMs in airgap environment
- privateRegistry:
- enabled: false
- registryIP: #Ex: 10.10.225.20
- registryBasePath:
- #Ex: specto-images
- serviceAccount:
- # Specifies whether a service account should be created
- create: true
- # Annotations to add to the service account
- annotations: {}
- # The name of the service account to use.
- # If not set and create is true, a name is generated using the fullname template
- name: ""
- service:
- type: LoadBalancer
- port: 443
- targetPort: 8443
- ingress:
- enabled: false
- className: "nginx"
- annotations:
- cert-manager.io/issuer: cdi-selfsigned-issuer
- nginx.ingress.kubernetes.io/proxy-body-size: "0"
- nginx.ingress.kubernetes.io/proxy-read-timeout: "600"
- nginx.ingress.kubernetes.io/proxy-send-timeout: "600"
- nginx.ingress.kubernetes.io/proxy-request-buffering: "off"
- nginx.ingress.kubernetes.io/backend-protocol: "HTTPS"
- hosts:
- - host: cdi-uploadproxy.maas.sc
- paths:
- - path: /
- pathType: ImplementationSpecific
- tls: []
- # - secretName: chart-example-tls
- # hosts:
- # - cdi-uploadproxy.maas.sc
- resources: {}
- # We usually recommend not to specify default resources and to leave this as a conscious
- # choice for the user. This also increases chances charts run on environments with little
- # resources, such as Minikube. If you do want to specify resources, uncomment the following
- # lines, adjust them as necessary, and remove the curly braces after 'resources:'.
- # limits:
- # cpu: 100m
- # memory: 128Mi
- # requests:
- # cpu: 100m
- # memory: 128Mi
+ nodeSelector: {}
+ tolerations: []
+ affinity: {}
+ # create a default volume snapshot class
+ volumeSnapshotClass:
+ create: true
+ name: "ceph-block-snapshot-class"
+ driver: "rook-ceph.rbd.csi.ceph.com"
+ # deletionPolicy determines whether a VolumeSnapshotContent created through
+ # the VolumeSnapshotClass should be deleted when its bound VolumeSnapshot is deleted.
+ # Supported values are "Retain" and "Delete".
+ deletionPolicy: "Delete"
+ # params is a key-value map with storage driver specific parameters for creating snapshots.
+ params:
+ clusterID: rook-ceph
+ csi.storage.k8s.io/snapshotter-secret-name: csi-rbd-secret
+ csi.storage.k8s.io/snapshotter-secret-namespace: rook-ceph
+ # key-value pair of extra labels to apply to the volumesnapshotclass
+ extraLabels:
+ velero.io/csi-volumesnapshot-class: "true"
+ # time for sleep hook in seconds
+ hooksleepTime: 12
+ kubevirt:
+ enabled: true
+ # defaults to kubevirt
+ namespace: kubevirt
+ namespaceLabels:
+ pod-security.kubernetes.io/enforce: privileged
+ pod-security.kubernetes.io/enforce-version: v{{ .spectro.system.kubernetes.version | substr 0 4 }}
+ replicas: 1
+ service:
+ type: LoadBalancer
+ port: 443
+ targetPort: 8443
+ image:
+ repository: us-docker.pkg.dev/palette-images/palette/kubevirt/virt-operator
+ pullPolicy: IfNotPresent
+ # Overrides the image tag whose default is the chart appVersion.
+ tag: "v1.4.0"
+ ## The Kubevirt CR that gets created
+ kubevirtResource:
+ name: kubevirt
+ useEmulation: false
+ # below gates are required for virtual machine orchestrator pack, users can append additional gates
+ additionalFeatureGates:
+ - LiveMigration
+ - HotplugVolumes
+ - Snapshot
+ - VMExport
+ - ExpandDisks
+ - HotplugNICs
+ - VMLiveUpdateFeatures
+ - VMPersistentState
+ - VolumesUpdateStrategy
+ - VolumeMigration
+ - CPUManager
+ - Sidecar
+ #- VMPersistentState
+ # for additional feature gates refer to https://docs.spectrocloud.com/vm-management#featuregates
+ config:
+ evictionStrategy: "LiveMigrate"
+ # additionalConfig lets you define any configuration other than developerConfiguration and evictionStrategy
+ additionalConfig:
+ vmStateStorageClass: "ceph-filesystem"
+ #vmStateStorageClass: "" #fileSystem-based storageclass for persistent TPM
+ migrations:
+ allowAutoConverge: true
+ completionTimeoutPerGiB: 800
+ # additionalDevConfig lets you define dev config other than emulation and feature gate
+ additionalDevConfig: {}
+ # vmRolloutStrategy lets you define how changes to a VM object propagate to its VMI objects
+ vmRolloutStrategy: LiveUpdate
+ certificateRotateStrategy: {}
+ customizeComponents:
+ # flags:
+ # api:
+ # v:
+ # "5"
+ # port:
+ # "8443"
+ imagePullPolicy: IfNotPresent
+ infra: {}
+ # The name of the Prometheus service account that needs read-access to KubeVirt endpoints
+ monitorAccount: "prometheus-operator-prometheus"
+ # The namespace Prometheus is deployed in
+ monitorNamespace: "monitoring"
+ # The namespace the service monitor is deployed to. Either specify this or the monitorNamespace
+ serviceMonitorNamespace: "monitoring"
+ workloads: {}
+ workloadsUpdateStrategy:
+ workloadUpdateMethods:
+ - LiveMigrate
+ # uninstallStrategy to use, options are RemoveWorkloads, BlockUninstallIfWorkloadsExist
+ uninstallStrategy: ""
+ ingress:
+ enabled: false
+ ingressClassName: nginx
+ annotations:
+ cert-manager.io/issuer: kubevirt-selfsigned-issuer
+ nginx.ingress.kubernetes.io/backend-protocol: "HTTPS"
+ labels: {}
+ hosts:
+ - host: virt-exportproxy.maas.sc
+ paths:
+ - path: /
+ pathType: ImplementationSpecific
+ # tls:
+ # - secretName: chart-example-tls
+ # hosts:
+ # - virt-exportproxy.maas.sc
+ cdi:
+ enabled: true
+ namespaceLabels:
+ pod-security.kubernetes.io/enforce: privileged
+ pod-security.kubernetes.io/enforce-version: v{{ .spectro.system.kubernetes.version | substr 0 4 }}
+ replicas: 1
+ image:
+ repository: quay.io/kubevirt/cdi-operator
+ pullPolicy: IfNotPresent
+ # Overrides the image tag whose default is the chart appVersion.
+ tag: "v1.61.0"
+ # set enabled to true and add private registry details to bring up VMs in airgap environment
+ privateRegistry:
+ enabled: false
+ registryIP: #Ex: 10.10.225.20
+ registryBasePath:
+ #Ex: specto-images
+ serviceAccount:
+ # Specifies whether a service account should be created
+ create: true
+ # Annotations to add to the service account
+ annotations: {}
+ # The name of the service account to use.
+ # If not set and create is true, a name is generated using the fullname template
+ name: ""
+ service:
+ type: LoadBalancer
+ port: 443
+ targetPort: 8443
+ ingress:
+ enabled: false
+ className: "nginx"
+ annotations:
+ cert-manager.io/issuer: cdi-selfsigned-issuer
+ nginx.ingress.kubernetes.io/proxy-body-size: "0"
+ nginx.ingress.kubernetes.io/proxy-read-timeout: "600"
+ nginx.ingress.kubernetes.io/proxy-send-timeout: "600"
+ nginx.ingress.kubernetes.io/proxy-request-buffering: "off"
+ nginx.ingress.kubernetes.io/backend-protocol: "HTTPS"
+ hosts:
+ - host: cdi-uploadproxy.maas.sc
+ paths:
+ - path: /
+ pathType: ImplementationSpecific
+ tls: []
+ # - secretName: chart-example-tls
+ # hosts:
+ # - cdi-uploadproxy.maas.sc
+ resources: {}
+ # We usually recommend not to specify default resources and to leave this as a conscious
+ # choice for the user. This also increases chances charts run on environments with little
+ # resources, such as Minikube. If you do want to specify resources, uncomment the following
+ # lines, adjust them as necessary, and remove the curly braces after 'resources:'.
+ # limits:
+ # cpu: 100m
+ # memory: 128Mi
+ # requests:
+ # cpu: 100m
+ # memory: 128Mi
- ## The CDI CR that gets created
- cdiResource:
- additionalFeatureGates: # - FeatureName
- additionalConfig:
- filesystemOverhead:
- global: "0.08"
- storageClass:
- spectro-storage-class: "0.08"
- podResourceRequirements:
- requests:
- cpu: 250m
- memory: 1G
- limits:
- cpu: 1
- memory: 8G
- insecureRegistries: [] # List of insecure registries to allow in the CDI importer, preffered in air-gapped environments
- importProxy:
- #HTTPProxy: "http://username:password@your-proxy-server:3128"
- #HTTPSProxy: "http://username:password@your-proxy-server:3128"
- #noProxy: "127.0.0.1,localhost,10.0.0.0/8,172.16.0.0/12,192.168.0.0/16,.company.local"
- #TrustedCAProxy: configmap-name # optional: the ConfigMap name of an user-provided trusted certificate authority (CA) bundle to be added to the importer pod CA bundle
- additionalSpec:
- infra:
- nodeSelector:
- kubernetes.io/os: linux
- tolerations:
- - key: CriticalAddonsOnly
- operator: Exists
- workload:
- nodeSelector:
- kubernetes.io/os: linux
- imagePullPolicy: IfNotPresent
- multus:
- enabled: true
- image:
- repository: ghcr.io/k8snetworkplumbingwg/multus-cni
- pullPolicy: IfNotPresent
- # Overrides the image tag whose default is the chart appVersion.
- tag: "v4.1.4-thick"
- networkController:
- criSocket:
- enableK3SHostPath: false # true for K3S and RKE2, false for PXK-E
- paletteAgentMode: false # true for running Palette Agent Mode clusters with PXK-E
- # criSocketHostPathOverride: /run/containerd/containerd.sock
- imagePullSecrets: []
- podAnnotations: {}
- resources:
- # We usually recommend not to specify default resources and to leave this as a conscious
- # choice for the user. This also increases chances charts run on environments with little
- # resources, such as Minikube. If you do want to specify resources, uncomment the following
- # lines, adjust them as necessary, and remove the curly braces after 'resources:'.
- limits:
- cpu: 100m
- memory: 1Gi
- requests:
- cpu: 100m
- memory: 50Mi
- nodeSelector: {}
- affinity: {}
- dpdkCompatibility: false
- cleanup:
- image: us-docker.pkg.dev/palette-images/palette/spectro-cleanup
- tag: "1.0.3"
- networkAttachDef:
- create: false
- # a json string to apply
- config: ""
- # a sample config
- # '{
- # "cniVersion": "0.3.0",
- # "type": "macvlan",
- # "master": "ens5",
- # "mode": "bridge",
- # "ipam": {
- # "type": "host-local",
- # "subnet": "192.168.1.0/24",
- # "rangeStart": "192.168.1.200",
- # "rangeEnd": "192.168.1.216",
- # "routes": [
- # { "dst": "0.0.0.0/0" }
- # ],
- # "gateway": "192.168.1.1"
- # }
- # }'
- descheduler:
- enabled: true
- namespace: "kube-system"
- # CronJob or Deployment
- kind: CronJob
- image:
- repository: registry.k8s.io/descheduler/descheduler
- # Overrides the image tag whose default is the chart version
- tag: "v0.32.0"
- pullPolicy: IfNotPresent
- imagePullSecrets: # - name: container-registry-secret
- resources:
- requests:
- cpu: 500m
- memory: 256Mi
- limits:
- cpu: 500m
- memory: 256Mi
- ports:
- - containerPort: 10258
- protocol: TCP
- securityContext:
- allowPrivilegeEscalation: false
- capabilities:
- drop:
- - ALL
- privileged: false
- readOnlyRootFilesystem: true
- runAsNonRoot: true
- runAsUser: 1000
- # podSecurityContext -- [Security context for pod](https://kubernetes.io/docs/tasks/configure-pod-container/security-context/)
- podSecurityContext: {} # fsGroup: 1000
- nameOverride: ""
- fullnameOverride: "descheduler"
- # -- Override the deployment namespace; defaults to .Release.Namespace
- namespaceOverride: ""
- # labels that'll be applied to all resources
- commonLabels: {}
- cronJobApiVersion: "batch/v1"
- schedule: "*/15 * * * *"
- suspend: false
- # startingDeadlineSeconds: 200
- # successfulJobsHistoryLimit: 3
- # failedJobsHistoryLimit: 1
- # ttlSecondsAfterFinished 600
- # timeZone: Etc/UTC
+ ## The CDI CR that gets created
+ cdiResource:
+ additionalFeatureGates: # - FeatureName
+ additionalConfig:
+ filesystemOverhead:
+ global: "0.08"
+ storageClass:
+ spectro-storage-class: "0.08"
+ podResourceRequirements:
+ requests:
+ cpu: 250m
+ memory: 1G
+ limits:
+ cpu: 1
+ memory: 8G
+ insecureRegistries: [] # List of insecure registries to allow in the CDI importer, preffered in air-gapped environments
+ importProxy:
+ #HTTPProxy: "http://username:password@your-proxy-server:3128"
+ #HTTPSProxy: "http://username:password@your-proxy-server:3128"
+ #noProxy: "127.0.0.1,localhost,10.0.0.0/8,172.16.0.0/12,192.168.0.0/16,.company.local"
+ #TrustedCAProxy: configmap-name # optional: the ConfigMap name of an user-provided trusted certificate authority (CA) bundle to be added to the importer pod CA bundle
+ additionalSpec:
+ infra:
+ nodeSelector:
+ kubernetes.io/os: linux
+ tolerations:
+ - key: CriticalAddonsOnly
+ operator: Exists
+ workload:
+ nodeSelector:
+ kubernetes.io/os: linux
+ imagePullPolicy: IfNotPresent
+ multus:
+ enabled: true
+ image:
+ repository: ghcr.io/k8snetworkplumbingwg/multus-cni
+ pullPolicy: IfNotPresent
+ # Overrides the image tag whose default is the chart appVersion.
+ tag: "v4.1.4-thick"
+ networkController:
+ criSocket:
+ enableK3SHostPath: false # true for K3S and RKE2, false for PXK-E
+ paletteAgentMode: false # true for running Palette Agent Mode clusters with PXK-E
+ # criSocketHostPathOverride: /run/containerd/containerd.sock
+ imagePullSecrets: []
+ podAnnotations: {}
+ resources:
+ # We usually recommend not to specify default resources and to leave this as a conscious
+ # choice for the user. This also increases chances charts run on environments with little
+ # resources, such as Minikube. If you do want to specify resources, uncomment the following
+ # lines, adjust them as necessary, and remove the curly braces after 'resources:'.
+ limits:
+ cpu: 100m
+ memory: 1Gi
+ requests:
+ cpu: 100m
+ memory: 50Mi
+ nodeSelector: {}
+ affinity: {}
+ dpdkCompatibility: false
+ cleanup:
+ image: us-docker.pkg.dev/palette-images/palette/spectro-cleanup
+ tag: "1.0.3"
+ networkAttachDef:
+ create: false
+ # a json string to apply
+ config: ""
+ # a sample config
+ # '{
+ # "cniVersion": "0.3.0",
+ # "type": "macvlan",
+ # "master": "ens5",
+ # "mode": "bridge",
+ # "ipam": {
+ # "type": "host-local",
+ # "subnet": "192.168.1.0/24",
+ # "rangeStart": "192.168.1.200",
+ # "rangeEnd": "192.168.1.216",
+ # "routes": [
+ # { "dst": "0.0.0.0/0" }
+ # ],
+ # "gateway": "192.168.1.1"
+ # }
+ # }'
+ descheduler:
+ enabled: true
+ namespace: "kube-system"
+ # CronJob or Deployment
+ kind: CronJob
+ image:
+ repository: registry.k8s.io/descheduler/descheduler
+ # Overrides the image tag whose default is the chart version
+ tag: "v0.32.0"
+ pullPolicy: IfNotPresent
+ imagePullSecrets: # - name: container-registry-secret
+ resources:
+ requests:
+ cpu: 500m
+ memory: 256Mi
+ limits:
+ cpu: 500m
+ memory: 256Mi
+ ports:
+ - containerPort: 10258
+ protocol: TCP
+ securityContext:
+ allowPrivilegeEscalation: false
+ capabilities:
+ drop:
+ - ALL
+ privileged: false
+ readOnlyRootFilesystem: true
+ runAsNonRoot: true
+ runAsUser: 1000
+ # podSecurityContext -- [Security context for pod](https://kubernetes.io/docs/tasks/configure-pod-container/security-context/)
+ podSecurityContext: {} # fsGroup: 1000
+ nameOverride: ""
+ fullnameOverride: "descheduler"
+ # -- Override the deployment namespace; defaults to .Release.Namespace
+ namespaceOverride: ""
+ # labels that'll be applied to all resources
+ commonLabels: {}
+ cronJobApiVersion: "batch/v1"
+ schedule: "*/15 * * * *"
+ suspend: false
+ # startingDeadlineSeconds: 200
+ # successfulJobsHistoryLimit: 3
+ # failedJobsHistoryLimit: 1
+ # ttlSecondsAfterFinished 600
+ # timeZone: Etc/UTC
- # Required when running as a Deployment
- deschedulingInterval: 15m
- # Specifies the replica count for Deployment
- # Set leaderElection if you want to use more than 1 replica
- # Set affinity.podAntiAffinity rule if you want to schedule onto a node
- # only if that node is in the same zone as at least one already-running descheduler
- replicas: 1
- # Specifies whether Leader Election resources should be created
- # Required when running as a Deployment
- # NOTE: Leader election can't be activated if DryRun enabled
- leaderElection: {}
- # enabled: true
- # leaseDuration: 15s
- # renewDeadline: 10s
- # retryPeriod: 2s
- # resourceLock: "leases"
- # resourceName: "descheduler"
- # resourceNamespace: "kube-system"
+ # Required when running as a Deployment
+ deschedulingInterval: 15m
+ # Specifies the replica count for Deployment
+ # Set leaderElection if you want to use more than 1 replica
+ # Set affinity.podAntiAffinity rule if you want to schedule onto a node
+ # only if that node is in the same zone as at least one already-running descheduler
+ replicas: 1
+ # Specifies whether Leader Election resources should be created
+ # Required when running as a Deployment
+ # NOTE: Leader election can't be activated if DryRun enabled
+ leaderElection: {}
+ # enabled: true
+ # leaseDuration: 15s
+ # renewDeadline: 10s
+ # retryPeriod: 2s
+ # resourceLock: "leases"
+ # resourceName: "descheduler"
+ # resourceNamespace: "kube-system"
- command:
- - "/bin/descheduler"
- cmdOptions:
- v: 3
- # Recommended to use the latest Policy API version supported by the Descheduler app version
- deschedulerPolicyAPIVersion: "descheduler/v1alpha2"
- # deschedulerPolicy contains the policies the descheduler executes.
- # To use policies stored in an existing configMap use:
- # NOTE: The name of the cm should comply to {{ template "descheduler.fullname" . }}
- # deschedulerPolicy: {}
- deschedulerPolicy:
- nodeSelector: kubevirt.io/schedulable=true
- maxNoOfPodsToEvictPerNode: 10
- # maxNoOfPodsToEvictPerNamespace: 10
- metricsCollector:
- enabled: true
- # ignorePvcPods: true
- # evictLocalStoragePods: true
- # evictDaemonSetPods: true
- # tracing:
- # collectorEndpoint: otel-collector.observability.svc.cluster.local:4317
- # transportCert: ""
- # serviceName: ""
- # serviceNamespace: ""
- # sampleRate: 1.0
- # fallbackToNoOpProviderOnError: true
- profiles:
- - name: default
- pluginConfig:
- - name: DefaultEvictor
- args:
- ignorePvcPods: true
- evictLocalStoragePods: true
- nodeFit: true
- ignorePodsWithoutPDB: true
- - name: RemoveDuplicates
- - name: RemovePodsHavingTooManyRestarts
- args:
- podRestartThreshold: 100
- includingInitContainers: true
- - name: RemovePodsViolatingNodeAffinity
- args:
- nodeAffinityType:
- - requiredDuringSchedulingIgnoredDuringExecution
- - name: RemovePodsViolatingNodeTaints
- args:
- excludedTaints:
- - node.kubernetes.io/unschedulable
- - name: RemovePodsViolatingInterPodAntiAffinity
- - name: RemovePodsViolatingTopologySpreadConstraint
- - name: LowNodeUtilization
- args:
- thresholds:
- cpu: 20
- memory: 25
- pods: 100
- targetThresholds:
- cpu: 60
- memory: 75
- pods: 100
- metricsUtilization:
- metricsServer: true
- evictableNamespaces:
- exclude:
- - "cert-manager"
- - "kube-system"
- - "palette-system"
- - "metallb-system"
- - "cluster-{{ .spectro.system.cluster.uid }}"
- - "kubevirt"
- - "monitoring"
- - "nginx"
- - "vm-dashboard"
- plugins:
- balance:
- enabled:
- - RemoveDuplicates
- - RemovePodsViolatingTopologySpreadConstraint
- - LowNodeUtilization
- deschedule:
- enabled:
- - RemovePodsHavingTooManyRestarts
- - RemovePodsViolatingNodeTaints
- - RemovePodsViolatingNodeAffinity
- - RemovePodsViolatingInterPodAntiAffinity
- priorityClassName: system-cluster-critical
- nodeSelector: {}
- # foo: bar
+ command:
+ - "/bin/descheduler"
+ cmdOptions:
+ v: 3
+ # Recommended to use the latest Policy API version supported by the Descheduler app version
+ deschedulerPolicyAPIVersion: "descheduler/v1alpha2"
+ # deschedulerPolicy contains the policies the descheduler executes.
+ # To use policies stored in an existing configMap use:
+ # NOTE: The name of the cm should comply to {{ template "descheduler.fullname" . }}
+ # deschedulerPolicy: {}
+ deschedulerPolicy:
+ nodeSelector: kubevirt.io/schedulable=true
+ maxNoOfPodsToEvictPerNode: 10
+ # maxNoOfPodsToEvictPerNamespace: 10
+ metricsCollector:
+ enabled: true
+ # ignorePvcPods: true
+ # evictLocalStoragePods: true
+ # evictDaemonSetPods: true
+ # tracing:
+ # collectorEndpoint: otel-collector.observability.svc.cluster.local:4317
+ # transportCert: ""
+ # serviceName: ""
+ # serviceNamespace: ""
+ # sampleRate: 1.0
+ # fallbackToNoOpProviderOnError: true
+ profiles:
+ - name: default
+ pluginConfig:
+ - name: DefaultEvictor
+ args:
+ ignorePvcPods: true
+ evictLocalStoragePods: true
+ nodeFit: true
+ ignorePodsWithoutPDB: true
+ - name: RemoveDuplicates
+ - name: RemovePodsHavingTooManyRestarts
+ args:
+ podRestartThreshold: 100
+ includingInitContainers: true
+ - name: RemovePodsViolatingNodeAffinity
+ args:
+ nodeAffinityType:
+ - requiredDuringSchedulingIgnoredDuringExecution
+ - name: RemovePodsViolatingNodeTaints
+ args:
+ excludedTaints:
+ - node.kubernetes.io/unschedulable
+ - name: RemovePodsViolatingInterPodAntiAffinity
+ - name: RemovePodsViolatingTopologySpreadConstraint
+ - name: LowNodeUtilization
+ args:
+ thresholds:
+ cpu: 20
+ memory: 25
+ pods: 100
+ targetThresholds:
+ cpu: 60
+ memory: 75
+ pods: 100
+ metricsUtilization:
+ metricsServer: true
+ evictableNamespaces:
+ exclude:
+ - "cert-manager"
+ - "kube-system"
+ - "palette-system"
+ - "metallb-system"
+ - "cluster-{{ .spectro.system.cluster.uid }}"
+ - "kubevirt"
+ - "monitoring"
+ - "nginx"
+ - "vm-dashboard"
+ plugins:
+ balance:
+ enabled:
+ - RemoveDuplicates
+ - RemovePodsViolatingTopologySpreadConstraint
+ - LowNodeUtilization
+ deschedule:
+ enabled:
+ - RemovePodsHavingTooManyRestarts
+ - RemovePodsViolatingNodeTaints
+ - RemovePodsViolatingNodeAffinity
+ - RemovePodsViolatingInterPodAntiAffinity
+ priorityClassName: system-cluster-critical
+ nodeSelector: {}
+ # foo: bar
- affinity: {}
- # nodeAffinity:
- # requiredDuringSchedulingIgnoredDuringExecution:
- # nodeSelectorTerms:
- # - matchExpressions:
- # - key: kubernetes.io/e2e-az-name
- # operator: In
- # values:
- # - e2e-az1
- # - e2e-az2
- # podAntiAffinity:
- # requiredDuringSchedulingIgnoredDuringExecution:
- # - labelSelector:
- # matchExpressions:
- # - key: app.kubernetes.io/name
- # operator: In
- # values:
- # - descheduler
- # topologyKey: "kubernetes.io/hostname"
- topologySpreadConstraints: []
- # - maxSkew: 1
- # topologyKey: kubernetes.io/hostname
- # whenUnsatisfiable: DoNotSchedule
- # labelSelector:
- # matchLabels:
- # app.kubernetes.io/name: descheduler
- tolerations: []
- # - key: 'management'
- # operator: 'Equal'
- # value: 'tool'
- # effect: 'NoSchedule'
+ affinity: {}
+ # nodeAffinity:
+ # requiredDuringSchedulingIgnoredDuringExecution:
+ # nodeSelectorTerms:
+ # - matchExpressions:
+ # - key: kubernetes.io/e2e-az-name
+ # operator: In
+ # values:
+ # - e2e-az1
+ # - e2e-az2
+ # podAntiAffinity:
+ # requiredDuringSchedulingIgnoredDuringExecution:
+ # - labelSelector:
+ # matchExpressions:
+ # - key: app.kubernetes.io/name
+ # operator: In
+ # values:
+ # - descheduler
+ # topologyKey: "kubernetes.io/hostname"
+ topologySpreadConstraints: []
+ # - maxSkew: 1
+ # topologyKey: kubernetes.io/hostname
+ # whenUnsatisfiable: DoNotSchedule
+ # labelSelector:
+ # matchLabels:
+ # app.kubernetes.io/name: descheduler
+ tolerations: []
+ # - key: 'management'
+ # operator: 'Equal'
+ # value: 'tool'
+ # effect: 'NoSchedule'
- rbac:
- # Specifies whether RBAC resources should be created
- create: true
- serviceAccount:
- # Specifies whether a ServiceAccount should be created
- create: true
- # The name of the ServiceAccount to use.
- # If not set and create is true, a name is generated using the fullname template
- name: # Specifies custom annotations for the serviceAccount
- annotations: {}
- podAnnotations: {}
- podLabels:
- spectrocloud.com/connection: proxy
- dnsConfig: {}
- livenessProbe:
- failureThreshold: 3
- httpGet:
- path: /healthz
- port: 10258
- scheme: HTTPS
- initialDelaySeconds: 3
- periodSeconds: 10
- service:
- enabled: false
- # @param service.ipFamilyPolicy [string], support SingleStack, PreferDualStack and RequireDualStack
- #
- ipFamilyPolicy: ""
- # @param service.ipFamilies [array] List of IP families (e.g. IPv4, IPv6) assigned to the service.
- # Ref: https://kubernetes.io/docs/concepts/services-networking/dual-stack/
- # E.g.
- # ipFamilies:
- # - IPv6
- # - IPv4
- ipFamilies: []
- serviceMonitor:
- enabled: false
- # The namespace where Prometheus expects to find service monitors.
- # namespace: ""
- # Add custom labels to the ServiceMonitor resource
- additionalLabels: {} # prometheus: kube-prometheus-stack
- interval: ""
- # honorLabels: true
- insecureSkipVerify: true
- serverName: null
- metricRelabelings: []
- # - action: keep
- # regex: 'descheduler_(build_info|pods_evicted)'
- # sourceLabels: [__name__]
- relabelings: []
- # - sourceLabels: [__meta_kubernetes_pod_node_name]
- # separator: ;
- # regex: ^(.*)$
- # targetLabel: nodename
- # replacement: $1
- # action: replace
\ No newline at end of file
+ rbac:
+ # Specifies whether RBAC resources should be created
+ create: true
+ serviceAccount:
+ # Specifies whether a ServiceAccount should be created
+ create: true
+ # The name of the ServiceAccount to use.
+ # If not set and create is true, a name is generated using the fullname template
+ name: # Specifies custom annotations for the serviceAccount
+ annotations: {}
+ podAnnotations: {}
+ podLabels:
+ spectrocloud.com/connection: proxy
+ dnsConfig: {}
+ livenessProbe:
+ failureThreshold: 3
+ httpGet:
+ path: /healthz
+ port: 10258
+ scheme: HTTPS
+ initialDelaySeconds: 3
+ periodSeconds: 10
+ service:
+ enabled: false
+ # @param service.ipFamilyPolicy [string], support SingleStack, PreferDualStack and RequireDualStack
+ #
+ ipFamilyPolicy: ""
+ # @param service.ipFamilies [array] List of IP families (e.g. IPv4, IPv6) assigned to the service.
+ # Ref: https://kubernetes.io/docs/concepts/services-networking/dual-stack/
+ # E.g.
+ # ipFamilies:
+ # - IPv6
+ # - IPv4
+ ipFamilies: []
+ serviceMonitor:
+ enabled: false
+ # The namespace where Prometheus expects to find service monitors.
+ # namespace: ""
+ # Add custom labels to the ServiceMonitor resource
+ additionalLabels: {} # prometheus: kube-prometheus-stack
+ interval: ""
+ # honorLabels: true
+ insecureSkipVerify: true
+ serverName: null
+ metricRelabelings: []
+ # - action: keep
+ # regex: 'descheduler_(build_info|pods_evicted)'
+ # sourceLabels: [__name__]
+ relabelings: []
+ # - sourceLabels: [__meta_kubernetes_pod_node_name]
+ # separator: ;
+ # regex: ^(.*)$
+ # targetLabel: nodename
+ # replacement: $1
+ # action: replace
\ No newline at end of file
diff --git a/terraform/vmo-cluster/terraform.tfvars b/terraform/vmo-cluster/terraform.tfvars
index 0eee3c6..885a4d4 100644
--- a/terraform/vmo-cluster/terraform.tfvars
+++ b/terraform/vmo-cluster/terraform.tfvars
@@ -11,7 +11,7 @@ palette-project = "Default" # The name of your project in Palette.
############################
deploy-maas = true # Set to true to deploy to a new VMO cluster to MAAS.
-deploy-maas-vm = false # Set to true to create a VM on MAAS VMO cluster once deployed.
+deploy-maas-vm = true # Set to true to create a VM on MAAS VMO cluster once deployed.
pcg-name = "maas-pcg" # Provide the name of the PCG that will be used to deploy the Palette cluster.
maas-domain = "maas.sc" # Provide the MAAS domain that will be used to deploy the Palette cluster.
maas-control-plane-nodes = 1 # Provide the number of control plane nodes that will be used for the Palette cluster.
@@ -62,8 +62,8 @@ node-network = "10.11.130.129-10.11.130.131" # IP addresses to be assigned for u
# virtual_machines.tf
#####################
vm-deploy-namespace = "virtual-machines" # Namespace where your VM will be deployed.
-vm-deploy-name = "vmo-vm" # The name of your VM
-vm-labels = ["my-vmo-vm"] # Labels that will be applied to your VM.
+vm-deploy-name = "tf-new-template" # The name of your VM
+vm-labels = ["tf-new-tamplate"] # Labels that will be applied to your VM.
vm-storage-Gi = "50Gi" # Size of the disk (PVC) that your VM will have.
vm-cpu-cores = 2 # Number of CPU cores your VM will have.
vm-cpu-sockets = 1 # Number of physical CPU sockets the CPU cores should be spread over.
@@ -73,4 +73,4 @@ vm-memory-Gi = "4Gi" # Amount of RAM (memory) your VM will h
#####################
# vmo-extras-manifest.yaml
#####################
-palette-user-id = "kenneth.heaslip@spectrocloud.com"
+palette-user-id = "kenneth.heaslip@spectrocloud.com"
diff --git a/terraform/vmo-cluster/tests/virtual-machines-replace-values.tftest.hcl b/terraform/vmo-cluster/tests/virtual-machines-replace-values.tftest.hcl
index e43a404..dda2366 100644
--- a/terraform/vmo-cluster/tests/virtual-machines-replace-values.tftest.hcl
+++ b/terraform/vmo-cluster/tests/virtual-machines-replace-values.tftest.hcl
@@ -26,10 +26,5 @@ run "verify_maas" {
command = plan
expect_failures = [
- var.vm-deploy-namespace,
- var.vm-deploy-name,
- var.vm-labels,
- var.vm-storage-Gi,
- var.vm-memory-Gi,
]
}
diff --git a/terraform/vmo-cluster/virtual-machines/cloud-init b/terraform/vmo-cluster/virtual-machines/cloud-init
index 935c9a1..ae54349 100644
--- a/terraform/vmo-cluster/virtual-machines/cloud-init
+++ b/terraform/vmo-cluster/virtual-machines/cloud-init
@@ -4,19 +4,19 @@ chpasswd: { expire: False }
password: spectro
disable_root: false
runcmd:
- - apt-get update
- - apt-get install -y qemu-guest-agent
- - systemctl start qemu-guest-agent
- - |
+- apt-get update
+- apt-get install -y qemu-guest-agent
+- systemctl start qemu-guest-agent
+- |
apt-get -y install ca-certificates curl
install -m 0755 -d /etc/apt/keyrings
curl -fsSL https://download.docker.com/linux/ubuntu/gpg -o /etc/apt/keyrings/docker.asc
chmod a+r /etc/apt/keyrings/docker.asc
echo \
- "deb [arch=$(dpkg --print-architecture) signed-by=/etc/apt/keyrings/docker.asc] https://download.docker.com/linux/ubuntu \
- $(. /etc/os-release && echo "$VERSION_CODENAME") stable" | \
- tee /etc/apt/sources.list.d/docker.list > /dev/null
+ "deb [arch=$(dpkg --print-architecture) signed-by=/etc/apt/keyrings/docker.asc] https://download.docker.com/linux/ubuntu \
+ $(. /etc/os-release && echo "$VERSION_CODENAME") stable" | \
+ tee /etc/apt/sources.list.d/docker.list > /dev/null
apt-get update
apt-get install -y docker-ce docker-ce-cli containerd.io docker-buildx-plugin docker-compose-plugin
groupadd docker
- gpasswd -a ubuntu docker
+ gpasswd -a ubuntu docker
\ No newline at end of file
diff --git a/terraform/vmo-cluster/virtual_machines.tf b/terraform/vmo-cluster/virtual_machines.tf
index d8c62af..cc45d51 100644
--- a/terraform/vmo-cluster/virtual_machines.tf
+++ b/terraform/vmo-cluster/virtual_machines.tf
@@ -50,7 +50,7 @@ resource "spectrocloud_virtual_machine" "virtual-machine" {
}
volume {
- name = "ubuntu-2204"
+ name = "ubuntu-2204-vm"
volume_source {
data_volume {
name = "ubuntu-2204"
@@ -68,7 +68,7 @@ resource "spectrocloud_virtual_machine" "virtual-machine" {
}
disk {
- name = "ubuntu-2204"
+ name = "ubuntu-2204-vm"
disk_device {
disk {
bus = "virtio"
diff --git a/terraform/vmo-cluster/vm-test.yaml b/terraform/vmo-cluster/vm-test.yaml
new file mode 100644
index 0000000..5a34da2
--- /dev/null
+++ b/terraform/vmo-cluster/vm-test.yaml
@@ -0,0 +1,87 @@
+apiVersion: kubevirt.io/v1
+kind: VirtualMachine
+metadata:
+ labels:
+ kubevirt.io/vm: tf-base-template-always-2
+ name: tf-base-template-always-2
+ namespace: virtual-machines
+spec:
+ dataVolumeTemplates:
+ - metadata:
+ name: tf-base-template-always-2-ubuntu
+ spec:
+ pvc:
+ accessModes:
+ - ReadWriteMany
+ resources:
+ requests:
+ storage: 50Gi
+ storageClassName: ceph-block
+ volumeMode: Block
+ source:
+ pvc:
+ name: template-ubuntu-2204
+ namespace: vmo-golden-images
+ template:
+ metadata:
+ annotations:
+ descheduler.alpha.kubernetes.io/evict: 'true'
+ labels:
+ kubevirt.io/domain: hellouni
+ kubevirt.io/size: small
+ spec:
+ domain:
+ cpu:
+ cores: 2
+ sockets: 1
+ threads: 1
+ devices:
+ disks:
+ - disk:
+ bus: virtio
+ name: datavolume-os
+ - disk:
+ bus: virtio
+ name: cloudinitdisk
+ interfaces:
+ - masquerade: {}
+ model: virtio
+ name: default
+ macAddress: 02:D1:47:31:59:20
+ machine:
+ type: q35
+ memory:
+ guest: 2Gi
+ networks:
+ - name: default
+ pod: {}
+ volumes:
+ - dataVolume:
+ name: tf-base-template-always-2-ubuntu
+ name: datavolume-os
+ - cloudInitNoCloud:
+ userData: |
+ #cloud-config
+ ssh_pwauth: True
+ chpasswd: { expire: False }
+ password: spectro
+ disable_root: false
+ runcmd:
+ - apt-get update
+ - apt-get install -y qemu-guest-agent
+ - systemctl start qemu-guest-agent
+ - |
+ apt-get -y install ca-certificates curl
+ install -m 0755 -d /etc/apt/keyrings
+ curl -fsSL https://download.docker.com/linux/ubuntu/gpg -o /etc/apt/keyrings/docker.asc
+ chmod a+r /etc/apt/keyrings/docker.asc
+ echo \
+ "deb [arch=$(dpkg --print-architecture) signed-by=/etc/apt/keyrings/docker.asc] https://download.docker.com/linux/ubuntu \
+ $(. /etc/os-release && echo "$VERSION_CODENAME") stable" | \
+ tee /etc/apt/sources.list.d/docker.list > /dev/null
+ apt-get update
+ apt-get install -y docker-ce docker-ce-cli containerd.io docker-buildx-plugin docker-compose-plugin
+ groupadd docker
+ gpasswd -a ubuntu docker
+ name: cloudinitdisk
+ runStrategy: Always
\ No newline at end of file
From defb64d68f31f00406f6aae6ecc68b69b2f57097 Mon Sep 17 00:00:00 2001
From: kenheaslip-sc
Date: Mon, 16 Jun 2025 13:49:00 -0400
Subject: [PATCH 08/11] RC2
---
terraform/vmo-cluster/terraform.tfvars | 4 ----
1 file changed, 4 deletions(-)
diff --git a/terraform/vmo-cluster/terraform.tfvars b/terraform/vmo-cluster/terraform.tfvars
index 885a4d4..49d6978 100644
--- a/terraform/vmo-cluster/terraform.tfvars
+++ b/terraform/vmo-cluster/terraform.tfvars
@@ -70,7 +70,3 @@ vm-cpu-sockets = 1 # Number of physical CPU sockets the CP
vm-cpu-threads = 2 # Number of CPU threads to use for the VM CPU
vm-memory-Gi = "4Gi" # Amount of RAM (memory) your VM will have
-#####################
-# vmo-extras-manifest.yaml
-#####################
-palette-user-id = "kenneth.heaslip@spectrocloud.com"
From cd5867fca6831bb72064345acf00738aaa0919ab Mon Sep 17 00:00:00 2001
From: kenheaslip-sc
Date: Mon, 16 Jun 2025 14:06:51 -0400
Subject: [PATCH 09/11] RC3
---
.../manifests/vmo-extras-manifest copy.yaml | 132 ------------------
terraform/vmo-cluster/terraform.tfvars | 30 ++--
terraform/vmo-cluster/vm-test.yaml | 87 ------------
3 files changed, 15 insertions(+), 234 deletions(-)
delete mode 100644 terraform/vmo-cluster/manifests/vmo-extras-manifest copy.yaml
delete mode 100644 terraform/vmo-cluster/vm-test.yaml
diff --git a/terraform/vmo-cluster/manifests/vmo-extras-manifest copy.yaml b/terraform/vmo-cluster/manifests/vmo-extras-manifest copy.yaml
deleted file mode 100644
index 6244567..0000000
--- a/terraform/vmo-cluster/manifests/vmo-extras-manifest copy.yaml
+++ /dev/null
@@ -1,132 +0,0 @@
-apiVersion: spectrocloud.com/v1
-kind: VmTemplate
-metadata:
- name: ubuntu-2204
-spec:
- description: Ubuntu 22.04
- displayName: Ubuntu 22.04
- icon: https://s3.amazonaws.com/manifests.spectrocloud.com/logos/ubuntu.png
- dataVolumeTemplates:
- - metadata:
- name: ubuntu-2204
- spec:
- source:
- pvc:
- name: template-ubuntu-2204
- namespace: vmo-golden-images
- pvc:
- accessModes:
- - ReadWriteMany
- resources:
- requests:
- storage: 50Gi
- volumeMode: Block
- storageClassName: ceph-block
- template:
- metadata:
- annotations:
- descheduler.alpha.kubernetes.io/evict: "true"
- labels:
- kubevirt.io/size: small
- kubevirt.io/domain: hellouni
- spec:
- domain:
- cpu:
- cores: 2
- sockets: 1
- threads: 1
- devices:
- disks:
- - disk:
- bus: virtio
- name: datavolume-os
- - disk:
- bus: virtio
- name: cloudinitdisk
- interfaces:
- - masquerade: {}
- name: default
- model: virtio
- #macAddress: '00:5e:ab:cd:ef:01'
- machine:
- type: q35
- resources:
- limits:
- memory: 2Gi
- requests:
- memory: 2Gi
- networks:
- - name: default
- pod: {}
- volumes:
- - dataVolume:
- name: ubuntu-2204
- name: datavolume-os
- - cloudInitNoCloud:
- userData: |
- #cloud-config
- ssh_pwauth: True
- chpasswd: { expire: False }
- password: spectro
- disable_root: false
- runcmd:
- - apt-get update
- - apt-get install -y qemu-guest-agent
- - systemctl start qemu-guest-agent
- - |
- apt-get -y install ca-certificates curl
- install -m 0755 -d /etc/apt/keyrings
- curl -fsSL https://download.docker.com/linux/ubuntu/gpg -o /etc/apt/keyrings/docker.asc
- chmod a+r /etc/apt/keyrings/docker.asc
- echo \
- "deb [arch=$(dpkg --print-architecture) signed-by=/etc/apt/keyrings/docker.asc] https://download.docker.com/linux/ubuntu \
- $(. /etc/os-release && echo "$VERSION_CODENAME") stable" | \
- tee /etc/apt/sources.list.d/docker.list > /dev/null
- apt-get update
- apt-get install -y docker-ce docker-ce-cli containerd.io docker-buildx-plugin docker-compose-plugin
- groupadd docker
- gpasswd -a ubuntu docker
- name: cloudinitdisk
----
-apiVersion: cdi.kubevirt.io/v1beta1
-kind: DataVolume
-metadata:
- name: "template-ubuntu-2204"
- namespace: "vmo-golden-images"
- annotations:
- cdi.kubevirt.io/storage.deleteAfterCompletion: "false"
- cdi.kubevirt.io/storage.bind.immediate.requested: ""
-spec:
- storage:
- accessModes:
- - ReadWriteMany
- resources:
- requests:
- storage: 50Gi
- volumeMode: Block
- storageClassName: ceph-block
- source:
- registry:
- url: "docker://gcr.io/spectro-images-public/release/vm-dashboard/os/ubuntu-container-disk:22.04"
----
-apiVersion: cdi.kubevirt.io/v1beta1
-kind: StorageProfile
-metadata:
- name: ceph-filesystem
-spec:
- claimPropertySets:
- - accessModes:
- - ReadWriteMany
- volumeMode: Filesystem
- cloneStrategy: csi-clone
----
-apiVersion: cdi.kubevirt.io/v1beta1
-kind: StorageProfile
-metadata:
- name: ceph-block
-spec:
- claimPropertySets:
- - accessModes:
- - ReadWriteMany
- volumeMode: Block
- cloneStrategy: csi-clone
\ No newline at end of file
diff --git a/terraform/vmo-cluster/terraform.tfvars b/terraform/vmo-cluster/terraform.tfvars
index 49d6978..e01a6c0 100644
--- a/terraform/vmo-cluster/terraform.tfvars
+++ b/terraform/vmo-cluster/terraform.tfvars
@@ -10,20 +10,20 @@ palette-project = "Default" # The name of your project in Palette.
# MAAS Deployment Settings
############################
-deploy-maas = true # Set to true to deploy to a new VMO cluster to MAAS.
-deploy-maas-vm = true # Set to true to create a VM on MAAS VMO cluster once deployed.
-pcg-name = "maas-pcg" # Provide the name of the PCG that will be used to deploy the Palette cluster.
-maas-domain = "maas.sc" # Provide the MAAS domain that will be used to deploy the Palette cluster.
+deploy-maas = false # Set to true to deploy to a new VMO cluster to MAAS.
+deploy-maas-vm = false # Set to true to create a VM on MAAS VMO cluster once deployed.
+pcg-name = "REPLACE ME" # Provide the name of the PCG that will be used to deploy the Palette cluster.
+maas-domain = "REPLACE ME" # Provide the MAAS domain that will be used to deploy the Palette cluster.
maas-control-plane-nodes = 1 # Provide the number of control plane nodes that will be used for the Palette cluster.
-maas-control-plane-resource-pool = "docs" # Provide a resource pool for the control plane nodes.
-maas-control-plane-azs = ["az1"] # Provide a set of availability zones for the control plane nodes.
-maas-control-plane-node-tags = ["docs-cp"] # Provide a set of node tags for the control plane nodes.
+maas-control-plane-resource-pool = "REPLACE ME" # Provide a resource pool for the control plane nodes.
+maas-control-plane-azs = ["REPLACE ME"] # Provide a set of availability zones for the control plane nodes.
+maas-control-plane-node-tags = ["REPLACE ME"] # Provide a set of node tags for the control plane nodes.
ctl-node-min-cpu = 6 # Minimum number of CPU cores required for control plane nodes
ctl-node-min-memory-mb = 8096 # Minimum amount of RAM (memory) required for control plane nodes
maas-worker-nodes = 1 # Provide the number of worker nodes that will be used for the Palette cluster.
-maas-worker-resource-pool = "docs" # Provide a resource pool for the worker nodes.
-maas-worker-azs = ["az1"] # Provide a set of availability zones for the worker nodes.
-maas-worker-node-tags = ["docs"] # Provide a set of node tags for the worker nodes.
+maas-worker-resource-pool = "REPLACE ME" # Provide a resource pool for the worker nodes.
+maas-worker-azs = ["REPLACE ME"] # Provide a set of availability zones for the worker nodes.
+maas-worker-node-tags = ["REPLACE ME"] # Provide a set of node tags for the worker nodes.
wrk-node-min-cpu = 8 # Minimum number of CPU cores required for worker nodes
wrk-node-min-memory-mb = 16384 # Minimum amount of RAM (memory) required for worker nodes
@@ -31,7 +31,7 @@ wrk-node-min-memory-mb = 16384 # Minimum amount of RAM (memory)
# cluster_profiles.tf
#####################
-vmo-cluster-name = "vmo-cluster-maas"
+vmo-cluster-name = "REPLACE ME"
cluster-profile-type = "cluster" # infra, cluster, add-on, or system
cluster-profile-version = "1.0.0" # Version number for the cluster profile in Palette
@@ -51,19 +51,19 @@ cluster-services-CIDR = ["100.64.64.0/18"]
###############################
# manifests/metallb-values.yaml
###############################
-metallb-ip-pool = ["10.11.130.129-10.11.130.131"] # IP addresses to be assigned for use by MetalLB
+metallb-ip-pool = ["REPLACE ME"] # IP addresses to be assigned for use by MetalLB
###############################
# manifests/ubuntu-values.yaml
###############################
-node-network = "10.11.130.129-10.11.130.131" # IP addresses to be assigned for use by MetalLB
+node-network = "REPLACE ME" # IP addresses to be assigned for use by MetalLB
#####################
# virtual_machines.tf
#####################
vm-deploy-namespace = "virtual-machines" # Namespace where your VM will be deployed.
-vm-deploy-name = "tf-new-template" # The name of your VM
-vm-labels = ["tf-new-tamplate"] # Labels that will be applied to your VM.
+vm-deploy-name = "REPLACE ME" # The name of your VM
+vm-labels = ["REPLACE ME"] # Labels that will be applied to your VM.
vm-storage-Gi = "50Gi" # Size of the disk (PVC) that your VM will have.
vm-cpu-cores = 2 # Number of CPU cores your VM will have.
vm-cpu-sockets = 1 # Number of physical CPU sockets the CPU cores should be spread over.
diff --git a/terraform/vmo-cluster/vm-test.yaml b/terraform/vmo-cluster/vm-test.yaml
deleted file mode 100644
index 5a34da2..0000000
--- a/terraform/vmo-cluster/vm-test.yaml
+++ /dev/null
@@ -1,87 +0,0 @@
-apiVersion: kubevirt.io/v1
-kind: VirtualMachine
-metadata:
- labels:
- kubevirt.io/vm: tf-base-template-always-2
- name: tf-base-template-always-2
- namespace: virtual-machines
-spec:
- dataVolumeTemplates:
- - metadata:
- name: tf-base-template-always-2-ubuntu
- spec:
- pvc:
- accessModes:
- - ReadWriteMany
- resources:
- requests:
- storage: 50Gi
- storageClassName: ceph-block
- volumeMode: Block
- source:
- pvc:
- name: template-ubuntu-2204
- namespace: vmo-golden-images
- template:
- metadata:
- annotations:
- descheduler.alpha.kubernetes.io/evict: 'true'
- labels:
- kubevirt.io/domain: hellouni
- kubevirt.io/size: small
- spec:
- domain:
- cpu:
- cores: 2
- sockets: 1
- threads: 1
- devices:
- disks:
- - disk:
- bus: virtio
- name: datavolume-os
- - disk:
- bus: virtio
- name: cloudinitdisk
- interfaces:
- - masquerade: {}
- model: virtio
- name: default
- macAddress: 02:D1:47:31:59:20
- machine:
- type: q35
- memory:
- guest: 2Gi
- networks:
- - name: default
- pod: {}
- volumes:
- - dataVolume:
- name: tf-base-template-always-2-ubuntu
- name: datavolume-os
- - cloudInitNoCloud:
- userData: |
- #cloud-config
- ssh_pwauth: True
- chpasswd: { expire: False }
- password: spectro
- disable_root: false
- runcmd:
- - apt-get update
- - apt-get install -y qemu-guest-agent
- - systemctl start qemu-guest-agent
- - |
- apt-get -y install ca-certificates curl
- install -m 0755 -d /etc/apt/keyrings
- curl -fsSL https://download.docker.com/linux/ubuntu/gpg -o /etc/apt/keyrings/docker.asc
- chmod a+r /etc/apt/keyrings/docker.asc
- echo \
- "deb [arch=$(dpkg --print-architecture) signed-by=/etc/apt/keyrings/docker.asc] https://download.docker.com/linux/ubuntu \
- $(. /etc/os-release && echo "$VERSION_CODENAME") stable" | \
- tee /etc/apt/sources.list.d/docker.list > /dev/null
- apt-get update
- apt-get install -y docker-ce docker-ce-cli containerd.io docker-buildx-plugin docker-compose-plugin
- groupadd docker
- gpasswd -a ubuntu docker
- name: cloudinitdisk
- runStrategy: Always
\ No newline at end of file
From 6b9fc2789afe7a3cf51023db2f408c299791530e Mon Sep 17 00:00:00 2001
From: kenheaslip-sc
Date: Tue, 17 Jun 2025 13:20:54 -0400
Subject: [PATCH 10/11] feat: vmo with terraform
---
README.md | 2 +
terraform/vmo-cluster/README.md | 41 +++--
terraform/vmo-cluster/cluster_profiles.tf | 36 ++---
terraform/vmo-cluster/clusters.tf | 10 +-
terraform/vmo-cluster/data.tf | 2 +-
terraform/vmo-cluster/inputs.tf | 150 ++++++------------
.../vmo-cluster/manifests/metallb-values.yaml | 2 +-
.../vmo-cluster/manifests/ubuntu-values.yaml | 2 +-
.../manifests/vmo-extras-manifest.yaml | 30 +++-
.../vmo-cluster/manifests/vmo-values.yaml | 6 +-
terraform/vmo-cluster/terraform.tfvars | 73 ++++-----
11 files changed, 149 insertions(+), 205 deletions(-)
diff --git a/README.md b/README.md
index bdbda40..3cf76d1 100644
--- a/README.md
+++ b/README.md
@@ -24,6 +24,8 @@ The following tutorial code is available:
- [getting-started-deployment-tf](./terraform/getting-started-deployment-tf/README.md) - Learn how to deploy and update a cluster to AWS, Azure, GCP, and VMware vSphere with Palette. [Link](https://docs.spectrocloud.com/getting-started/terraform)
+- [maas-vmo-cluster-deployment-tf](./terraform/vmo-cluster/README.md) - Learn how to deploy a VMO cluster to MAAS and deploy VMs with Palette. [Link](https://docs.spectrocloud.com/tutorials/vmo/vmo-maas)
+
## Docker
All the tutorials are available in a Docker image that you can use to get started with the tutorials.
diff --git a/terraform/vmo-cluster/README.md b/terraform/vmo-cluster/README.md
index df72fa0..6cd8857 100644
--- a/terraform/vmo-cluster/README.md
+++ b/terraform/vmo-cluster/README.md
@@ -1,6 +1,6 @@
# Deploy and Manage VMs using Palette VMO
-This folder contains the demo code for the **Deploy and Manage VMs using Palette VMO** tutorial.
+This folder contains the demo code for the [Deploy and Manage VMs using Palette VMO](https://docs.spectrocloud.com/tutorials/vmo/vmo-maas/) tutorial.
The Terraform code has two main toggle variables that you can use to deploy resources to [Canonical MAAS](https://maas.io/docs).
@@ -10,7 +10,8 @@ The Terraform code has two main toggle variables that you can use to deploy reso
| `deploy-maas-vm` | MAAS | Enable to deploy a VM to a deployed MAAS cluster. | `false` |
-To get started, open the **terraform.tfvars** file. Toggle the provider variable as specified in the table and provide values to your cloud provider variables, replacing all instances of the string `REPLACE ME`.
+To get started, open the **terraform.tfvars** file. Toggle the provider variable as specified in the table and provide values to your cloud provider variables, replacing all instances of the string `REPLACE_ME`.
+
## Requirements
@@ -53,43 +54,37 @@ No modules.
| Name | Description | Type | Default | Required |
|------|-------------|------|---------|:--------:|
-| [cluster-profile-type](#input\_cluster-profile-type) | The name of the PCG that will be used to deploy the cluster. | `string` | n/a | yes |
-| [cluster-profile-version](#input\_cluster-profile-version) | The name of the PCG that will be used to deploy the cluster. | `string` | n/a | yes |
-| [cluster-services-CIDR](#input\_cluster-services-CIDR) | CIDR notation subnets for cluster services ex. 192.168.1.0/24. | `set(string)` | n/a | yes |
-| [ctl-node-min-cpu](#input\_ctl-node-min-cpu) | Minimum number of CPU cores allocated to the Control Plane node. | `number` | n/a | yes |
-| [ctl-node-min-memory-mb](#input\_ctl-node-min-memory-mb) | Minimum amount of RAM allocated to the Control Plane node. | `number` | n/a | yes |
| [deploy-maas](#input\_deploy-maas) | A flag for enabling a deployment on MAAS. | `bool` | n/a | yes |
| [deploy-maas-vm](#input\_deploy-maas-vm) | A flag for enabling a VM creation on the MAAS cluster. | `bool` | n/a | yes |
-| [host-vlans](#input\_host-vlans) | Node Allowed VLANs | `number` | `1` | no |
+| [host-vlans](#input\_host-vlans) | Node Allowed VLANs | `string` | `"1"` | no |
+| [maas-control-node-min-cpu](#input\_maas-control-node-min-cpu) | Minimum number of CPU cores allocated to the Control Plane node. | `number` | n/a | yes |
+| [maas-control-node-min-memory-mb](#input\_maas-control-node-min-memory-mb) | Minimum amount of RAM allocated to the Control Plane node. | `number` | n/a | yes |
| [maas-control-plane-azs](#input\_maas-control-plane-azs) | Set of AZs for the MAAS control plane nodes. | `set(string)` | n/a | yes |
| [maas-control-plane-node-tags](#input\_maas-control-plane-node-tags) | Set of node tags for the MAAS control plane nodes. | `set(string)` | n/a | yes |
-| [maas-control-plane-nodes](#input\_maas-control-plane-nodes) | Number of MaaS control plane nodes | `number` | `1` | no |
| [maas-control-plane-resource-pool](#input\_maas-control-plane-resource-pool) | Resource pool for the MAAS control plane nodes. | `string` | n/a | yes |
| [maas-domain](#input\_maas-domain) | MAAS domain | `string` | n/a | yes |
| [maas-worker-azs](#input\_maas-worker-azs) | Set of AZs for the MAAS worker nodes. | `set(string)` | n/a | yes |
+| [maas-worker-node-min-cpu](#input\_maas-worker-node-min-cpu) | Minimum number of CPU cores allocated to the worker node. | `number` | n/a | yes |
+| [maas-worker-node-min-memory-mb](#input\_maas-worker-node-min-memory-mb) | Minimum amount of RAM allocated to the worker node. | `number` | n/a | yes |
| [maas-worker-node-tags](#input\_maas-worker-node-tags) | Set of node tags for the MAAS worker nodes. | `set(string)` | n/a | yes |
-| [maas-worker-nodes](#input\_maas-worker-nodes) | Number of MaaS worker nodes | `number` | `1` | no |
| [maas-worker-resource-pool](#input\_maas-worker-resource-pool) | Resource pool for the MAAS worker nodes. | `string` | n/a | yes |
-| [metallb-ip-pool](#input\_metallb-ip-pool) | CIDR notation subnets or IP range ex. 192.168.1.0/24 or 192.168.1.0-192.168.1.255 | `set(string)` | n/a | yes |
+| [metallb-ip-pool](#input\_metallb-ip-pool) | CIDR notation subnets or IP range ex. 192.168.1.0/24 or 192.168.1.0-192.168.1.255 | `string` | n/a | yes |
| [node-network](#input\_node-network) | The subnet the Ubuntu nodes will use. | `string` | n/a | yes |
| [palette-project](#input\_palette-project) | The name of your project in Palette. | `string` | n/a | yes |
-| [palette-user-id](#input\_palette-user-id) | The amount of storage to provision for your VM in Gi. | `string` | n/a | yes |
+| [palette-user-id](#input\_palette-user-id) | The name of your project in Palette. | `string` | n/a | yes |
| [pcg-name](#input\_pcg-name) | The name of the PCG that will be used to deploy the cluster. | `string` | n/a | yes |
-| [pod-CIDR](#input\_pod-CIDR) | CIDR notation subnets for the pd network ex. 192.168.1.0/24. | `set(string)` | n/a | yes |
| [tags](#input\_tags) | The default tags to apply to Palette resources. | `list(string)` | [
"spectro-cloud-education",
"spectrocloud:tutorials",
"terraform_managed:true",
"tutorial:vmo-cluster-deployment"
]
| no |
| [vm-cpu-cores](#input\_vm-cpu-cores) | Number of CPU cores to allocate to your VM. | `number` | `1` | no |
-| [vm-cpu-sockets](#input\_vm-cpu-sockets) | Number of CPU cores to allocate to your VM. | `number` | `1` | no |
-| [vm-cpu-threads](#input\_vm-cpu-threads) | Number of CPU cores to allocate to your VM. | `number` | `1` | no |
-| [vm-deploy-name](#input\_vm-deploy-name) | The namespace where your VMs will be deployed. | `string` | n/a | yes |
-| [vm-deploy-namespace](#input\_vm-deploy-namespace) | The namespace where your VMs will be deployed. | `string` | n/a | yes |
-| [vm-labels](#input\_vm-labels) | The namespace where your VMs will be deployed. | `set(string)` | n/a | yes |
+| [vm-cpu-sockets](#input\_vm-cpu-sockets) | Number of CPU sockets the assigned CPU cores should be spread across. | `number` | `1` | no |
+| [vm-cpu-threads](#input\_vm-cpu-threads) | Number of CPU threads your VM can use. | `number` | `1` | no |
+| [vm-deploy-name](#input\_vm-deploy-name) | The namespace where your VMs will be deployed. | `string` | `"vmo-tutorial-vm"` | no |
+| [vm-deploy-namespace](#input\_vm-deploy-namespace) | The namespace where your VMs will be deployed. | `string` | `"virtual-machines"` | no |
+| [vm-labels](#input\_vm-labels) | The labels that will be applied to your VM. | `set(string)` | [
"vmo-tutorial-vm"
]
| no |
| [vm-memory-Gi](#input\_vm-memory-Gi) | The amount of storage to provision for your VM in Gi. | `string` | n/a | yes |
| [vm-storage-Gi](#input\_vm-storage-Gi) | The amount of storage to provision for your VM in Gi. | `string` | n/a | yes |
-| [vm-vlans](#input\_vm-vlans) | VM allowed VLANs. | `number` | `1` | no |
-| [vmo-cluster-name](#input\_vmo-cluster-name) | The name of the cluster. | `string` | n/a | yes |
-| [vmo-network-interface](#input\_vmo-network-interface) | The network interface VMO will use for VM traffic. | `set(string)` | n/a | yes |
-| [wrk-node-min-cpu](#input\_wrk-node-min-cpu) | Minimum number of CPU cores allocated to the Control Plane node. | `number` | n/a | yes |
-| [wrk-node-min-memory-mb](#input\_wrk-node-min-memory-mb) | Minimum amount of RAM allocated to the Control Plane node. | `number` | n/a | yes |
+| [vm-vlans](#input\_vm-vlans) | VM allowed VLANs. | `string` | `"1"` | no |
+| [vmo-cluster-name](#input\_vmo-cluster-name) | The name of the cluster. | `string` | `"vmo-tutorial-cluster"` | no |
+| [vmo-network-interface](#input\_vmo-network-interface) | The host network interface VMO will use for VM traffic. | `string` | `"br0"` | no |
## Outputs
diff --git a/terraform/vmo-cluster/cluster_profiles.tf b/terraform/vmo-cluster/cluster_profiles.tf
index 9becb9b..775bb95 100644
--- a/terraform/vmo-cluster/cluster_profiles.tf
+++ b/terraform/vmo-cluster/cluster_profiles.tf
@@ -8,8 +8,8 @@ resource "spectrocloud_cluster_profile" "maas-vmo-profile" {
description = "A basic cluster profile for MAAS VMO"
tags = concat(var.tags, ["env:maas"])
cloud = "maas"
- type = var.cluster-profile-type
- version = var.cluster-profile-version
+ type = "cluster"
+ version = "1.0.0"
pack {
name = data.spectrocloud_pack.maas_ubuntu.name
@@ -22,14 +22,11 @@ resource "spectrocloud_cluster_profile" "maas-vmo-profile" {
}
pack {
- name = data.spectrocloud_pack.maas_k8s.name
- tag = data.spectrocloud_pack.maas_k8s.version
- uid = data.spectrocloud_pack.maas_k8s.id
- values = templatefile("manifests/k8s-values.yaml", {
- pod-CIDR = var.pod-CIDR,
- clusterServicesCIDR = var.cluster-services-CIDR
- })
- type = "spectro"
+ name = data.spectrocloud_pack.maas_k8s.name
+ tag = data.spectrocloud_pack.maas_k8s.version
+ uid = data.spectrocloud_pack.maas_k8s.id
+ values = file("manifests/k8s-values.yaml")
+ type = "spectro"
}
pack {
@@ -41,13 +38,11 @@ resource "spectrocloud_cluster_profile" "maas-vmo-profile" {
}
pack {
- name = data.spectrocloud_pack.maas_csi.name
- tag = data.spectrocloud_pack.maas_csi.version
- uid = data.spectrocloud_pack.maas_csi.id
- values = templatefile("manifests/csi-values.yaml", {
- worker_nodes = var.maas-worker-nodes
- })
- type = "spectro"
+ name = data.spectrocloud_pack.maas_csi.name
+ tag = data.spectrocloud_pack.maas_csi.version
+ uid = data.spectrocloud_pack.maas_csi.id
+ values = file("manifests/csi-values.yaml")
+ type = "spectro"
}
pack {
@@ -79,8 +74,9 @@ resource "spectrocloud_cluster_profile" "maas-vmo-profile" {
values = file("manifests/vmo-extras-values.yaml")
manifest {
name = "vmo-extras"
- content = file("manifests/vmo-extras-manifest.yaml")
+ content = templatefile("manifests/vmo-extras-manifest.yaml", {
+ palette-user-id = var.palette-user-id
+ })
}
}
-
-}
+}
\ No newline at end of file
diff --git a/terraform/vmo-cluster/clusters.tf b/terraform/vmo-cluster/clusters.tf
index cfb02e5..3341565 100644
--- a/terraform/vmo-cluster/clusters.tf
+++ b/terraform/vmo-cluster/clusters.tf
@@ -8,7 +8,7 @@
resource "spectrocloud_cluster_maas" "maas-cluster" {
count = var.deploy-maas ? 1 : 0
- name = var.vmo-cluster-name
+ name = "vmo-tutorial-cluster"
tags = concat(var.tags, ["env:maas"])
cloud_account_id = data.spectrocloud_cloudaccount_maas.account[0].id
pause_agent_upgrades = "unlock"
@@ -28,8 +28,8 @@ resource "spectrocloud_cluster_maas" "maas-cluster" {
azs = var.maas-control-plane-azs
node_tags = var.maas-control-plane-node-tags
instance_type {
- min_cpu = var.ctl-node-min-cpu
- min_memory_mb = var.ctl-node-min-memory-mb
+ min_cpu = var.maas-control-node-min-cpu
+ min_memory_mb = var.maas-control-node-min-memory-mb
}
placement {
resource_pool = var.maas-control-plane-resource-pool
@@ -42,8 +42,8 @@ resource "spectrocloud_cluster_maas" "maas-cluster" {
azs = var.maas-worker-azs
node_tags = var.maas-worker-node-tags
instance_type {
- min_cpu = var.wrk-node-min-cpu
- min_memory_mb = var.wrk-node-min-memory-mb
+ min_cpu = var.maas-worker-node-min-cpu
+ min_memory_mb = var.maas-worker-node-min-memory-mb
}
placement {
resource_pool = var.maas-worker-resource-pool
diff --git a/terraform/vmo-cluster/data.tf b/terraform/vmo-cluster/data.tf
index baac57c..2b15c62 100644
--- a/terraform/vmo-cluster/data.tf
+++ b/terraform/vmo-cluster/data.tf
@@ -56,6 +56,6 @@ data "spectrocloud_pack" "maas_vmo" {
data "spectrocloud_cluster" "maas_vmo_cluster" {
count = var.deploy-maas-vm ? 1 : 0
depends_on = [spectrocloud_cluster_maas.maas-cluster]
- name = "vmo-cluster-maas"
+ name = "vmo-tutorial-cluster"
context = "project"
}
diff --git a/terraform/vmo-cluster/inputs.tf b/terraform/vmo-cluster/inputs.tf
index b7ee3eb..70805fd 100644
--- a/terraform/vmo-cluster/inputs.tf
+++ b/terraform/vmo-cluster/inputs.tf
@@ -11,9 +11,18 @@ variable "palette-project" {
validation {
condition = var.palette-project != ""
- error_message = "Provide the correct Palette project."
+ error_message = "Provide a Palette project name."
}
+}
+variable "palette-user-id" {
+ type = string
+ description = "The name of your project in Palette."
+
+ validation {
+ condition = var.palette-user-id != ""
+ error_message = "Please provide a Palette user ID."
+ }
}
######################
@@ -31,73 +40,46 @@ variable "tags" {
]
}
-
-
-
-#####################
-# cluster_profiles.tf
-#####################
-
-variable "cluster-profile-type" {
- type = string
- description = "The name of the PCG that will be used to deploy the cluster."
-
- validation {
- condition = var.deploy-maas ? var.cluster-profile-type != "REPLACE ME" && lower(var.cluster-profile-type) == "cluster" || lower(var.cluster-profile-type) == "infra" || lower(var.cluster-profile-type) == "add-on" || lower(var.cluster-profile-type) == "system" : true
- error_message = "Cluster profile type must be 'cluster', 'infra', 'add-on', or 'system'."
- }
-}
-
-variable "cluster-profile-version" {
- type = string
- description = "The name of the PCG that will be used to deploy the cluster."
-
- validation {
- condition = var.deploy-maas ? var.cluster-profile-version != "REPLACE ME" && var.cluster-profile-version != "" : true
- error_message = "Cluster profile version must be set."
- }
-}
-
#########################
# clusters.tf
#########################
-variable "ctl-node-min-cpu" {
+variable "maas-control-node-min-cpu" {
type = number
description = "Minimum number of CPU cores allocated to the Control Plane node."
validation {
- condition = var.deploy-maas ? var.ctl-node-min-cpu > 0 : true
+ condition = var.deploy-maas ? var.maas-control-node-min-cpu > 0 : true
error_message = "Provide a valid number of cores for your Control Plane node."
}
}
-variable "ctl-node-min-memory-mb" {
+variable "maas-control-node-min-memory-mb" {
type = number
description = "Minimum amount of RAM allocated to the Control Plane node."
validation {
- condition = var.deploy-maas ? var.ctl-node-min-memory-mb > 0 : true
+ condition = var.deploy-maas ? var.maas-control-node-min-memory-mb > 0 : true
error_message = "Provide a valid amount of RAM (MB) for your Control Plane node."
}
}
-variable "wrk-node-min-cpu" {
+variable "maas-worker-node-min-cpu" {
type = number
- description = "Minimum number of CPU cores allocated to the Control Plane node."
+ description = "Minimum number of CPU cores allocated to the worker node."
validation {
- condition = var.deploy-maas ? var.wrk-node-min-cpu > 0 : true
- error_message = "Provide a valid number of cores for your worker node."
+ condition = var.deploy-maas ? var.maas-worker-node-min-cpu > 0 : true
+ error_message = "Provide a valid number of CPU cores for your worker node."
}
}
-variable "wrk-node-min-memory-mb" {
+variable "maas-worker-node-min-memory-mb" {
type = number
- description = "Minimum amount of RAM allocated to the Control Plane node."
+ description = "Minimum amount of RAM allocated to the worker node."
validation {
- condition = var.deploy-maas ? var.wrk-node-min-memory-mb > 0 : true
+ condition = var.deploy-maas ? var.maas-worker-node-min-memory-mb > 0 : true
error_message = "Provide a valid amount of RAM (MB) for your worker node."
}
}
@@ -105,6 +87,7 @@ variable "wrk-node-min-memory-mb" {
variable "vmo-cluster-name" {
type = string
description = "The name of the cluster."
+ default = "vmo-tutorial-cluster"
validation {
condition = var.deploy-maas ? var.vmo-cluster-name != "REPLACE ME" && var.vmo-cluster-name != "" : true
@@ -128,7 +111,7 @@ variable "pcg-name" {
validation {
condition = var.deploy-maas ? var.pcg-name != "REPLACE ME" && var.pcg-name != "" : true
- error_message = "Provide the correct MAAS PCG name."
+ error_message = "Provide a valid MAAS PCG name."
}
}
@@ -138,18 +121,7 @@ variable "maas-domain" {
validation {
condition = var.deploy-maas ? var.maas-domain != "REPLACE ME" && var.maas-domain != "" : true
- error_message = "Provide the correct MAAS domain."
- }
-}
-
-variable "maas-worker-nodes" {
- type = number
- description = "Number of MaaS worker nodes"
- default = 1
-
- validation {
- condition = var.deploy-maas ? var.maas-worker-nodes > 0 : true
- error_message = "Provide a valid number of worker nodes."
+ error_message = "Provide a valid MAAS domain."
}
}
@@ -183,24 +155,13 @@ variable "maas-worker-node-tags" {
}
}
-variable "maas-control-plane-nodes" {
- type = number
- description = "Number of MaaS control plane nodes"
- default = 1
-
- validation {
- condition = var.deploy-maas ? var.maas-control-plane-nodes > 0 : true
- error_message = "Provide a valid number of control plane nodes."
- }
-}
-
variable "maas-control-plane-resource-pool" {
type = string
description = "Resource pool for the MAAS control plane nodes."
validation {
condition = var.deploy-maas ? var.maas-control-plane-resource-pool != "REPLACE ME" && var.maas-control-plane-resource-pool != "" : true
- error_message = "Provide a valid resource pool for worker nodes."
+ error_message = "Provide a valid resource pool for MAAS control plane nodes."
}
}
@@ -210,7 +171,7 @@ variable "maas-control-plane-azs" {
validation {
condition = var.deploy-maas ? !contains(var.maas-control-plane-azs, "REPLACE ME") && length(var.maas-control-plane-azs) != 0 : true
- error_message = "Provide a valid set of AZs for control plane nodes."
+ error_message = "Provide a valid set of AZs for MAAS control plane nodes."
}
}
@@ -220,31 +181,7 @@ variable "maas-control-plane-node-tags" {
validation {
condition = var.deploy-maas ? !contains(var.maas-control-plane-node-tags, "REPLACE ME") && length(var.maas-control-plane-node-tags) != 0 : true
- error_message = "Provide a valid set of node tags for control plane nodes."
- }
-}
-
-#################
-# /manifests/k8s-values.yaml
-#################
-
-variable "pod-CIDR" {
- type = set(string)
- description = "CIDR notation subnets for the pd network ex. 192.168.1.0/24."
-
- validation {
- condition = var.deploy-maas ? !contains(var.pod-CIDR, "REPLACE ME") && length(var.pod-CIDR) != 0 : true
- error_message = "Provide a valid Subnet (CIDR Notation) for the pod network."
- }
-}
-
-variable "cluster-services-CIDR" {
- type = set(string)
- description = "CIDR notation subnets for cluster services ex. 192.168.1.0/24."
-
- validation {
- condition = var.deploy-maas ? !contains(var.cluster-services-CIDR, "REPLACE ME") && length(var.cluster-services-CIDR) != 0 : true
- error_message = "Provide a valid Subnet (CIDR Notation for cluster services."
+ error_message = "Provide a valid set of node tags for MAAS control plane nodes."
}
}
@@ -253,11 +190,11 @@ variable "cluster-services-CIDR" {
#####################
variable "metallb-ip-pool" {
- type = set(string)
+ type = string
description = "CIDR notation subnets or IP range ex. 192.168.1.0/24 or 192.168.1.0-192.168.1.255"
validation {
- condition = var.deploy-maas ? !contains(var.metallb-ip-pool, "REPLACE ME") && length(var.metallb-ip-pool) != 0 : true
+ condition = var.deploy-maas ? var.metallb-ip-pool != "REPLACE ME" && length(var.metallb-ip-pool) != 0 : true
error_message = "Provide a valid Subnet (CIDR Notation) or IP Range (192.168.1.0-192.168.1.255) for MetalLB."
}
}
@@ -267,25 +204,26 @@ variable "metallb-ip-pool" {
#################
variable "vmo-network-interface" {
- type = set(string)
- description = "The network interface VMO will use for VM traffic."
+ type = string
+ description = "The host network interface VMO will use for VM traffic."
+ default = "br0"
validation {
- condition = var.deploy-maas ? !contains(var.vmo-network-interface, "REPLACE ME") && length(var.vmo-network-interface) != 0 : true
- error_message = "Provide a valid network interface for the VMO service to use."
+ condition = var.deploy-maas ? var.vmo-network-interface != "REPLACE ME" && length(var.vmo-network-interface) != 0 : true
+ error_message = "Provide a valid host network interface for the VMO service to use."
}
}
variable "vm-vlans" {
- type = number
+ type = string
description = "VM allowed VLANs."
- default = 1
+ default = "1"
}
variable "host-vlans" {
- type = number
+ type = string
description = "Node Allowed VLANs"
- default = 1
+ default = "1"
}
#################
@@ -298,11 +236,10 @@ variable "node-network" {
validation {
condition = var.deploy-maas ? var.node-network != "REPLACE ME" && length(var.node-network) != 0 : true
- error_message = "Provide a valid network interface for the VMO service to use."
+ error_message = "Provide a valid network (CIDR notation) for the OS to use."
}
}
-
#####################
# virtual_machines.tf
#####################
@@ -310,6 +247,7 @@ variable "node-network" {
variable "vm-deploy-namespace" {
type = string
description = "The namespace where your VMs will be deployed."
+ default = "virtual-machines"
validation {
condition = var.deploy-maas ? var.vm-deploy-namespace != "REPLACE ME" && length(var.vm-deploy-namespace) != 0 : true
@@ -320,6 +258,7 @@ variable "vm-deploy-namespace" {
variable "vm-deploy-name" {
type = string
description = "The namespace where your VMs will be deployed."
+ default = "vmo-tutorial-vm"
validation {
condition = var.deploy-maas ? var.vm-deploy-name != "REPLACE ME" && length(var.vm-deploy-name) != 0 : true
@@ -329,7 +268,8 @@ variable "vm-deploy-name" {
variable "vm-labels" {
type = set(string)
- description = "The namespace where your VMs will be deployed."
+ description = "The labels that will be applied to your VM."
+ default = ["vmo-tutorial-vm"]
validation {
condition = var.deploy-maas ? var.vm-labels != "REPLACE ME" && length(var.vm-labels) != 0 : true
@@ -360,7 +300,7 @@ variable "vm-cpu-cores" {
variable "vm-cpu-sockets" {
type = number
- description = "Number of CPU cores to allocate to your VM."
+ description = "Number of CPU sockets the assigned CPU cores should be spread across."
default = 1
validation {
@@ -371,7 +311,7 @@ variable "vm-cpu-sockets" {
variable "vm-cpu-threads" {
type = number
- description = "Number of CPU cores to allocate to your VM."
+ description = "Number of CPU threads your VM can use."
default = 1
validation {
diff --git a/terraform/vmo-cluster/manifests/metallb-values.yaml b/terraform/vmo-cluster/manifests/metallb-values.yaml
index 30af484..71e91d9 100644
--- a/terraform/vmo-cluster/manifests/metallb-values.yaml
+++ b/terraform/vmo-cluster/manifests/metallb-values.yaml
@@ -19,7 +19,7 @@ charts:
first-pool:
spec:
addresses:
- - 10.11.130.129-10.11.130.131
+ - ${metallb-ip-pool}
# - 192.168.100.50-192.168.100.60
avoidBuggyIPs: true
autoAssign: true
diff --git a/terraform/vmo-cluster/manifests/ubuntu-values.yaml b/terraform/vmo-cluster/manifests/ubuntu-values.yaml
index 26d80be..9b0a9e7 100644
--- a/terraform/vmo-cluster/manifests/ubuntu-values.yaml
+++ b/terraform/vmo-cluster/manifests/ubuntu-values.yaml
@@ -6,7 +6,7 @@ kubeadmconfig:
- apt install -y grepcidr
- |
# Enter as a CIDR '10.11.130.0/24'
- NETWORKS="10.11.130.0/24"
+ NETWORKS=${node-network}
IPS=$(hostname -I)
for IP in $IPS
do
diff --git a/terraform/vmo-cluster/manifests/vmo-extras-manifest.yaml b/terraform/vmo-cluster/manifests/vmo-extras-manifest.yaml
index 6244567..a8bea4e 100644
--- a/terraform/vmo-cluster/manifests/vmo-extras-manifest.yaml
+++ b/terraform/vmo-cluster/manifests/vmo-extras-manifest.yaml
@@ -129,4 +129,32 @@ spec:
- accessModes:
- ReadWriteMany
volumeMode: Block
- cloneStrategy: csi-clone
\ No newline at end of file
+ cloneStrategy: csi-clone
+---
+apiVersion: rbac.authorization.k8s.io/v1
+kind: ClusterRoleBinding
+metadata:
+ labels:
+ app.kubernetes.io/name: virtual-machine-orchestrator
+ name: virtual-machine-orchestrator
+roleRef:
+ apiGroup: rbac.authorization.k8s.io
+ kind: ClusterRole
+ name: cluster-admin
+subjects:
+- kind: ServiceAccount
+ name: virtual-machine-orchestrator
+ namespace: vm-dashboard
+---
+apiVersion: rbac.authorization.k8s.io/v1
+kind: ClusterRoleBinding
+metadata:
+ name: cluster-admin
+subjects:
+- kind: User
+ name: ${palette-user-id}
+ apiGroup: rbac.authorization.k8s.io
+roleRef:
+ kind: ClusterRole
+ name: cluster-admin
+ apiGroup: rbac.authorization.k8s.io
diff --git a/terraform/vmo-cluster/manifests/vmo-values.yaml b/terraform/vmo-cluster/manifests/vmo-values.yaml
index 8e66e80..f6c9c70 100644
--- a/terraform/vmo-cluster/manifests/vmo-values.yaml
+++ b/terraform/vmo-cluster/manifests/vmo-values.yaml
@@ -81,13 +81,13 @@ charts:
tag: "latest"
env:
# Which bridge interface to control
- bridgeIF: "br0"
+ bridgeIF: ${vmo-network-interface}
# Beginning of VLAN range to enable
- allowedVlans: "1"
+ allowedVlans: ${vm-vlans}
# Set to "true" to enable VLANs on the br0 interface for the host to use itself
allowVlansOnSelf: "true"
# Beginning of VLAN range to enable for use by the node itself
- allowedVlansOnSelf: "1"
+ allowedVlansOnSelf: ${host-vlans}
snapshot-controller:
enabled: true
replicas: 1
diff --git a/terraform/vmo-cluster/terraform.tfvars b/terraform/vmo-cluster/terraform.tfvars
index e01a6c0..f5dee74 100644
--- a/terraform/vmo-cluster/terraform.tfvars
+++ b/terraform/vmo-cluster/terraform.tfvars
@@ -4,69 +4,52 @@
#####################
# Palette Settings
#####################
-palette-project = "Default" # The name of your project in Palette.
+palette-project = "REPLACE_ME" # The name of your project in Palette.
+palette-user-id = "REPLACE_ME" # Your Palette user ID
############################
# MAAS Deployment Settings
############################
-deploy-maas = false # Set to true to deploy to a new VMO cluster to MAAS.
-deploy-maas-vm = false # Set to true to create a VM on MAAS VMO cluster once deployed.
-pcg-name = "REPLACE ME" # Provide the name of the PCG that will be used to deploy the Palette cluster.
-maas-domain = "REPLACE ME" # Provide the MAAS domain that will be used to deploy the Palette cluster.
-maas-control-plane-nodes = 1 # Provide the number of control plane nodes that will be used for the Palette cluster.
-maas-control-plane-resource-pool = "REPLACE ME" # Provide a resource pool for the control plane nodes.
-maas-control-plane-azs = ["REPLACE ME"] # Provide a set of availability zones for the control plane nodes.
-maas-control-plane-node-tags = ["REPLACE ME"] # Provide a set of node tags for the control plane nodes.
-ctl-node-min-cpu = 6 # Minimum number of CPU cores required for control plane nodes
-ctl-node-min-memory-mb = 8096 # Minimum amount of RAM (memory) required for control plane nodes
-maas-worker-nodes = 1 # Provide the number of worker nodes that will be used for the Palette cluster.
-maas-worker-resource-pool = "REPLACE ME" # Provide a resource pool for the worker nodes.
-maas-worker-azs = ["REPLACE ME"] # Provide a set of availability zones for the worker nodes.
-maas-worker-node-tags = ["REPLACE ME"] # Provide a set of node tags for the worker nodes.
-wrk-node-min-cpu = 8 # Minimum number of CPU cores required for worker nodes
-wrk-node-min-memory-mb = 16384 # Minimum amount of RAM (memory) required for worker nodes
-
-#####################
-# cluster_profiles.tf
-#####################
-
-vmo-cluster-name = "REPLACE ME"
-cluster-profile-type = "cluster" # infra, cluster, add-on, or system
-cluster-profile-version = "1.0.0" # Version number for the cluster profile in Palette
-
-#####################
-# vmo-values.tf
-####################
-vmo-network-interface = ["br0"]
-vm-vlans = 1
-host-vlans = 1
-
-###########################
-# manifests/k8s-values.yaml
-###########################
-pod-CIDR = ["100.64.0.0/18"] # Set the subnet that your pods will run on
-cluster-services-CIDR = ["100.64.64.0/18"]
+deploy-maas = true # Set to true to deploy to a new VMO cluster to MAAS.
+deploy-maas-vm = true # Set to true to create a VM on MAAS VMO cluster once deployed.
+pcg-name = "REPLACE_ME" # Provide the name of the PCG that will be used to deploy the Palette cluster.
+maas-domain = "REPLACE_ME" # Provide the MAAS domain that will be used to deploy the Palette cluster.
+maas-control-plane-resource-pool = "REPLACE_ME" # Provide a resource pool for the control plane nodes.
+maas-control-plane-azs = ["REPLACE_ME"] # Provide a set of availability zones for the control plane nodes.
+maas-control-plane-node-tags = ["REPLACE_ME"] # Provide a set of node tags for the control plane nodes.
+maas-control-node-min-cpu = REPLACE_ME # Minimum number of CPU cores required for control plane nodes
+maas-control-node-min-memory-mb = REPLACE_ME # Minimum amount of RAM (memory) required for control plane nodes
+maas-worker-resource-pool = "REPLACE_ME" # Provide a resource pool for the worker nodes.
+maas-worker-azs = ["REPLACE_ME"] # Provide a set of availability zones for the worker nodes.
+maas-worker-node-tags = ["REPLACE_ME"] # Provide a set of node tags for the worker nodes.
+maas-worker-node-min-cpu = REPLACE_ME # Minimum number of CPU cores required for worker nodes
+maas-worker-node-min-memory-mb = REPLACE_ME # Minimum amount of RAM (memory) required for worker nodes
###############################
# manifests/metallb-values.yaml
###############################
-metallb-ip-pool = ["REPLACE ME"] # IP addresses to be assigned for use by MetalLB
+metallb-ip-pool = "REPLACE_ME" # IP addresses to be assigned for use by MetalLB. Example 192.168.0.1-192.168.0.4
###############################
# manifests/ubuntu-values.yaml
###############################
-node-network = "REPLACE ME" # IP addresses to be assigned for use by MetalLB
+node-network = "REPLACE_ME" # IP addresses to be assigned for use by the Ubuntu Kubelet services.
#####################
-# virtual_machines.tf
+# virtual_machines.tf - we recommend leaving these values as is to avoid issues with other resource requirements.
#####################
vm-deploy-namespace = "virtual-machines" # Namespace where your VM will be deployed.
-vm-deploy-name = "REPLACE ME" # The name of your VM
-vm-labels = ["REPLACE ME"] # Labels that will be applied to your VM.
-vm-storage-Gi = "50Gi" # Size of the disk (PVC) that your VM will have.
+vm-storage-Gi = "50Gi" # Size of the disk (PVC) that your VM will have. Leave this value at 50Gi.
vm-cpu-cores = 2 # Number of CPU cores your VM will have.
vm-cpu-sockets = 1 # Number of physical CPU sockets the CPU cores should be spread over.
-vm-cpu-threads = 2 # Number of CPU threads to use for the VM CPU
+vm-cpu-threads = 1 # Number of CPU threads to use for the VM CPU
vm-memory-Gi = "4Gi" # Amount of RAM (memory) your VM will have
+
+#####################
+# vmo-values.tf
+####################
+vmo-network-interface = "br0" # The name of the host network interface VMO will use. Default is 'br0'
+vm-vlans = "1" # VLANs your VMs must be able to communicate on. Default is "1" which is `untagged`.
+host-vlans = "1" # VLANs your VMO host needs to communicate on. Default is "1" which is `untagged`.
From a1b530fdb192e422117d4d8e424e23a7a26c9d75 Mon Sep 17 00:00:00 2001
From: kenheaslip-sc
Date: Thu, 19 Jun 2025 10:00:21 -0400
Subject: [PATCH 11/11] Final-Commit
---
terraform/vmo-cluster/data.tf | 4 ---
terraform/vmo-cluster/inputs.tf | 30 +++++++++++--------
.../manifests/vmo-extras-manifest.yaml | 22 +++-----------
terraform/vmo-cluster/terraform.tfvars | 22 +++++++-------
.../virtual-machine-missing-values.tftest.hcl | 2 +-
...virtual-machines-replace-values.tftest.hcl | 6 +---
terraform/vmo-cluster/virtual_machines.tf | 4 +--
7 files changed, 35 insertions(+), 55 deletions(-)
diff --git a/terraform/vmo-cluster/data.tf b/terraform/vmo-cluster/data.tf
index 2b15c62..173f02c 100644
--- a/terraform/vmo-cluster/data.tf
+++ b/terraform/vmo-cluster/data.tf
@@ -8,10 +8,6 @@ data "spectrocloud_registry" "public_registry" {
name = "Public Repo"
}
-######
-# MAAS
-######
-
data "spectrocloud_cloudaccount_maas" "account" {
count = var.deploy-maas ? 1 : 0
name = var.pcg-name
diff --git a/terraform/vmo-cluster/inputs.tf b/terraform/vmo-cluster/inputs.tf
index 70805fd..f6fbbe5 100644
--- a/terraform/vmo-cluster/inputs.tf
+++ b/terraform/vmo-cluster/inputs.tf
@@ -47,6 +47,7 @@ variable "tags" {
variable "maas-control-node-min-cpu" {
type = number
description = "Minimum number of CPU cores allocated to the Control Plane node."
+ default = 8
validation {
condition = var.deploy-maas ? var.maas-control-node-min-cpu > 0 : true
@@ -57,6 +58,7 @@ variable "maas-control-node-min-cpu" {
variable "maas-control-node-min-memory-mb" {
type = number
description = "Minimum amount of RAM allocated to the Control Plane node."
+ default = 32
validation {
condition = var.deploy-maas ? var.maas-control-node-min-memory-mb > 0 : true
@@ -67,6 +69,7 @@ variable "maas-control-node-min-memory-mb" {
variable "maas-worker-node-min-cpu" {
type = number
description = "Minimum number of CPU cores allocated to the worker node."
+ default = 8
validation {
condition = var.deploy-maas ? var.maas-worker-node-min-cpu > 0 : true
@@ -77,6 +80,7 @@ variable "maas-worker-node-min-cpu" {
variable "maas-worker-node-min-memory-mb" {
type = number
description = "Minimum amount of RAM allocated to the worker node."
+ default = 32
validation {
condition = var.deploy-maas ? var.maas-worker-node-min-memory-mb > 0 : true
@@ -117,7 +121,7 @@ variable "pcg-name" {
variable "maas-domain" {
type = string
- description = "MAAS domain"
+ description = "The name of the MAAS domain."
validation {
condition = var.deploy-maas ? var.maas-domain != "REPLACE ME" && var.maas-domain != "" : true
@@ -185,23 +189,23 @@ variable "maas-control-plane-node-tags" {
}
}
-#####################
+################################
# /manifests/metallb-values.yaml
-#####################
+################################
variable "metallb-ip-pool" {
type = string
- description = "CIDR notation subnets or IP range ex. 192.168.1.0/24 or 192.168.1.0-192.168.1.255"
+ description = "CIDR notation subnets or IP range for MetalLb. For example, 192.168.1.0/24 or 192.168.1.0-192.168.1.255."
validation {
condition = var.deploy-maas ? var.metallb-ip-pool != "REPLACE ME" && length(var.metallb-ip-pool) != 0 : true
- error_message = "Provide a valid Subnet (CIDR Notation) or IP Range (192.168.1.0-192.168.1.255) for MetalLB."
+ error_message = "Provide a valid subnet (CIDR Notation) or IP Range (192.168.1.0-192.168.1.255) for MetalLB."
}
}
-#################
+############################
# /manifests/vmo-values.yaml
-#################
+############################
variable "vmo-network-interface" {
type = string
@@ -226,9 +230,9 @@ variable "host-vlans" {
default = "1"
}
-#################
+###############################
# /manifests/ubuntu-values.yaml
-#################
+###############################
variable "node-network" {
type = string
@@ -283,14 +287,14 @@ variable "vm-storage-Gi" {
validation {
condition = var.deploy-maas ? var.vm-storage-Gi != "REPLACE ME" && length(var.vm-storage-Gi) != 0 && endswith((var.vm-storage-Gi), "Gi") : true
- error_message = "Provide a valid amount of storage for your VM. You must include 'Gi' at the end of your numerical value. Example: '50Gi'."
+ error_message = "Provide a valid amount of storage for your VM. You must include 'Gi' at the end of your numerical value. For example, '50Gi'."
}
}
variable "vm-cpu-cores" {
type = number
description = "Number of CPU cores to allocate to your VM."
- default = 1
+ default = 4
validation {
condition = var.deploy-maas ? var.vm-cpu-cores > 0 : true
@@ -323,9 +327,9 @@ variable "vm-cpu-threads" {
variable "vm-memory-Gi" {
type = string
description = "The amount of storage to provision for your VM in Gi."
-
+ default = "8Gi"
validation {
condition = var.deploy-maas ? var.vm-memory-Gi != "REPLACE ME" && length(var.vm-memory-Gi) != 0 && endswith((var.vm-memory-Gi), "Gi") : true
- error_message = "Provide a valid amount of memory to allocate your VM. You must include 'Gi' at the end of your numerical value. Example: '4Gi'."
+ error_message = "Provide a valid amount of memory to allocate your VM. You must include 'Gi' at the end of your numerical value. For example, '4Gi'."
}
}
\ No newline at end of file
diff --git a/terraform/vmo-cluster/manifests/vmo-extras-manifest.yaml b/terraform/vmo-cluster/manifests/vmo-extras-manifest.yaml
index a8bea4e..eb99934 100644
--- a/terraform/vmo-cluster/manifests/vmo-extras-manifest.yaml
+++ b/terraform/vmo-cluster/manifests/vmo-extras-manifest.yaml
@@ -29,10 +29,11 @@ spec:
labels:
kubevirt.io/size: small
kubevirt.io/domain: hellouni
+ app: hello-universe
spec:
domain:
cpu:
- cores: 2
+ cores: 4
sockets: 1
threads: 1
devices:
@@ -52,9 +53,9 @@ spec:
type: q35
resources:
limits:
- memory: 2Gi
+ memory: 16Gi
requests:
- memory: 2Gi
+ memory: 8Gi
networks:
- name: default
pod: {}
@@ -133,21 +134,6 @@ spec:
---
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRoleBinding
-metadata:
- labels:
- app.kubernetes.io/name: virtual-machine-orchestrator
- name: virtual-machine-orchestrator
-roleRef:
- apiGroup: rbac.authorization.k8s.io
- kind: ClusterRole
- name: cluster-admin
-subjects:
-- kind: ServiceAccount
- name: virtual-machine-orchestrator
- namespace: vm-dashboard
----
-apiVersion: rbac.authorization.k8s.io/v1
-kind: ClusterRoleBinding
metadata:
name: cluster-admin
subjects:
diff --git a/terraform/vmo-cluster/terraform.tfvars b/terraform/vmo-cluster/terraform.tfvars
index f5dee74..aaefca1 100644
--- a/terraform/vmo-cluster/terraform.tfvars
+++ b/terraform/vmo-cluster/terraform.tfvars
@@ -11,25 +11,25 @@ palette-user-id = "REPLACE_ME" # Your Palette user ID
# MAAS Deployment Settings
############################
-deploy-maas = true # Set to true to deploy to a new VMO cluster to MAAS.
-deploy-maas-vm = true # Set to true to create a VM on MAAS VMO cluster once deployed.
+deploy-maas = false # Set to true to deploy a new VMO cluster to MAAS.
+deploy-maas-vm = false # Set to true to create a VM on the MAAS VMO cluster once deployed.
pcg-name = "REPLACE_ME" # Provide the name of the PCG that will be used to deploy the Palette cluster.
maas-domain = "REPLACE_ME" # Provide the MAAS domain that will be used to deploy the Palette cluster.
maas-control-plane-resource-pool = "REPLACE_ME" # Provide a resource pool for the control plane nodes.
maas-control-plane-azs = ["REPLACE_ME"] # Provide a set of availability zones for the control plane nodes.
maas-control-plane-node-tags = ["REPLACE_ME"] # Provide a set of node tags for the control plane nodes.
-maas-control-node-min-cpu = REPLACE_ME # Minimum number of CPU cores required for control plane nodes
-maas-control-node-min-memory-mb = REPLACE_ME # Minimum amount of RAM (memory) required for control plane nodes
+maas-control-node-min-cpu = 8 # Minimum number of CPU cores required for control plane nodes.
+maas-control-node-min-memory-mb = 32768 # Minimum amount of RAM (memory) required for control plane nodes.
maas-worker-resource-pool = "REPLACE_ME" # Provide a resource pool for the worker nodes.
maas-worker-azs = ["REPLACE_ME"] # Provide a set of availability zones for the worker nodes.
maas-worker-node-tags = ["REPLACE_ME"] # Provide a set of node tags for the worker nodes.
-maas-worker-node-min-cpu = REPLACE_ME # Minimum number of CPU cores required for worker nodes
-maas-worker-node-min-memory-mb = REPLACE_ME # Minimum amount of RAM (memory) required for worker nodes
+maas-worker-node-min-cpu = 8 # Minimum number of CPU cores required for worker nodes.
+maas-worker-node-min-memory-mb = 32768 # Minimum amount of RAM (memory) required for worker nodes
###############################
# manifests/metallb-values.yaml
###############################
-metallb-ip-pool = "REPLACE_ME" # IP addresses to be assigned for use by MetalLB. Example 192.168.0.1-192.168.0.4
+metallb-ip-pool = "REPLACE_ME" # IP addresses to be assigned for use by MetalLB. For example, 192.168.0.1-192.168.0.4.
###############################
# manifests/ubuntu-values.yaml
@@ -41,10 +41,10 @@ node-network = "REPLACE_ME" # IP addresses to be assigned for use by the Ubuntu
#####################
vm-deploy-namespace = "virtual-machines" # Namespace where your VM will be deployed.
vm-storage-Gi = "50Gi" # Size of the disk (PVC) that your VM will have. Leave this value at 50Gi.
-vm-cpu-cores = 2 # Number of CPU cores your VM will have.
-vm-cpu-sockets = 1 # Number of physical CPU sockets the CPU cores should be spread over.
-vm-cpu-threads = 1 # Number of CPU threads to use for the VM CPU
-vm-memory-Gi = "4Gi" # Amount of RAM (memory) your VM will have
+vm-cpu-cores = 2 # The number of CPU cores your VM will have.
+vm-cpu-sockets = 1 # The umber of physical CPU sockets the CPU cores should be spread over.
+vm-cpu-threads = 1 # The umber of CPU threads to use for the VM CPU.
+vm-memory-Gi = "4Gi" # The amount of RAM (memory) your VM will have.
#####################
diff --git a/terraform/vmo-cluster/tests/virtual-machine-missing-values.tftest.hcl b/terraform/vmo-cluster/tests/virtual-machine-missing-values.tftest.hcl
index bd64f34..4e1895b 100644
--- a/terraform/vmo-cluster/tests/virtual-machine-missing-values.tftest.hcl
+++ b/terraform/vmo-cluster/tests/virtual-machine-missing-values.tftest.hcl
@@ -1,6 +1,6 @@
# Copyright (c) Spectro Cloud
# SPDX-License-Identifier: Apache-2.0
-# Test case 4 - Verify PCG name, domain, resource pools, AZs and node tags cannot be empty.
+# Test case 4 - Verify VM Variables cannot be empty.
variables {
deploy-maas = true
diff --git a/terraform/vmo-cluster/tests/virtual-machines-replace-values.tftest.hcl b/terraform/vmo-cluster/tests/virtual-machines-replace-values.tftest.hcl
index dda2366..3b8b332 100644
--- a/terraform/vmo-cluster/tests/virtual-machines-replace-values.tftest.hcl
+++ b/terraform/vmo-cluster/tests/virtual-machines-replace-values.tftest.hcl
@@ -1,6 +1,6 @@
# Copyright (c) Spectro Cloud
# SPDX-License-Identifier: Apache-2.0
-# Test case 5 - Verify PCG name, domain, resource pools, AZs and node tags cannot have REPLACE ME values.
+# Test case 5 - Verify VM variables cannot have REPLACE ME values.
variables {
@@ -12,10 +12,6 @@ vm-cpu-cores = 2
vm-cpu-sockets = 1
vm-cpu-threads = 2
vm-memory-Gi = "REPLACE ME"
-
-
-
-
}
mock_provider "spectrocloud" {
diff --git a/terraform/vmo-cluster/virtual_machines.tf b/terraform/vmo-cluster/virtual_machines.tf
index cc45d51..1a1f254 100644
--- a/terraform/vmo-cluster/virtual_machines.tf
+++ b/terraform/vmo-cluster/virtual_machines.tf
@@ -8,9 +8,7 @@ resource "spectrocloud_virtual_machine" "virtual-machine" {
cluster_uid = data.spectrocloud_cluster.maas_vmo_cluster[0].id
cluster_context = data.spectrocloud_cluster.maas_vmo_cluster[0].context
-
- #run_on_launch = true
- run_strategy = "Halted"
+ run_strategy = "Always"
namespace = var.vm-deploy-namespace
name = var.vm-deploy-name