Nutanix Kubernetes Engine | Nutanix Community
Skip to main content

Nutanix Kubernetes Engine

Kubernetes Management Made Simple

  • 113 Topics
  • 308 Replies

Backing Up Karbon Kubernetes clusters with Velero and Nutanix Objects

  • 4
  • 0

Latest Nutanix Karbon How-To Videos

  • 2
  • 2

Tillerless Helm on Nutanix Karbon

  • 9
  • 2
113 Topics
K
KarangDikaTrailblazer
asked in Nutanix Kubernetes Engine
Failed to deploy kubernetes cluster (Failed to deploy ntnx dvp)

Hi,I’m trying to explore kubernetes by deploying Development Cluster. But it only stuck at 8% and eventually failed with notification (Internal Error : Failed to deploy ntnx dvp).Here is my detailSegment 192.168.2.x for Guest VM,PC,AOS and AHV. Segment 192.168.3.x for Kubernetes cluster itself (DHCP Enabled)Each segment can ping each other and all those segments are able to access the internet.Here is the detail of the temporary deployed Karbon VM (After failed deploying, the VM got deleted automatically)I’ve been reading someone posted same problem like mine, and it solved because of the VM previously unable to access the internet. But mine is able to access internet, PC and the Internal Nutanix.Perhaps someone can enlighten me what did i do wrong?-Able to pull newest docker image-Able to ping Prism Central (192.168.2.11)-Able to ping CVM (192.168.2.2)-Able to access internetDeploying Cluster stuck at 8%Deleting VM after failure deploymentNotification Internal Error : Failed to deploy

144011
K
3 years ago
R
RonnyLPathfinder
asked in Nutanix Kubernetes Engine
Multiple worker node pools in Karbon

Node sizes are set when creating a kubernetes cluster in Karbon. These sizes cannot be changed once the cluster has been built. While this is fine, it would be nice if it was possible to have several worker node pools with different node sizes in a cluster, like in AKS (https://docs.microsoft.com/en-us/azure/aks/use-multiple-node-pools). As of now , we need to create several clusters to have worker nodes of different sizes, and this adds more master and etcd nodes as well as the need for a new subnet.For example, we could create a node pool for applications with high memory needs and another for applications that need more CPU in the same cluster. Then, we could specify which named pool we wanted to deploy to.With storage, we already have the option to create several kinds of storage, fast, slow, object, and so on.

3621
JoseNutanix
Nutanix Employee
3 years ago
V
VaccanoAdventurer
asked in Nutanix Kubernetes Engine
Minimum Permissions Required for Karbon kubectl Access?

I need to create a role that will be able to get the 24 hour certificate to be able to run `kubectl` calls against Karbon.When I look at the role creation page, there are a lot of options there.  I am a bit overwhelmed in trying to figure out what permissions I need to just grant this one function.What permissions are needed for a user to be able to get the 24 hour certificate to be able to run `kubectl` commands?

1732
AnishWalia20
Nutanix Employee
3 years ago
N
nethraWayfarer
asked in Nutanix Kubernetes Engine
Passing File Reference Into Yaml File For K8

I'm writing a yaml file to create a pod. And i have to pass multiple json files into the docker container. How can i pass these files into the yaml file dynamically?

3102
AnishWalia20
Nutanix Employee
3 years ago
ashwin.ramaswamy
Nutanix Employee
ashwin.ramaswamyNutanix Employee
posted in Nutanix Kubernetes Engine
Karbon Platform Services Project User Guide

Karbon Platform Services OverviewKarbon Platform Services is a Kubernetes-based multicloud platform as a service that enables rapid development and deployment of microservice-based applications. These applications can range from simple stateful containerized applications to complex web-scale applications across any cloud.In its simplest form, Karbon Platform Services consists of a Service Domain encapsulating a project, application, and services infrastructure, and other supporting resources. It also incorporates project and administrator user access and cloud and data pipelines to help converge edge and cloud data.With Karbon Platform Services, you can: Quickly build and deploy intelligent applications across a public or private cloud infrastructure. Connect various mobile, highly distributed data sensors (like video cameras, temperature or pressure sensors, streaming devices, and so on) to help collect data. Create intelligent applications using data connectors and machine learni

2350
ashwin.ramaswamy
Nutanix Employee
3 years ago
A
abbasiVoyager
asked in Nutanix Kubernetes Engine
karbon shared volume for all pods

Good dayI have a questions regarding PVs on Karbon Clusters.Is there a way to access Persistent Volumes created by Kubernetes on all pods ? or if we can have nfs share on all pods ? basically we need to share some files to be exist on all pods . thanks in advance .

4452
A
4 years ago
C
CeciaVoyager
asked in Nutanix Kubernetes Engine
Keycloack operator/PotgresSQL permission denied

Hello everyone,  I'm having some trouble using the keycloak operator installing on a simple Kubernetes Cluster on Karbon Basically, what happens is that when I install a new Keycloak, the PostgresSQL is not able to run properly because it does not have permissions to create a new directory on /var/lib/pgsql/data/userdata As far as I understood, the problem is related to the securityContext which is not set to the postgres deployment even if Postgres runs always using user 26 (as can be noted here: https://catalog.redhat.com/software/containers/rhscl/postgresql-10-rhel7/5aa63541ac3db95f196086f1?container-tabs=dockerfile) I had to do a lot of workarounds to make it work, and finally I succeded by configuring manually the security context as follows: securityContext:  fsGroup: 26  runAsUser: 26 There is any possibility to set the security context via the operator? if not, can you please point me out what is the correct solution to apply?

8671
vshuguet
Nutanix Employee
4 years ago
D
Daniel-UnicoVoyager
asked in Nutanix Kubernetes Engine
Nutanix DVP

Dear CommunityScenarioI’m currently testing Nutanix DVP (Link) on Centos 7 with Netbox Docker (Link).I’m overriding the original volume definition in the Docker Compose file. Instead of the local driver I use nutanix:latest. volumes:   netbox-static-files:     driver: nutanix:latest   netbox-nginx-config:     driver: nutanix:latest   netbox-media-files:     driver: nutanix:latest   netbox-postgres-data:     driver: nutanix:latest   netbox-redis-data:     driver: nutanix:latestI’m then able to start and use Netbox Docker (docker compose up -d).Problem/SymptomsWhen I’m stopping Netbox Docker with docker compose down usually I’m able to bring up Netbox Docker again. Sometimes this works up to three times. But after a few times of up and down it isn’t possible anymore. If it doesn’t work anymore, following error is shown while starting:root@b2cntr-dckwor02[13:06:08]/var/projects/netbox-docker$ docker-compose up -d Creating network "netbox-docker_default" with the default driver Creating ne

4081
Ateiv
4 years ago
K
Keith33Adventurer
asked in Nutanix Kubernetes Engine
Karbon CSR Request Stuck in Approved State

Hello, After a new deployment, I downloaded the kubeconfig and upon trying to approve a Certificate Signing Request (CSR), the csr just sits in an approved state, but never becomes Issued. Is there a restriction or something on the default-kubernetes-<clustername> user that I might not be familiar with? That or maybe my process is wrong, its odd that it just sits in an Approved state. Any help is appreciated!

8589
K
4 years ago
C
cjpVoyager
asked in Nutanix Kubernetes Engine
Creating clusters with Calico

I just upgraded Karbon to 2.1 to gain access to the new support for Calico and was after some tips on how to create a cluster using it for networking.As I understand Calico can only be used if a cluster is created via API and not web UI. I’m assuming this is just because it didn’t make release and not another reason such as it having any issues or not being production ready? Similarly, are there any known issues currently I should be aware of?With regards to the POST I need to make to create a cluster, is there some guidance on setting the options under cni_config, specifically the cidr in ip_pool_configs and its relation to pod_ipv4_cidr, service_ipv4_cidr and node_cidr_mask_size.Thanks,Callum

4682
C
4 years ago
Sateesh
Nutanix Employee
SateeshNutanix Employee
posted in Nutanix Kubernetes Engine
Karbon Platform Services: Creating an Application

You can create intelligent applications to run on the Service Domain infrastructure or the cloud where you have pushed collected data. You can implement application YAML files to use as a template, where you can customize the template by passing existing Categories associated with a Service Domain to it.You need to create a project with at least one user to create an app. Creating an Application:Create a Kubernetes application that you can associate with a project. Before you begin To complete this task, log on to the cloud management console. If your app requires a service, make sure you enable it in the associated project. Application YAML files can also be a template where you can customize the template by passing existing Categories associated with a Service Domain to it. See also Configure Service Domain Environment Variables to set and use environment variables in your app. Nutanix recommends that you do not reuse application names after creating and then deleting (removing) an a

2910
Sateesh
Nutanix Employee
4 years ago
Q
QiruiAdventurer
asked in Nutanix Kubernetes Engine
Question about "SSH Access" in Karbon Cluster tab

Hi, I am a Newbie for Nutanix Karbon and I would like to know that whether the “SSH Access” under the Cluster tab allows to access node in any Kubernetes cluster or it only allows to access a node that is in a Karbon-created Kubernetes cluster?

9503
vshuguet
Nutanix Employee
4 years ago
Q
QiruiAdventurer
asked in Nutanix Kubernetes Engine
Does Nutanix Karbon 2.0 support Windows node now?

Does Nutanix Karbon 2.0 support Windows node now? I was planing to create windows nodes using Karbon service but does not know whether Karbon 2.0 support that.

5663
vshuguet
Nutanix Employee
4 years ago
Jubran
Nutanix Employee
JubranNutanix Employee
posted in Nutanix Kubernetes Engine
How to setup and use Karbon

What is Karbon? Nutanix Karbon is a curated turnkey offering that provides simplified provisioning and operations of Kubernetes clusters. Kubernetes is an open source container orchestration system for deploying and managing container-based applications. The Karbon web console simplifies the deployment and management of Kubernetes clusters with a simple GUI and built-in event monitoring tools. There are built-in add-ons such as Kibana and Prometheus for parsing logs and monitoring alert triggering mechanism in you cluster. Using Karbon you can:  Deploy Kubernetes clusters. Use Nutanix Volumes and Nutanix Files storage for your applications. Manage Kubernetes cluster resources. Upgrade your Kubernetes deployment. Ensure high-availability. To set up your Karbon environment, perform the following tasks: Enable Karbon through Prism Central, Enabling Karbon Download an image, see OS Images Create clusters, see Creating a Cluster Download the kubeconfig, Downloading the Kubeconfig Configure

79328
J
4 years ago
Riddhima.singh
Nutanix Employee
Riddhima.singhNutanix Employee
posted in Nutanix Kubernetes Engine
What is Karbon?

 Nutanix Karbon is a curated turnkey offering that provides simplified provisioning and operations of Kubernetes clusters. Kubernetes is an open source container orchestration system for deploying and managing container-based applications. You can also set up an offline Karbon environment using the Karbon airgap, Karbon uses the CentOS Linux-based operating systems for Karbon-enabled Kubernetes cluster creation. Linux containers provide the flexibility to deploy applications in different environments with consistent results. Karbon streamlines the deployment and management of Kubernetes clusters with a simple GUI integrated into Prism Central (PC). Kibana, the built-in add-on, lets you filter and parse logs for systems, pods, and nodes. Prometheus, another add-on, provides a monitoring mechanism that triggers alerts on your cluster. Karbon also uses Pulse, Prism's health-monitoring system, which interacts with Nutanix Support to expedite cluster issue resolutions.To set up your Karbon

9910
Riddhima.singh
Nutanix Employee
4 years ago
maaz
Nutanix Employee
maazNutanix Employee
posted in Nutanix Kubernetes Engine
Enabling Nutanix Karbon

Karbon orchestrates Kubernetes clusters to simplify the provisioning and management of containerized applications. Kubernetes packages applications in their own dedicated containers together with all of the required operational components for running the application. Containers , which run inside of pods on top of nodes, are the core building block of Kubernetes architecture. Using Karbon to manage Kubernetes operations requires a basic familiarity with key Kubernetes concepts. Requirements: Ensure that the configuration of the Prism Element (PE) cluster meets the following specifications: AHV A minimum 120 MB of memory and 700 MB of disk space in PC  Firewall Requirements:Ensure that your firewall allows Karbon VMs and CVMs to reach the following domains and sub-domains *.cloudfront.net *.quay.io ntnx-portal.s3.amazonaws.com portal.nutanix.com release-api.nutanix.com   Enabling Karbon: Log on to Prism Central. Click the collapsed menu icon. In the Services option, clic

7720
maaz
Nutanix Employee
4 years ago
A
AlanC75Voyager
asked in Nutanix Kubernetes Engine
Karbon alarms notifications

Hello,it would be nice to be able to send emails (or teams, slack) notifications whenever a critical alarm is fired in the karbon alert section.At least i can’t find a way to do it right now.Is it possible?Thanks

6603
vshuguet
Nutanix Employee
4 years ago
ashwin.ramaswamy
Nutanix Employee
ashwin.ramaswamyNutanix Employee
posted in Nutanix Kubernetes Engine
Karbon Airgap (dark site) FAQ and Guide

FAQs What is the Airgap feature? Airgap feature is useful for customers in a dark site environment without Internet access or with relatively low Internet bandwidth that would like to use Karbon. Up until the introduction of the Airgap feature, Karbon was only available with sites connected to the Internet. The Airgap feature is also helpful for customers that face Karbon cluster deployment timeouts due to slow image pull speeds.  When was the Airgap feature introduced? Karbon version 2.0.  How to enable Airgap mode for Karbon? Please refer to Karbon Admin Guide (here) for the latest instructions. As of Karbon 2.0: Karbon Airgap is enabled via karbonctl. The overview of the process of Karbon 2.0, is as follows: The Airgap bundle is downloaded from the Nutanix Portal and extracted to a directory on a web server accessible from Prism Central. Using karbonctl, perform a login to authenticate with the Prism Central username and password. Logging in prevents the need to repeatedly provide

21163
ashwin.ramaswamy
Nutanix Employee
4 years ago
Alona
Nutanix Employee
AlonaNutanix Employee
posted in Nutanix Kubernetes Engine
You created a Kubernetes cluster, now what? Download Kubeconfig

The Kubeconfig is a configuration file for running kubectl commands against the deployed Kubernetes cluster. To deploy applications on your cluster using kubectl, download the Kubernetes cluster configuration file (Kubeconfig) to your host. The Kubeconfig token expires after 24 hours. This is a security feature by design in Karbon. A fresh and valid kubeconfig can be obtained using Karbon UI or using karbonctl. Ensure that you have downloaded kubectl to the machine from which you manage the cluster. Karbonctl has undergone some improvements. You no longer need to pass the password via cleartext nor do you need to pass credentials for every karbonctl command. Also, there is no need to pass UUID of the k8s cluster. A simple login to Prims Central CLI and you can retrieve the Kubeconfig. We recommend you upgrade to Karbon 2.0 if you intend to use karbonctl.   For the process of obtaining kubeconfig via Karbon UI refer to Nutanix Karbon Guide: Downloading the Kubeconfig. To perform th

11382
Alona
Nutanix Employee
4 years ago
Anibal Ulisses
Anibal UlissesTrailblazer
asked in Nutanix Kubernetes Engine
Use internal ca certificate chain on Karbon

Hi, My company have a internal CA certificate chain and I need to install the internal ca.crt on Karbon, it’s possible? Use case, install a pod using kubectl from a internal registry are not possible due they didn’t know the root CA authority installed at the registry server. Anibal

26636
AnishWalia20
Nutanix Employee
4 years ago
K
KeoNaaneAdventurer
asked in Nutanix Kubernetes Engine
Karbon Nodes TimeZone

Hi all  We have karbon clusters running in our Nutanix environment, and I noticed the timezone in the Karbon cluster is not the same as that in other VMs on the Nutanix cluster.  The time zone set for the Nutanix cluster is SAST (UTC +2), and the Karbon VMs timezone is UTC (UTC +0).  The UTC+0 timezone is only on the Karbon Nodes.  It seems it doesn’t use the Nutanix Cluster’s timezone, our logs are 2 hours behind on Karbon Clusters(all 3 cluster).  Is there a way to change the timezone for Karbon?  

29008
AnishWalia20
Nutanix Employee
4 years ago
Anibal Ulisses
Anibal UlissesTrailblazer
asked in Nutanix Kubernetes Engine
Manually adjust the kube-apiserver?

Hi, It’s possible to manually adjust the file /var/nutanix/etc/kubernetes/manifests/kube-apiserver.yaml and apply this update into the kubernetes cluster? I tried to adjust and after run: sudo systemctl daemon-reload && sudo systemctl restart kubelet-master But when I describe the kube-api pod I see that the adjusts are not applied. Anibal

638519
Anibal Ulisses
4 years ago
Anibal Ulisses
Anibal UlissesTrailblazer
asked in Nutanix Kubernetes Engine
Enable PodPreset

Hi, Someone know if we can enable PodPreset on the Karbon? (https://kubernetes.io/docs/concepts/workloads/pods/podpreset/#enable-pod-preset) Basically my cluster are under a Proxy and I can’t deploy application under Pod because they need to access the internet, with the PodPreset I can configure the proxy information like this https://docs.gitlab.com/ee/topics/autodevops/index.html#installing-helm-behind-a-proxy

287312
Anibal Ulisses
4 years ago
MVerhaeghe
MVerhaegheVoyager
asked in Nutanix Kubernetes Engine
Karbon API Deployment - Autentification Error

Hi all,  I tried to deploy a Karbon Development Cluster by using Karbon API, but I encounter an error with authentication.    {"message_list":{"Unauthorized":"Failed to get authentication info"},"status_code":401} The command for calling Karbon API is :  curl -k -X POST -d @create-cluster-dev.json --header "Content-Type: application/json" --header "Accept: application/json" --user $NUTANIX_USER:$NUTANIX_USER_PASS "https://xxx.xxx.xxx.xxx:9440/karbon/acs/k8s/cluster"   When I try to use other Prism API command, like cluster or vm with these command below,, everything works fine, so I don’t think that my login/password are wrong. I haven’t seen much more into nutanix log file, but maybe i’m looking at the wrong place (/data/logs).  curl -k -X POST -d @nutanix-list-cluster.json --header "Content-Type: application/json" --header "Accept: application/json" --user $NUTANIX_USER:$NUTANIX_USER_PASS "https://xxx.xxx.xxx.xxx:9440/api/nutanix/v3/clusters/list"   Has anyone encountered th

27736
AnishWalia20
Nutanix Employee
4 years ago
Anibal Ulisses
Anibal UlissesTrailblazer
asked in Nutanix Kubernetes Engine
Karbon integration with GitLab

Hi, someone have experience integrating GitLab with Karbon? Basically I’m looking for automatic deployment from gitlab to karbon.

37736
Anibal Ulisses
4 years ago

Badges

Show all badges
Terms & Conditions