Skip to main content

Cloud Native

Nutanix enables customers to innovate faster with a complete, enterprise-ready cloud native stack.

125 Topics
M
Moises S FAdventurer
asked in Nutanix Kubernetes Engine (NKE)
Karbon, Rancher and similars

Hello friends,From what I have read in the Karbon documentation, as well as from YouTube videos, through karbon in AHV I cannot manage aspects of the containers, the applications themselves, load balancing, reverse proxy, container images, etc. Is that right?Associated with this, if Karbon does not in fact have such features, is it possible to use Karbon in conjunction with tools that have the above features, like Rancher? Has anyone had this experience?

8631
JoseNutanix
Nutanix Employee
R
RanuAdventurer
asked in Nutanix Kubernetes Engine (NKE)
Kubernetes Cluster deployment failing

We have enable karbon on a 3-node nutanix cluster but kubernetes deployment is failing with below error. Any ideas?2021-04-06T07:58:33.103Z k8s_deploy.go:167: [error] [k8s_cluster=Ranu-Demo] failed to create worker node pool and deploy worker nodes(VMs): failed to deploy K8s cluster: failed to deploy worker nodes: Operation timed out2021-04-06T07:58:33.103Z k8s_deploy.go:882: [error] [k8s_cluster=Ranu-Demo] Error seen in configuring worker node: "Operation timed out"2021-04-06T07:58:33.125Z k8s_lib_deploy_task.go:113: [error] [k8s_cluster=Ranu-Demo] failed to deploy K8s cluster: failed to create worker node pool and deploy worker nodes(VMs): failed to deploy K8s cluster: failed to deploy worker nodes: Operation timed out2021-04-06T07:58:33.125Z k8s_lib_deploy_task.go:78: [info] [k8s_cluster=Ranu-Demo] token refresher received stopRefresh2021-04-06T07:58:36.03Z deploy_k8s_task.go:365: [error] [k8s_cluster=Ranu-Demo] Cluster Ranu-Demo:failed to deploy K8s cluster: failed to create worker

6561
maaz
Nutanix Employee
A
Alan CVoyager
posted in Nutanix Kubernetes Engine (NKE)
Permanent karbon kubeconfig file

If you are annoyed, as myself, about renewing the kubeconfig every 24 hours, i’ve created a simple script that generates a permanent kubeconfig file without expiration.This script makes sense, obviously, if you have more than 1 karbon cluster to manage.#!/bin/bashif [ -n "$1" ]; then        echo Cluster name: $1.else        echo "No cluster name has been specified. "    exit 1fikubectl create serviceaccount --namespace kube-system superuserkubectl create clusterrolebinding superuser-rule --clusterrole=cluster-admin --serviceaccount=kube-system:superuserA=$(kubectl -n kube-system describe secret/$(kubectl -n kube-system get sa/superuser -o jsonpath='{.secrets[0].name}')|awk '{for(i=1;i<=NF;i++)if($i=="token:")print $(i+1)}')B=$(kubectl config view --flatten --minify|awk '{for(i=1;i<=NF;i++)if($i=="certificate-authority-data:")print $(i+1)}')C=$(kubectl config view --flatten --minify|awk '{for(i=1;i<=NF;i++)if($i=="server:")print $(i+1)}')D=$(kubectl config view --flatten --mini

11394
A
UPX
UPXOutrider
asked in Nutanix Kubernetes Engine (NKE)
Add existing Karbon Cluster to a new Prism Central Instance

Hi everybody,the question is, as i’d to reinstall a new PC Instance (the old one crashed), is there a way to import the configuration of a previously deployed Karbon Cluster in the new PC instance?I would like to manage the old cluster with the new PC.Thank you all

2402
UPX
W
WanexaVoyager
asked in Nutanix Kubernetes Engine (NKE)
Karbon API need new stuffs

Is there a way to retrieve an image OS and k8s version in the api in the future please, need for the ci/cd and deployment.

771
JoseNutanix
Nutanix Employee
V
VaccanoAdventurer
asked in Nutanix Kubernetes Engine (NKE)
Karbon errors can't see anything wrong in Prism Element

I have a Dev Nutanix Cluster that I use to host Kubernetes clusters.  Today I added a large Kuberentes cluster to it (I intended to add it to my Prod Nutanix Cluster, but accidentally added to my Dev Nutanix Cluster).I started to get a lot of alerts from 2 of the 3 Kubernetes clusters hosted on the Dev Nutanix Cluster.  As soon as the install was complete, I deleted the large Kubernetes cluster from the Dev Nutanix Cluster.I figured that since the resources have all been freed up, the cluster would be fine.  But I am still getting errors when using `kubectl`.The two most common are:Error from server: etcdserver: request timed outandUnable to connect to the server: dial tcp 10.62.12.91:443: connectex: No connection could be made because the target machine actively refused it.10.62.12.91 is my control plane host.I have tried to reboot both the etcd server and my control plane host.  That did not fix the issue.I loaded up the Dev Nutanix Cluster in Prim Element and it does not give any er

5851
JoseNutanix
Nutanix Employee
S
senthil_pExplorer
asked in Nutanix Kubernetes Engine (NKE)
Karbon Cluster with static IP

its there any way to create karbon cluster with static ip ? if Yes then how its possible.. default worker node and master nodes are assigned with DHCP ip pools .. we cant mange IPs address. please help us .

2861
JoseNutanix
Nutanix Employee
clindevall
clindevallVoyager
posted in Nutanix Kubernetes Engine (NKE)
Renewing cluster kubeconfig from the command line

Just wanted to share how we are renewing the kubeconfig from the command line. Background: In our organization it was considered a bit clumsy to download the kubeconfig from the Karbon UI. We love the command line and wanted a quick’n’easy way to renew the authentication token. The solution: We created a docker image that contains the “karbonctl” binary and a wrapper script. The Dockerfile was also included into our CI/CD pipeline to automate the image creation. The wrapper script does two things: karbonctl login --pc-ip prism.nightingale.nu --pc-username “$1” karbonctl cluster kubeconfig --cluster-name “$2” >”$3” The commands that the end user run: docker run --rm -it -v “$(pwd)”:/tmp docker.registry.local/karbonctl:latest <login> mycluster /tmp/karbon.cfg export KUBECONFIG=”$(pwd)/karbon.cfg”  

446814
mikkisse
V
VaccanoAdventurer
asked in Nutanix Kubernetes Engine (NKE)
Is Support for Windows (along side Linux) Support Planned for Karbon?

I have seen several posts that indicate that Karbon does not support Windows Containers.  But I have not heard if that is on the roadmap or not.Is it on the roadmap?  Being considered?  Has the idea been considered and discarded?I am interested in what ever information you are able to share about future plans for Karbon in relation to mixed workloads.

2703
L
Nutanix Employee
V
VaccanoAdventurer
asked in Nutanix Kubernetes Engine (NKE)
In Karbon are all users the same user?

When I get a kubeconfig file from Karbon, the user is always default-user-MyClusterNameHere in the kubeconfig file.I am trying to setup RBAC permissions for various users as indicated on your post here: https://next.nutanix.com/community-blog-154/providing-rbac-for-your-karbon-kubernetes-clusters-33132But the user is always the same user (default-user-MyClusterNameHere).  How can I get a user logged in as the actual user that they are?And more, how can I get the groups that my users are in so I do not have to assign permissions to specific users? (We use Active Directory.)UpdateAfter a fair amount of searching, I have found that I can enable OIDC support in a Kubernetes cluster. It looks like I will have to do the following:Setup an OIDC server and make an application in there and note its ClientID and Client Secret Log into the Master Kubernetes nodes and update the file found at /var/nutanix/etc/kubernetes/manifests/kube-apiserver.yaml with the following changes under the - kube-apis

3120
V
J
JAC_BrianAdventurer
asked in Nutanix Kubernetes Engine (NKE)
Clicked Enable button for Karbon—what’d I just do?

So I was starting to read about Karbon kubernetes management in Prism Central, inadvertently clicked the Enable button, and now something's happened/installed but it’s unclear what.Can I uninstall or disable it?Can it even run on ESXi? (It would appear not to be the case)

1002
Chaitrali Deshpande
Nutanix Employee
P
PasqualePathfinder
asked in Nutanix Kubernetes Engine (NKE)
Local Persistent Volume

I would like to know if is it possible to use with Karbon, the Kubernetes Local Persistent Volumes available by version 1.14 of Kubernetes.

600
P
K
KarangDikaTrailblazer
asked in Nutanix Kubernetes Engine (NKE)
Failed to deploy kubernetes cluster (Failed to deploy ntnx dvp)

Hi,I’m trying to explore kubernetes by deploying Development Cluster. But it only stuck at 8% and eventually failed with notification (Internal Error : Failed to deploy ntnx dvp).Here is my detailSegment 192.168.2.x for Guest VM,PC,AOS and AHV. Segment 192.168.3.x for Kubernetes cluster itself (DHCP Enabled)Each segment can ping each other and all those segments are able to access the internet.Here is the detail of the temporary deployed Karbon VM (After failed deploying, the VM got deleted automatically)I’ve been reading someone posted same problem like mine, and it solved because of the VM previously unable to access the internet. But mine is able to access internet, PC and the Internal Nutanix.Perhaps someone can enlighten me what did i do wrong?-Able to pull newest docker image-Able to ping Prism Central (192.168.2.11)-Able to ping CVM (192.168.2.2)-Able to access internetDeploying Cluster stuck at 8%Deleting VM after failure deploymentNotification Internal Error : Failed to deploy

154711
K
R
RonnyLPathfinder
asked in Nutanix Kubernetes Engine (NKE)
Multiple worker node pools in Karbon

Node sizes are set when creating a kubernetes cluster in Karbon. These sizes cannot be changed once the cluster has been built. While this is fine, it would be nice if it was possible to have several worker node pools with different node sizes in a cluster, like in AKS (https://docs.microsoft.com/en-us/azure/aks/use-multiple-node-pools). As of now , we need to create several clusters to have worker nodes of different sizes, and this adds more master and etcd nodes as well as the need for a new subnet.For example, we could create a node pool for applications with high memory needs and another for applications that need more CPU in the same cluster. Then, we could specify which named pool we wanted to deploy to.With storage, we already have the option to create several kinds of storage, fast, slow, object, and so on.

3771
JoseNutanix
Nutanix Employee
V
VaccanoAdventurer
asked in Nutanix Kubernetes Engine (NKE)
Minimum Permissions Required for Karbon kubectl Access?

I need to create a role that will be able to get the 24 hour certificate to be able to run `kubectl` calls against Karbon.When I look at the role creation page, there are a lot of options there.  I am a bit overwhelmed in trying to figure out what permissions I need to just grant this one function.What permissions are needed for a user to be able to get the 24 hour certificate to be able to run `kubectl` commands?

1762
AnishWalia20
Nutanix Employee
N
nethraWayfarer
asked in Nutanix Kubernetes Engine (NKE)
Passing File Reference Into Yaml File For K8

I'm writing a yaml file to create a pod. And i have to pass multiple json files into the docker container. How can i pass these files into the yaml file dynamically?

3192
AnishWalia20
Nutanix Employee
ashwin.ramaswamy
Nutanix Employee
ashwin.ramaswamyNutanix Employee
posted in Nutanix Kubernetes Engine (NKE)
Karbon Platform Services Project User Guide

Karbon Platform Services OverviewKarbon Platform Services is a Kubernetes-based multicloud platform as a service that enables rapid development and deployment of microservice-based applications. These applications can range from simple stateful containerized applications to complex web-scale applications across any cloud.In its simplest form, Karbon Platform Services consists of a Service Domain encapsulating a project, application, and services infrastructure, and other supporting resources. It also incorporates project and administrator user access and cloud and data pipelines to help converge edge and cloud data.With Karbon Platform Services, you can: Quickly build and deploy intelligent applications across a public or private cloud infrastructure. Connect various mobile, highly distributed data sensors (like video cameras, temperature or pressure sensors, streaming devices, and so on) to help collect data. Create intelligent applications using data connectors and machine learni

2480
ashwin.ramaswamy
Nutanix Employee
A
abbasiVoyager
asked in Nutanix Kubernetes Engine (NKE)
karbon shared volume for all pods

Good dayI have a questions regarding PVs on Karbon Clusters.Is there a way to access Persistent Volumes created by Kubernetes on all pods ? or if we can have nfs share on all pods ? basically we need to share some files to be exist on all pods . thanks in advance .

4652
A
C
CeciaVoyager
asked in Nutanix Kubernetes Engine (NKE)
Keycloack operator/PotgresSQL permission denied

Hello everyone,  I'm having some trouble using the keycloak operator installing on a simple Kubernetes Cluster on Karbon Basically, what happens is that when I install a new Keycloak, the PostgresSQL is not able to run properly because it does not have permissions to create a new directory on /var/lib/pgsql/data/userdata As far as I understood, the problem is related to the securityContext which is not set to the postgres deployment even if Postgres runs always using user 26 (as can be noted here: https://catalog.redhat.com/software/containers/rhscl/postgresql-10-rhel7/5aa63541ac3db95f196086f1?container-tabs=dockerfile) I had to do a lot of workarounds to make it work, and finally I succeded by configuring manually the security context as follows: securityContext:  fsGroup: 26  runAsUser: 26 There is any possibility to set the security context via the operator? if not, can you please point me out what is the correct solution to apply?

8721
vshuguet
Nutanix Employee
D
Daniel-UnicoVoyager
asked in Nutanix Kubernetes Engine (NKE)
Nutanix DVP

Dear CommunityScenarioI’m currently testing Nutanix DVP (Link) on Centos 7 with Netbox Docker (Link).I’m overriding the original volume definition in the Docker Compose file. Instead of the local driver I use nutanix:latest. volumes:   netbox-static-files:     driver: nutanix:latest   netbox-nginx-config:     driver: nutanix:latest   netbox-media-files:     driver: nutanix:latest   netbox-postgres-data:     driver: nutanix:latest   netbox-redis-data:     driver: nutanix:latestI’m then able to start and use Netbox Docker (docker compose up -d).Problem/SymptomsWhen I’m stopping Netbox Docker with docker compose down usually I’m able to bring up Netbox Docker again. Sometimes this works up to three times. But after a few times of up and down it isn’t possible anymore. If it doesn’t work anymore, following error is shown while starting:root@b2cntr-dckwor02[13:06:08]/var/projects/netbox-docker$ docker-compose up -d Creating network "netbox-docker_default" with the default driver Creating ne

4211
Ateiv
K
Keith33Adventurer
asked in Nutanix Kubernetes Engine (NKE)
Karbon CSR Request Stuck in Approved State

Hello, After a new deployment, I downloaded the kubeconfig and upon trying to approve a Certificate Signing Request (CSR), the csr just sits in an approved state, but never becomes Issued. Is there a restriction or something on the default-kubernetes-<clustername> user that I might not be familiar with? That or maybe my process is wrong, its odd that it just sits in an Approved state. Any help is appreciated!

8709
K
C
cjpVoyager
asked in Nutanix Kubernetes Engine (NKE)
Creating clusters with Calico

I just upgraded Karbon to 2.1 to gain access to the new support for Calico and was after some tips on how to create a cluster using it for networking.As I understand Calico can only be used if a cluster is created via API and not web UI. I’m assuming this is just because it didn’t make release and not another reason such as it having any issues or not being production ready? Similarly, are there any known issues currently I should be aware of?With regards to the POST I need to make to create a cluster, is there some guidance on setting the options under cni_config, specifically the cidr in ip_pool_configs and its relation to pod_ipv4_cidr, service_ipv4_cidr and node_cidr_mask_size.Thanks,Callum

4772
C
Sateesh
Nutanix Employee
SateeshNutanix Employee
posted in Nutanix Kubernetes Engine (NKE)
Karbon Platform Services: Creating an Application

You can create intelligent applications to run on the Service Domain infrastructure or the cloud where you have pushed collected data. You can implement application YAML files to use as a template, where you can customize the template by passing existing Categories associated with a Service Domain to it.You need to create a project with at least one user to create an app. Creating an Application:Create a Kubernetes application that you can associate with a project. Before you begin To complete this task, log on to the cloud management console. If your app requires a service, make sure you enable it in the associated project. Application YAML files can also be a template where you can customize the template by passing existing Categories associated with a Service Domain to it. See also Configure Service Domain Environment Variables to set and use environment variables in your app. Nutanix recommends that you do not reuse application names after creating and then deleting (removing) an a

2960
Sateesh
Nutanix Employee
Q
QiruiAdventurer
asked in Nutanix Kubernetes Engine (NKE)
Question about "SSH Access" in Karbon Cluster tab

Hi, I am a Newbie for Nutanix Karbon and I would like to know that whether the “SSH Access” under the Cluster tab allows to access node in any Kubernetes cluster or it only allows to access a node that is in a Karbon-created Kubernetes cluster?

9763
vshuguet
Nutanix Employee
Q
QiruiAdventurer
asked in Nutanix Kubernetes Engine (NKE)
Does Nutanix Karbon 2.0 support Windows node now?

Does Nutanix Karbon 2.0 support Windows node now? I was planing to create windows nodes using Karbon service but does not know whether Karbon 2.0 support that.

5763
vshuguet
Nutanix Employee

Badges

Show all badges
Terms & Conditions